2021-03-10T19:54:44.038 INFO:root:teuthology version: 1.1.0-b6eecfe8 2021-03-10T19:54:44.040 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_sage@teuthology --description rados:cephadm:upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait fixed-2 mon_election/classic} --archive /home/teuthworker/archive/sage-2021-03-10_17:49:17-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba/5953932 --name sage-2021-03-10_17:49:17-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba --verbose -- /home/teuthworker/archive/sage-2021-03-10_17:49:17-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba/5953932/orig.config.yaml 2021-03-10T19:54:44.073 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-03-10T19:54:44.126 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2021-03-10_17:49:17-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba/5953932 branch: wip-sage-testing-2021-03-09-1434 description: rados:cephadm:upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait fixed-2 mon_election/classic} email: null first_in_suite: false job_id: '5953932' kernel: kdb: true sha1: distro last_in_suite: false machine_type: gibba name: sage-2021-03-10_17:49:17-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-sage-testing-2021-03-09-1434 ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 osd shutdown pgref assert: true log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: b26fc080937a021ce826cdc94d1adb52c064381a ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: b26fc080937a021ce826cdc94d1adb52c064381a workunit: branch: cephadm-rgw-simplification sha1: d44b8689de3933d84fb4c950485b7316ce1737e8 owner: scheduled_sage@teuthology priority: 71 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b sha1: b26fc080937a021ce826cdc94d1adb52c064381a sleep_before_teardown: 0 suite: rados:cephadm:upgrade suite_branch: cephadm-rgw-simplification suite_path: /home/teuthworker/src/github.com_liewegas_ceph_d44b8689de3933d84fb4c950485b7316ce1737e8/qa suite_relpath: qa suite_repo: https://github.com/liewegas/ceph suite_sha1: d44b8689de3933d84fb4c950485b7316ce1737e8 targets: gibba023.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr0AS/2q00+Fbgq4o/3eccfNOlrLii2tPkeodvhD4kgzj70Qx8cWBIuico5rPEMcvdqYBdSHN9WNMwhzxjE1aRMO6n+Er3tMh83FmQZmWC/kYoZm5j1smrQe8xwkvr8j41m616YRl1AKszes8U8XzC1l+OUw02N7bYDiEooth/zRSAgFGLgOiqbcowA4ERX1h3vwjEFBrHOIlni2Wi8lFTox4NQ2RGx9VuBrSVP1K0woIdnOohMDiQRNB84qiPNdd35vnVbh6jz2cDrXxEIeFzsVvoBpk7pqmN+LYhrDfUgDbMTu1ef+xkUZdA64DjLp50+yAqHb1SWCR0voCi8RocUgdwKsMMFTKzvfdIingN69STSKLdNwZ9QScCZCPkvkxktNaOYBfGyi0QK6jgWkofHkTKgrum0c5NqaK/ykQDSM358oHKaxEZl1jaTieRAnZtqmSG6UKe3x7zhjBwK/HsWYeHbCQu0zzG/ymxxuPUm6WUl7Wm4ztOmKiyGKqE7gU= gibba044.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCf5PsX9ReubNzJhrcVzhPA2UWs0i4biiELnWbRMPCHmjQ5KPiDBZUsz1XrSIEeXTLRCgSD5xMTSAAiqAeP5s7tVb7c+Qj68LACr7tgNQmAKfgNlIDOQWlKP8e5NHsQkwbbO/kwEm9derHU+IGmLg5wSleiCIdExqnah9YvRQox1ExNn/YNlBRP+e1TnT9OjZENYmpqsOD0yI4b024nLTl95i4opsbG6OZ6J3DRzQ6w24bqAC27wZy0Fit9u8I2pVzeGAxUmGNyUnqWEXw8cnunF+OWONVh/MFT9XYHlXkaxXkxhm5RUfscJdyuy0eDKEcCRoUDz8tqLu0W9f0Ix2OWl2+ZVAPW2KpG8/Q09PVZyqjWa7vzsqH/RbKyg5R6RTnp3TXkeKO0Q71jEz0QVNWrqLuEqSp3Cv2EsMFen48yhh/MwYk1Tls1FDjTUEbGxULl3oHt7KsX423HhPqRCCSuSYQhUyF8eRmW8bDB2DDGz3RGvei2138PopD0uQib7N8= tasks: - cephadm: allow_ptrace: false cephadm_branch: v15.2.0 cephadm_git_url: https://github.com/ceph/ceph image: docker.io/ceph/ceph:v15.2.0 - cephadm.shell: mon.a: - ceph config set mgr mgr/cephadm/use_repo_digest false --force - cephadm.shell: env: - sha1 mon.a: - radosgw-admin realm create --rgw-realm=r --default - radosgw-admin zonegroup create --rgw-zonegroup=default --master --default - radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default - radosgw-admin period update --rgw-realm=r --commit - ceph orch apply rgw r z --placement=2 - sleep 120 - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 mon.a: - while ceph orch upgrade status | jq '.in_progress' | grep true ; do ceph orch ps ; ceph versions ; sleep 30 ; done - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 teuthology_branch: master teuthology_sha1: b6eecfe89a4363750d696160843a096384b357a8 timestamp: 2021-03-10_17:49:17 tube: gibba user: sage verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.gibba.26181 2021-03-10T19:54:44.127 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_liewegas_ceph_d44b8689de3933d84fb4c950485b7316ce1737e8/qa; will attempt to use it 2021-03-10T19:54:44.127 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_liewegas_ceph_d44b8689de3933d84fb4c950485b7316ce1737e8/qa/tasks 2021-03-10T19:54:44.128 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-03-10T19:54:44.131 INFO:teuthology.task.internal:Checking packages... 2021-03-10T19:54:44.152 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash 'b26fc080937a021ce826cdc94d1adb52c064381a' 2021-03-10T19:54:44.153 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-03-10T19:54:44.154 INFO:teuthology.packaging:ref: None 2021-03-10T19:54:44.154 INFO:teuthology.packaging:tag: None 2021-03-10T19:54:44.154 INFO:teuthology.packaging:branch: wip-sage-testing-2021-03-09-1434 2021-03-10T19:54:44.155 INFO:teuthology.packaging:sha1: b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T19:54:44.155 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-sage-testing-2021-03-09-1434 2021-03-10T19:54:44.290 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-1749-gb26fc080-1focal 2021-03-10T19:54:44.291 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-03-10T19:54:44.303 INFO:teuthology.task.internal:no buildpackages task found 2021-03-10T19:54:44.303 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-03-10T19:54:44.346 INFO:teuthology.task.internal:Saving configuration 2021-03-10T19:54:44.359 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-03-10T19:54:44.378 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-03-10T19:54:44.397 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-03-10 19:49:36.327846', 'description': '/home/teuthworker/archive/sage-2021-03-10_17:49:17-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba/5953932', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICTvwaZere5XbmjcqWaKcpCyv+QnuS4oWJupg5dBat/U', 'os_version': '20.04', 'machine_type': 'gibba', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'gibba023.front.sepia.ceph.com'} 2021-03-10T19:54:44.415 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-03-10 19:49:36.327826', 'description': '/home/teuthworker/archive/sage-2021-03-10_17:49:17-rados:cephadm:upgrade-wip-sage-testing-2021-03-09-1434-distro-basic-gibba/5953932', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO+gbAb+P4PXPMFHnCsgSr2qqccQaBvhmxaMVioQe8QA', 'os_version': '20.04', 'machine_type': 'gibba', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'gibba044.front.sepia.ceph.com'} 2021-03-10T19:54:44.416 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-03-10T19:54:44.425 INFO:teuthology.task.internal:roles: ubuntu@gibba023.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2021-03-10T19:54:44.426 INFO:teuthology.task.internal:roles: ubuntu@gibba044.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2021-03-10T19:54:44.426 INFO:teuthology.run_tasks:Running task console_log... 2021-03-10T19:54:44.502 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3a2fa5f598>, signals=[15]) 2021-03-10T19:54:44.504 INFO:teuthology.run_tasks:Running task internal.connect... 2021-03-10T19:54:44.515 INFO:teuthology.task.internal:Opening connections... 2021-03-10T19:54:44.516 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba023.front.sepia.ceph.com 2021-03-10T19:54:44.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-10T19:54:44.558 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba044.front.sepia.ceph.com 2021-03-10T19:54:44.560 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-10T19:54:44.597 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-03-10T19:54:44.620 DEBUG:teuthology.orchestra.run.gibba023:> uname -m 2021-03-10T19:54:44.625 INFO:teuthology.orchestra.run.gibba023.stdout:x86_64 2021-03-10T19:54:44.625 DEBUG:teuthology.orchestra.run.gibba023:> cat /etc/os-release 2021-03-10T19:54:44.673 INFO:teuthology.orchestra.run.gibba023.stdout:NAME="Ubuntu" 2021-03-10T19:54:44.673 INFO:teuthology.orchestra.run.gibba023.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-03-10T19:54:44.673 INFO:teuthology.orchestra.run.gibba023.stdout:ID=ubuntu 2021-03-10T19:54:44.674 INFO:teuthology.orchestra.run.gibba023.stdout:ID_LIKE=debian 2021-03-10T19:54:44.674 INFO:teuthology.orchestra.run.gibba023.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-03-10T19:54:44.674 INFO:teuthology.orchestra.run.gibba023.stdout:VERSION_ID="20.04" 2021-03-10T19:54:44.674 INFO:teuthology.orchestra.run.gibba023.stdout:HOME_URL="https://www.ubuntu.com/" 2021-03-10T19:54:44.675 INFO:teuthology.orchestra.run.gibba023.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-03-10T19:54:44.675 INFO:teuthology.orchestra.run.gibba023.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-03-10T19:54:44.675 INFO:teuthology.orchestra.run.gibba023.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-03-10T19:54:44.675 INFO:teuthology.orchestra.run.gibba023.stdout:VERSION_CODENAME=focal 2021-03-10T19:54:44.675 INFO:teuthology.orchestra.run.gibba023.stdout:UBUNTU_CODENAME=focal 2021-03-10T19:54:44.676 INFO:teuthology.lock.ops:Updating gibba023.front.sepia.ceph.com on lock server 2021-03-10T19:54:44.692 DEBUG:teuthology.orchestra.run.gibba044:> uname -m 2021-03-10T19:54:44.697 INFO:teuthology.orchestra.run.gibba044.stdout:x86_64 2021-03-10T19:54:44.698 DEBUG:teuthology.orchestra.run.gibba044:> cat /etc/os-release 2021-03-10T19:54:44.703 INFO:teuthology.orchestra.run.gibba044.stdout:NAME="Ubuntu" 2021-03-10T19:54:44.704 INFO:teuthology.orchestra.run.gibba044.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-03-10T19:54:44.704 INFO:teuthology.orchestra.run.gibba044.stdout:ID=ubuntu 2021-03-10T19:54:44.704 INFO:teuthology.orchestra.run.gibba044.stdout:ID_LIKE=debian 2021-03-10T19:54:44.705 INFO:teuthology.orchestra.run.gibba044.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-03-10T19:54:44.705 INFO:teuthology.orchestra.run.gibba044.stdout:VERSION_ID="20.04" 2021-03-10T19:54:44.706 INFO:teuthology.orchestra.run.gibba044.stdout:HOME_URL="https://www.ubuntu.com/" 2021-03-10T19:54:44.707 INFO:teuthology.orchestra.run.gibba044.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-03-10T19:54:44.707 INFO:teuthology.orchestra.run.gibba044.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-03-10T19:54:44.707 INFO:teuthology.orchestra.run.gibba044.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-03-10T19:54:44.708 INFO:teuthology.orchestra.run.gibba044.stdout:VERSION_CODENAME=focal 2021-03-10T19:54:44.708 INFO:teuthology.orchestra.run.gibba044.stdout:UBUNTU_CODENAME=focal 2021-03-10T19:54:44.708 INFO:teuthology.lock.ops:Updating gibba044.front.sepia.ceph.com on lock server 2021-03-10T19:54:44.725 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-03-10T19:54:44.742 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-03-10T19:54:44.769 INFO:teuthology.task.internal:Checking for old test directory... 2021-03-10T19:54:44.770 DEBUG:teuthology.orchestra.run.gibba023:> test '!' -e /home/ubuntu/cephtest 2021-03-10T19:54:44.774 DEBUG:teuthology.orchestra.run.gibba044:> test '!' -e /home/ubuntu/cephtest 2021-03-10T19:54:44.781 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-03-10T19:54:44.803 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-03-10T19:54:44.804 DEBUG:teuthology.orchestra.run.gibba023:> test -z $(ls -A /var/lib/ceph) 2021-03-10T19:54:44.826 DEBUG:teuthology.orchestra.run.gibba044:> test -z $(ls -A /var/lib/ceph) 2021-03-10T19:54:44.847 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-03-10T19:54:44.911 INFO:teuthology.run_tasks:Running task kernel... 2021-03-10T19:54:44.930 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.a': {'kdb': True, 'sha1': 'distro'}, 'alertmanager.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'prometheus.a': {'kdb': True, 'sha1': 'distro'}, 'grafana.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.b': {'kdb': True, 'sha1': 'distro'}} 2021-03-10T19:54:44.930 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-03-10T19:54:44.931 DEBUG:teuthology.orchestra.run.gibba023:> uname -r 2021-03-10T19:54:44.939 INFO:teuthology.orchestra.run.gibba023.stdout:5.4.0-66-generic 2021-03-10T19:54:44.940 INFO:teuthology.task.kernel:Running kernel on gibba023: 5.4.0-66-generic 2021-03-10T19:54:44.940 DEBUG:teuthology.orchestra.run.gibba023:> sudo apt-get clean 2021-03-10T19:54:45.025 DEBUG:teuthology.orchestra.run.gibba023:> sudo apt-get update 2021-03-10T19:54:45.254 INFO:teuthology.orchestra.run.gibba023.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-03-10T19:54:45.262 INFO:teuthology.orchestra.run.gibba023.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [109 kB] 2021-03-10T19:54:45.322 INFO:teuthology.orchestra.run.gibba023.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-03-10T19:54:45.636 INFO:teuthology.orchestra.run.gibba023.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-03-10T19:54:45.637 INFO:teuthology.orchestra.run.gibba023.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [200 kB] 2021-03-10T19:54:45.747 INFO:teuthology.orchestra.run.gibba023.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [436 kB] 2021-03-10T19:54:45.823 INFO:teuthology.orchestra.run.gibba023.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [528 kB] 2021-03-10T19:54:45.884 INFO:teuthology.orchestra.run.gibba023.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [844 kB] 2021-03-10T19:54:45.946 INFO:teuthology.orchestra.run.gibba023.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [114 kB] 2021-03-10T19:54:45.967 INFO:teuthology.orchestra.run.gibba023.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [7,264 B] 2021-03-10T19:54:45.968 INFO:teuthology.orchestra.run.gibba023.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [133 kB] 2021-03-10T19:54:45.986 INFO:teuthology.orchestra.run.gibba023.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [19.5 kB] 2021-03-10T19:54:45.988 INFO:teuthology.orchestra.run.gibba023.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [431 kB] 2021-03-10T19:54:45.995 INFO:teuthology.orchestra.run.gibba023.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [202 kB] 2021-03-10T19:54:46.009 INFO:teuthology.orchestra.run.gibba023.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [12.8 kB] 2021-03-10T19:54:46.010 INFO:teuthology.orchestra.run.gibba023.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [156 kB] 2021-03-10T19:54:46.021 INFO:teuthology.orchestra.run.gibba023.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [23.3 kB] 2021-03-10T19:54:46.022 INFO:teuthology.orchestra.run.gibba023.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [749 kB] 2021-03-10T19:54:46.024 INFO:teuthology.orchestra.run.gibba023.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [546 kB] 2021-03-10T19:54:46.065 INFO:teuthology.orchestra.run.gibba023.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [558 kB] 2021-03-10T19:54:46.068 INFO:teuthology.orchestra.run.gibba023.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [79.8 kB] 2021-03-10T19:54:46.073 INFO:teuthology.orchestra.run.gibba023.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [10.5 kB] 2021-03-10T19:54:46.088 INFO:teuthology.orchestra.run.gibba023.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [157 kB] 2021-03-10T19:54:46.091 INFO:teuthology.orchestra.run.gibba023.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [16.2 kB] 2021-03-10T19:54:47.937 INFO:teuthology.orchestra.run.gibba023.stdout:Fetched 5,546 kB in 1s (4,363 kB/s) 2021-03-10T19:54:48.970 INFO:teuthology.orchestra.run.gibba023.stdout:Reading package lists... 2021-03-10T19:54:48.981 DEBUG:teuthology.orchestra.run.gibba023:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-03-10T19:54:49.016 INFO:teuthology.orchestra.run.gibba023.stdout:Reading package lists... 2021-03-10T19:54:49.110 INFO:teuthology.orchestra.run.gibba023.stdout:Building dependency tree... 2021-03-10T19:54:49.111 INFO:teuthology.orchestra.run.gibba023.stdout:Reading state information... 2021-03-10T19:54:49.153 INFO:teuthology.orchestra.run.gibba023.stderr:E: Unable to locate package linux-image-current-generic 2021-03-10T19:54:49.154 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-03-10T19:54:49.155 DEBUG:teuthology.orchestra.run.gibba023:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-03-10T19:54:49.191 INFO:teuthology.orchestra.run.gibba023.stdout:Reading package lists... 2021-03-10T19:54:49.284 INFO:teuthology.orchestra.run.gibba023.stdout:Building dependency tree... 2021-03-10T19:54:49.284 INFO:teuthology.orchestra.run.gibba023.stdout:Reading state information... 2021-03-10T19:54:49.371 INFO:teuthology.orchestra.run.gibba023.stdout:linux-image-generic is already the newest version (5.4.0.66.69). 2021-03-10T19:54:49.371 INFO:teuthology.orchestra.run.gibba023.stdout:linux-image-generic set to manually installed. 2021-03-10T19:54:49.372 INFO:teuthology.orchestra.run.gibba023.stdout:0 upgraded, 0 newly installed, 0 to remove and 12 not upgraded. 2021-03-10T19:54:49.373 DEBUG:teuthology.orchestra.run.gibba023:> dpkg -s linux-image-generic 2021-03-10T19:54:49.383 INFO:teuthology.orchestra.run.gibba023.stdout:Package: linux-image-generic 2021-03-10T19:54:49.383 INFO:teuthology.orchestra.run.gibba023.stdout:Status: install ok installed 2021-03-10T19:54:49.383 INFO:teuthology.orchestra.run.gibba023.stdout:Priority: optional 2021-03-10T19:54:49.384 INFO:teuthology.orchestra.run.gibba023.stdout:Section: kernel 2021-03-10T19:54:49.384 INFO:teuthology.orchestra.run.gibba023.stdout:Installed-Size: 18 2021-03-10T19:54:49.384 INFO:teuthology.orchestra.run.gibba023.stdout:Maintainer: Ubuntu Kernel Team 2021-03-10T19:54:49.384 INFO:teuthology.orchestra.run.gibba023.stdout:Architecture: amd64 2021-03-10T19:54:49.385 INFO:teuthology.orchestra.run.gibba023.stdout:Source: linux-meta 2021-03-10T19:54:49.385 INFO:teuthology.orchestra.run.gibba023.stdout:Version: 5.4.0.66.69 2021-03-10T19:54:49.385 INFO:teuthology.orchestra.run.gibba023.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.6) 2021-03-10T19:54:49.385 INFO:teuthology.orchestra.run.gibba023.stdout:Depends: linux-image-5.4.0-66-generic, linux-modules-extra-5.4.0-66-generic, linux-firmware, intel-microcode, amd64-microcode 2021-03-10T19:54:49.385 INFO:teuthology.orchestra.run.gibba023.stdout:Recommends: thermald 2021-03-10T19:54:49.386 INFO:teuthology.orchestra.run.gibba023.stdout:Description: Generic Linux kernel image 2021-03-10T19:54:49.386 INFO:teuthology.orchestra.run.gibba023.stdout: This package will always depend on the latest generic kernel image 2021-03-10T19:54:49.386 INFO:teuthology.orchestra.run.gibba023.stdout: available. 2021-03-10T19:54:49.386 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2021-03-10T19:54:49.387 DEBUG:teuthology.orchestra.run.gibba044:> uname -r 2021-03-10T19:54:49.396 INFO:teuthology.orchestra.run.gibba044.stdout:5.4.0-66-generic 2021-03-10T19:54:49.396 INFO:teuthology.task.kernel:Running kernel on gibba044: 5.4.0-66-generic 2021-03-10T19:54:49.396 DEBUG:teuthology.orchestra.run.gibba044:> sudo apt-get clean 2021-03-10T19:54:49.513 DEBUG:teuthology.orchestra.run.gibba044:> sudo apt-get update 2021-03-10T19:54:49.653 INFO:teuthology.orchestra.run.gibba044.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [109 kB] 2021-03-10T19:54:49.759 INFO:teuthology.orchestra.run.gibba044.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-03-10T19:54:49.838 INFO:teuthology.orchestra.run.gibba044.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-03-10T19:54:49.905 INFO:teuthology.orchestra.run.gibba044.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [200 kB] 2021-03-10T19:54:49.961 INFO:teuthology.orchestra.run.gibba044.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [528 kB] 2021-03-10T19:54:49.988 INFO:teuthology.orchestra.run.gibba044.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [114 kB] 2021-03-10T19:54:49.992 INFO:teuthology.orchestra.run.gibba044.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [7,264 B] 2021-03-10T19:54:49.992 INFO:teuthology.orchestra.run.gibba044.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [133 kB] 2021-03-10T19:54:49.996 INFO:teuthology.orchestra.run.gibba044.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [19.5 kB] 2021-03-10T19:54:49.997 INFO:teuthology.orchestra.run.gibba044.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [546 kB] 2021-03-10T19:54:50.006 INFO:teuthology.orchestra.run.gibba044.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [431 kB] 2021-03-10T19:54:50.013 INFO:teuthology.orchestra.run.gibba044.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [79.8 kB] 2021-03-10T19:54:50.014 INFO:teuthology.orchestra.run.gibba044.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [10.5 kB] 2021-03-10T19:54:50.166 INFO:teuthology.orchestra.run.gibba044.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-03-10T19:54:50.282 INFO:teuthology.orchestra.run.gibba044.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [844 kB] 2021-03-10T19:54:50.742 INFO:teuthology.orchestra.run.gibba044.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [436 kB] 2021-03-10T19:54:50.801 INFO:teuthology.orchestra.run.gibba044.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [202 kB] 2021-03-10T19:54:50.822 INFO:teuthology.orchestra.run.gibba044.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [12.8 kB] 2021-03-10T19:54:50.822 INFO:teuthology.orchestra.run.gibba044.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [156 kB] 2021-03-10T19:54:50.837 INFO:teuthology.orchestra.run.gibba044.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [23.3 kB] 2021-03-10T19:54:50.839 INFO:teuthology.orchestra.run.gibba044.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [558 kB] 2021-03-10T19:54:50.876 INFO:teuthology.orchestra.run.gibba044.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [749 kB] 2021-03-10T19:54:50.913 INFO:teuthology.orchestra.run.gibba044.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [157 kB] 2021-03-10T19:54:50.920 INFO:teuthology.orchestra.run.gibba044.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [16.2 kB] 2021-03-10T19:54:52.757 INFO:teuthology.orchestra.run.gibba044.stdout:Fetched 5,546 kB in 1s (3,790 kB/s) 2021-03-10T19:54:53.763 INFO:teuthology.orchestra.run.gibba044.stdout:Reading package lists... 2021-03-10T19:54:53.774 DEBUG:teuthology.orchestra.run.gibba044:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-03-10T19:54:53.810 INFO:teuthology.orchestra.run.gibba044.stdout:Reading package lists... 2021-03-10T19:54:53.904 INFO:teuthology.orchestra.run.gibba044.stdout:Building dependency tree... 2021-03-10T19:54:53.905 INFO:teuthology.orchestra.run.gibba044.stdout:Reading state information... 2021-03-10T19:54:53.948 INFO:teuthology.orchestra.run.gibba044.stderr:E: Unable to locate package linux-image-current-generic 2021-03-10T19:54:53.949 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-03-10T19:54:53.950 DEBUG:teuthology.orchestra.run.gibba044:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-03-10T19:54:53.985 INFO:teuthology.orchestra.run.gibba044.stdout:Reading package lists... 2021-03-10T19:54:54.077 INFO:teuthology.orchestra.run.gibba044.stdout:Building dependency tree... 2021-03-10T19:54:54.077 INFO:teuthology.orchestra.run.gibba044.stdout:Reading state information... 2021-03-10T19:54:54.161 INFO:teuthology.orchestra.run.gibba044.stdout:linux-image-generic is already the newest version (5.4.0.66.69). 2021-03-10T19:54:54.162 INFO:teuthology.orchestra.run.gibba044.stdout:linux-image-generic set to manually installed. 2021-03-10T19:54:54.162 INFO:teuthology.orchestra.run.gibba044.stdout:0 upgraded, 0 newly installed, 0 to remove and 12 not upgraded. 2021-03-10T19:54:54.163 DEBUG:teuthology.orchestra.run.gibba044:> dpkg -s linux-image-generic 2021-03-10T19:54:54.220 INFO:teuthology.orchestra.run.gibba044.stdout:Package: linux-image-generic 2021-03-10T19:54:54.220 INFO:teuthology.orchestra.run.gibba044.stdout:Status: install ok installed 2021-03-10T19:54:54.221 INFO:teuthology.orchestra.run.gibba044.stdout:Priority: optional 2021-03-10T19:54:54.221 INFO:teuthology.orchestra.run.gibba044.stdout:Section: kernel 2021-03-10T19:54:54.221 INFO:teuthology.orchestra.run.gibba044.stdout:Installed-Size: 18 2021-03-10T19:54:54.221 INFO:teuthology.orchestra.run.gibba044.stdout:Maintainer: Ubuntu Kernel Team 2021-03-10T19:54:54.222 INFO:teuthology.orchestra.run.gibba044.stdout:Architecture: amd64 2021-03-10T19:54:54.222 INFO:teuthology.orchestra.run.gibba044.stdout:Source: linux-meta 2021-03-10T19:54:54.222 INFO:teuthology.orchestra.run.gibba044.stdout:Version: 5.4.0.66.69 2021-03-10T19:54:54.223 INFO:teuthology.orchestra.run.gibba044.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.6) 2021-03-10T19:54:54.223 INFO:teuthology.orchestra.run.gibba044.stdout:Depends: linux-image-5.4.0-66-generic, linux-modules-extra-5.4.0-66-generic, linux-firmware, intel-microcode, amd64-microcode 2021-03-10T19:54:54.223 INFO:teuthology.orchestra.run.gibba044.stdout:Recommends: thermald 2021-03-10T19:54:54.223 INFO:teuthology.orchestra.run.gibba044.stdout:Description: Generic Linux kernel image 2021-03-10T19:54:54.224 INFO:teuthology.orchestra.run.gibba044.stdout: This package will always depend on the latest generic kernel image 2021-03-10T19:54:54.224 INFO:teuthology.orchestra.run.gibba044.stdout: available. 2021-03-10T19:54:54.224 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2021-03-10T19:54:54.225 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-03-10T19:54:54.225 DEBUG:teuthology.orchestra.run.gibba023:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-03-10T19:54:54.247 INFO:teuthology.orchestra.run.gibba023.stdout:ttyS1 2021-03-10T19:54:54.294 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-03-10T19:54:54.294 DEBUG:teuthology.orchestra.run.gibba044:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-03-10T19:54:54.311 INFO:teuthology.orchestra.run.gibba044.stdout:ttyS1 2021-03-10T19:54:54.340 INFO:teuthology.run_tasks:Running task internal.base... 2021-03-10T19:54:54.348 INFO:teuthology.task.internal:Creating test directory... 2021-03-10T19:54:54.349 DEBUG:teuthology.orchestra.run.gibba023:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-03-10T19:54:54.353 DEBUG:teuthology.orchestra.run.gibba044:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-03-10T19:54:54.362 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-03-10T19:54:54.375 INFO:teuthology.run_tasks:Running task internal.archive... 2021-03-10T19:54:54.402 INFO:teuthology.task.internal:Creating archive directory... 2021-03-10T19:54:54.403 DEBUG:teuthology.orchestra.run.gibba023:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-03-10T19:54:54.406 DEBUG:teuthology.orchestra.run.gibba044:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-03-10T19:54:54.420 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-03-10T19:54:54.429 INFO:teuthology.task.internal:Enabling coredump saving... 2021-03-10T19:54:54.429 DEBUG:teuthology.orchestra.run.gibba023:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-03-10T19:54:54.433 DEBUG:teuthology.orchestra.run.gibba044:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-03-10T19:54:54.442 INFO:teuthology.orchestra.run.gibba023.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-10T19:54:54.445 INFO:teuthology.orchestra.run.gibba023.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-10T19:54:54.466 INFO:teuthology.orchestra.run.gibba044.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-10T19:54:54.476 INFO:teuthology.orchestra.run.gibba044.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-03-10T19:54:54.477 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-03-10T19:54:54.496 INFO:teuthology.task.internal:Configuring sudo... 2021-03-10T19:54:54.497 DEBUG:teuthology.orchestra.run.gibba023:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-03-10T19:54:54.500 DEBUG:teuthology.orchestra.run.gibba044:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-03-10T19:54:54.524 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-03-10T19:54:54.564 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-03-10T19:54:54.565 DEBUG:teuthology.orchestra.run.gibba023:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-03-10T19:54:54.568 DEBUG:teuthology.orchestra.run.gibba044:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-03-10T19:54:54.578 DEBUG:teuthology.orchestra.run.gibba023:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-03-10T19:54:54.588 DEBUG:teuthology.orchestra.run.gibba023:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-03-10T19:54:54.636 DEBUG:teuthology.orchestra.run.gibba023:> set -ex 2021-03-10T19:54:54.637 DEBUG:teuthology.orchestra.run.gibba023:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-03-10T19:54:54.656 DEBUG:teuthology.orchestra.run.gibba044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-03-10T19:54:54.666 DEBUG:teuthology.orchestra.run.gibba044:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-03-10T19:54:54.718 DEBUG:teuthology.orchestra.run.gibba044:> set -ex 2021-03-10T19:54:54.718 DEBUG:teuthology.orchestra.run.gibba044:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-03-10T19:54:54.734 DEBUG:teuthology.orchestra.run.gibba023:> sudo service rsyslog restart 2021-03-10T19:54:54.737 DEBUG:teuthology.orchestra.run.gibba044:> sudo service rsyslog restart 2021-03-10T19:54:54.784 INFO:teuthology.run_tasks:Running task internal.timer... 2021-03-10T19:54:54.792 INFO:teuthology.task.internal:Starting timer... 2021-03-10T19:54:54.793 INFO:teuthology.run_tasks:Running task pcp... 2021-03-10T19:54:54.823 INFO:teuthology.run_tasks:Running task selinux... 2021-03-10T19:54:54.847 DEBUG:teuthology.task.selinux:Excluding gibba023: OS 'ubuntu' does not support SELinux 2021-03-10T19:54:54.848 DEBUG:teuthology.task.selinux:Excluding gibba044: OS 'ubuntu' does not support SELinux 2021-03-10T19:54:54.848 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-03-10T19:54:54.848 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-03-10T19:54:54.849 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-03-10T19:54:54.849 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-03-10T19:54:54.881 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-03-10T19:54:54.883 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-03-10T19:54:54.901 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2021-03-10T19:54:54.903 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit gibba023.front.sepia.ceph.com,gibba044.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-03-10T19:54:55.306 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-03-10T19:54:56.103 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-03-10T19:54:58.115 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-03-10T19:54:58.139 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:54:58 +0000 (0:00:00.039) 0:00:00.039 ******* 2021-03-10T19:54:58.150 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:54:58 +0000 (0:00:00.010) 0:00:00.050 ******* 2021-03-10T19:54:59.865 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-03-10T19:54:59.866 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host gibba023.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [gibba023.front.sepia.ceph.com] 2021-03-10T19:54:59.900 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host gibba044.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [gibba044.front.sepia.ceph.com] 2021-03-10T19:54:59.930 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:54:59 +0000 (0:00:01.780) 0:00:01.831 ******* 2021-03-10T19:54:59.978 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:54:59 +0000 (0:00:00.047) 0:00:01.879 ******* 2021-03-10T19:55:00.174 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-03-10T19:55:00.176 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-03-10T19:55:00.197 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:00 +0000 (0:00:00.219) 0:00:02.098 ******* 2021-03-10T19:55:00.204 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-03-10T19:55:00.232 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:00 +0000 (0:00:00.034) 0:00:02.133 ******* 2021-03-10T19:55:00.847 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-03-10T19:55:00.849 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-03-10T19:55:00.873 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:00 +0000 (0:00:00.640) 0:00:02.774 ******* 2021-03-10T19:55:00.890 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-03-10T19:55:00.918 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:00 +0000 (0:00:00.044) 0:00:02.819 ******* 2021-03-10T19:55:01.193 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-03-10T19:55:01.195 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.042326", "end": "2021-03-10 19:55:01.538192", "rc": 0, "start": "2021-03-10 19:55:01.495866", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-03-10T19:55:01.220 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:01 +0000 (0:00:00.301) 0:00:03.120 ******* 2021-03-10T19:55:01.240 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.066841", "end": "2021-03-10 19:55:01.067175", "rc": 0, "start": "2021-03-10 19:55:01.000334", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-03-10T19:55:01.269 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:01 +0000 (0:00:00.049) 0:00:03.170 ******* 2021-03-10T19:55:01.497 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-03-10T19:55:01.499 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T19:55:01.535 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:01 +0000 (0:00:00.266) 0:00:03.436 ******* 2021-03-10T19:55:01.544 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T19:55:01.569 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:01 +0000 (0:00:00.033) 0:00:03.469 ******* 2021-03-10T19:55:02.344 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-03-10T19:55:02.346 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615406101.5716622-19966-16784451109605/source", "state": "file", "uid": 0} 2021-03-10T19:55:02.369 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:02 +0000 (0:00:00.800) 0:00:04.270 ******* 2021-03-10T19:55:02.377 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615406101.6254096-19972-4052129477018/source", "state": "file", "uid": 0} 2021-03-10T19:55:02.403 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:02 +0000 (0:00:00.034) 0:00:04.304 ******* 2021-03-10T19:55:02.886 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-03-10T19:55:02.888 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4 2021-03-10T19:55:02.890 INFO:teuthology.task.ansible.out:r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-03-10T19:55:02.911 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4 2021-03-10T19:55:02.912 INFO:teuthology.task.ansible.out:r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-03-10T19:55:03.019 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-03-10T19:55:03.022 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-03-10T19:55:03.173 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:03 +0000 (0:00:00.769) 0:00:05.074 ******* 2021-03-10T19:55:03.195 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:03 +0000 (0:00:00.021) 0:00:05.095 ******* 2021-03-10T19:55:03.871 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-03-10T19:55:03.873 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] 2021-03-10T19:55:03.932 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-03-10T19:55:03.934 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:03 +0000 (0:00:00.737) 0:00:05.833 ******* 2021-03-10T19:55:03.977 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] 2021-03-10T19:55:04.033 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:04 +0000 (0:00:00.100) 0:00:05.934 ******* 2021-03-10T19:55:04.369 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-03-10T19:55:04.373 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.164264", "end": "2021-03-10 19:55:04.330141", "rc": 0, "start": "2021-03-10 19:55:04.165877", "stderr": "", "stderr_lines": [], "stdout": "c31004c4720a55ac12a95d66c32e64f592877604", "stdout_lines": ["c31004c4720a55ac12a95d66c32e64f592877604"]} 2021-03-10T19:55:04.396 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:04 +0000 (0:00:00.362) 0:00:06.297 ******* 2021-03-10T19:55:04.524 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.217267", "end": "2021-03-10 19:55:04.496374", "rc": 0, "start": "2021-03-10 19:55:04.279107", "stderr": "", "stderr_lines": [], "stdout": "c31004c4720a55ac12a95d66c32e64f592877604", "stdout_lines": ["c31004c4720a55ac12a95d66c32e64f592877604"]} TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [gibba023.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.004538", "end": "2021-03-10 19:55:04.354431", "failed_when_result": false, "rc": 0, "start": "2021-03-10 19:55:04.349893", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-03-10T19:55:04.549 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:04 +0000 (0:00:00.152) 0:00:06.449 ******* 2021-03-10T19:55:04.571 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:04 +0000 (0:00:00.022) 0:00:06.472 ******* 2021-03-10T19:55:04.620 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-03-10T19:55:04.621 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:04.653 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:04 +0000 (0:00:00.081) 0:00:06.553 ******* 2021-03-10T19:55:04.692 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-03-10T19:55:04.694 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.009643", "end": "2021-03-10 19:55:05.023452", "failed_when_result": false, "rc": 0, "start": "2021-03-10 19:55:05.013809", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-03-10T19:55:04.719 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:04 +0000 (0:00:00.065) 0:00:06.618 ******* 2021-03-10T19:55:04.737 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-03-10T19:55:04.740 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:04.764 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:04 +0000 (0:00:00.046) 0:00:06.665 ******* 2021-03-10T19:55:04.800 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-03-10T19:55:04.802 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:04.834 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:04 +0000 (0:00:00.069) 0:00:06.734 ******* 2021-03-10T19:55:04.843 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-03-10T19:55:04.845 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:04.872 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:04 +0000 (0:00:00.038) 0:00:06.773 ******* 2021-03-10T19:55:04.920 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-03-10T19:55:04.923 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:04.946 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:04 +0000 (0:00:00.073) 0:00:06.846 ******* 2021-03-10T19:55:04.955 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-03-10T19:55:04.957 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:04.985 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:04 +0000 (0:00:00.039) 0:00:06.886 ******* 2021-03-10T19:55:05.037 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-03-10T19:55:05.039 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:05.063 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:05 +0000 (0:00:00.077) 0:00:06.963 ******* 2021-03-10T19:55:05.095 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-03-10T19:55:05.097 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:05.120 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:05 +0000 (0:00:00.056) 0:00:07.020 ******* 2021-03-10T19:55:05.142 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:05.181 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:05 +0000 (0:00:00.060) 0:00:07.080 ******* 2021-03-10T19:55:05.275 INFO:teuthology.task.ansible.out: 2021-03-10T19:55:05.277 INFO:teuthology.task.ansible.out:TASK [Filter the managed_admin_users list] ************************************* skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:05.277 INFO:teuthology.task.ansible.out:TASK [users : Set UID_MIN to 1001] ********************************************* 2021-03-10T19:55:05.277 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T19:55:05.302 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:05 +0000 (0:00:00.122) 0:00:07.203 ******* 2021-03-10T19:55:05.335 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:05 +0000 (0:00:00.030) 0:00:07.234 ******* 2021-03-10T19:55:05.491 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T19:55:05.517 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:05 +0000 (0:00:00.183) 0:00:07.418 ******* 2021-03-10T19:55:05.525 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-03-10T19:55:05.526 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-03-10T19:55:05.623 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-03-10T19:55:05.723 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-03-10T19:55:05.748 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-03-10T19:55:05.835 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-03-10T19:55:05.847 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-03-10T19:55:05.935 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-03-10T19:55:05.948 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-03-10T19:55:06.035 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-03-10T19:55:06.045 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-03-10T19:55:06.135 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-03-10T19:55:06.142 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-03-10T19:55:06.237 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-03-10T19:55:06.249 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-03-10T19:55:06.344 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-03-10T19:55:06.345 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-03-10T19:55:06.440 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-03-10T19:55:06.441 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-03-10T19:55:06.535 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-03-10T19:55:06.536 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-03-10T19:55:06.623 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-03-10T19:55:06.655 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-03-10T19:55:06.719 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-03-10T19:55:06.752 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-03-10T19:55:06.817 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-03-10T19:55:06.860 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-03-10T19:55:06.913 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-03-10T19:55:06.956 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-03-10T19:55:07.011 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-03-10T19:55:07.048 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-03-10T19:55:07.101 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-03-10T19:55:07.134 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-03-10T19:55:07.198 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-03-10T19:55:07.230 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-03-10T19:55:07.295 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-03-10T19:55:07.317 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-03-10T19:55:07.393 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-03-10T19:55:07.425 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-03-10T19:55:07.490 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-03-10T19:55:07.523 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-03-10T19:55:07.598 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-03-10T19:55:07.620 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-03-10T19:55:07.694 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-03-10T19:55:07.726 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-03-10T19:55:07.790 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-03-10T19:55:07.822 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-03-10T19:55:07.876 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-03-10T19:55:07.908 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-03-10T19:55:07.972 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-03-10T19:55:08.004 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-03-10T19:55:08.068 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-03-10T19:55:08.101 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-03-10T19:55:08.166 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-03-10T19:55:08.189 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-03-10T19:55:08.263 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-03-10T19:55:08.286 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-03-10T19:55:08.361 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-03-10T19:55:08.383 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-03-10T19:55:08.458 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-03-10T19:55:08.480 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-03-10T19:55:08.554 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-03-10T19:55:08.587 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-03-10T19:55:08.640 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-03-10T19:55:08.693 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-03-10T19:55:08.736 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-03-10T19:55:08.780 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-03-10T19:55:08.837 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-03-10T19:55:08.903 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-03-10T19:55:08.937 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-03-10T19:55:09.002 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-03-10T19:55:09.034 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-03-10T19:55:09.087 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-03-10T19:55:09.141 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-03-10T19:55:09.184 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-03-10T19:55:09.238 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-03-10T19:55:09.291 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-10T19:55:09.336 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-03-10T19:55:09.380 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-03-10T19:55:09.437 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-10T19:55:09.480 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-03-10T19:55:09.578 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-03-10T19:55:09.654 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-03-10T19:55:09.710 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-03-10T19:55:09.763 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-03-10T19:55:09.806 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-03-10T19:55:09.859 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-03-10T19:55:09.902 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-03-10T19:55:09.965 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-03-10T19:55:09.998 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-03-10T19:55:10.073 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-03-10T19:55:10.115 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-03-10T19:55:10.158 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-10T19:55:10.212 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-03-10T19:55:10.255 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-03-10T19:55:10.309 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-10T19:55:10.354 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-03-10T19:55:10.408 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-03-10T19:55:10.451 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-03-10T19:55:10.505 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-03-10T19:55:10.549 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-03-10T19:55:10.613 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-03-10T19:55:10.635 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-03-10T19:55:10.719 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-03-10T19:55:10.731 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-03-10T19:55:10.817 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-03-10T19:55:10.829 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-03-10T19:55:10.914 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-03-10T19:55:10.925 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-03-10T19:55:11.022 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-03-10T19:55:11.023 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-03-10T19:55:11.130 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-03-10T19:55:11.131 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-03-10T19:55:11.225 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-03-10T19:55:11.237 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-03-10T19:55:11.321 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-03-10T19:55:11.333 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-03-10T19:55:11.420 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-03-10T19:55:11.443 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-03-10T19:55:11.516 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-03-10T19:55:11.549 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-03-10T19:55:11.551 INFO:teuthology.task.ansible.out: 2021-03-10T19:55:11.636 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-03-10T19:55:11.658 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-03-10T19:55:11.722 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-03-10T19:55:11.755 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-03-10T19:55:11.819 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-03-10T19:55:11.851 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-10T19:55:11.916 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-03-10T19:55:11.947 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-03-10T19:55:12.024 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-03-10T19:55:12.047 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-03-10T19:55:12.134 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-03-10T19:55:12.145 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-03-10T19:55:12.232 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-03-10T19:55:12.254 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-03-10T19:55:12.340 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-03-10T19:55:12.352 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-03-10T19:55:12.438 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-03-10T19:55:12.439 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-03-10T19:55:12.524 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-03-10T19:55:12.537 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-03-10T19:55:12.624 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-03-10T19:55:12.635 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-03-10T19:55:12.723 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-03-10T19:55:12.734 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-03-10T19:55:12.810 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-03-10T19:55:12.833 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-03-10T19:55:12.907 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-03-10T19:55:12.939 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-03-10T19:55:13.004 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-03-10T19:55:13.026 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-03-10T19:55:13.112 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-03-10T19:55:13.123 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-03-10T19:55:13.208 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-03-10T19:55:13.230 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-03-10T19:55:13.294 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-03-10T19:55:13.337 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-03-10T19:55:13.395 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-03-10T19:55:13.417 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-03-10T19:55:13.493 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-03-10T19:55:13.515 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-03-10T19:55:13.590 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-03-10T19:55:13.592 INFO:teuthology.task.ansible.out: 2021-03-10T19:55:13.613 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-03-10T19:55:13.688 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-03-10T19:55:13.711 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-03-10T19:55:13.785 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-03-10T19:55:13.818 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-03-10T19:55:13.881 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-03-10T19:55:13.914 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-03-10T19:55:13.968 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-03-10T19:55:14.022 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-03-10T19:55:14.064 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-03-10T19:55:14.117 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-03-10T19:55:14.160 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-03-10T19:55:14.257 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-03-10T19:55:14.259 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-03-10T19:55:14.353 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-03-10T19:55:14.354 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-03-10T19:55:14.450 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-03-10T19:55:14.451 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-03-10T19:55:14.537 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-03-10T19:55:14.623 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-03-10T19:55:14.656 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-03-10T19:55:14.740 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-03-10T19:55:14.742 INFO:teuthology.task.ansible.out: ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-03-10T19:55:14.838 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-03-10T19:55:14.849 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-03-10T19:55:14.934 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-03-10T19:55:14.935 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-03-10T19:55:15.031 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-03-10T19:55:15.042 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-03-10T19:55:15.127 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-03-10T19:55:15.129 INFO:teuthology.task.ansible.out: 2021-03-10T19:55:15.139 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-03-10T19:55:15.214 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-03-10T19:55:15.237 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-03-10T19:55:15.312 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-03-10T19:55:15.333 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-03-10T19:55:15.397 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-03-10T19:55:15.419 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-03-10T19:55:15.493 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-10T19:55:15.515 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-03-10T19:55:15.590 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-03-10T19:55:15.612 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-03-10T19:55:15.687 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-03-10T19:55:15.698 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-03-10T19:55:15.784 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-03-10T19:55:15.807 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-03-10T19:55:15.894 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-03-10T19:55:15.942 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-03-10T19:55:16.033 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-03-10T19:55:16.068 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-03-10T19:55:16.153 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-03-10T19:55:16.176 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-03-10T19:55:16.251 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-03-10T19:55:16.273 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-03-10T19:55:16.371 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-03-10T19:55:16.393 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-03-10T19:55:16.467 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-03-10T19:55:16.489 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-03-10T19:55:16.563 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-03-10T19:55:16.587 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-03-10T19:55:16.661 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-03-10T19:55:16.673 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-03-10T19:55:16.759 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-03-10T19:55:16.781 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-03-10T19:55:16.856 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-03-10T19:55:16.889 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-03-10T19:55:16.953 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-03-10T19:55:16.986 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-03-10T19:55:17.051 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-03-10T19:55:17.083 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-03-10T19:55:17.160 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-03-10T19:55:17.183 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-03-10T19:55:17.279 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-03-10T19:55:17.291 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-03-10T19:55:17.375 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-03-10T19:55:17.376 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-03-10T19:55:17.462 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-03-10T19:55:17.464 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-03-10T19:55:17.558 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-03-10T19:55:17.559 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-03-10T19:55:17.655 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-03-10T19:55:17.657 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-03-10T19:55:17.739 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-03-10T19:55:17.752 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-03-10T19:55:17.846 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-03-10T19:55:17.879 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-03-10T19:55:17.881 INFO:teuthology.task.ansible.out: 2021-03-10T19:55:17.964 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-03-10T19:55:17.997 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-03-10T19:55:18.060 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-03-10T19:55:18.083 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-03-10T19:55:18.157 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-03-10T19:55:18.179 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-03-10T19:55:18.253 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-03-10T19:55:18.275 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-03-10T19:55:18.339 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-03-10T19:55:18.361 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-03-10T19:55:18.446 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-03-10T19:55:18.468 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-03-10T19:55:18.533 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-03-10T19:55:18.555 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-03-10T19:55:18.633 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-03-10T19:55:18.655 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-03-10T19:55:18.729 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-03-10T19:55:18.793 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-03-10T19:55:18.872 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-03-10T19:55:18.895 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-03-10T19:55:18.959 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-03-10T19:55:18.992 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-03-10T19:55:19.066 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-03-10T19:55:19.088 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-03-10T19:55:19.224 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-03-10T19:55:19.257 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-03-10T19:55:19.331 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-03-10T19:55:19.492 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-03-10T19:55:19.616 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:19 +0000 (0:00:14.098) 0:00:21.517 ******* 2021-03-10T19:55:19.626 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-03-10T19:55:19.652 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-03-10T19:55:19.705 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-03-10T19:55:19.736 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:19 +0000 (0:00:00.119) 0:00:21.637 ******* 2021-03-10T19:55:19.778 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-03-10T19:55:19.780 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-03-10T19:55:19.904 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-03-10T19:55:19.906 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora r 2021-03-10T19:55:19.908 INFO:teuthology.task.ansible.out:T6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c 2021-03-10T19:55:19.909 INFO:teuthology.task.ansible.out:63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD 2021-03-10T19:55:19.911 INFO:teuthology.task.ansible.out:0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9d 2021-03-10T19:55:19.912 INFO:teuthology.task.ansible.out:f7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 2021-03-10T19:55:19.914 INFO:teuthology.task.ansible.out:4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953 2021-03-10T19:55:19.916 INFO:teuthology.task.ansible.out:cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4 2021-03-10T19:55:19.916 INFO:teuthology.task.ansible.out:fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7 2021-03-10T19:55:19.918 INFO:teuthology.task.ansible.out:cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef148 2021-03-10T19:55:19.919 INFO:teuthology.task.ansible.out:0c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017 2021-03-10T19:55:19.921 INFO:teuthology.task.ansible.out:b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214b 2021-03-10T19:55:19.922 INFO:teuthology.task.ansible.out:bea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez 2021-03-10T19:55:19.924 INFO:teuthology.task.ansible.out:@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed1 2021-03-10T19:55:19.925 INFO:teuthology.task.ansible.out:9b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe 2021-03-10T19:55:19.926 INFO:teuthology.task.ansible.out:16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} 2021-03-10T19:55:19.956 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:19 +0000 (0:00:00.219) 0:00:21.856 ******* 2021-03-10T19:55:19.981 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:19 +0000 (0:00:00.025) 0:00:21.882 ******* 2021-03-10T19:55:20.065 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-03-10T19:55:20.095 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:20 +0000 (0:00:00.113) 0:00:21.996 ******* 2021-03-10T19:55:20.189 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-03-10T19:55:20.191 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora r 2021-03-10T19:55:20.193 INFO:teuthology.task.ansible.out:T6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c 2021-03-10T19:55:20.195 INFO:teuthology.task.ansible.out:63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD 2021-03-10T19:55:20.196 INFO:teuthology.task.ansible.out:0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9d 2021-03-10T19:55:20.198 INFO:teuthology.task.ansible.out:f7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 2021-03-10T19:55:20.200 INFO:teuthology.task.ansible.out:4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953 2021-03-10T19:55:20.201 INFO:teuthology.task.ansible.out:cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4 2021-03-10T19:55:20.202 INFO:teuthology.task.ansible.out:fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7 2021-03-10T19:55:20.203 INFO:teuthology.task.ansible.out:cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef148 2021-03-10T19:55:20.205 INFO:teuthology.task.ansible.out:0c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017 2021-03-10T19:55:20.207 INFO:teuthology.task.ansible.out:b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214b 2021-03-10T19:55:20.208 INFO:teuthology.task.ansible.out:bea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez 2021-03-10T19:55:20.210 INFO:teuthology.task.ansible.out:@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed1 2021-03-10T19:55:20.212 INFO:teuthology.task.ansible.out:9b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe 2021-03-10T19:55:20.212 INFO:teuthology.task.ansible.out:16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} 2021-03-10T19:55:20.242 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:20 +0000 (0:00:00.146) 0:00:22.143 ******* 2021-03-10T19:55:20.819 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-03-10T19:55:20.821 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"after": "c31004c4720a55ac12a95d66c32e64f592877604", "attempts": 1, "before": "c31004c4720a55ac12a95d66c32e64f592877604", "changed": false, "remote_url_changed": false} 2021-03-10T19:55:20.847 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:20 +0000 (0:00:00.605) 0:00:22.748 ******* 2021-03-10T19:55:20.921 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"after": "c31004c4720a55ac12a95d66c32e64f592877604", "attempts": 1, "before": "c31004c4720a55ac12a95d66c32e64f592877604", "changed": false, "remote_url_changed": false} 2021-03-10T19:55:20.948 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:20 +0000 (0:00:00.100) 0:00:22.848 ******* 2021-03-10T19:55:21.084 INFO:teuthology.task.ansible.out: 2021-03-10T19:55:21.086 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys using the keys repo] ********************** ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-03-10T19:55:21.162 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-03-10T19:55:21.184 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-03-10T19:55:21.262 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-03-10T19:55:21.306 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-03-10T19:55:21.368 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-03-10T19:55:21.422 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-03-10T19:55:21.424 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-03-10T19:55:21.491 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-03-10T19:55:21.493 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-03-10T19:55:21.567 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-03-10T19:55:21.610 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-03-10T19:55:21.684 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-03-10T19:55:21.686 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-03-10T19:55:21.717 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-03-10T19:55:21.718 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-03-10T19:55:21.792 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-03-10T19:55:21.847 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-03-10T19:55:21.913 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-03-10T19:55:21.968 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-03-10T19:55:22.023 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-03-10T19:55:22.034 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:22.087 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-03-10T19:55:22.089 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:22.173 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-03-10T19:55:22.174 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-03-10T19:55:22.236 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-03-10T19:55:22.238 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-03-10T19:55:22.333 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-03-10T19:55:22.335 INFO:teuthology.task.ansible.out:on", "validate_certs": true} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:22.345 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-03-10T19:55:22.347 INFO:teuthology.task.ansible.out:on", "validate_certs": true} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:22.357 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:22.359 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:22.464 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-03-10T19:55:22.465 INFO:teuthology.task.ansible.out: 2021-03-10T19:55:22.476 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-03-10T19:55:22.591 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-03-10T19:55:22.593 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@ 2021-03-10T19:55:22.595 INFO:teuthology.task.ansible.out:kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh 2021-03-10T19:55:22.596 INFO:teuthology.task.ansible.out:+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-03-10T19:55:22.721 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-03-10T19:55:22.732 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-03-10T19:55:22.817 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": n 2021-03-10T19:55:22.819 INFO:teuthology.task.ansible.out:ull, "state": "present", "user": "davidz", "validate_certs": true} 2021-03-10T19:55:22.829 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": n 2021-03-10T19:55:22.831 INFO:teuthology.task.ansible.out:ull, "state": "present", "user": "davidz", "validate_certs": true} 2021-03-10T19:55:22.935 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-03-10T19:55:22.937 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-03-10T19:55:23.031 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-03-10T19:55:23.042 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-03-10T19:55:23.137 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-03-10T19:55:23.148 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-03-10T19:55:23.233 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-03-10T19:55:23.235 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-03-10T19:55:23.255 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-03-10T19:55:23.257 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-03-10T19:55:23.340 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-03-10T19:55:23.342 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-03-10T19:55:23.416 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-03-10T19:55:23.417 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-03-10T19:55:23.470 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-03-10T19:55:23.535 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-03-10T19:55:23.600 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-03-10T19:55:23.633 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-03-10T19:55:23.701 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46T 2021-03-10T19:55:23.702 INFO:teuthology.task.ansible.out:RJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-03-10T19:55:23.733 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46T 2021-03-10T19:55:23.735 INFO:teuthology.task.ansible.out:RJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-03-10T19:55:23.796 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-03-10T19:55:23.828 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-03-10T19:55:23.902 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-03-10T19:55:23.946 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-03-10T19:55:24.009 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-03-10T19:55:24.073 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-03-10T19:55:24.116 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-03-10T19:55:24.169 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-03-10T19:55:24.201 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-03-10T19:55:24.265 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-03-10T19:55:24.308 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-03-10T19:55:24.310 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-03-10T19:55:24.361 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-03-10T19:55:24.363 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-03-10T19:55:24.415 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-03-10T19:55:24.458 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-03-10T19:55:24.522 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-03-10T19:55:24.565 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-03-10T19:55:24.619 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-03-10T19:55:24.663 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-03-10T19:55:24.716 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-03-10T19:55:24.801 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-03-10T19:55:24.824 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-03-10T19:55:24.939 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-03-10T19:55:24.972 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-03-10T19:55:25.081 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-03-10T19:55:25.105 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-10T19:55:25.214 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-03-10T19:55:25.237 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-10T19:55:25.326 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-03-10T19:55:25.379 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-03-10T19:55:25.381 INFO:teuthology.task.ansible.out: 2021-03-10T19:55:25.465 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-03-10T19:55:25.467 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-03-10T19:55:25.512 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-03-10T19:55:25.608 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-03-10T19:55:25.609 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-03-10T19:55:25.653 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-03-10T19:55:25.655 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-03-10T19:55:25.715 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-03-10T19:55:25.802 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-03-10T19:55:25.803 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-03-10T19:55:25.822 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-03-10T19:55:25.898 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-03-10T19:55:25.918 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-03-10T19:55:26.003 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-03-10T19:55:26.025 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nul 2021-03-10T19:55:26.027 INFO:teuthology.task.ansible.out:l, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-10T19:55:26.111 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-03-10T19:55:26.133 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-03-10T19:55:26.135 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-03-10T19:55:26.136 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-03-10T19:55:26.210 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nul 2021-03-10T19:55:26.212 INFO:teuthology.task.ansible.out:l, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-10T19:55:26.233 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-03-10T19:55:26.307 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-03-10T19:55:26.309 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-03-10T19:55:26.311 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-03-10T19:55:26.340 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-03-10T19:55:26.406 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-03-10T19:55:26.439 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-03-10T19:55:26.506 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-03-10T19:55:26.539 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-03-10T19:55:26.613 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-03-10T19:55:26.634 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-03-10T19:55:26.709 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-03-10T19:55:26.731 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-03-10T19:55:26.733 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-03-10T19:55:26.820 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-03-10T19:55:26.822 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-03-10T19:55:26.919 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-03-10T19:55:26.921 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-03-10T19:55:26.931 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-03-10T19:55:27.030 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-03-10T19:55:27.032 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-03-10T19:55:27.033 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-03-10T19:55:27.136 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-03-10T19:55:27.138 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-03-10T19:55:27.222 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-03-10T19:55:27.233 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-03-10T19:55:27.235 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-03-10T19:55:27.328 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-03-10T19:55:27.340 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-03-10T19:55:27.342 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-03-10T19:55:27.435 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-03-10T19:55:27.437 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-03-10T19:55:27.530 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-03-10T19:55:27.532 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-03-10T19:55:27.542 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-03-10T19:55:27.628 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-03-10T19:55:27.629 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-03-10T19:55:27.630 INFO:teuthology.task.ansible.out: 2021-03-10T19:55:27.725 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-10T19:55:27.736 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-03-10T19:55:27.831 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-03-10T19:55:27.842 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-03-10T19:55:27.937 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-03-10T19:55:27.949 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-03-10T19:55:28.034 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-03-10T19:55:28.057 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-03-10T19:55:28.152 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-03-10T19:55:28.164 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-03-10T19:55:28.251 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-03-10T19:55:28.262 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-03-10T19:55:28.366 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-03-10T19:55:28.369 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-03-10T19:55:28.463 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": tr 2021-03-10T19:55:28.465 INFO:teuthology.task.ansible.out:ue} 2021-03-10T19:55:28.557 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-03-10T19:55:28.570 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-03-10T19:55:28.665 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-03-10T19:55:28.677 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-03-10T19:55:28.783 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-03-10T19:55:28.795 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-03-10T19:55:28.901 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-03-10T19:55:28.912 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-03-10T19:55:29.020 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-03-10T19:55:29.053 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-03-10T19:55:29.120 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-03-10T19:55:29.152 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-03-10T19:55:29.237 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-03-10T19:55:29.249 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-03-10T19:55:29.333 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-03-10T19:55:29.345 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-03-10T19:55:29.429 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-03-10T19:55:29.441 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-03-10T19:55:29.547 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-03-10T19:55:29.558 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-03-10T19:55:29.560 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-03-10T19:55:29.653 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-03-10T19:55:29.675 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-03-10T19:55:29.760 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-03-10T19:55:29.762 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-03-10T19:55:29.782 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-03-10T19:55:29.857 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-03-10T19:55:29.888 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-03-10T19:55:29.978 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-03-10T19:55:30.001 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-03-10T19:55:30.097 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-03-10T19:55:30.110 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.localdo 2021-03-10T19:55:30.112 INFO:teuthology.task.ansible.out:main", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-03-10T19:55:30.205 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-03-10T19:55:30.216 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-03-10T19:55:30.221 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-03-10T19:55:30.311 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.localdo 2021-03-10T19:55:30.313 INFO:teuthology.task.ansible.out:main", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-03-10T19:55:30.322 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-03-10T19:55:30.409 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-03-10T19:55:30.420 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-03-10T19:55:30.422 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-03-10T19:55:30.528 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-03-10T19:55:30.560 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-03-10T19:55:30.658 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-03-10T19:55:30.714 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-03-10T19:55:30.765 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-03-10T19:55:30.851 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-03-10T19:55:30.895 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-03-10T19:55:30.950 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-03-10T19:55:31.002 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-03-10T19:55:31.056 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-03-10T19:55:31.109 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-03-10T19:55:31.111 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-03-10T19:55:31.173 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-03-10T19:55:31.206 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-03-10T19:55:31.283 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-03-10T19:55:31.315 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-03-10T19:55:31.411 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-03-10T19:55:31.412 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-03-10T19:55:31.423 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-03-10T19:55:31.518 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-03-10T19:55:31.541 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-03-10T19:55:31.650 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-03-10T19:55:31.683 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-03-10T19:55:31.759 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-03-10T19:55:31.771 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-03-10T19:55:31.881 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-03-10T19:55:31.925 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", " 2021-03-10T19:55:31.928 INFO:teuthology.task.ansible.out:manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-10T19:55:32.021 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-03-10T19:55:32.044 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-03-10T19:55:32.155 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-03-10T19:55:32.168 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-03-10T19:55:32.284 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", " 2021-03-10T19:55:32.286 INFO:teuthology.task.ansible.out:manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-03-10T19:55:32.296 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-03-10T19:55:32.393 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-03-10T19:55:32.405 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-03-10T19:55:32.492 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-03-10T19:55:32.514 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-03-10T19:55:32.601 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-03-10T19:55:32.613 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-03-10T19:55:32.700 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-03-10T19:55:32.734 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-03-10T19:55:32.809 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-03-10T19:55:32.811 INFO:teuthology.task.ansible.out: 2021-03-10T19:55:32.831 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-03-10T19:55:32.926 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-03-10T19:55:32.948 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-03-10T19:55:33.035 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-03-10T19:55:33.056 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-03-10T19:55:33.154 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-03-10T19:55:33.186 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-03-10T19:55:33.250 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-03-10T19:55:33.313 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-03-10T19:55:33.346 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-03-10T19:55:33.420 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-03-10T19:55:33.442 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-03-10T19:55:33.519 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-03-10T19:55:33.557 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-03-10T19:55:33.648 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-03-10T19:55:33.671 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-03-10T19:55:33.771 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-03-10T19:55:33.782 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-03-10T19:55:33.871 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-03-10T19:55:33.883 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-03-10T19:55:33.977 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-03-10T19:55:34.000 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-03-10T19:55:34.002 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-03-10T19:55:34.076 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-03-10T19:55:34.108 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-03-10T19:55:34.162 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-03-10T19:55:34.246 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-03-10T19:55:34.268 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-03-10T19:55:34.353 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-03-10T19:55:34.396 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-03-10T19:55:34.397 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-03-10T19:55:34.459 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-03-10T19:55:34.533 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-03-10T19:55:34.555 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-03-10T19:55:34.628 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-03-10T19:55:34.672 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-03-10T19:55:34.736 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-03-10T19:55:34.789 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-03-10T19:55:34.832 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-03-10T19:55:34.885 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-03-10T19:55:34.928 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-03-10T19:55:34.993 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-03-10T19:55:35.025 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-03-10T19:55:35.186 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-03-10T19:55:35.207 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-03-10T19:55:35.292 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-03-10T19:55:35.324 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-03-10T19:55:35.389 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-03-10T19:55:35.421 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-03-10T19:55:35.537 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-03-10T19:55:35.560 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-03-10T19:55:35.634 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-03-10T19:55:35.679 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-03-10T19:55:35.754 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-03-10T19:55:35.799 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-03-10T19:55:35.854 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-03-10T19:55:35.928 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-03-10T19:55:35.962 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "k 2021-03-10T19:55:35.964 INFO:teuthology.task.ansible.out:ey_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-03-10T19:55:36.026 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-03-10T19:55:36.060 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-03-10T19:55:36.133 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-03-10T19:55:36.160 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:36 +0000 (0:00:15.210) 0:00:38.059 ******* 2021-03-10T19:55:36.242 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-03-10T19:55:36.253 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-10T19:55:36.255 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.266 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.267 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.277 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.279 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.290 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.292 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.304 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.334 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-10T19:55:36.336 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "k 2021-03-10T19:55:36.337 INFO:teuthology.task.ansible.out:ey_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-03-10T19:55:36.409 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-10T19:55:36.411 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-03-10T19:55:36.442 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.444 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.453 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-03-10T19:55:36.455 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-03-10T19:55:36.553 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:36 +0000 (0:00:00.394) 0:00:38.454 ******* 2021-03-10T19:55:36.575 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-10T19:55:36.577 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-03-10T19:55:36.671 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.685 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-03-10T19:55:36.694 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.696 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59 2021-03-10T19:55:36.697 INFO:teuthology.task.ansible.out:894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": 2021-03-10T19:55:36.699 INFO:teuthology.task.ansible.out: {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.710 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.721 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.722 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.733 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.734 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.744 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.746 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.756 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.767 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.779 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.801 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.803 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.813 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.824 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.826 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.836 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.847 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.850 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.860 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a92 2021-03-10T19:55:36.861 INFO:teuthology.task.ansible.out:1169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.872 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.874 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.885 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.886 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.896 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.908 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.909 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.920 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.931 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.933 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.943 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.945 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.954 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.966 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.968 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.979 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-03-10T19:55:36.981 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.983 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:36.994 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.007 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.009 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.018 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.029 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.031 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.041 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.043 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.054 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.065 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.077 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.079 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.089 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.090 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.100 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.102 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.112 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-03-10T19:55:37.113 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.115 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.125 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.126 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad 2021-03-10T19:55:37.128 INFO:teuthology.task.ansible.out: IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.138 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.139 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.141 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.141 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.143 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.154 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.155 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.156 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.157 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.168 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.169 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.171 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.182 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.183 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.184 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.196 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.197 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.199 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.210 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.211 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.223 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.224 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.235 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.237 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.248 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.249 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.260 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.262 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.272 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.274 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.285 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.287 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.287 INFO:teuthology.task.ansible.out: 2021-03-10T19:55:37.287 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.299 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.300 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.312 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.314 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.335 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.337 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.348 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.359 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.361 INFO:teuthology.task.ansible.out: skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.373 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.374 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.375 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.388 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.390 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.403 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.405 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.415 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.416 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.418 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.419 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.431 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.432 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.433 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.446 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.457 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.459 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.470 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.472 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.482 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.483 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.485 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.498 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.510 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.512 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.523 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.525 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.541 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.551 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.553 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.563 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.564 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.574 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.579 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.581 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.610 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.612 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.665 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:37 +0000 (0:00:01.111) 0:00:39.566 ******* 2021-03-10T19:55:37.673 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.678 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.680 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.692 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.695 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.705 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.717 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.728 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.739 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.750 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.754 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.776 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:37 +0000 (0:00:00.110) 0:00:39.676 ******* 2021-03-10T19:55:37.786 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.797 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.808 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.810 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.820 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.821 INFO:teuthology.task.ansible.out: 2021-03-10T19:55:37.832 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.834 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.844 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.855 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.856 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.867 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.869 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.879 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.890 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.892 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.902 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.913 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.915 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.925 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.937 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.939 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.949 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.950 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [gibba044.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-03-10T19:55:37.951 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.965 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.976 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.977 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.991 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:37.999 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:38.001 INFO:teuthology.task.ansible.out: skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:38.002 INFO:teuthology.task.ansible.out: 2021-03-10T19:55:38.012 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:38.014 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:38.028 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:38.036 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:38.038 INFO:teuthology.task.ansible.out: skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:38.048 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:38.049 INFO:teuthology.task.ansible.out: 2021-03-10T19:55:38.051 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T19:55:38.051 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-03-10T19:55:38.063 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-10T19:55:38.064 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:38.075 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:38.086 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:38.088 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:38.100 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:38.101 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:38.111 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:38.122 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:38.124 INFO:teuthology.task.ansible.out: skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:38.136 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:38.148 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:38.159 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:38.161 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:38.171 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:38.174 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [gibba044.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-03-10T19:55:38.183 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-03-10T19:55:38.185 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:38.227 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:38 +0000 (0:00:00.451) 0:00:40.128 ******* 2021-03-10T19:55:38.278 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T19:55:38.280 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-03-10T19:55:38.311 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:38.334 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:38 +0000 (0:00:00.106) 0:00:40.235 ******* 2021-03-10T19:55:38.385 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T19:55:38.387 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-03-10T19:55:38.494 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-03-10T19:55:38.548 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-03-10T19:55:38.602 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-03-10T19:55:38.647 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-03-10T19:55:38.701 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-03-10T19:55:38.744 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-03-10T19:55:38.809 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-03-10T19:55:38.852 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-03-10T19:55:38.916 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-03-10T19:55:38.949 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-03-10T19:55:39.051 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-03-10T19:55:39.086 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-03-10T19:55:39.181 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-03-10T19:55:39.192 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-03-10T19:55:39.309 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-03-10T19:55:39.322 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-03-10T19:55:39.421 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-03-10T19:55:39.422 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-03-10T19:55:39.527 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-03-10T19:55:39.549 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-03-10T19:55:39.635 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-03-10T19:55:39.646 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-03-10T19:55:39.732 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-03-10T19:55:39.746 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-03-10T19:55:39.849 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-03-10T19:55:39.871 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-03-10T19:55:39.956 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-03-10T19:55:39.958 INFO:teuthology.task.ansible.out: 2021-03-10T19:55:39.999 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-03-10T19:55:40.074 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-03-10T19:55:40.107 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-03-10T19:55:40.204 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-03-10T19:55:40.205 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-03-10T19:55:40.289 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-03-10T19:55:40.322 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-03-10T19:55:40.422 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-03-10T19:55:40.450 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-03-10T19:55:40.534 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-03-10T19:55:40.557 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-03-10T19:55:40.631 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-03-10T19:55:40.654 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-03-10T19:55:40.731 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-03-10T19:55:40.753 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-03-10T19:55:40.817 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-03-10T19:55:40.850 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-03-10T19:55:40.915 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-03-10T19:55:40.958 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-03-10T19:55:41.011 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-03-10T19:55:41.044 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-03-10T19:55:41.110 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-03-10T19:55:41.132 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-03-10T19:55:41.206 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-03-10T19:55:41.228 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-03-10T19:55:41.315 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-03-10T19:55:41.326 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-03-10T19:55:41.411 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-03-10T19:55:41.411 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-03-10T19:55:41.496 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-03-10T19:55:41.508 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-03-10T19:55:41.608 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-03-10T19:55:41.619 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-03-10T19:55:41.697 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-03-10T19:55:41.761 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-03-10T19:55:41.794 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-03-10T19:55:41.858 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-03-10T19:55:41.880 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-03-10T19:55:41.955 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-03-10T19:55:41.967 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-03-10T19:55:42.062 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-03-10T19:55:42.063 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-03-10T19:55:42.147 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-03-10T19:55:42.149 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-03-10T19:55:42.245 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-03-10T19:55:42.247 INFO:teuthology.task.ansible.out: ok: [gibba023.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-03-10T19:55:42.248 INFO:teuthology.task.ansible.out: 2021-03-10T19:55:42.332 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-03-10T19:55:42.354 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-03-10T19:55:42.430 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-03-10T19:55:42.442 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-03-10T19:55:42.532 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-03-10T19:55:42.537 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-03-10T19:55:42.629 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-03-10T19:55:42.631 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-03-10T19:55:42.725 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-03-10T19:55:42.736 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-03-10T19:55:42.812 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-03-10T19:55:42.834 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-03-10T19:55:42.922 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-03-10T19:55:42.944 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-03-10T19:55:43.018 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-03-10T19:55:43.029 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-03-10T19:55:43.077 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:43 +0000 (0:00:04.742) 0:00:44.978 ******* 2021-03-10T19:55:43.107 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-03-10T19:55:43.223 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-03-10T19:55:43.321 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-03-10T19:55:43.407 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-03-10T19:55:43.409 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "checksum": "1d9711ff879c231c67cb70d00ca0088797a377d0", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "80a55def4b505d08aff3687f81f74dc2", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615406143.1699932-27882-245272877967991/source", "state": "file", "uid": 0} 2021-03-10T19:55:43.432 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:43 +0000 (0:00:00.354) 0:00:45.332 ******* 2021-03-10T19:55:43.439 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-03-10T19:55:43.441 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-03-10T19:55:43.486 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:43 +0000 (0:00:00.054) 0:00:45.387 ******* 2021-03-10T19:55:43.515 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-03-10T19:55:43.517 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => { "msg": "Host gibba044.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-03-10T19:55:43.541 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:43 +0000 (0:00:00.054) 0:00:45.442 ******* 2021-03-10T19:55:43.666 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-03-10T19:55:43.668 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-03-10T19:55:43.690 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:43 +0000 (0:00:00.148) 0:00:45.591 ******* 2021-03-10T19:55:43.770 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-03-10T19:55:43.772 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:43.797 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:43 +0000 (0:00:00.106) 0:00:45.697 ******* 2021-03-10T19:55:43.870 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-03-10T19:55:43.872 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:43.895 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:43 +0000 (0:00:00.097) 0:00:45.795 ******* 2021-03-10T19:55:43.954 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-03-10T19:55:43.956 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => {"changed": true, "checksum": "1d9711ff879c231c67cb70d00ca0088797a377d0", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "80a55def4b505d08aff3687f81f74dc2", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615406143.6176329-28008-53626942897996/source", "state": "file", "uid": 0} 2021-03-10T19:55:43.994 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:43 +0000 (0:00:00.098) 0:00:45.894 ******* 2021-03-10T19:55:44.005 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-03-10T19:55:44.007 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:44.043 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:44 +0000 (0:00:00.048) 0:00:45.943 ******* 2021-03-10T19:55:44.082 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-03-10T19:55:44.083 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => { "msg": "Host gibba023.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-03-10T19:55:44.109 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:44 +0000 (0:00:00.065) 0:00:46.009 ******* 2021-03-10T19:55:44.128 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-03-10T19:55:44.130 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:44.158 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:44 +0000 (0:00:00.049) 0:00:46.058 ******* 2021-03-10T19:55:44.253 INFO:teuthology.task.ansible.out: 2021-03-10T19:55:44.255 INFO:teuthology.task.ansible.out:TASK [common : Including major version specific variables.] ******************** ok: [gibba023.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-03-10T19:55:44.279 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:44 +0000 (0:00:00.121) 0:00:46.180 ******* 2021-03-10T19:55:44.283 INFO:teuthology.task.ansible.out: 2021-03-10T19:55:44.305 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-03-10T19:55:44.306 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:44.333 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:44 +0000 (0:00:00.054) 0:00:46.234 ******* 2021-03-10T19:55:44.398 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:44.418 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:44 +0000 (0:00:00.084) 0:00:46.319 ******* 2021-03-10T19:55:44.439 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-03-10T19:55:44.441 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:44.482 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:44 +0000 (0:00:00.064) 0:00:46.383 ******* 2021-03-10T19:55:44.525 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:44.550 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:44 +0000 (0:00:00.067) 0:00:46.451 ******* 2021-03-10T19:55:44.585 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-03-10T19:55:44.587 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:44.610 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:44 +0000 (0:00:00.059) 0:00:46.511 ******* 2021-03-10T19:55:44.641 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:44.668 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:44 +0000 (0:00:00.056) 0:00:46.567 ******* 2021-03-10T19:55:44.710 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-03-10T19:55:44.713 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:44.737 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:44 +0000 (0:00:00.069) 0:00:46.637 ******* 2021-03-10T19:55:44.754 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-03-10T19:55:44.756 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:44.780 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:44 +0000 (0:00:00.044) 0:00:46.681 ******* 2021-03-10T19:55:44.829 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-03-10T19:55:44.831 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [gibba044.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:55:44.855 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:44 +0000 (0:00:00.073) 0:00:46.755 ******* 2021-03-10T19:55:44.861 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-03-10T19:55:44.862 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:44.886 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:44 +0000 (0:00:00.031) 0:00:46.786 ******* 2021-03-10T19:55:44.935 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-03-10T19:55:44.937 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:44.959 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:44 +0000 (0:00:00.073) 0:00:46.860 ******* 2021-03-10T19:55:44.967 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-03-10T19:55:44.969 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:44.995 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:44 +0000 (0:00:00.035) 0:00:46.896 ******* 2021-03-10T19:55:45.034 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-03-10T19:55:45.036 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:45.062 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:45 +0000 (0:00:00.066) 0:00:46.963 ******* 2021-03-10T19:55:45.080 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-03-10T19:55:45.081 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:45.106 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:45 +0000 (0:00:00.043) 0:00:47.006 ******* 2021-03-10T19:55:45.146 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-03-10T19:55:45.148 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:55:45.176 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:45 +0000 (0:00:00.070) 0:00:47.077 ******* 2021-03-10T19:55:45.186 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-03-10T19:55:45.188 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:45.216 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:45 +0000 (0:00:00.039) 0:00:47.116 ******* 2021-03-10T19:55:45.297 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-03-10T19:55:45.339 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 March 2021 19:55:45 +0000 (0:00:00.106) 0:00:47.223 ******* 2021-03-10T19:55:45.376 INFO:teuthology.task.ansible.out: 2021-03-10T19:55:45.377 INFO:teuthology.task.ansible.out:TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [gibba023.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [gibba023.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:55:45.414 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:45 +0000 (0:00:00.091) 0:00:47.315 ******* 2021-03-10T19:55:45.432 INFO:teuthology.task.ansible.out: 2021-03-10T19:55:45.434 INFO:teuthology.task.ansible.out:TASK [common : Register with subscription-manager.] **************************** skipping: [gibba044.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:55:45.470 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:45 +0000 (0:00:00.055) 0:00:47.370 ******* 2021-03-10T19:55:45.509 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-03-10T19:55:45.511 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:45.537 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:45 +0000 (0:00:00.066) 0:00:47.437 ******* 2021-03-10T19:55:45.556 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-03-10T19:55:45.558 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:45.594 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:45 +0000 (0:00:00.057) 0:00:47.494 ******* 2021-03-10T19:55:45.637 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-03-10T19:55:45.646 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:45.667 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:45 +0000 (0:00:00.073) 0:00:47.568 ******* 2021-03-10T19:55:45.690 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-03-10T19:55:45.692 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:45.718 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:45 +0000 (0:00:00.050) 0:00:47.619 ******* 2021-03-10T19:55:45.746 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-03-10T19:55:45.748 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:55:45.773 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:45 +0000 (0:00:00.053) 0:00:47.674 ******* 2021-03-10T19:55:45.801 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-03-10T19:55:45.803 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:45.827 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:45 +0000 (0:00:00.054) 0:00:47.728 ******* 2021-03-10T19:55:45.866 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-03-10T19:55:45.868 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:45.890 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:45 +0000 (0:00:00.062) 0:00:47.790 ******* 2021-03-10T19:55:45.908 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-03-10T19:55:45.910 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:45.938 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:45 +0000 (0:00:00.048) 0:00:47.839 ******* 2021-03-10T19:55:45.976 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-03-10T19:55:45.978 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:55:46.004 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:46 +0000 (0:00:00.066) 0:00:47.905 ******* 2021-03-10T19:55:46.022 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-03-10T19:55:46.023 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:55:46.048 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:46 +0000 (0:00:00.043) 0:00:47.948 ******* 2021-03-10T19:55:46.051 INFO:teuthology.task.ansible.out: 2021-03-10T19:55:46.077 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-03-10T19:55:46.079 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:46.111 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:46 +0000 (0:00:00.058) 0:00:48.007 ******* 2021-03-10T19:55:46.128 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-03-10T19:55:46.130 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:46.162 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:46 +0000 (0:00:00.055) 0:00:48.062 ******* 2021-03-10T19:55:46.202 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:46.229 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:46 +0000 (0:00:00.067) 0:00:48.130 ******* 2021-03-10T19:55:46.268 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:46.299 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:46 +0000 (0:00:00.069) 0:00:48.199 ******* 2021-03-10T19:55:46.329 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-03-10T19:55:46.330 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:46.359 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:46 +0000 (0:00:00.059) 0:00:48.259 ******* 2021-03-10T19:55:46.399 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-03-10T19:55:46.400 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:46.423 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:46 +0000 (0:00:00.064) 0:00:48.324 ******* 2021-03-10T19:55:46.425 INFO:teuthology.task.ansible.out: 2021-03-10T19:55:46.442 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-03-10T19:55:46.444 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:46.470 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:46 +0000 (0:00:00.045) 0:00:48.370 ******* 2021-03-10T19:55:46.520 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:46.551 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:46 +0000 (0:00:00.081) 0:00:48.452 ******* 2021-03-10T19:55:46.561 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-03-10T19:55:46.562 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:55:46.587 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:46 +0000 (0:00:00.035) 0:00:48.488 ******* 2021-03-10T19:55:46.629 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:46.662 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:46 +0000 (0:00:00.074) 0:00:48.562 ******* 2021-03-10T19:55:46.679 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-03-10T19:55:46.681 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:46.707 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:46 +0000 (0:00:00.045) 0:00:48.607 ******* 2021-03-10T19:55:46.755 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-03-10T19:55:46.757 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:46.784 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:46 +0000 (0:00:00.077) 0:00:48.685 ******* 2021-03-10T19:55:46.791 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-03-10T19:55:46.793 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:46.828 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:46 +0000 (0:00:00.044) 0:00:48.729 ******* 2021-03-10T19:55:46.854 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-03-10T19:55:46.855 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:55:46.884 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:46 +0000 (0:00:00.054) 0:00:48.784 ******* 2021-03-10T19:55:46.914 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-03-10T19:55:46.915 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:46.939 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:46 +0000 (0:00:00.055) 0:00:48.839 ******* 2021-03-10T19:55:46.959 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-03-10T19:55:46.960 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:46.962 INFO:teuthology.task.ansible.out: 2021-03-10T19:55:46.987 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:46 +0000 (0:00:00.048) 0:00:48.887 ******* 2021-03-10T19:55:47.019 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-03-10T19:55:47.021 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:47.046 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:47 +0000 (0:00:00.059) 0:00:48.947 ******* 2021-03-10T19:55:47.088 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-03-10T19:55:47.089 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:47.119 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:47 +0000 (0:00:00.073) 0:00:49.020 ******* 2021-03-10T19:55:47.137 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-03-10T19:55:47.139 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:47.164 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:47 +0000 (0:00:00.044) 0:00:49.065 ******* 2021-03-10T19:55:47.237 INFO:teuthology.task.ansible.out: 2021-03-10T19:55:47.239 INFO:teuthology.task.ansible.out:TASK [common : Increase the yum timeout.] ************************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:47.286 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:47 +0000 (0:00:00.122) 0:00:49.187 ******* 2021-03-10T19:55:47.305 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-03-10T19:55:47.307 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:47.343 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:47 +0000 (0:00:00.056) 0:00:49.244 ******* 2021-03-10T19:55:47.392 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-03-10T19:55:47.396 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:47.404 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:47.443 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:47 +0000 (0:00:00.099) 0:00:49.343 ******* 2021-03-10T19:55:47.451 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-03-10T19:55:47.452 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:55:47.480 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:47 +0000 (0:00:00.036) 0:00:49.380 ******* 2021-03-10T19:55:47.520 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* skipping: [gibba044.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2021-03-10T19:55:47.531 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-03-10T19:55:47.558 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:47 +0000 (0:00:00.078) 0:00:49.458 ******* 2021-03-10T19:55:47.566 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-03-10T19:55:47.568 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:47.595 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:47 +0000 (0:00:00.036) 0:00:49.495 ******* 2021-03-10T19:55:47.634 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-03-10T19:55:47.636 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:47.673 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:47 +0000 (0:00:00.078) 0:00:49.573 ******* 2021-03-10T19:55:47.683 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-03-10T19:55:47.685 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:47.711 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:47 +0000 (0:00:00.038) 0:00:49.612 ******* 2021-03-10T19:55:47.792 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-03-10T19:55:47.794 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:47.818 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:47 +0000 (0:00:00.107) 0:00:49.719 ******* 2021-03-10T19:55:47.837 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-03-10T19:55:47.839 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.009987", "end": "2021-03-10 19:55:48.182948", "rc": 0, "start": "2021-03-10 19:55:48.172961", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-03-10T19:55:47.864 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:47 +0000 (0:00:00.045) 0:00:49.764 ******* 2021-03-10T19:55:47.902 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-03-10T19:55:47.904 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:47.914 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:47.939 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:47 +0000 (0:00:00.075) 0:00:49.840 ******* 2021-03-10T19:55:47.957 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-03-10T19:55:47.958 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:47.982 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:47 +0000 (0:00:00.042) 0:00:49.883 ******* 2021-03-10T19:55:48.035 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* skipping: [gibba023.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-03-10T19:55:48.058 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:48 +0000 (0:00:00.076) 0:00:49.959 ******* 2021-03-10T19:55:48.066 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-03-10T19:55:48.068 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:48.099 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:48 +0000 (0:00:00.039) 0:00:49.998 ******* 2021-03-10T19:55:48.136 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:48.164 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:48 +0000 (0:00:00.065) 0:00:50.064 ******* 2021-03-10T19:55:48.354 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-03-10T19:55:48.356 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.012770", "end": "2021-03-10 19:55:48.185194", "rc": 0, "start": "2021-03-10 19:55:48.172424", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-03-10T19:55:48.381 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:48 +0000 (0:00:00.217) 0:00:50.282 ******* 2021-03-10T19:55:48.461 INFO:teuthology.task.ansible.out: 2021-03-10T19:55:48.463 INFO:teuthology.task.ansible.out:TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:48.486 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:48 +0000 (0:00:00.104) 0:00:50.387 ******* 2021-03-10T19:55:48.557 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-03-10T19:55:48.558 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:48.559 INFO:teuthology.task.ansible.out: 2021-03-10T19:55:48.582 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:48 +0000 (0:00:00.095) 0:00:50.482 ******* 2021-03-10T19:55:48.728 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-03-10T19:55:48.730 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T19:55:48.783 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T19:55:48.840 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T19:55:48.905 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T19:55:48.959 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T19:55:49.028 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T19:55:49.103 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T19:55:49.106 INFO:teuthology.task.ansible.out: 2021-03-10T19:55:49.131 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:49 +0000 (0:00:00.549) 0:00:51.032 ******* 2021-03-10T19:55:49.148 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-03-10T19:55:49.181 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:49 +0000 (0:00:00.049) 0:00:51.081 ******* 2021-03-10T19:55:49.209 INFO:teuthology.task.ansible.out: 2021-03-10T19:55:49.211 INFO:teuthology.task.ansible.out:TASK [common : Get the current timezone] *************************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:49.236 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:49 +0000 (0:00:00.055) 0:00:51.137 ******* 2021-03-10T19:55:49.265 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:49.292 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:49 +0000 (0:00:00.055) 0:00:51.193 ******* 2021-03-10T19:55:49.342 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-03-10T19:55:49.343 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:49.370 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:49 +0000 (0:00:00.078) 0:00:51.271 ******* 2021-03-10T19:55:49.382 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:49.410 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:49 +0000 (0:00:00.039) 0:00:51.310 ******* 2021-03-10T19:55:49.458 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-03-10T19:55:49.460 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:49.487 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:49 +0000 (0:00:00.076) 0:00:51.387 ******* 2021-03-10T19:55:49.494 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:49.520 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:49 +0000 (0:00:00.033) 0:00:51.421 ******* 2021-03-10T19:55:49.559 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-03-10T19:55:49.561 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:49.584 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:49 +0000 (0:00:00.063) 0:00:51.484 ******* 2021-03-10T19:55:49.602 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:49.629 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:49 +0000 (0:00:00.045) 0:00:51.530 ******* 2021-03-10T19:55:49.647 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-03-10T19:55:49.649 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:49.676 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:49 +0000 (0:00:00.046) 0:00:51.576 ******* 2021-03-10T19:55:49.703 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:49.729 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:49 +0000 (0:00:00.052) 0:00:51.629 ******* 2021-03-10T19:55:50.156 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-03-10T19:55:50.158 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.388208", "end": "2021-03-10 19:55:50.500919", "rc": 0, "start": "2021-03-10 19:55:50.112711", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:55:50.185 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:50 +0000 (0:00:00.456) 0:00:52.086 ******* 2021-03-10T19:55:50.278 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-03-10T19:55:50.280 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:50.301 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:50 +0000 (0:00:00.115) 0:00:52.202 ******* 2021-03-10T19:55:50.493 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-03-10T19:55:50.495 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.007714", "end": "2021-03-10 19:55:50.836310", "rc": 0, "start": "2021-03-10 19:55:50.828596", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:55:50.521 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:50 +0000 (0:00:00.220) 0:00:52.422 ******* 2021-03-10T19:55:50.663 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-03-10T19:55:50.665 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.833454", "end": "2021-03-10 19:55:50.500895", "rc": 0, "start": "2021-03-10 19:55:49.667441", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:55:50.687 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:50 +0000 (0:00:00.166) 0:00:52.588 ******* 2021-03-10T19:55:50.767 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:50.793 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:50 +0000 (0:00:00.105) 0:00:52.694 ******* 2021-03-10T19:55:50.947 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-03-10T19:55:50.949 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.007622", "end": "2021-03-10 19:55:50.784752", "rc": 0, "start": "2021-03-10 19:55:50.777130", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:55:50.974 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:50 +0000 (0:00:00.181) 0:00:52.875 ******* 2021-03-10T19:55:52.429 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-03-10T19:55:52.431 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1615406091, "cache_updated": false, "changed": false} 2021-03-10T19:55:52.455 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:52 +0000 (0:00:01.480) 0:00:54.355 ******* 2021-03-10T19:55:52.516 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1615406086, "cache_updated": false, "changed": false} 2021-03-10T19:55:52.543 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:52 +0000 (0:00:00.088) 0:00:54.444 ******* 2021-03-10T19:55:52.929 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-03-10T19:55:52.931 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1615406091, "cache_updated": false, "changed": false} 2021-03-10T19:55:52.967 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:52 +0000 (0:00:00.423) 0:00:54.867 ******* 2021-03-10T19:55:53.017 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"cache_update_time": 1615406086, "cache_updated": false, "changed": false} 2021-03-10T19:55:53.043 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:53 +0000 (0:00:00.076) 0:00:54.944 ******* 2021-03-10T19:55:53.050 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-03-10T19:55:53.051 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:53.076 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:53 +0000 (0:00:00.032) 0:00:54.976 ******* 2021-03-10T19:55:53.116 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:53.150 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:53 +0000 (0:00:00.073) 0:00:55.050 ******* 2021-03-10T19:55:53.691 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-03-10T19:55:53.693 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-03-10T19:55:53.715 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:53 +0000 (0:00:00.565) 0:00:55.616 ******* 2021-03-10T19:55:53.723 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-03-10T19:55:53.753 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:53 +0000 (0:00:00.037) 0:00:55.653 ******* 2021-03-10T19:55:54.168 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-03-10T19:55:54.170 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"cache_update_time": 1615406086, "cache_updated": false, "changed": false} 2021-03-10T19:55:54.192 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:54 +0000 (0:00:00.439) 0:00:56.093 ******* 2021-03-10T19:55:54.202 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1615406091, "cache_updated": false, "changed": false} 2021-03-10T19:55:54.230 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:54 +0000 (0:00:00.037) 0:00:56.131 ******* 2021-03-10T19:55:54.547 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [gibba023.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-03-10T19:55:54.569 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-03-10T19:55:54.802 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-03-10T19:55:54.845 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-03-10T19:55:55.045 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-03-10T19:55:55.073 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:55 +0000 (0:00:00.842) 0:00:56.973 ******* 2021-03-10T19:55:55.081 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-03-10T19:55:55.109 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:55 +0000 (0:00:00.036) 0:00:57.009 ******* 2021-03-10T19:55:55.199 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-03-10T19:55:55.201 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T19:55:55.229 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:55 +0000 (0:00:00.120) 0:00:57.130 ******* 2021-03-10T19:55:55.247 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T19:55:55.277 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:55 +0000 (0:00:00.046) 0:00:57.177 ******* 2021-03-10T19:55:55.527 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-03-10T19:55:55.529 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-03-10T19:55:55.582 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-03-10T19:55:55.783 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-03-10T19:55:55.825 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-03-10T19:55:56.017 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-03-10T19:55:56.018 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-03-10T19:55:56.045 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:56 +0000 (0:00:00.768) 0:00:57.946 ******* 2021-03-10T19:55:56.067 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:56 +0000 (0:00:00.021) 0:00:57.967 ******* 2021-03-10T19:55:56.140 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-03-10T19:55:56.141 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-03-10T19:55:56.165 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:56 +0000 (0:00:00.098) 0:00:58.066 ******* 2021-03-10T19:55:56.173 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-03-10T19:55:56.198 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:56 +0000 (0:00:00.032) 0:00:58.099 ******* 2021-03-10T19:55:56.237 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-03-10T19:55:56.238 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:56.262 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:56 +0000 (0:00:00.063) 0:00:58.163 ******* 2021-03-10T19:55:56.280 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:56.305 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:56 +0000 (0:00:00.042) 0:00:58.205 ******* 2021-03-10T19:55:56.343 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-03-10T19:55:56.345 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:55:56.370 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:56 +0000 (0:00:00.065) 0:00:58.271 ******* 2021-03-10T19:55:56.381 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:55:56.409 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:56 +0000 (0:00:00.038) 0:00:58.310 ******* 2021-03-10T19:55:56.457 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-03-10T19:55:56.459 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T19:55:56.469 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T19:55:56.480 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T19:55:56.482 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T19:55:56.506 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:56 +0000 (0:00:00.096) 0:00:58.406 ******* 2021-03-10T19:55:56.512 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T19:55:56.514 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-03-10T19:55:56.542 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:56 +0000 (0:00:00.035) 0:00:58.442 ******* 2021-03-10T19:55:56.579 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-03-10T19:55:56.581 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:56.604 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:56 +0000 (0:00:00.062) 0:00:58.504 ******* 2021-03-10T19:55:56.621 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:56.647 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:56 +0000 (0:00:00.043) 0:00:58.548 ******* 2021-03-10T19:55:57.078 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-03-10T19:55:57.079 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"cache_update_time": 1615406086, "cache_updated": false, "changed": false} 2021-03-10T19:55:57.102 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:57 +0000 (0:00:00.455) 0:00:59.003 ******* 2021-03-10T19:55:57.133 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1615406091, "cache_updated": false, "changed": false} 2021-03-10T19:55:57.161 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:57 +0000 (0:00:00.059) 0:00:59.062 ******* 2021-03-10T19:55:57.581 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-03-10T19:55:57.583 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-03-10T19:55:57.609 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:57 +0000 (0:00:00.448) 0:00:59.510 ******* 2021-03-10T19:55:57.654 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-03-10T19:55:57.691 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:57 +0000 (0:00:00.080) 0:00:59.591 ******* 2021-03-10T19:55:58.085 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-03-10T19:55:58.112 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:58 +0000 (0:00:00.421) 0:01:00.012 ******* 2021-03-10T19:55:58.163 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-03-10T19:55:58.188 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:58 +0000 (0:00:00.075) 0:01:00.088 ******* 2021-03-10T19:55:58.294 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-03-10T19:55:58.296 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-03-10T19:55:58.393 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-03-10T19:55:58.419 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:58 +0000 (0:00:00.230) 0:01:00.319 ******* 2021-03-10T19:55:58.429 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-03-10T19:55:58.506 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-03-10T19:55:58.508 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:58.530 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:58 +0000 (0:00:00.111) 0:01:00.430 ******* 2021-03-10T19:55:58.539 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [gibba023.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-03-10T19:55:58.568 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:58 +0000 (0:00:00.037) 0:01:00.468 ******* 2021-03-10T19:55:58.638 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-03-10T19:55:58.640 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:55:58.663 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:58 +0000 (0:00:00.095) 0:01:00.564 ******* 2021-03-10T19:55:58.681 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-03-10T19:55:58.682 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:58.710 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:58 +0000 (0:00:00.046) 0:01:00.611 ******* 2021-03-10T19:55:58.910 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-03-10T19:55:58.912 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:58.937 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:58 +0000 (0:00:00.226) 0:01:00.838 ******* 2021-03-10T19:55:58.959 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** skipping: [gibba023.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-03-10T19:55:58.987 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:58 +0000 (0:00:00.044) 0:01:00.882 ******* 2021-03-10T19:55:59.210 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-03-10T19:55:59.211 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:55:59.236 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:59 +0000 (0:00:00.254) 0:01:01.137 ******* 2021-03-10T19:55:59.398 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-03-10T19:55:59.434 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:59 +0000 (0:00:00.197) 0:01:01.334 ******* 2021-03-10T19:55:59.724 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-03-10T19:55:59.890 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:59 +0000 (0:00:00.456) 0:01:01.791 ******* 2021-03-10T19:55:59.899 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-03-10T19:55:59.901 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 19:54:14 UTC", "ActiveEnterTimestampMonotonic": "12728813", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket -.mount nss-lookup.target local-fs.target systemd-tmpfiles-setup.service var-run.mount network.target sysinit.target basic.target system.slice remote-fs.target time-sync.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 19:54:14 UTC", "AssertTimestampMonotonic": "12687287", "Before": "getty@tty1.service shutdown.target plymouth-quit.service xdm.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 19:54:14 UTC", "Con 2021-03-10T19:55:59.903 INFO:teuthology.task.ansible.out:ditionTimestampMonotonic": "12687287", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "965", "ExecMainStartTimestamp": "Wed 2021-03-10 19:54:14 UTC", "ExecMainStartTimestampMonotonic": "12728714", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", 2021-03-10T19:55:59.904 INFO:teuthology.task.ansible.out:"IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 19:54:14 UTC", "InactiveExitTimestampMonotonic": "12728813", "InvocationID": "0c7f2a73ae8a4a048aec4dffd7112321", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "965", "MemoryAccounting": "yes", "MemoryCurrent": "1339392", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "Me 2021-03-10T19:55:59.907 INFO:teuthology.task.ansible.out:moryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 19:54:14 UTC", "StateChangeTimestampMonotonic": "12728813", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "Sy 2021-03-10T19:55:59.909 INFO:teuthology.task.ansible.out:slogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38348", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T19:55:59.936 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:55:59 +0000 (0:00:00.045) 0:01:01.837 ******* 2021-03-10T19:56:00.018 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-03-10T19:56:00.019 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:00.042 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:00 +0000 (0:00:00.105) 0:01:01.942 ******* 2021-03-10T19:56:00.124 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-03-10T19:56:00.125 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 19:54:15 UTC", "ActiveEnterTimestampMonotonic": "14480029", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target local-fs.target basic.target var-run.mount system.slice systemd-journald.socket time-sync.target sysinit.target network.target systemd-tmpfiles-setup.service -.mount remote-fs.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 19:54:15 UTC", "AssertTimestampMonotonic": "14467079", "Before": "plymouth-quit.service getty@tty1.service shutdown.target multi-user.target xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 19:54:15 UTC", "Con 2021-03-10T19:56:00.127 INFO:teuthology.task.ansible.out:ditionTimestampMonotonic": "14467078", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1390", "ExecMainStartTimestamp": "Wed 2021-03-10 19:54:15 UTC", "ExecMainStartTimestampMonotonic": "14479918", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", 2021-03-10T19:56:00.129 INFO:teuthology.task.ansible.out: "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 19:54:15 UTC", "InactiveExitTimestampMonotonic": "14480029", "InvocationID": "2ed94d979475455ea4081bad2851b19c", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1390", "MemoryAccounting": "yes", "MemoryCurrent": "1359872", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", " 2021-03-10T19:56:00.131 INFO:teuthology.task.ansible.out:MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 19:54:15 UTC", "StateChangeTimestampMonotonic": "14480029", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", " 2021-03-10T19:56:00.133 INFO:teuthology.task.ansible.out:SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38348", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T19:56:00.150 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:00 +0000 (0:00:00.107) 0:01:02.050 ******* 2021-03-10T19:56:00.159 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:00.185 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:00 +0000 (0:00:00.035) 0:01:02.086 ******* 2021-03-10T19:56:00.233 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-03-10T19:56:00.235 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:00.261 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:00 +0000 (0:00:00.075) 0:01:02.161 ******* 2021-03-10T19:56:00.280 INFO:teuthology.task.ansible.out: 2021-03-10T19:56:00.282 INFO:teuthology.task.ansible.out:TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:00.312 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:00 +0000 (0:00:00.051) 0:01:02.213 ******* 2021-03-10T19:56:00.351 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-03-10T19:56:00.353 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:00.379 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:00 +0000 (0:00:00.066) 0:01:02.280 ******* 2021-03-10T19:56:00.395 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-03-10T19:56:00.397 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:00.427 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:00 +0000 (0:00:00.046) 0:01:02.327 ******* 2021-03-10T19:56:00.461 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:00.503 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:00 +0000 (0:00:00.076) 0:01:02.403 ******* 2021-03-10T19:56:00.532 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:00.557 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:00 +0000 (0:00:00.054) 0:01:02.457 ******* 2021-03-10T19:56:00.575 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-03-10T19:56:00.577 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:00.610 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:00 +0000 (0:00:00.051) 0:01:02.509 ******* 2021-03-10T19:56:00.640 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:00.666 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:00 +0000 (0:00:00.057) 0:01:02.567 ******* 2021-03-10T19:56:00.695 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-03-10T19:56:00.696 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:00.721 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:00 +0000 (0:00:00.054) 0:01:02.622 ******* 2021-03-10T19:56:00.750 INFO:teuthology.task.ansible.out: 2021-03-10T19:56:00.752 INFO:teuthology.task.ansible.out:TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:00.780 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:00 +0000 (0:00:00.058) 0:01:02.680 ******* 2021-03-10T19:56:00.797 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:00.823 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:00 +0000 (0:00:00.043) 0:01:02.723 ******* 2021-03-10T19:56:00.861 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-03-10T19:56:00.862 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:00.887 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:00 +0000 (0:00:00.063) 0:01:02.787 ******* 2021-03-10T19:56:00.904 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-03-10T19:56:00.906 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:00.933 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:00 +0000 (0:00:00.045) 0:01:02.833 ******* 2021-03-10T19:56:00.961 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-03-10T19:56:00.963 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:00.987 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:00 +0000 (0:00:00.053) 0:01:02.887 ******* 2021-03-10T19:56:01.036 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-03-10T19:56:01.037 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:01.063 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:01 +0000 (0:00:00.075) 0:01:02.963 ******* 2021-03-10T19:56:01.102 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:01.128 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:01 +0000 (0:00:00.065) 0:01:03.028 ******* 2021-03-10T19:56:01.157 INFO:teuthology.task.ansible.out: 2021-03-10T19:56:01.159 INFO:teuthology.task.ansible.out:TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:01.191 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:01 +0000 (0:00:00.063) 0:01:03.092 ******* 2021-03-10T19:56:01.242 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-03-10T19:56:01.243 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-03-10T19:56:01.268 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:01 +0000 (0:00:00.076) 0:01:03.168 ******* 2021-03-10T19:56:01.287 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-03-10T19:56:01.290 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:01.314 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:01 +0000 (0:00:00.045) 0:01:03.214 ******* 2021-03-10T19:56:01.361 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-03-10T19:56:01.363 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-03-10T19:56:01.399 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:01 +0000 (0:00:00.085) 0:01:03.300 ******* 2021-03-10T19:56:01.418 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-03-10T19:56:01.420 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-03-10T19:56:01.449 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:01 +0000 (0:00:00.049) 0:01:03.350 ******* 2021-03-10T19:56:01.502 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-03-10T19:56:01.505 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-03-10T19:56:01.533 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:01 +0000 (0:00:00.084) 0:01:03.434 ******* 2021-03-10T19:56:01.608 INFO:teuthology.task.ansible.out: 2021-03-10T19:56:01.608 INFO:teuthology.task.ansible.out:TASK [testnode : Including distro specific variables.] ************************* 2021-03-10T19:56:01.610 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-03-10T19:56:01.640 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:01 +0000 (0:00:00.106) 0:01:03.540 ******* 2021-03-10T19:56:01.690 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-03-10T19:56:01.692 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-03-10T19:56:01.726 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:01 +0000 (0:00:00.086) 0:01:03.627 ******* 2021-03-10T19:56:01.774 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-03-10T19:56:01.776 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-03-10T19:56:01.807 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:01 +0000 (0:00:00.078) 0:01:03.705 ******* 2021-03-10T19:56:01.835 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-03-10T19:56:01.860 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:01 +0000 (0:00:00.055) 0:01:03.761 ******* 2021-03-10T19:56:01.862 INFO:teuthology.task.ansible.out: 2021-03-10T19:56:01.931 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [gibba023.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-03-10T19:56:01.959 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:01 +0000 (0:00:00.098) 0:01:03.859 ******* 2021-03-10T19:56:01.961 INFO:teuthology.task.ansible.out: 2021-03-10T19:56:02.031 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-03-10T19:56:02.066 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:02 +0000 (0:00:00.106) 0:01:03.966 ******* 2021-03-10T19:56:02.084 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-03-10T19:56:02.118 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:02 +0000 (0:00:00.052) 0:01:04.018 ******* 2021-03-10T19:56:02.149 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-03-10T19:56:02.150 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:02.175 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:02 +0000 (0:00:00.056) 0:01:04.075 ******* 2021-03-10T19:56:02.256 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-03-10T19:56:02.258 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:02.280 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:02 +0000 (0:00:00.105) 0:01:04.181 ******* 2021-03-10T19:56:02.288 INFO:teuthology.task.ansible.out: 2021-03-10T19:56:02.289 INFO:teuthology.task.ansible.out:TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-03-10T19:56:02.291 INFO:teuthology.task.ansible.out: ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-03-10T19:56:02.319 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:02 +0000 (0:00:00.038) 0:01:04.219 ******* 2021-03-10T19:56:02.320 INFO:teuthology.task.ansible.out: 2021-03-10T19:56:02.422 INFO:teuthology.task.ansible.out: 2021-03-10T19:56:02.424 INFO:teuthology.task.ansible.out:TASK [testnode : Create the teuthology user.] ********************************** skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:02.451 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:02 +0000 (0:00:00.130) 0:01:04.350 ******* 2021-03-10T19:56:02.486 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-03-10T19:56:02.487 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-03-10T19:56:02.513 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:02 +0000 (0:00:00.064) 0:01:04.414 ******* 2021-03-10T19:56:02.574 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-03-10T19:56:02.575 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:02.600 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:02 +0000 (0:00:00.086) 0:01:04.500 ******* 2021-03-10T19:56:02.796 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-03-10T19:56:02.798 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-03-10T19:56:02.825 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:02 +0000 (0:00:00.225) 0:01:04.725 ******* 2021-03-10T19:56:02.964 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-03-10T19:56:02.966 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-03-10T19:56:02.994 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:02 +0000 (0:00:00.169) 0:01:04.895 ******* 2021-03-10T19:56:03.096 INFO:teuthology.task.ansible.out: 2021-03-10T19:56:03.098 INFO:teuthology.task.ansible.out:TASK [testnode : Set hostname var] ********************************************* ok: [gibba044.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba044"}, "changed": false} 2021-03-10T19:56:03.120 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:03 +0000 (0:00:00.126) 0:01:05.021 ******* 2021-03-10T19:56:03.262 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-03-10T19:56:03.286 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:03 +0000 (0:00:00.165) 0:01:05.187 ******* 2021-03-10T19:56:03.380 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-03-10T19:56:03.381 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba023"}, "changed": false} 2021-03-10T19:56:03.408 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:03 +0000 (0:00:00.122) 0:01:05.309 ******* 2021-03-10T19:56:03.863 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ ok: [gibba044.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "gibba044", "ansible_hostname": "gibba044", "ansible_nodename": "gibba044"}, "changed": false, "name": "gibba044"} 2021-03-10T19:56:03.888 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:03 +0000 (0:00:00.479) 0:01:05.789 ******* 2021-03-10T19:56:03.898 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "gibba023", "ansible_hostname": "gibba023", "ansible_nodename": "gibba023"}, "changed": false, "name": "gibba023"} 2021-03-10T19:56:03.927 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:03 +0000 (0:00:00.038) 0:01:05.828 ******* 2021-03-10T19:56:04.247 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-03-10T19:56:04.249 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-03-10T19:56:04.275 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:04 +0000 (0:00:00.347) 0:01:06.175 ******* 2021-03-10T19:56:04.284 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-03-10T19:56:04.316 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:04 +0000 (0:00:00.041) 0:01:06.217 ******* 2021-03-10T19:56:04.611 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-03-10T19:56:04.613 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-03-10T19:56:04.637 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:04 +0000 (0:00:00.320) 0:01:06.537 ******* 2021-03-10T19:56:04.711 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-03-10T19:56:04.735 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:04 +0000 (0:00:00.098) 0:01:06.635 ******* 2021-03-10T19:56:05.074 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-03-10T19:56:05.076 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-03-10T19:56:05.102 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:05 +0000 (0:00:00.367) 0:01:07.003 ******* 2021-03-10T19:56:05.153 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-03-10T19:56:05.184 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:05 +0000 (0:00:00.081) 0:01:07.084 ******* 2021-03-10T19:56:05.192 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-03-10T19:56:05.193 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:05.219 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:05 +0000 (0:00:00.035) 0:01:07.120 ******* 2021-03-10T19:56:05.258 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:05.284 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:05 +0000 (0:00:00.064) 0:01:07.185 ******* 2021-03-10T19:56:05.301 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-10T19:56:05.303 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:05.328 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:05 +0000 (0:00:00.043) 0:01:07.228 ******* 2021-03-10T19:56:05.355 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:05.381 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:05 +0000 (0:00:00.053) 0:01:07.282 ******* 2021-03-10T19:56:05.402 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-03-10T19:56:05.404 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:05.431 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:05 +0000 (0:00:00.049) 0:01:07.331 ******* 2021-03-10T19:56:05.460 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:05.487 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:05 +0000 (0:00:00.055) 0:01:07.387 ******* 2021-03-10T19:56:05.504 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-03-10T19:56:05.505 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:05.532 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:05 +0000 (0:00:00.045) 0:01:07.432 ******* 2021-03-10T19:56:05.572 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:05.601 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:05 +0000 (0:00:00.069) 0:01:07.502 ******* 2021-03-10T19:56:05.628 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-03-10T19:56:05.630 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:05.654 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:05 +0000 (0:00:00.052) 0:01:07.555 ******* 2021-03-10T19:56:05.684 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:05.716 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:05 +0000 (0:00:00.059) 0:01:07.614 ******* 2021-03-10T19:56:05.868 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-03-10T19:56:05.870 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:05.893 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:05 +0000 (0:00:00.178) 0:01:07.793 ******* 2021-03-10T19:56:05.913 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:05.947 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:05 +0000 (0:00:00.054) 0:01:07.847 ******* 2021-03-10T19:56:06.011 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-03-10T19:56:06.012 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:06.038 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:06 +0000 (0:00:00.090) 0:01:07.938 ******* 2021-03-10T19:56:06.044 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:06.072 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:06 +0000 (0:00:00.034) 0:01:07.972 ******* 2021-03-10T19:56:06.115 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-03-10T19:56:06.117 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:06.142 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:06 +0000 (0:00:00.070) 0:01:08.043 ******* 2021-03-10T19:56:06.161 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:06.188 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:06 +0000 (0:00:00.046) 0:01:08.089 ******* 2021-03-10T19:56:06.216 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-03-10T19:56:06.245 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:06 +0000 (0:00:00.056) 0:01:08.146 ******* 2021-03-10T19:56:06.302 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:06 +0000 (0:00:00.054) 0:01:08.200 ******* 2021-03-10T19:56:06.350 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-03-10T19:56:06.380 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:06 +0000 (0:00:00.080) 0:01:08.281 ******* 2021-03-10T19:56:06.416 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:06 +0000 (0:00:00.035) 0:01:08.317 ******* 2021-03-10T19:56:06.476 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-03-10T19:56:06.522 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:06 +0000 (0:00:00.106) 0:01:08.423 ******* 2021-03-10T19:56:06.568 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:06 +0000 (0:00:00.045) 0:01:08.469 ******* 2021-03-10T19:56:06.611 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:06.637 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:06 +0000 (0:00:00.069) 0:01:08.538 ******* 2021-03-10T19:56:06.656 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:06.686 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:06 +0000 (0:00:00.048) 0:01:08.587 ******* 2021-03-10T19:56:06.742 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [gibba023.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-03-10T19:56:06.771 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:06 +0000 (0:00:00.084) 0:01:08.671 ******* 2021-03-10T19:56:06.788 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-03-10T19:56:06.799 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-03-10T19:56:06.829 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:06 +0000 (0:00:00.057) 0:01:08.729 ******* 2021-03-10T19:56:06.856 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-03-10T19:56:06.858 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:06.893 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:06 +0000 (0:00:00.064) 0:01:08.794 ******* 2021-03-10T19:56:06.922 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:06.948 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:06 +0000 (0:00:00.054) 0:01:08.848 ******* 2021-03-10T19:56:06.967 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T19:56:06.969 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:06.998 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:06 +0000 (0:00:00.049) 0:01:08.898 ******* 2021-03-10T19:56:07.026 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:07.050 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:07 +0000 (0:00:00.052) 0:01:08.951 ******* 2021-03-10T19:56:07.081 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-03-10T19:56:07.083 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:07.109 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:07 +0000 (0:00:00.058) 0:01:09.010 ******* 2021-03-10T19:56:07.138 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:07.165 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:07 +0000 (0:00:00.054) 0:01:09.065 ******* 2021-03-10T19:56:07.191 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-03-10T19:56:07.194 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:07.219 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:07 +0000 (0:00:00.055) 0:01:09.120 ******* 2021-03-10T19:56:07.238 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:07.265 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:07 +0000 (0:00:00.045) 0:01:09.165 ******* 2021-03-10T19:56:07.303 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-03-10T19:56:07.305 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:07.328 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:07 +0000 (0:00:00.063) 0:01:09.229 ******* 2021-03-10T19:56:07.348 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:07.378 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:07 +0000 (0:00:00.049) 0:01:09.279 ******* 2021-03-10T19:56:07.417 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-03-10T19:56:07.418 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:07.446 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:07 +0000 (0:00:00.067) 0:01:09.347 ******* 2021-03-10T19:56:07.466 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:07.492 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:07 +0000 (0:00:00.046) 0:01:09.393 ******* 2021-03-10T19:56:07.531 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-03-10T19:56:07.533 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:07.560 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:07 +0000 (0:00:00.065) 0:01:09.459 ******* 2021-03-10T19:56:07.578 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:07.604 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:07 +0000 (0:00:00.046) 0:01:09.505 ******* 2021-03-10T19:56:07.653 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-03-10T19:56:07.655 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:07.679 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:07 +0000 (0:00:00.074) 0:01:09.580 ******* 2021-03-10T19:56:07.699 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:07.730 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:07 +0000 (0:00:00.050) 0:01:09.630 ******* 2021-03-10T19:56:07.773 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:07.798 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:07 +0000 (0:00:00.068) 0:01:09.699 ******* 2021-03-10T19:56:07.868 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:07.896 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:07 +0000 (0:00:00.097) 0:01:09.796 ******* 2021-03-10T19:56:07.913 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-03-10T19:56:07.915 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:07.943 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:07 +0000 (0:00:00.046) 0:01:09.843 ******* 2021-03-10T19:56:08.004 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:08.030 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:08 +0000 (0:00:00.086) 0:01:09.930 ******* 2021-03-10T19:56:08.079 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-03-10T19:56:08.081 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:08.115 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:08 +0000 (0:00:00.084) 0:01:10.015 ******* 2021-03-10T19:56:08.156 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:08.189 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:08 +0000 (0:00:00.075) 0:01:10.090 ******* 2021-03-10T19:56:08.230 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-10T19:56:08.232 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:08.272 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:08 +0000 (0:00:00.074) 0:01:10.164 ******* 2021-03-10T19:56:08.301 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:08.327 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:08 +0000 (0:00:00.063) 0:01:10.228 ******* 2021-03-10T19:56:08.355 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-03-10T19:56:08.357 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:08.381 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:08 +0000 (0:00:00.053) 0:01:10.281 ******* 2021-03-10T19:56:08.409 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:08.436 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:08 +0000 (0:00:00.055) 0:01:10.337 ******* 2021-03-10T19:56:08.507 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-03-10T19:56:08.509 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:08.540 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:08 +0000 (0:00:00.102) 0:01:10.439 ******* 2021-03-10T19:56:08.546 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:08.573 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:08 +0000 (0:00:00.034) 0:01:10.474 ******* 2021-03-10T19:56:08.612 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:08.639 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:08 +0000 (0:00:00.065) 0:01:10.539 ******* 2021-03-10T19:56:08.669 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:08.696 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:08 +0000 (0:00:00.056) 0:01:10.596 ******* 2021-03-10T19:56:08.771 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-03-10T19:56:08.775 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:08.798 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:08 +0000 (0:00:00.102) 0:01:10.699 ******* 2021-03-10T19:56:08.817 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:08.818 INFO:teuthology.task.ansible.out: 2021-03-10T19:56:08.843 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:08 +0000 (0:00:00.044) 0:01:10.744 ******* 2021-03-10T19:56:08.909 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-03-10T19:56:08.914 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:08.939 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:08 +0000 (0:00:00.095) 0:01:10.840 ******* 2021-03-10T19:56:08.983 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:09.019 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:09 +0000 (0:00:00.080) 0:01:10.920 ******* 2021-03-10T19:56:09.042 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-03-10T19:56:09.044 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:09.077 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:09 +0000 (0:00:00.056) 0:01:10.976 ******* 2021-03-10T19:56:09.152 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:09.186 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:09 +0000 (0:00:00.110) 0:01:11.086 ******* 2021-03-10T19:56:09.203 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-03-10T19:56:09.204 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:09.253 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:09 +0000 (0:00:00.066) 0:01:11.153 ******* 2021-03-10T19:56:09.286 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:09.313 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:09 +0000 (0:00:00.060) 0:01:11.214 ******* 2021-03-10T19:56:09.363 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-03-10T19:56:09.364 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:09.388 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:09 +0000 (0:00:00.074) 0:01:11.289 ******* 2021-03-10T19:56:09.411 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:09.438 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:09 +0000 (0:00:00.050) 0:01:11.339 ******* 2021-03-10T19:56:09.561 INFO:teuthology.task.ansible.out: 2021-03-10T19:56:09.563 INFO:teuthology.task.ansible.out:TASK [testnode : Check for custom repos] *************************************** ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.001350", "end": "2021-03-10 19:56:09.391179", "rc": 0, "start": "2021-03-10 19:56:09.389829", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:56:09.590 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:09 +0000 (0:00:00.151) 0:01:11.491 ******* 2021-03-10T19:56:09.609 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.001342", "end": "2021-03-10 19:56:09.946466", "rc": 0, "start": "2021-03-10 19:56:09.945124", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:56:09.640 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:09 +0000 (0:00:00.049) 0:01:11.540 ******* 2021-03-10T19:56:09.681 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-03-10T19:56:09.707 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:09 +0000 (0:00:00.066) 0:01:11.607 ******* 2021-03-10T19:56:09.752 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:09 +0000 (0:00:00.045) 0:01:11.653 ******* 2021-03-10T19:56:10.013 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-03-10T19:56:10.014 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-03-10T19:56:10.047 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:10 +0000 (0:00:00.294) 0:01:11.947 ******* 2021-03-10T19:56:10.070 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-03-10T19:56:10.099 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:10 +0000 (0:00:00.052) 0:01:11.999 ******* 2021-03-10T19:56:10.139 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-03-10T19:56:10.140 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:10.164 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:10 +0000 (0:00:00.065) 0:01:12.064 ******* 2021-03-10T19:56:10.203 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:10.229 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:10 +0000 (0:00:00.065) 0:01:12.130 ******* 2021-03-10T19:56:11.088 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-03-10T19:56:11.090 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-03-10T19:56:11.142 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-03-10T19:56:11.144 INFO:teuthology.task.ansible.out: 2021-03-10T19:56:11.835 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-03-10T19:56:11.863 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:11 +0000 (0:00:01.633) 0:01:13.763 ******* 2021-03-10T19:56:11.880 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-03-10T19:56:11.908 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:11 +0000 (0:00:00.044) 0:01:13.808 ******* 2021-03-10T19:56:12.368 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-03-10T19:56:12.370 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1615406091, "cache_updated": false, "changed": false} 2021-03-10T19:56:12.392 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:12 +0000 (0:00:00.484) 0:01:14.292 ******* 2021-03-10T19:56:12.399 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"cache_update_time": 1615406086, "cache_updated": false, "changed": false} 2021-03-10T19:56:12.429 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:12 +0000 (0:00:00.037) 0:01:14.330 ******* 2021-03-10T19:56:12.468 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-03-10T19:56:12.494 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:12 +0000 (0:00:00.064) 0:01:14.394 ******* 2021-03-10T19:56:12.536 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:12 +0000 (0:00:00.042) 0:01:14.436 ******* 2021-03-10T19:56:12.680 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-03-10T19:56:12.681 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.010877", "end": "2021-03-10 19:56:13.019067", "rc": 0, "start": "2021-03-10 19:56:13.008190", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:56:12.704 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:12 +0000 (0:00:00.168) 0:01:14.605 ******* 2021-03-10T19:56:12.712 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.009970", "end": "2021-03-10 19:56:12.527181", "rc": 0, "start": "2021-03-10 19:56:12.517211", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:56:12.746 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:12 +0000 (0:00:00.041) 0:01:14.646 ******* 2021-03-10T19:56:14.178 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-03-10T19:56:14.180 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1615406091, "cache_updated": false, "changed": false} 2021-03-10T19:56:14.212 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:14 +0000 (0:00:01.466) 0:01:16.113 ******* 2021-03-10T19:56:14.221 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"cache_update_time": 1615406086, "cache_updated": false, "changed": false} 2021-03-10T19:56:14.256 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:14 +0000 (0:00:00.043) 0:01:16.156 ******* 2021-03-10T19:56:23.358 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-03-10T19:56:23.360 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 12 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101691 files and directories currently installed.)\r\n 2021-03-10T19:56:23.362 INFO:teuthology.task.ansible.out:Removing qemu-utils (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nRemoving librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 12 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Readi 2021-03-10T19:56:23.363 INFO:teuthology.task.ansible.out:ng database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101691 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.14) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Removing librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-03-10T19:56:23.384 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:23 +0000 (0:00:09.127) 0:01:25.284 ******* 2021-03-10T19:56:23.856 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-10T19:56:23.858 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"cache_update_time": 1615406086, "cache_updated": false, "changed": false} 2021-03-10T19:56:23.887 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:23 +0000 (0:00:00.503) 0:01:25.788 ******* 2021-03-10T19:56:23.953 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-03-10T19:56:23.955 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 12 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101691 files and directories currently installed.)\r\n 2021-03-10T19:56:23.958 INFO:teuthology.task.ansible.out:Removing qemu-utils (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nRemoving librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 12 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Readi 2021-03-10T19:56:23.959 INFO:teuthology.task.ansible.out:ng database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101691 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.14) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Removing librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-03-10T19:56:23.981 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:23 +0000 (0:00:00.093) 0:01:25.881 ******* 2021-03-10T19:56:23.989 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-03-10T19:56:23.990 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:24.019 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:24 +0000 (0:00:00.039) 0:01:25.920 ******* 2021-03-10T19:56:24.449 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-10T19:56:24.451 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1615406091, "cache_updated": false, "changed": false} 2021-03-10T19:56:24.474 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:24 +0000 (0:00:00.454) 0:01:26.375 ******* 2021-03-10T19:56:24.564 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-03-10T19:56:24.566 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:24.589 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:24 +0000 (0:00:00.114) 0:01:26.489 ******* 2021-03-10T19:56:34.294 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-10T19:56:34.296 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1615406091, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git\n1 upgraded, 6 newly installed, 0 to remove and 11 not upgraded.\nNeed to get 18.2 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.8-0ubuntu0.20.04.1 [3209 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.8-0ubuntu0.20.04.1 [1615 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.14 [53.1 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.14 [1055 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.14 [6726 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.14 [975 kB]\nFetched 18.2 MB in 1s (14.6 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading databa 2021-03-10T19:56:34.297 INFO:teuthology.task.ansible.out:se ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101619 files and directories currently installed.)\r\nPreparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...\r\nUnpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...\r\nSelecting previously unselected package librados2.\r\nPreparing to unpack .../1-librados2_15.2.8-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../2-librbd1_15.2.8-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../5-qemu-system-x86_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../6-qemu-utils_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.14) ...\r\nSetting up librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nSetting up git (1:2.25.1-1ubuntu3.1) ...\r\nSetting up librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) 2021-03-10T19:56:34.299 INFO:teuthology.task.ansible.out: ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.14) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git", "1 upgraded, 6 newly installed, 0 to remove and 11 not upgraded.", "Need to get 18.2 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.8-0ubuntu0.20.04.1 [3209 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.8-0ubuntu0.20.04.1 [1615 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.14 [53.1 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.14 [1055 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.14 [6726 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.14 [975 kB]", "Fetched 18.2 MB in 1s (14.6 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", 2021-03-10T19:56:34.301 INFO:teuthology.task.ansible.out: "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101619 files and directories currently installed.)", "Preparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...", "Unpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...", "Selecting previously unselected package librados2.", "Preparing to unpack .../1-librados2_15.2.8-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../2-librbd1_15.2.8-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../5-qemu-system-x86_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../6-qemu-utils_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.14) ...", "Setting up librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Setting up git (1:2.25.1-1ubuntu3.1) ...", "Setting up librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Se 2021-03-10T19:56:34.303 INFO:teuthology.task.ansible.out:tting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.14) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.14) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-03-10T19:56:34.330 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:34 +0000 (0:00:09.741) 0:01:36.231 ******* 2021-03-10T19:56:34.814 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-03-10T19:56:34.815 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1615406091, "cache_updated": false, "changed": false} 2021-03-10T19:56:34.838 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:34 +0000 (0:00:00.507) 0:01:36.738 ******* 2021-03-10T19:56:35.280 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-03-10T19:56:35.281 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1615406091, "cache_updated": false, "changed": false} 2021-03-10T19:56:35.309 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:35 +0000 (0:00:00.471) 0:01:37.210 ******* 2021-03-10T19:56:35.481 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-03-10T19:56:35.483 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-03-10T19:56:35.510 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:35 +0000 (0:00:00.199) 0:01:37.410 ******* 2021-03-10T19:56:35.589 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-03-10T19:56:35.591 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:35.613 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:35 +0000 (0:00:00.103) 0:01:37.513 ******* 2021-03-10T19:56:35.778 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-03-10T19:56:35.780 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-03-10T19:56:35.801 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:35 +0000 (0:00:00.188) 0:01:37.701 ******* 2021-03-10T19:56:36.128 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-03-10T19:56:36.129 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-03-10T19:56:36.153 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:36 +0000 (0:00:00.352) 0:01:38.054 ******* 2021-03-10T19:56:36.185 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-10T19:56:36.186 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => {"cache_update_time": 1615406086, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git\n1 upgraded, 6 newly installed, 0 to remove and 11 not upgraded.\nNeed to get 18.2 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.8-0ubuntu0.20.04.1 [3209 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.8-0ubuntu0.20.04.1 [1615 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.14 [53.1 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.14 [1055 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.14 [6726 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.14 [975 kB]\nFetched 18.2 MB in 4s (4759 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading databa 2021-03-10T19:56:36.188 INFO:teuthology.task.ansible.out:se ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101619 files and directories currently installed.)\r\nPreparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...\r\nUnpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...\r\nSelecting previously unselected package librados2.\r\nPreparing to unpack .../1-librados2_15.2.8-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../2-librbd1_15.2.8-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../5-qemu-system-x86_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../6-qemu-utils_1%3a4.2-3ubuntu6.14_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.14) ...\r\nSetting up librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nSetting up git (1:2.25.1-1ubuntu3.1) ...\r\nSetting up librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) 2021-03-10T19:56:36.189 INFO:teuthology.task.ansible.out: ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.14) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git", "1 upgraded, 6 newly installed, 0 to remove and 11 not upgraded.", "Need to get 18.2 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.8-0ubuntu0.20.04.1 [3209 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.8-0ubuntu0.20.04.1 [1615 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.14 [53.1 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.14 [1055 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.14 [6726 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.14 [975 kB]", "Fetched 18.2 MB in 4s (4759 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", 2021-03-10T19:56:36.191 INFO:teuthology.task.ansible.out: "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101619 files and directories currently installed.)", "Preparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...", "Unpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...", "Selecting previously unselected package librados2.", "Preparing to unpack .../1-librados2_15.2.8-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../2-librbd1_15.2.8-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../5-qemu-system-x86_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../6-qemu-utils_1%3a4.2-3ubuntu6.14_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.14) ...", "Setting up librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Setting up git (1:2.25.1-1ubuntu3.1) ...", "Setting up librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Se 2021-03-10T19:56:36.192 INFO:teuthology.task.ansible.out:tting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.14) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.14) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-03-10T19:56:36.213 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:36 +0000 (0:00:00.059) 0:01:38.114 ******* 2021-03-10T19:56:36.347 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-03-10T19:56:36.349 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-03-10T19:56:36.372 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:36 +0000 (0:00:00.159) 0:01:38.273 ******* 2021-03-10T19:56:36.536 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-03-10T19:56:36.538 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T19:56:36.563 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:36 +0000 (0:00:00.190) 0:01:38.463 ******* 2021-03-10T19:56:36.675 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-03-10T19:56:36.677 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"cache_update_time": 1615406086, "cache_updated": false, "changed": false} 2021-03-10T19:56:36.700 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:36 +0000 (0:00:00.137) 0:01:38.601 ******* 2021-03-10T19:56:36.842 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-03-10T19:56:36.843 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 19:54:15 UTC", "ActiveEnterTimestampMonotonic": "14325944", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target system.slice systemd-journald.socket systemd-tmpfiles-setup.service remote-fs.target network.target basic.target nss-lookup.target -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 19:54:14 UTC", "AssertTimestampMonotonic": "12611211", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 19:54:14 UTC", "ConditionTimestampMonotonic": "12611211", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": 2021-03-10T19:56:36.845 INFO:teuthology.task.ansible.out: "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1428", "ExecMainStartTimestamp": "Wed 2021-03-10 19:54:15 UTC", "ExecMainStartTimestampMonotonic": "14325862", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709 2021-03-10T19:56:36.847 INFO:teuthology.task.ansible.out:551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 19:54:14 UTC", "InactiveExitTimestampMonotonic": "12611786", "InvocationID": "0c31b23bae5b4f7893beff6c33e25e41", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1428", "MemoryAccounting": "yes", "MemoryCurrent": "10719232", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPoli 2021-03-10T19:56:36.848 INFO:teuthology.task.ansible.out:cy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 19:54:15 UTC", "StateChangeTimestampMonotonic": "14325944", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38348", "TimeoutAbortUSec": 2021-03-10T19:56:36.850 INFO:teuthology.task.ansible.out: "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T19:56:36.870 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:36 +0000 (0:00:00.169) 0:01:38.770 ******* 2021-03-10T19:56:36.950 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-10T19:56:36.952 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:36.977 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:36 +0000 (0:00:00.107) 0:01:38.877 ******* 2021-03-10T19:56:37.057 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-03-10T19:56:37.058 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:37.080 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:37 +0000 (0:00:00.102) 0:01:38.980 ******* 2021-03-10T19:56:37.151 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-03-10T19:56:37.153 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:37.175 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:37 +0000 (0:00:00.095) 0:01:39.076 ******* 2021-03-10T19:56:37.182 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-03-10T19:56:37.184 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"cache_update_time": 1615406086, "cache_updated": false, "changed": false} 2021-03-10T19:56:37.208 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:37 +0000 (0:00:00.032) 0:01:39.109 ******* 2021-03-10T19:56:37.246 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-03-10T19:56:37.248 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:37.272 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:37 +0000 (0:00:00.063) 0:01:39.172 ******* 2021-03-10T19:56:37.340 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-03-10T19:56:37.342 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:37.364 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:37 +0000 (0:00:00.092) 0:01:39.264 ******* 2021-03-10T19:56:37.369 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-03-10T19:56:37.371 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-03-10T19:56:37.395 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:37 +0000 (0:00:00.031) 0:01:39.296 ******* 2021-03-10T19:56:37.434 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:37.458 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:37 +0000 (0:00:00.062) 0:01:39.358 ******* 2021-03-10T19:56:37.485 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-03-10T19:56:37.488 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:37.516 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:37 +0000 (0:00:00.058) 0:01:39.417 ******* 2021-03-10T19:56:37.536 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-03-10T19:56:37.537 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:37.564 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:37 +0000 (0:00:00.047) 0:01:39.465 ******* 2021-03-10T19:56:37.634 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-03-10T19:56:37.636 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:37.658 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:37 +0000 (0:00:00.093) 0:01:39.559 ******* 2021-03-10T19:56:37.716 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-03-10T19:56:37.718 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-03-10T19:56:37.741 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:37 +0000 (0:00:00.083) 0:01:39.642 ******* 2021-03-10T19:56:37.748 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T19:56:37.751 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:37.775 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:37 +0000 (0:00:00.033) 0:01:39.675 ******* 2021-03-10T19:56:37.856 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-03-10T19:56:37.858 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:37.884 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:37 +0000 (0:00:00.109) 0:01:39.785 ******* 2021-03-10T19:56:37.956 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-10T19:56:37.957 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:37.984 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:37 +0000 (0:00:00.099) 0:01:39.885 ******* 2021-03-10T19:56:37.986 INFO:teuthology.task.ansible.out: 2021-03-10T19:56:38.069 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-03-10T19:56:38.071 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:38.093 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:38 +0000 (0:00:00.108) 0:01:39.994 ******* 2021-03-10T19:56:38.114 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:38 +0000 (0:00:00.020) 0:01:40.015 ******* 2021-03-10T19:56:38.194 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:38.217 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:38 +0000 (0:00:00.102) 0:01:40.117 ******* 2021-03-10T19:56:38.277 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-03-10T19:56:38.278 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-03-10T19:56:38.301 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:38 +0000 (0:00:00.084) 0:01:40.202 ******* 2021-03-10T19:56:38.311 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-10T19:56:38.313 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:38.338 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:38 +0000 (0:00:00.036) 0:01:40.239 ******* 2021-03-10T19:56:38.408 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-10T19:56:38.409 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:38.436 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:38 +0000 (0:00:00.098) 0:01:40.337 ******* 2021-03-10T19:56:38.455 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-03-10T19:56:38.457 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T19:56:38.484 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:38 +0000 (0:00:00.047) 0:01:40.385 ******* 2021-03-10T19:56:38.503 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T19:56:38.505 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:38.529 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:38 +0000 (0:00:00.044) 0:01:40.429 ******* 2021-03-10T19:56:38.599 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-10T19:56:38.601 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:38.623 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:38 +0000 (0:00:00.094) 0:01:40.523 ******* 2021-03-10T19:56:38.692 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-10T19:56:38.694 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:38.717 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:38 +0000 (0:00:00.094) 0:01:40.618 ******* 2021-03-10T19:56:38.725 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-03-10T19:56:38.727 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 19:54:16 UTC", "ActiveEnterTimestampMonotonic": "15508174", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "remote-fs.target network.target sysinit.target systemd-journald.socket system.slice basic.target nss-lookup.target systemd-tmpfiles-setup.service -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 19:54:15 UTC", "AssertTimestampMonotonic": "14386804", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 19:54:15 UTC", "ConditionTimestampMonotonic": "14386804", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": 2021-03-10T19:56:38.728 INFO:teuthology.task.ansible.out: "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1536", "ExecMainStartTimestamp": "Wed 2021-03-10 19:54:16 UTC", "ExecMainStartTimestampMonotonic": "15508162", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709 2021-03-10T19:56:38.730 INFO:teuthology.task.ansible.out:551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 19:54:15 UTC", "InactiveExitTimestampMonotonic": "14387453", "InvocationID": "923d8100186144cab032bf11a9cd2de6", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1536", "MemoryAccounting": "yes", "MemoryCurrent": "10682368", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPoli 2021-03-10T19:56:38.731 INFO:teuthology.task.ansible.out:cy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 19:54:16 UTC", "StateChangeTimestampMonotonic": "15508174", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38348", "TimeoutAbortUSec": 2021-03-10T19:56:38.733 INFO:teuthology.task.ansible.out: "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T19:56:38.756 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:38 +0000 (0:00:00.038) 0:01:40.657 ******* 2021-03-10T19:56:38.784 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-10T19:56:38.786 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:38.810 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:38 +0000 (0:00:00.054) 0:01:40.711 ******* 2021-03-10T19:56:38.828 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-03-10T19:56:38.830 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:38.854 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:38 +0000 (0:00:00.043) 0:01:40.755 ******* 2021-03-10T19:56:38.882 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-10T19:56:38.884 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:38.907 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:38 +0000 (0:00:00.053) 0:01:40.808 ******* 2021-03-10T19:56:38.924 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-03-10T19:56:38.927 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:38.951 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:38 +0000 (0:00:00.043) 0:01:40.852 ******* 2021-03-10T19:56:38.978 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-10T19:56:38.980 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:39.005 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:39 +0000 (0:00:00.053) 0:01:40.906 ******* 2021-03-10T19:56:39.036 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-03-10T19:56:39.038 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:39.067 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:39 +0000 (0:00:00.061) 0:01:40.967 ******* 2021-03-10T19:56:39.086 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T19:56:39.088 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:39.113 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:39 +0000 (0:00:00.046) 0:01:41.014 ******* 2021-03-10T19:56:39.131 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:39.157 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:39 +0000 (0:00:00.043) 0:01:41.058 ******* 2021-03-10T19:56:39.160 INFO:teuthology.task.ansible.out: 2021-03-10T19:56:39.178 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:39.202 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:39 +0000 (0:00:00.044) 0:01:41.103 ******* 2021-03-10T19:56:39.230 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-03-10T19:56:39.232 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:39.257 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:39 +0000 (0:00:00.054) 0:01:41.157 ******* 2021-03-10T19:56:39.274 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-10T19:56:39.276 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:39.302 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:39 +0000 (0:00:00.044) 0:01:41.202 ******* 2021-03-10T19:56:39.330 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-03-10T19:56:39.332 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:39.356 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:39 +0000 (0:00:00.054) 0:01:41.257 ******* 2021-03-10T19:56:39.386 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T19:56:39.388 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:39.413 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:39 +0000 (0:00:00.056) 0:01:41.314 ******* 2021-03-10T19:56:39.431 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-03-10T19:56:39.433 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:39.458 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:39 +0000 (0:00:00.044) 0:01:41.358 ******* 2021-03-10T19:56:39.487 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-03-10T19:56:39.489 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:39.513 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:39 +0000 (0:00:00.055) 0:01:41.414 ******* 2021-03-10T19:56:39.530 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-03-10T19:56:39.532 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:39.555 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:39 +0000 (0:00:00.042) 0:01:41.456 ******* 2021-03-10T19:56:39.625 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T19:56:39.627 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:39.652 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:39 +0000 (0:00:00.096) 0:01:41.553 ******* 2021-03-10T19:56:39.670 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-03-10T19:56:39.671 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-03-10T19:56:39.699 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:39 +0000 (0:00:00.046) 0:01:41.599 ******* 2021-03-10T19:56:39.727 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-03-10T19:56:39.728 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:39.752 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:39 +0000 (0:00:00.052) 0:01:41.652 ******* 2021-03-10T19:56:39.823 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-03-10T19:56:39.824 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:39.848 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:39 +0000 (0:00:00.096) 0:01:41.748 ******* 2021-03-10T19:56:39.850 INFO:teuthology.task.ansible.out: 2021-03-10T19:56:39.918 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-03-10T19:56:39.920 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:39.942 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:39 +0000 (0:00:00.094) 0:01:41.843 ******* 2021-03-10T19:56:39.981 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-10T19:56:39.983 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-03-10T19:56:40.009 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:40 +0000 (0:00:00.066) 0:01:41.909 ******* 2021-03-10T19:56:40.026 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-03-10T19:56:40.028 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:40.055 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:40 +0000 (0:00:00.046) 0:01:41.956 ******* 2021-03-10T19:56:40.096 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-10T19:56:40.098 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:40.123 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:40 +0000 (0:00:00.068) 0:01:42.024 ******* 2021-03-10T19:56:40.141 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-10T19:56:40.143 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:40.169 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:40 +0000 (0:00:00.045) 0:01:42.070 ******* 2021-03-10T19:56:40.262 INFO:teuthology.task.ansible.out: 2021-03-10T19:56:40.264 INFO:teuthology.task.ansible.out:TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:40.286 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:40 +0000 (0:00:00.116) 0:01:42.187 ******* 2021-03-10T19:56:40.368 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:40.383 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:40 +0000 (0:00:00.097) 0:01:42.284 ******* 2021-03-10T19:56:40.464 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:40.488 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:40 +0000 (0:00:00.104) 0:01:42.389 ******* 2021-03-10T19:56:40.496 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-03-10T19:56:40.498 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-03-10T19:56:40.529 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:40 +0000 (0:00:00.040) 0:01:42.429 ******* 2021-03-10T19:56:40.579 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-10T19:56:40.580 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:40.609 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:40 +0000 (0:00:00.080) 0:01:42.510 ******* 2021-03-10T19:56:40.682 INFO:teuthology.task.ansible.out: 2021-03-10T19:56:40.683 INFO:teuthology.task.ansible.out:TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:40.707 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:40 +0000 (0:00:00.097) 0:01:42.608 ******* 2021-03-10T19:56:40.790 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-10T19:56:40.792 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:40.816 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:40 +0000 (0:00:00.108) 0:01:42.716 ******* 2021-03-10T19:56:40.844 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-03-10T19:56:40.845 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-03-10T19:56:40.870 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:40 +0000 (0:00:00.054) 0:01:42.771 ******* 2021-03-10T19:56:40.888 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-10T19:56:40.890 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:40.920 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:40 +0000 (0:00:00.049) 0:01:42.820 ******* 2021-03-10T19:56:41.028 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T19:56:41.030 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:41.052 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:41 +0000 (0:00:00.132) 0:01:42.953 ******* 2021-03-10T19:56:41.138 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-03-10T19:56:41.139 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:41.162 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:41 +0000 (0:00:00.110) 0:01:43.063 ******* 2021-03-10T19:56:41.259 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-03-10T19:56:41.287 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:41 +0000 (0:00:00.124) 0:01:43.187 ******* 2021-03-10T19:56:41.294 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-03-10T19:56:41.295 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:41.325 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:41 +0000 (0:00:00.037) 0:01:43.225 ******* 2021-03-10T19:56:41.405 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-03-10T19:56:41.407 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:41.429 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:41 +0000 (0:00:00.104) 0:01:43.329 ******* 2021-03-10T19:56:41.446 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-03-10T19:56:41.448 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T19:56:41.474 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:41 +0000 (0:00:00.045) 0:01:43.375 ******* 2021-03-10T19:56:41.503 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-03-10T19:56:41.504 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:41.528 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:41 +0000 (0:00:00.053) 0:01:43.429 ******* 2021-03-10T19:56:41.556 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-03-10T19:56:41.558 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:41.590 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:41 +0000 (0:00:00.061) 0:01:43.490 ******* 2021-03-10T19:56:41.662 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-03-10T19:56:41.664 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:41.688 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:41 +0000 (0:00:00.098) 0:01:43.589 ******* 2021-03-10T19:56:41.695 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-03-10T19:56:41.697 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-03-10T19:56:41.726 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:41 +0000 (0:00:00.037) 0:01:43.626 ******* 2021-03-10T19:56:41.754 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-03-10T19:56:41.756 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:41.784 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:41 +0000 (0:00:00.057) 0:01:43.684 ******* 2021-03-10T19:56:41.864 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-03-10T19:56:41.866 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:41.888 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:41 +0000 (0:00:00.104) 0:01:43.788 ******* 2021-03-10T19:56:41.970 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-03-10T19:56:41.972 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:41.998 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:41 +0000 (0:00:00.110) 0:01:43.899 ******* 2021-03-10T19:56:42.052 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-03-10T19:56:42.054 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-03-10T19:56:42.078 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:42 +0000 (0:00:00.079) 0:01:43.978 ******* 2021-03-10T19:56:42.090 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T19:56:42.095 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-03-10T19:56:42.125 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:42 +0000 (0:00:00.047) 0:01:44.026 ******* 2021-03-10T19:56:42.175 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-03-10T19:56:42.176 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:42.210 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:42 +0000 (0:00:00.084) 0:01:44.111 ******* 2021-03-10T19:56:42.242 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-03-10T19:56:42.244 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-03-10T19:56:42.254 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-03-10T19:56:42.256 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-03-10T19:56:42.266 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-03-10T19:56:42.288 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-03-10T19:56:42.299 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-03-10T19:56:42.311 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-03-10T19:56:42.313 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-03-10T19:56:42.323 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-03-10T19:56:42.325 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-03-10T19:56:42.334 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-03-10T19:56:42.353 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-03-10T19:56:42.381 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:42 +0000 (0:00:00.170) 0:01:44.281 ******* 2021-03-10T19:56:42.599 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-03-10T19:56:42.600 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-03-10T19:56:42.624 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:42 +0000 (0:00:00.243) 0:01:44.524 ******* 2021-03-10T19:56:42.643 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-03-10T19:56:42.645 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004923", "end": "2021-03-10 19:56:42.611825", "rc": 0, "start": "2021-03-10 19:56:42.606902", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b6eecfe89a4363750d696160843a096384b357a8/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b6eecfe89a4363750d696160843a096384b357a8/virtualenv/bin/teuthology-lock"]} 2021-03-10T19:56:42.676 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:42 +0000 (0:00:00.052) 0:01:44.577 ******* 2021-03-10T19:56:42.678 INFO:teuthology.task.ansible.out: 2021-03-10T19:56:42.747 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-03-10T19:56:42.749 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:42.775 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:42 +0000 (0:00:00.099) 0:01:44.676 ******* 2021-03-10T19:56:42.856 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-03-10T19:56:42.858 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:42.884 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:42 +0000 (0:00:00.108) 0:01:44.784 ******* 2021-03-10T19:56:42.934 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-03-10T19:56:42.935 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-03-10T19:56:42.960 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:42 +0000 (0:00:00.076) 0:01:44.861 ******* 2021-03-10T19:56:42.967 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-03-10T19:56:42.969 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:42.995 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:42 +0000 (0:00:00.034) 0:01:44.896 ******* 2021-03-10T19:56:43.258 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-03-10T19:56:43.260 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-03-10T19:56:43.284 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:43 +0000 (0:00:00.289) 0:01:45.185 ******* 2021-03-10T19:56:43.438 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-03-10T19:56:43.440 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1615406091, "cache_updated": false, "changed": false} 2021-03-10T19:56:43.471 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:43 +0000 (0:00:00.186) 0:01:45.371 ******* 2021-03-10T19:56:43.488 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-03-10T19:56:43.490 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T19:56:43.514 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:43 +0000 (0:00:00.043) 0:01:45.414 ******* 2021-03-10T19:56:43.542 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-03-10T19:56:43.544 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:43.569 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:43 +0000 (0:00:00.054) 0:01:45.469 ******* 2021-03-10T19:56:43.586 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:43.611 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:43 +0000 (0:00:00.042) 0:01:45.512 ******* 2021-03-10T19:56:43.661 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-03-10T19:56:43.663 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item={'block_used': 13728341, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366767, 'size_available': 927198277632, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113652, 'block_size': 4096, 'inode_available': 60941324}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366767, "block_size": 4096, "block_total": 240095108, "block_used": 13728341, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941324, "inode_total": 61054976, "inode_used": 113652, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198277632, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}} 2021-03-10T19:56:43.687 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:43 +0000 (0:00:00.075) 0:01:45.588 ******* 2021-03-10T19:56:43.693 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-03-10T19:56:43.695 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:43.726 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:43 +0000 (0:00:00.038) 0:01:45.626 ******* 2021-03-10T19:56:43.810 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-03-10T19:56:43.811 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:43.833 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:43 +0000 (0:00:00.106) 0:01:45.733 ******* 2021-03-10T19:56:43.849 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-03-10T19:56:43.851 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.002379", "end": "2021-03-10 19:56:44.191224", "rc": 0, "start": "2021-03-10 19:56:44.188845", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:56:43.878 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:43 +0000 (0:00:00.045) 0:01:45.779 ******* 2021-03-10T19:56:43.895 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-03-10T19:56:43.898 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:43.927 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:43 +0000 (0:00:00.048) 0:01:45.827 ******* 2021-03-10T19:56:43.956 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-03-10T19:56:43.958 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'block_used': 13728341, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366767, 'size_available': 927198277632, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113652, 'block_size': 4096, 'inode_available': 60941324}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366767, "block_size": 4096, "block_total": 240095108, "block_used": 13728341, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941324, "inode_total": 61054976, "inode_used": 113652, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198277632, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:43.982 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:43 +0000 (0:00:00.055) 0:01:45.883 ******* 2021-03-10T19:56:43.999 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-03-10T19:56:44.001 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:44.026 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:44 +0000 (0:00:00.043) 0:01:45.926 ******* 2021-03-10T19:56:44.064 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-03-10T19:56:44.092 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:44 +0000 (0:00:00.065) 0:01:45.992 ******* 2021-03-10T19:56:44.108 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T19:56:44.110 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-03-10T19:56:44.133 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:44 +0000 (0:00:00.041) 0:01:46.034 ******* 2021-03-10T19:56:44.183 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-10T19:56:44.185 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:44.227 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba023.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-03-10T19:56:44.229 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-03-10T19:56:44.251 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-03-10T19:56:44.253 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-03-10T19:56:44.265 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-03-10T19:56:44.266 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-03-10T19:56:44.267 INFO:teuthology.task.ansible.out: 2021-03-10T19:56:44.278 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-03-10T19:56:44.279 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-03-10T19:56:44.289 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-03-10T19:56:44.294 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-03-10T19:56:44.301 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-03-10T19:56:44.303 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-03-10T19:56:44.313 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-03-10T19:56:44.342 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:44 +0000 (0:00:00.208) 0:01:46.242 ******* 2021-03-10T19:56:44.616 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-03-10T19:56:44.618 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.005508", "end": "2021-03-10 19:56:44.588873", "rc": 0, "start": "2021-03-10 19:56:44.583365", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b6eecfe89a4363750d696160843a096384b357a8/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b6eecfe89a4363750d696160843a096384b357a8/virtualenv/bin/teuthology-lock"]} 2021-03-10T19:56:44.643 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:44 +0000 (0:00:00.300) 0:01:46.543 ******* 2021-03-10T19:56:44.727 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:44.754 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:44 +0000 (0:00:00.110) 0:01:46.654 ******* 2021-03-10T19:56:44.855 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-03-10T19:56:44.857 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:44.886 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:44 +0000 (0:00:00.132) 0:01:46.787 ******* 2021-03-10T19:56:44.967 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-03-10T19:56:44.969 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:44.993 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:44 +0000 (0:00:00.106) 0:01:46.894 ******* 2021-03-10T19:56:45.485 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-03-10T19:56:45.487 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"cache_update_time": 1615406086, "cache_updated": false, "changed": false} 2021-03-10T19:56:45.513 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:45 +0000 (0:00:00.520) 0:01:47.414 ******* 2021-03-10T19:56:45.595 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-03-10T19:56:45.598 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:45.637 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:45 +0000 (0:00:00.123) 0:01:47.537 ******* 2021-03-10T19:56:45.740 INFO:teuthology.task.ansible.out: 2021-03-10T19:56:45.742 INFO:teuthology.task.ansible.out:TASK [testnode : Set root disk] ************************************************ ok: [gibba023.front.sepia.ceph.com] => (item={'block_used': 13728331, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366777, 'size_available': 927198318592, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113650, 'block_size': 4096, 'inode_available': 60941326}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366777, "block_size": 4096, "block_total": 240095108, "block_used": 13728331, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941326, "inode_total": 61054976, "inode_used": 113650, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198318592, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}} 2021-03-10T19:56:45.769 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:45 +0000 (0:00:00.131) 0:01:47.669 ******* 2021-03-10T19:56:45.953 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-03-10T19:56:45.956 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.002445", "end": "2021-03-10 19:56:45.785257", "rc": 0, "start": "2021-03-10 19:56:45.782812", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:56:45.977 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:45 +0000 (0:00:00.208) 0:01:47.878 ******* 2021-03-10T19:56:46.104 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-10T19:56:46.105 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-uehR4unnp2BpsUE3JAg5Sy6YAc7ETWs1LzrUyhUEg07Jrg1GG0YHdsLv8xSWVDG6'], 'uuids': ['0e13e7d1-5bd7-4816-baab-e96f5d621b2b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.812038", "end": "2021-03-10 19:56:46.429741", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-uehR4unnp2BpsUE3JAg5Sy6YAc7ETWs1LzrUyhUEg07Jrg1GG0YHdsLv8xSWVDG6"], "labels": [], "masters": [], "uuids": ["0e13e7d1-5bd7-4816-baab-e96f5d621b2b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:56:44.617703", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T19:56:46.107 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-03-10T19:56:46.109 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'block_used': 13728331, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366777, 'size_available': 927198318592, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113650, 'block_size': 4096, 'inode_available': 60941326}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366777, "block_size": 4096, "block_total": 240095108, "block_used": 13728331, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941326, "inode_total": 61054976, "inode_used": 113650, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198318592, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:46.151 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:46 +0000 (0:00:00.166) 0:01:48.044 ******* 2021-03-10T19:56:46.156 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-10T19:56:46.157 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:46.159 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:46.243 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-03-10T19:56:46.272 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:46 +0000 (0:00:00.125) 0:01:48.170 ******* 2021-03-10T19:56:46.395 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-10T19:56:46.397 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:47.354 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-uehR4unnp2BpsUE3JAg5Sy6YAc7ETWs1ebBqNSPaAcCaaJAyXV3PvWfTelAzbWbF'], 'uuids': ['0a71c4fa-3ef7-4df0-8d84-8df115ec6327']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.117775", "end": "2021-03-10 19:56:47.680547", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-uehR4unnp2BpsUE3JAg5Sy6YAc7ETWs1ebBqNSPaAcCaaJAyXV3PvWfTelAzbWbF"], "labels": [], "masters": [], "uuids": ["0a71c4fa-3ef7-4df0-8d84-8df115ec6327"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:56:46.562772", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T19:56:47.366 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38NF6XF', 'wwn-0x50000399aba8166d'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38NF6XF-part1', 'wwn-0x50000399aba8166d-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399aba8166d', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I8K38NF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38NF6XF", "wwn-0x50000399aba8166d"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38NF6XF-part1", "wwn-0x50000399aba8166d-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I8K38NF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399aba8166d"}}, "skip_reason": "Cond 2021-03-10T19:56:47.368 INFO:teuthology.task.ansible.out:itional result was False"} 2021-03-10T19:56:47.923 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-0nMcMfS8WGeFgW93DsW8uQf4YNSnWr9rOcADA6BRl0YfFYScNzY7AXuzxu2flbGd'], 'uuids': ['25f2f78a-a298-4b2a-8db7-ab4fe9343504']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.445757", "end": "2021-03-10 19:56:47.741769", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-0nMcMfS8WGeFgW93DsW8uQf4YNSnWr9rOcADA6BRl0YfFYScNzY7AXuzxu2flbGd"], "labels": [], "masters": [], "uuids": ["25f2f78a-a298-4b2a-8db7-ab4fe9343504"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:56:46.296012", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T19:56:47.924 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:47.936 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:48.612 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-If2tt2-6yja-ex1Z-NesP-OVmL-5jpN-fcvzQg', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400FA375A', 'nvme-nvme.8086-50484b4d393133343030464133373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.129354", "end": "2021-03-10 19:56:48.945167", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-If2tt2-6yja-ex1Z-NesP-OVmL-5jpN-fcvzQg", "nvme-INTEL_SSDPEL1K375GA_PHKM913400FA375A", "nvme-nvme.8086-50484b4d393133343030464133373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:56:47.815813", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You m 2021-03-10T19:56:48.613 INFO:teuthology.task.ansible.out:ay now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T19:56:48.624 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:48.636 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:49.142 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-0nMcMfS8WGeFgW93DsW8uQf4YNSnWr9rHKto3pCZTyap4MOvyKT9hj6oYvMLObCx'], 'uuids': ['892d72a9-94ed-40d7-bce4-3bdf59598790']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.104143", "end": "2021-03-10 19:56:48.970079", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-0nMcMfS8WGeFgW93DsW8uQf4YNSnWr9rHKto3pCZTyap4MOvyKT9hj6oYvMLObCx"], "labels": [], "masters": [], "uuids": ["892d72a9-94ed-40d7-bce4-3bdf59598790"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:56:47.865936", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T19:56:49.154 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF', 'wwn-0x50000399ab9813cc'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF-part1', 'wwn-0x50000399ab9813cc-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab9813cc', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I6K2JYF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF", "wwn-0x50000399ab9813cc"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF-part1", "wwn-0x50000399ab9813cc-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I6K2JYF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab9813cc"}}, "skip_reason": "Cond 2021-03-10T19:56:49.156 INFO:teuthology.task.ansible.out:itional result was False"} 2021-03-10T19:56:49.840 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-uehR4unnp2BpsUE3JAg5Sy6YAc7ETWs119j27VMUeGhNgQhXvYrjws8G9uTLsLlf'], 'uuids': ['50fe496f-4664-473e-8fdb-a6c9f6111d13']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.113344", "end": "2021-03-10 19:56:50.174025", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-uehR4unnp2BpsUE3JAg5Sy6YAc7ETWs119j27VMUeGhNgQhXvYrjws8G9uTLsLlf"], "labels": [], "masters": [], "uuids": ["50fe496f-4664-473e-8fdb-a6c9f6111d13"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:56:49.060681", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T19:56:49.852 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:49.864 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:50.355 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-ph02PX-NVVe-A5UL-Iyoa-0ccz-zex2-qIeUEd', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400CL375A', 'nvme-nvme.8086-50484b4d393133343030434c33373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.113278", "end": "2021-03-10 19:56:50.181857", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-ph02PX-NVVe-A5UL-Iyoa-0ccz-zex2-qIeUEd", "nvme-INTEL_SSDPEL1K375GA_PHKM913400CL375A", "nvme-nvme.8086-50484b4d393133343030434c33373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:56:49.068579", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures destroyed! You m 2021-03-10T19:56:50.356 INFO:teuthology.task.ansible.out:ay now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T19:56:50.367 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:50.378 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:51.060 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-uehR4unnp2BpsUE3JAg5Sy6YAc7ETWs1XPBiybebRWwvGQ3VkW12k6Cc3GRJcAte'], 'uuids': ['86e7e5e7-3d6c-419c-a3ec-ee32418ff7fe']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.111251", "end": "2021-03-10 19:56:51.399210", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-uehR4unnp2BpsUE3JAg5Sy6YAc7ETWs1XPBiybebRWwvGQ3VkW12k6Cc3GRJcAte"], "labels": [], "masters": [], "uuids": ["86e7e5e7-3d6c-419c-a3ec-ee32418ff7fe"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:56:50.287959", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T19:56:51.073 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:51.641 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-0nMcMfS8WGeFgW93DsW8uQf4YNSnWr9rsrLyWibhY0Dbt6QfzR2pXM1qcaSTObj8'], 'uuids': ['ce2ef24b-432e-4d30-acf3-0d8b9ea8096a']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.123327", "end": "2021-03-10 19:56:51.458319", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-0nMcMfS8WGeFgW93DsW8uQf4YNSnWr9rsrLyWibhY0Dbt6QfzR2pXM1qcaSTObj8"], "labels": [], "masters": [], "uuids": ["ce2ef24b-432e-4d30-acf3-0d8b9ea8096a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:56:50.334992", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T19:56:51.642 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:51.655 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:52.309 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-uehR4unnp2BpsUE3JAg5Sy6YAc7ETWs1KsjkKlvVAraBYH0aY82BvxIdmjnLdSwI'], 'uuids': ['3f03f883-f48e-4086-bcbe-335455bb84ec']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.115124", "end": "2021-03-10 19:56:52.640673", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-uehR4unnp2BpsUE3JAg5Sy6YAc7ETWs1KsjkKlvVAraBYH0aY82BvxIdmjnLdSwI"], "labels": [], "masters": [], "uuids": ["3f03f883-f48e-4086-bcbe-335455bb84ec"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:56:51.525549", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T19:56:52.345 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:52 +0000 (0:00:06.076) 0:01:54.246 ******* 2021-03-10T19:56:52.498 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-10T19:56:52.499 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:52.644 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-uehR4unnp2BpsUE3JAg5Sy6YAc7ETWs1LzrUyhUEg07Jrg1GG0YHdsLv8xSWVDG6'], 'uuids': ['0e13e7d1-5bd7-4816-baab-e96f5d621b2b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.077270", "end": "2021-03-10 19:56:52.980626", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-uehR4unnp2BpsUE3JAg5Sy6YAc7ETWs1LzrUyhUEg07Jrg1GG0YHdsLv8xSWVDG6"], "labels": [], "masters": [], "uuids": ["0e13e7d1-5bd7-4816-baab-e96f5d621b2b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:56:52.903356", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0758748 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0758748 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T19:56:52.645 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:52.657 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:52.834 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-uehR4unnp2BpsUE3JAg5Sy6YAc7ETWs1ebBqNSPaAcCaaJAyXV3PvWfTelAzbWbF'], 'uuids': ['0a71c4fa-3ef7-4df0-8d84-8df115ec6327']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.077683", "end": "2021-03-10 19:56:53.169776", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-uehR4unnp2BpsUE3JAg5Sy6YAc7ETWs1ebBqNSPaAcCaaJAyXV3PvWfTelAzbWbF"], "labels": [], "masters": [], "uuids": ["0a71c4fa-3ef7-4df0-8d84-8df115ec6327"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:56:53.092093", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0764613 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0764613 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T19:56:52.835 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38NF6XF', 'wwn-0x50000399aba8166d'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38NF6XF-part1', 'wwn-0x50000399aba8166d-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399aba8166d', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I8K38NF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38NF6XF", "wwn-0x50000399aba8166d"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38NF6XF-part1", "wwn-0x50000399aba8166d-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I8K38NF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399aba8166d"}}, "skip_reason": "Cond 2021-03-10T19:56:52.837 INFO:teuthology.task.ansible.out:itional result was False"} 2021-03-10T19:56:52.983 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-10T19:56:52.984 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-0nMcMfS8WGeFgW93DsW8uQf4YNSnWr9rQFnWdoHBlO0WiDUvecoblYK8poF864cP'], 'uuids': ['10d88eca-b651-487a-84f0-5ac9109c41b3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.083734", "end": "2021-03-10 19:56:52.810828", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-0nMcMfS8WGeFgW93DsW8uQf4YNSnWr9rQFnWdoHBlO0WiDUvecoblYK8poF864cP"], "labels": [], "masters": [], "uuids": ["10d88eca-b651-487a-84f0-5ac9109c41b3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:56:51.727094", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T19:56:52.985 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-If2tt2-6yja-ex1Z-NesP-OVmL-5jpN-fcvzQg', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400FA375A', 'nvme-nvme.8086-50484b4d393133343030464133373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.024844", "end": "2021-03-10 19:56:53.316582", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-If2tt2-6yja-ex1Z-NesP-OVmL-5jpN-fcvzQg", "nvme-INTEL_SSDPEL1K375GA_PHKM913400FA375A", "nvme-nvme.8086-50484b4d393133343030464133373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:56:53.291738", "stderr": "110+0 records in\n110+0 records out\n1 2021-03-10T19:56:52.987 INFO:teuthology.task.ansible.out:15343360 bytes (115 MB, 110 MiB) copied, 0.0236848 s, 4.9 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0236848 s, 4.9 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T19:56:52.997 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-10T19:56:52.999 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:53.011 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:53.172 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-uehR4unnp2BpsUE3JAg5Sy6YAc7ETWs119j27VMUeGhNgQhXvYrjws8G9uTLsLlf'], 'uuids': ['50fe496f-4664-473e-8fdb-a6c9f6111d13']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.077469", "end": "2021-03-10 19:56:53.511020", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-uehR4unnp2BpsUE3JAg5Sy6YAc7ETWs119j27VMUeGhNgQhXvYrjws8G9uTLsLlf"], "labels": [], "masters": [], "uuids": ["50fe496f-4664-473e-8fdb-a6c9f6111d13"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:56:53.433551", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0762486 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0762486 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T19:56:53.184 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:53.185 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:53.365 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-uehR4unnp2BpsUE3JAg5Sy6YAc7ETWs1XPBiybebRWwvGQ3VkW12k6Cc3GRJcAte'], 'uuids': ['86e7e5e7-3d6c-419c-a3ec-ee32418ff7fe']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.077754", "end": "2021-03-10 19:56:53.704447", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-uehR4unnp2BpsUE3JAg5Sy6YAc7ETWs1XPBiybebRWwvGQ3VkW12k6Cc3GRJcAte"], "labels": [], "masters": [], "uuids": ["86e7e5e7-3d6c-419c-a3ec-ee32418ff7fe"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:56:53.626693", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0764786 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0764786 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T19:56:53.377 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:53.560 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-uehR4unnp2BpsUE3JAg5Sy6YAc7ETWs1KsjkKlvVAraBYH0aY82BvxIdmjnLdSwI'], 'uuids': ['3f03f883-f48e-4086-bcbe-335455bb84ec']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.077902", "end": "2021-03-10 19:56:53.894918", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-uehR4unnp2BpsUE3JAg5Sy6YAc7ETWs1KsjkKlvVAraBYH0aY82BvxIdmjnLdSwI"], "labels": [], "masters": [], "uuids": ["3f03f883-f48e-4086-bcbe-335455bb84ec"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:56:53.817016", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0766876 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0766876 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T19:56:53.595 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:53 +0000 (0:00:01.250) 0:01:55.496 ******* 2021-03-10T19:56:53.910 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-03-10T19:56:53.912 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.137821", "end": "2021-03-10 19:56:54.189564", "rc": 0, "start": "2021-03-10 19:56:54.051743", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:56:53.937 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:53 +0000 (0:00:00.341) 0:01:55.837 ******* 2021-03-10T19:56:54.119 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-03-10T19:56:54.120 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.069860", "end": "2021-03-10 19:56:54.456583", "rc": 0, "start": "2021-03-10 19:56:54.386723", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:56:54.142 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:54 +0000 (0:00:00.205) 0:01:56.043 ******* 2021-03-10T19:56:54.173 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-03-10T19:56:54.175 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-0nMcMfS8WGeFgW93DsW8uQf4YNSnWr9rK19Va6FuavJOn8d22EOS2UkqIqYZxzgX'], 'uuids': ['296300f1-4791-40d1-be91-55f9ff588a87']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.085254", "end": "2021-03-10 19:56:53.995292", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-0nMcMfS8WGeFgW93DsW8uQf4YNSnWr9rK19Va6FuavJOn8d22EOS2UkqIqYZxzgX"], "labels": [], "masters": [], "uuids": ["296300f1-4791-40d1-be91-55f9ff588a87"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:56:52.910038", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-03-10T19:56:54.216 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:54 +0000 (0:00:00.073) 0:01:56.116 ******* 2021-03-10T19:56:54.233 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-03-10T19:56:54.413 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:54 +0000 (0:00:00.196) 0:01:56.313 ******* 2021-03-10T19:56:54.442 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-10T19:56:54.444 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:54.470 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:54 +0000 (0:00:00.057) 0:01:56.371 ******* 2021-03-10T19:56:54.508 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-03-10T19:56:54.510 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:54.532 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:54 +0000 (0:00:00.061) 0:01:56.432 ******* 2021-03-10T19:56:54.559 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-03-10T19:56:54.561 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:54.588 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:54 +0000 (0:00:00.055) 0:01:56.488 ******* 2021-03-10T19:56:54.615 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-10T19:56:54.617 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-0nMcMfS8WGeFgW93DsW8uQf4YNSnWr9rOcADA6BRl0YfFYScNzY7AXuzxu2flbGd'], 'uuids': ['25f2f78a-a298-4b2a-8db7-ab4fe9343504']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.077378", "end": "2021-03-10 19:56:54.439041", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-0nMcMfS8WGeFgW93DsW8uQf4YNSnWr9rOcADA6BRl0YfFYScNzY7AXuzxu2flbGd"], "labels": [], "masters": [], "uuids": ["25f2f78a-a298-4b2a-8db7-ab4fe9343504"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:56:54.361663", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0761351 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0761351 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T19:56:54.628 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:54.629 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:54.630 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:54.654 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:54 +0000 (0:00:00.066) 0:01:56.555 ******* 2021-03-10T19:56:54.755 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [gibba044.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T19:56:54.781 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:54 +0000 (0:00:00.127) 0:01:56.682 ******* 2021-03-10T19:56:54.815 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-10T19:56:54.817 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-0nMcMfS8WGeFgW93DsW8uQf4YNSnWr9rHKto3pCZTyap4MOvyKT9hj6oYvMLObCx'], 'uuids': ['892d72a9-94ed-40d7-bce4-3bdf59598790']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.078058", "end": "2021-03-10 19:56:54.638361", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-0nMcMfS8WGeFgW93DsW8uQf4YNSnWr9rHKto3pCZTyap4MOvyKT9hj6oYvMLObCx"], "labels": [], "masters": [], "uuids": ["892d72a9-94ed-40d7-bce4-3bdf59598790"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:56:54.560303", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0767919 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0767919 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T19:56:54.817 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF', 'wwn-0x50000399ab9813cc'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'links': {'masters': [ 2021-03-10T19:56:54.819 INFO:teuthology.task.ansible.out:], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF-part1', 'wwn-0x50000399ab9813cc-part1'], 'uuids': ['a79497c0-8b9d-46cc-9a4d-f403ab32c811']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab9813cc', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I6K2JYF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF", "wwn-0x50000399ab9813cc"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF-part1", "wwn-0x50000399ab9813cc-part1"], "labels": [], "masters": [], "uuids": ["a79497c0-8b9d-46cc-9a4d-f403ab32c811"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I6K2JYF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab9813cc"}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:54.850 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-03-10T19:56:54.852 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'block_used': 13728341, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366767, 'size_available': 927198277632, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113652, 'block_size': 4096, 'inode_available': 60941324}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366767, "block_size": 4096, "block_total": 240095108, "block_used": 13728341, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941324, "inode_total": 61054976, "inode_used": 113652, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198277632, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:54.875 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:54 +0000 (0:00:00.093) 0:01:56.775 ******* 2021-03-10T19:56:54.915 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-03-10T19:56:54.917 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:54.948 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:54 +0000 (0:00:00.072) 0:01:56.848 ******* 2021-03-10T19:56:54.999 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [gibba023.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-ph02PX-NVVe-A5UL-Iyoa-0ccz-zex2-qIeUEd', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400CL375A', 'nvme-nvme.8086-50484b4d393133343030434c33373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.024863", "end": "2021-03-10 19:56:54.821764", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-ph02PX-NVVe-A5UL-Iyoa-0ccz-zex2-qIeUEd", "nvme-INTEL_SSDPEL1K375GA_PHKM913400CL375A", "nvme-nvme.8086-50484b4d393133343030434c33373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", " 2021-03-10T19:56:55.002 INFO:teuthology.task.ansible.out:sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:56:54.796901", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0236462 s, 4.9 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0236462 s, 4.9 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T19:56:55.034 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:55 +0000 (0:00:00.086) 0:01:56.934 ******* 2021-03-10T19:56:55.042 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:55.044 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:55.066 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:55.090 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:55 +0000 (0:00:00.056) 0:01:56.991 ******* 2021-03-10T19:56:55.133 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-03-10T19:56:55.135 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:55.161 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:55 +0000 (0:00:00.070) 0:01:57.061 ******* 2021-03-10T19:56:55.191 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-03-10T19:56:55.193 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:55.194 INFO:teuthology.task.ansible.out: 2021-03-10T19:56:55.242 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:55 +0000 (0:00:00.080) 0:01:57.142 ******* 2021-03-10T19:56:55.260 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-03-10T19:56:55.261 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-0nMcMfS8WGeFgW93DsW8uQf4YNSnWr9rsrLyWibhY0Dbt6QfzR2pXM1qcaSTObj8'], 'uuids': ['ce2ef24b-432e-4d30-acf3-0d8b9ea8096a']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.077691", "end": "2021-03-10 19:56:55.036450", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-0nMcMfS8WGeFgW93DsW8uQf4YNSnWr9rsrLyWibhY0Dbt6QfzR2pXM1qcaSTObj8"], "labels": [], "masters": [], "uuids": ["ce2ef24b-432e-4d30-acf3-0d8b9ea8096a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:56:54.958759", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.076475 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.076475 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T19:56:55.264 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:55.266 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:55.334 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-03-10T19:56:55.337 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:55.358 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:55 +0000 (0:00:00.116) 0:01:57.258 ******* 2021-03-10T19:56:55.440 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [gibba023.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-0nMcMfS8WGeFgW93DsW8uQf4YNSnWr9rQFnWdoHBlO0WiDUvecoblYK8poF864cP'], 'uuids': ['10d88eca-b651-487a-84f0-5ac9109c41b3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.079940", "end": "2021-03-10 19:56:55.258259", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-0nMcMfS8WGeFgW93DsW8uQf4YNSnWr9rQFnWdoHBlO0WiDUvecoblYK8poF864cP"], "labels": [], "masters": [], "uuids": ["10d88eca-b651-487a-84f0-5ac9109c41b3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:56:55.178319", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0787011 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0787011 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T19:56:55.441 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:55.641 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-0nMcMfS8WGeFgW93DsW8uQf4YNSnWr9rK19Va6FuavJOn8d22EOS2UkqIqYZxzgX'], 'uuids': ['296300f1-4791-40d1-be91-55f9ff588a87']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.078060", "end": "2021-03-10 19:56:55.464393", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-0nMcMfS8WGeFgW93DsW8uQf4YNSnWr9rK19Va6FuavJOn8d22EOS2UkqIqYZxzgX"], "labels": [], "masters": [], "uuids": ["296300f1-4791-40d1-be91-55f9ff588a87"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-03-10 19:56:55.386333", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0768425 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0768425 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-03-10T19:56:55.682 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:55 +0000 (0:00:00.323) 0:01:57.582 ******* 2021-03-10T19:56:56.032 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-03-10T19:56:56.033 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-03-10T19:56:56.063 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:56 +0000 (0:00:00.381) 0:01:57.964 ******* 2021-03-10T19:56:56.082 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-03-10T19:56:56.084 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.249456", "end": "2021-03-10 19:56:55.874171", "rc": 0, "start": "2021-03-10 19:56:55.624715", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:56:56.108 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:56 +0000 (0:00:00.044) 0:01:58.009 ******* 2021-03-10T19:56:56.337 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-03-10T19:56:56.339 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.091436", "end": "2021-03-10 19:56:56.161456", "rc": 0, "start": "2021-03-10 19:56:56.070020", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:56:56.366 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:56 +0000 (0:00:00.257) 0:01:58.267 ******* 2021-03-10T19:56:56.399 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-03-10T19:56:56.442 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:56 +0000 (0:00:00.075) 0:01:58.343 ******* 2021-03-10T19:56:56.482 INFO:teuthology.task.ansible.out: 2021-03-10T19:56:56.484 INFO:teuthology.task.ansible.out:TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:56.514 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:56 +0000 (0:00:00.071) 0:01:58.415 ******* 2021-03-10T19:56:56.545 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:56.575 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:56 +0000 (0:00:00.060) 0:01:58.475 ******* 2021-03-10T19:56:56.617 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:56.651 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:56 +0000 (0:00:00.076) 0:01:58.552 ******* 2021-03-10T19:56:56.677 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-03-10T19:56:56.678 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T19:56:56.688 INFO:teuthology.task.ansible.out: 2021-03-10T19:56:56.690 INFO:teuthology.task.ansible.out:TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:56.714 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:56 +0000 (0:00:00.063) 0:01:58.615 ******* 2021-03-10T19:56:56.819 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-03-10T19:56:56.821 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-03-10T19:56:56.843 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:56 +0000 (0:00:00.128) 0:01:58.744 ******* 2021-03-10T19:56:56.894 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-03-10T19:56:56.896 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'block_used': 13728331, 'uuid': 'a79497c0-8b9d-46cc-9a4d-f403ab32c811', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226366777, 'size_available': 927198318592, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 113650, 'block_size': 4096, 'inode_available': 60941326}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226366777, "block_size": 4096, "block_total": 240095108, "block_used": 13728331, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941326, "inode_total": 61054976, "inode_used": 113650, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 927198318592, "size_total": 983429562368, "uuid": "a79497c0-8b9d-46cc-9a4d-f403ab32c811"}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:56.928 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:56 +0000 (0:00:00.084) 0:01:58.828 ******* 2021-03-10T19:56:56.956 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-03-10T19:56:56.958 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:56.984 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:56 +0000 (0:00:00.056) 0:01:58.885 ******* 2021-03-10T19:56:57.021 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T19:56:57.023 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:57.045 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:57 +0000 (0:00:00.060) 0:01:58.946 ******* 2021-03-10T19:56:57.073 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T19:56:57.075 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:57.104 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:57 +0000 (0:00:00.057) 0:01:59.004 ******* 2021-03-10T19:56:57.121 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-03-10T19:56:57.123 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T19:56:57.132 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:57.156 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:57 +0000 (0:00:00.052) 0:01:59.057 ******* 2021-03-10T19:56:57.194 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-03-10T19:56:57.196 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:57.220 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:57 +0000 (0:00:00.063) 0:01:59.120 ******* 2021-03-10T19:56:57.248 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-03-10T19:56:57.250 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:57.279 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:57 +0000 (0:00:00.060) 0:01:59.180 ******* 2021-03-10T19:56:57.281 INFO:teuthology.task.ansible.out: 2021-03-10T19:56:57.490 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T19:56:57.492 INFO:teuthology.task.ansible.out: 2021-03-10T19:56:57.883 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-03-10T19:56:57.885 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-03-10T19:56:57.909 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:57 +0000 (0:00:00.629) 0:01:59.809 ******* 2021-03-10T19:56:57.921 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-03-10T19:56:57.924 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T19:56:58.227 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T19:56:58.256 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:58 +0000 (0:00:00.347) 0:02:00.157 ******* 2021-03-10T19:56:58.338 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T19:56:58.435 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-03-10T19:56:58.457 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:58 +0000 (0:00:00.200) 0:02:00.357 ******* 2021-03-10T19:56:58.602 INFO:teuthology.task.ansible.out: 2021-03-10T19:56:58.604 INFO:teuthology.task.ansible.out:TASK [testnode : Write /scratch_devs] ****************************************** changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T19:56:58.657 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-03-10T19:56:58.659 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T19:56:58.689 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-10T19:56:58.691 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T19:56:58.797 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T19:56:58.894 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T19:56:58.906 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:58.932 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:58 +0000 (0:00:00.474) 0:02:00.832 ******* 2021-03-10T19:56:58.970 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-03-10T19:56:58.972 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:58.996 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:58 +0000 (0:00:00.064) 0:02:00.897 ******* 2021-03-10T19:56:59.005 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-03-10T19:56:59.007 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T19:56:59.040 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-03-10T19:56:59.041 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:56:59.081 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:59 +0000 (0:00:00.085) 0:02:00.982 ******* 2021-03-10T19:56:59.204 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-03-10T19:56:59.206 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T19:56:59.230 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:59 +0000 (0:00:00.148) 0:02:01.130 ******* 2021-03-10T19:56:59.269 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-03-10T19:56:59.271 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-03-10T19:56:59.301 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:59 +0000 (0:00:00.071) 0:02:01.201 ******* 2021-03-10T19:56:59.329 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-03-10T19:56:59.331 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T19:56:59.622 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-03-10T19:56:59.624 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true} 2021-03-10T19:56:59.649 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:59 +0000 (0:00:00.348) 0:02:01.550 ******* 2021-03-10T19:56:59.693 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-03-10T19:56:59.694 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-03-10T19:56:59.734 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:59 +0000 (0:00:00.084) 0:02:01.634 ******* 2021-03-10T19:56:59.864 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [gibba023.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-03-10T19:56:59.888 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:56:59 +0000 (0:00:00.154) 0:02:01.789 ******* 2021-03-10T19:56:59.992 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-03-10T19:56:59.994 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-03-10T19:57:00.022 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:00 +0000 (0:00:00.133) 0:02:01.922 ******* 2021-03-10T19:57:00.051 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-03-10T19:57:00.053 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T19:57:00.063 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:00.086 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:00 +0000 (0:00:00.064) 0:02:01.987 ******* 2021-03-10T19:57:00.113 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-03-10T19:57:00.115 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:00.139 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:00 +0000 (0:00:00.050) 0:02:02.038 ******* 2021-03-10T19:57:00.148 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [gibba023.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T19:57:00.179 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-03-10T19:57:00.181 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:00.203 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:00 +0000 (0:00:00.066) 0:02:02.104 ******* 2021-03-10T19:57:00.236 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [gibba023.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T19:57:00.248 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:00.275 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:00 +0000 (0:00:00.071) 0:02:02.175 ******* 2021-03-10T19:57:00.340 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [gibba023.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-03-10T19:57:00.354 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:00.380 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:00 +0000 (0:00:00.105) 0:02:02.281 ******* 2021-03-10T19:57:00.418 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-03-10T19:57:00.420 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:00.442 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:00 +0000 (0:00:00.062) 0:02:02.343 ******* 2021-03-10T19:57:00.451 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-03-10T19:57:00.485 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:00 +0000 (0:00:00.042) 0:02:02.386 ******* 2021-03-10T19:57:00.495 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-03-10T19:57:00.497 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:00.523 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:00 +0000 (0:00:00.037) 0:02:02.424 ******* 2021-03-10T19:57:00.624 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T19:57:00.651 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:00 +0000 (0:00:00.127) 0:02:02.551 ******* 2021-03-10T19:57:00.658 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:00.666 INFO:teuthology.task.ansible.out:TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-03-10T19:57:00.667 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:00.669 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T19:57:00.700 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:00 +0000 (0:00:00.049) 0:02:02.601 ******* 2021-03-10T19:57:00.739 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-03-10T19:57:00.741 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-03-10T19:57:00.764 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:00 +0000 (0:00:00.063) 0:02:02.665 ******* 2021-03-10T19:57:00.922 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-03-10T19:57:00.924 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => {"changed": true} 2021-03-10T19:57:00.947 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:00 +0000 (0:00:00.182) 0:02:02.847 ******* 2021-03-10T19:57:00.985 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-03-10T19:57:00.987 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-03-10T19:57:01.022 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:01 +0000 (0:00:00.075) 0:02:02.923 ******* 2021-03-10T19:57:01.199 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-03-10T19:57:01.201 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-03-10T19:57:01.227 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:01 +0000 (0:00:00.204) 0:02:03.127 ******* 2021-03-10T19:57:01.268 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-03-10T19:57:01.270 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:01.296 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:01 +0000 (0:00:00.069) 0:02:03.196 ******* 2021-03-10T19:57:01.336 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-03-10T19:57:01.337 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:01.363 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:01 +0000 (0:00:00.067) 0:02:03.264 ******* 2021-03-10T19:57:01.371 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-03-10T19:57:01.373 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-03-10T19:57:01.400 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:01 +0000 (0:00:00.036) 0:02:03.300 ******* 2021-03-10T19:57:01.408 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-03-10T19:57:01.410 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:01.435 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:01 +0000 (0:00:00.035) 0:02:03.336 ******* 2021-03-10T19:57:01.476 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-03-10T19:57:01.477 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:01.513 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:01 +0000 (0:00:00.078) 0:02:03.414 ******* 2021-03-10T19:57:01.687 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-03-10T19:57:01.713 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:01 +0000 (0:00:00.199) 0:02:03.613 ******* 2021-03-10T19:57:01.848 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-03-10T19:57:01.850 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1615406091, "cache_updated": false, "changed": false} 2021-03-10T19:57:01.877 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:01 +0000 (0:00:00.164) 0:02:03.778 ******* 2021-03-10T19:57:01.885 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-03-10T19:57:01.886 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T19:57:01.915 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:01 +0000 (0:00:00.038) 0:02:03.816 ******* 2021-03-10T19:57:02.185 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:02.187 INFO:teuthology.task.ansible.out:TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.157623", "end": "2021-03-10 19:57:02.509972", "rc": 0, "start": "2021-03-10 19:57:02.352349", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-03-10T19:57:02.211 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:02 +0000 (0:00:00.296) 0:02:04.112 ******* 2021-03-10T19:57:02.262 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:02.287 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:02 +0000 (0:00:00.075) 0:02:04.187 ******* 2021-03-10T19:57:02.305 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-03-10T19:57:02.309 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-03-10T19:57:02.339 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:02 +0000 (0:00:00.051) 0:02:04.239 ******* 2021-03-10T19:57:02.348 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-03-10T19:57:02.350 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:02.385 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:02 +0000 (0:00:00.046) 0:02:04.286 ******* 2021-03-10T19:57:02.686 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:02.688 INFO:teuthology.task.ansible.out:TASK [testnode : Upload CPAN config for root.] ********************************* ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-03-10T19:57:02.689 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:02.719 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:02 +0000 (0:00:00.332) 0:02:04.619 ******* 2021-03-10T19:57:02.821 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** ok: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1615406091, "cache_updated": false, "changed": false} 2021-03-10T19:57:02.847 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:02 +0000 (0:00:00.128) 0:02:04.748 ******* 2021-03-10T19:57:02.874 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-03-10T19:57:02.876 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:02.900 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:02 +0000 (0:00:00.052) 0:02:04.800 ******* 2021-03-10T19:57:03.139 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:03.141 INFO:teuthology.task.ansible.out:TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** ok: [gibba023.front.sepia.ceph.com] => {"cache_update_time": 1615406086, "cache_updated": false, "changed": false} 2021-03-10T19:57:03.168 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:03 +0000 (0:00:00.268) 0:02:05.068 ******* 2021-03-10T19:57:03.175 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-03-10T19:57:03.177 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-03-10T19:57:03.202 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:03 +0000 (0:00:00.033) 0:02:05.102 ******* 2021-03-10T19:57:03.229 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-03-10T19:57:03.230 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:03.254 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:03 +0000 (0:00:00.052) 0:02:05.155 ******* 2021-03-10T19:57:03.452 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:03.454 INFO:teuthology.task.ansible.out:TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.154506", "end": "2021-03-10 19:57:03.283122", "rc": 0, "start": "2021-03-10 19:57:03.128616", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-03-10T19:57:03.456 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-03-10T19:57:03.457 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 19:54:14 UTC", "ActiveEnterTimestampMonotonic": "12833700", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount sysinit.target network.target systemd-journald.socket basic.target systemd-tmpfiles-setup.service system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 19:54:13 UTC", "AssertTimestampMonotonic": "12563033", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 19:54:13 UTC", "ConditionTimestampMonotonic": "12563032", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2021-03-10T19:57:03.459 INFO:teuthology.task.ansible.out:"/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "968", "ExecMainStartTimestamp": "Wed 2021-03-10 19:54:14 UTC", "ExecMainStartTimestampMonotonic": "12833691", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 19:54:13 UTC", "InactiveExitTimestampMonotonic": "12563666", "InvocationID": "00572b1df23448e5b2ffc12655479dc6", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Limi 2021-03-10T19:57:03.460 INFO:teuthology.task.ansible.out:tCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "968", "MemoryAccounting": "yes", "MemoryCurrent": "4063232", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "Requir 2021-03-10T19:57:03.462 INFO:teuthology.task.ansible.out:esMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 19:54:14 UTC", "StateChangeTimestampMonotonic": "12833700", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38348", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T19:57:03.484 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:03 +0000 (0:00:00.230) 0:02:05.385 ******* 2021-03-10T19:57:03.512 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:03 +0000 (0:00:00.027) 0:02:05.412 ******* 2021-03-10T19:57:03.521 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:03.545 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:03 +0000 (0:00:00.033) 0:02:05.445 ******* 2021-03-10T19:57:03.553 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [gibba044.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-03-10T19:57:03.581 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:03 +0000 (0:00:00.036) 0:02:05.482 ******* 2021-03-10T19:57:03.588 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-03-10T19:57:03.590 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:03.615 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:03 +0000 (0:00:00.034) 0:02:05.516 ******* 2021-03-10T19:57:03.622 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T19:57:03.624 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-03-10T19:57:03.648 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:03 +0000 (0:00:00.032) 0:02:05.549 ******* 2021-03-10T19:57:03.676 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:03.707 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:03 +0000 (0:00:00.058) 0:02:05.608 ******* 2021-03-10T19:57:04.026 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-03-10T19:57:04.027 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"cache_update_time": 1615406086, "cache_updated": false, "changed": false} 2021-03-10T19:57:04.050 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:04 +0000 (0:00:00.342) 0:02:05.951 ******* 2021-03-10T19:57:04.089 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-03-10T19:57:04.091 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:04.116 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:04 +0000 (0:00:00.065) 0:02:06.016 ******* 2021-03-10T19:57:04.408 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-03-10T19:57:04.410 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-03-10T19:57:04.433 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:04 +0000 (0:00:00.317) 0:02:06.333 ******* 2021-03-10T19:57:04.481 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-03-10T19:57:04.483 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:04.511 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:04 +0000 (0:00:00.078) 0:02:06.411 ******* 2021-03-10T19:57:04.624 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-03-10T19:57:04.626 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1615406091, "cache_updated": false, "changed": false} 2021-03-10T19:57:04.651 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:04 +0000 (0:00:00.139) 0:02:06.551 ******* 2021-03-10T19:57:04.690 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-03-10T19:57:04.692 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:04.720 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:04 +0000 (0:00:00.068) 0:02:06.620 ******* 2021-03-10T19:57:04.730 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-03-10T19:57:04.733 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-03-10 19:54:13 UTC", "ActiveEnterTimestampMonotonic": "12453162", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount systemd-tmpfiles-setup.service basic.target sysinit.target system.slice network.target systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-03-10 19:54:13 UTC", "AssertTimestampMonotonic": "12318812", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-03-10 19:54:13 UTC", "ConditionTimestampMonotonic": "12318811", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-03-10T19:57:04.735 INFO:teuthology.task.ansible.out:"/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "966", "ExecMainStartTimestamp": "Wed 2021-03-10 19:54:13 UTC", "ExecMainStartTimestampMonotonic": "12453153", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-03-10 19:54:13 UTC", "InactiveExitTimestampMonotonic": "12319323", "InvocationID": "abb5f445058e4eb4b1e3741561b3d369", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Limi 2021-03-10T19:57:04.737 INFO:teuthology.task.ansible.out:tCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127828", "LimitNPROCSoft": "127828", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "966", "MemoryAccounting": "yes", "MemoryCurrent": "3981312", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "Requir 2021-03-10T19:57:04.739 INFO:teuthology.task.ansible.out:esMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 19:54:13 UTC", "StateChangeTimestampMonotonic": "12453162", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38348", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T19:57:04.765 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:04 +0000 (0:00:00.045) 0:02:06.666 ******* 2021-03-10T19:57:04.818 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T19:57:04.820 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-03-10T19:57:04.844 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:04 +0000 (0:00:00.078) 0:02:06.745 ******* 2021-03-10T19:57:04.889 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [gibba023.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-03-10T19:57:04.913 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:04 +0000 (0:00:00.068) 0:02:06.813 ******* 2021-03-10T19:57:04.922 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-03-10T19:57:04.956 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:04 +0000 (0:00:00.043) 0:02:06.857 ******* 2021-03-10T19:57:04.969 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-03-10T19:57:04.970 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:05.001 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:04 +0000 (0:00:00.044) 0:02:06.901 ******* 2021-03-10T19:57:05.308 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-03-10T19:57:05.310 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-03-10T19:57:05.334 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:05 +0000 (0:00:00.333) 0:02:07.235 ******* 2021-03-10T19:57:05.902 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-03-10T19:57:05.903 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"cache_update_time": 1615406086, "cache_updated": false, "changed": false} 2021-03-10T19:57:05.934 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:05 +0000 (0:00:00.598) 0:02:07.833 ******* 2021-03-10T19:57:05.993 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-03-10T19:57:05.995 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:06.037 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:06 +0000 (0:00:00.104) 0:02:07.938 ******* 2021-03-10T19:57:06.192 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-03-10T19:57:06.194 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-03-10T19:57:06.223 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:06 +0000 (0:00:00.185) 0:02:08.123 ******* 2021-03-10T19:57:06.574 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-03-10T19:57:06.576 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-03-10T19:57:06.599 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:06 +0000 (0:00:00.375) 0:02:08.499 ******* 2021-03-10T19:57:07.532 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-03-10T19:57:07.534 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-03-10T19:57:07.573 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:07 +0000 (0:00:00.973) 0:02:09.473 ******* 2021-03-10T19:57:07.983 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-03-10T19:57:07.986 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false} 2021-03-10T19:57:08.011 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:08 +0000 (0:00:00.438) 0:02:09.912 ******* 2021-03-10T19:57:08.051 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-03-10T19:57:08.053 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-03-10T19:57:08.080 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:08 +0000 (0:00:00.068) 0:02:09.980 ******* 2021-03-10T19:57:08.226 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-03-10T19:57:08.227 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1615406069.505391, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1615406069.501391, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 158, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1615406069.501391, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1582242096", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-03-10T19:57:08.261 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:08 +0000 (0:00:00.180) 0:02:10.161 ******* 2021-03-10T19:57:08.270 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-03-10T19:57:08.271 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-03-10T19:57:08.307 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:08 +0000 (0:00:00.045) 0:02:10.207 ******* 2021-03-10T19:57:08.678 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-03-10T19:57:08.680 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false} 2021-03-10T19:57:08.703 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:08 +0000 (0:00:00.396) 0:02:10.603 ******* 2021-03-10T19:57:08.723 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-03-10T19:57:08.725 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-03-10T19:57:08.760 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:08 +0000 (0:00:00.056) 0:02:10.660 ******* 2021-03-10T19:57:08.786 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-03-10T19:57:08.788 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-03-10T19:57:08.830 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:08 +0000 (0:00:00.070) 0:02:10.731 ******* 2021-03-10T19:57:08.860 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-03-10T19:57:08.864 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-03-10T19:57:08.887 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:08 +0000 (0:00:00.056) 0:02:10.788 ******* 2021-03-10T19:57:08.924 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-03-10T19:57:08.926 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:08.947 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:08 +0000 (0:00:00.060) 0:02:10.848 ******* 2021-03-10T19:57:09.007 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-03-10T19:57:09.008 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1615406071.2439592, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1615406071.2399592, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 158, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1615406071.2399592, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1582242096", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-03-10T19:57:09.042 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:09 +0000 (0:00:00.094) 0:02:10.942 ******* 2021-03-10T19:57:09.148 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-03-10T19:57:09.149 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-03-10T19:57:09.174 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:09 +0000 (0:00:00.132) 0:02:11.074 ******* 2021-03-10T19:57:09.244 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-03-10T19:57:09.246 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-03-10T19:57:09.270 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:09 +0000 (0:00:00.095) 0:02:11.170 ******* 2021-03-10T19:57:09.366 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-03-10T19:57:09.368 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-03-10T19:57:09.393 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:09 +0000 (0:00:00.123) 0:02:11.294 ******* 2021-03-10T19:57:09.420 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-03-10T19:57:09.422 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-03-10T19:57:09.448 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:09 +0000 (0:00:00.054) 0:02:11.349 ******* 2021-03-10T19:57:09.471 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-03-10T19:57:09.473 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:09.500 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:09 +0000 (0:00:00.051) 0:02:11.401 ******* 2021-03-10T19:57:09.509 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:09.545 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-03-10T19:57:09.547 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:09.577 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:09 +0000 (0:00:00.075) 0:02:11.477 ******* 2021-03-10T19:57:09.657 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-03-10T19:57:09.659 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} 2021-03-10T19:57:09.669 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} 2021-03-10T19:57:09.671 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-03-10T19:57:09.706 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:09 +0000 (0:00:00.129) 0:02:11.607 ******* 2021-03-10T19:57:09.732 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-03-10T19:57:09.733 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-03-10T19:57:09.766 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:09 +0000 (0:00:00.059) 0:02:11.666 ******* 2021-03-10T19:57:09.770 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:09.788 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-03-10T19:57:09.790 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba044.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:09.812 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:09.824 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:09.854 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:09 +0000 (0:00:00.087) 0:02:11.754 ******* 2021-03-10T19:57:09.882 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T19:57:09.884 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:09.909 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:09 +0000 (0:00:00.055) 0:02:11.809 ******* 2021-03-10T19:57:09.914 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:09.957 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-03-10T19:57:09.958 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-03-10T19:57:09.990 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:09 +0000 (0:00:00.081) 0:02:11.891 ******* 2021-03-10T19:57:10.010 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-03-10T19:57:10.012 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:10.055 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:10 +0000 (0:00:00.063) 0:02:11.955 ******* 2021-03-10T19:57:10.069 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-03-10T19:57:10.071 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:10.102 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:10 +0000 (0:00:00.047) 0:02:12.002 ******* 2021-03-10T19:57:10.118 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-03-10T19:57:10.120 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:10.168 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:10 +0000 (0:00:00.064) 0:02:12.069 ******* 2021-03-10T19:57:10.185 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:10.187 INFO:teuthology.task.ansible.out:TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [gibba023.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-03-10T19:57:10.189 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-03-10T19:57:10.190 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} skipping: [gibba023.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} 2021-03-10T19:57:10.192 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:10.192 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-03-10T19:57:10.236 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:10 +0000 (0:00:00.067) 0:02:12.136 ******* 2021-03-10T19:57:10.245 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-03-10T19:57:10.247 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:10.275 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:10 +0000 (0:00:00.039) 0:02:12.175 ******* 2021-03-10T19:57:10.303 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-03-10T19:57:10.305 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:10.326 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:10.327 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Define net_to_configure var] ********************************** skipping: [gibba023.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:10.369 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:10 +0000 (0:00:00.094) 0:02:12.270 ******* 2021-03-10T19:57:10.379 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:10.380 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:10.410 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:10 +0000 (0:00:00.040) 0:02:12.310 ******* 2021-03-10T19:57:10.417 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-10T19:57:10.418 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:10.446 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:10 +0000 (0:00:00.036) 0:02:12.346 ******* 2021-03-10T19:57:10.453 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-03-10T19:57:10.454 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:10.502 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:10 +0000 (0:00:00.056) 0:02:12.403 ******* 2021-03-10T19:57:10.509 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-03-10T19:57:10.511 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:10.547 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:10 +0000 (0:00:00.044) 0:02:12.447 ******* 2021-03-10T19:57:10.553 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-03-10T19:57:10.555 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:10.584 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:10 +0000 (0:00:00.037) 0:02:12.484 ******* 2021-03-10T19:57:10.595 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-10T19:57:10.597 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:10.627 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:10 +0000 (0:00:00.043) 0:02:12.528 ******* 2021-03-10T19:57:10.640 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:10.641 INFO:teuthology.task.ansible.out:TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-03-10T19:57:10.643 INFO:teuthology.task.ansible.out: skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:10.688 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:10 +0000 (0:00:00.060) 0:02:12.588 ******* 2021-03-10T19:57:10.729 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:10.755 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:10 +0000 (0:00:00.066) 0:02:12.655 ******* 2021-03-10T19:57:10.804 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:10.806 INFO:teuthology.task.ansible.out:TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:10.834 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:10 +0000 (0:00:00.078) 0:02:12.733 ******* 2021-03-10T19:57:10.847 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-03-10T19:57:10.850 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.002537", "end": "2021-03-10 19:57:11.133351", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-03-10 19:57:11.130814", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:57:10.875 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:10.905 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:10 +0000 (0:00:00.071) 0:02:12.805 ******* 2021-03-10T19:57:10.934 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:10.936 INFO:teuthology.task.ansible.out:TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [gibba044.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001855", "end": "2021-03-10 19:57:11.263919", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-03-10 19:57:11.262064", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:10.964 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:10 +0000 (0:00:00.058) 0:02:12.864 ******* 2021-03-10T19:57:10.992 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-03-10T19:57:10.993 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:10.994 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:11.022 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:11 +0000 (0:00:00.057) 0:02:12.922 ******* 2021-03-10T19:57:11.052 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-03-10T19:57:11.055 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001695", "end": "2021-03-10 19:57:11.377007", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-03-10 19:57:11.375312", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-03-10T19:57:11.188 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.020237", "end": "2021-03-10 19:57:11.505061", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-03-10 19:57:11.484824", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:57:11.218 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:11 +0000 (0:00:00.195) 0:02:13.117 ******* 2021-03-10T19:57:11.252 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.002454", "end": "2021-03-10 19:57:11.050118", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-03-10 19:57:11.047664", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:57:11.278 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-03-10T19:57:11.302 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:11 +0000 (0:00:00.085) 0:02:13.202 ******* 2021-03-10T19:57:11.405 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [gibba023.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001803", "end": "2021-03-10 19:57:11.220636", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-03-10 19:57:11.218833", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:57:11.479 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-03-10T19:57:11.481 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-03-10T19:57:11.639 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-03-10T19:57:11.641 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001647", "end": "2021-03-10 19:57:11.446252", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-03-10 19:57:11.444605", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-03-10T19:57:11.789 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.019089", "end": "2021-03-10 19:57:11.599179", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-03-10 19:57:11.580090", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:57:11.820 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:11 +0000 (0:00:00.517) 0:02:13.720 ******* 2021-03-10T19:57:11.849 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-03-10T19:57:11.877 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:11 +0000 (0:00:00.057) 0:02:13.777 ******* 2021-03-10T19:57:12.021 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-03-10T19:57:12.023 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-03-10T19:57:12.092 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-03-10T19:57:12.112 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:12 +0000 (0:00:00.234) 0:02:14.012 ******* 2021-03-10T19:57:12.133 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:12 +0000 (0:00:00.022) 0:02:14.034 ******* 2021-03-10T19:57:12.976 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba023.front.sepia.ceph.com] 2021-03-10T19:57:13.018 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] 2021-03-10T19:57:13.052 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:13 +0000 (0:00:00.919) 0:02:14.953 ******* 2021-03-10T19:57:13.098 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:13 +0000 (0:00:00.045) 0:02:14.999 ******* 2021-03-10T19:57:13.105 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T19:57:13.107 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-03-10T19:57:13.133 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:13 +0000 (0:00:00.034) 0:02:15.033 ******* 2021-03-10T19:57:13.144 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-03-10T19:57:13.146 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:13.175 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:13 +0000 (0:00:00.042) 0:02:15.075 ******* 2021-03-10T19:57:13.176 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:13.183 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:13.185 INFO:teuthology.task.ansible.out:TASK [container-host : set_fact] *********************************************** skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:13.216 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:13 +0000 (0:00:00.041) 0:02:15.117 ******* 2021-03-10T19:57:13.224 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:13.250 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:13 +0000 (0:00:00.033) 0:02:15.151 ******* 2021-03-10T19:57:13.258 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-03-10T19:57:13.260 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-03-10T19:57:13.288 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:13 +0000 (0:00:00.038) 0:02:15.189 ******* 2021-03-10T19:57:13.312 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-03-10T19:57:13.340 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:13 +0000 (0:00:00.051) 0:02:15.240 ******* 2021-03-10T19:57:13.794 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-03-10T19:57:13.796 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"cache_update_time": 1615406086, "cache_updated": false, "changed": false} 2021-03-10T19:57:13.821 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:13 +0000 (0:00:00.481) 0:02:15.722 ******* 2021-03-10T19:57:13.823 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:13.831 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"cache_update_time": 1615406091, "cache_updated": false, "changed": false} 2021-03-10T19:57:13.833 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:13.860 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:13 +0000 (0:00:00.038) 0:02:15.760 ******* 2021-03-10T19:57:13.866 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T19:57:13.868 INFO:teuthology.task.ansible.out:skipping: [gibba023.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:13.897 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:13 +0000 (0:00:00.036) 0:02:15.797 ******* 2021-03-10T19:57:13.905 INFO:teuthology.task.ansible.out:skipping: [gibba044.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-03-10T19:57:13.932 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:13 +0000 (0:00:00.035) 0:02:15.832 ******* 2021-03-10T19:57:13.937 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-03-10T19:57:13.939 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-03-10T19:57:13.965 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:13 +0000 (0:00:00.033) 0:02:15.865 ******* 2021-03-10T19:57:13.974 INFO:teuthology.task.ansible.out:ok: [gibba044.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-03-10T19:57:14.003 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:14 +0000 (0:00:00.038) 0:02:15.904 ******* 2021-03-10T19:57:14.136 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-03-10T19:57:14.138 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T19:57:14.169 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T19:57:14.244 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T19:57:14.276 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:14 +0000 (0:00:00.272) 0:02:16.176 ******* 2021-03-10T19:57:14.285 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-03-10T19:57:14.316 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:14 +0000 (0:00:00.040) 0:02:16.216 ******* 2021-03-10T19:57:14.318 INFO:teuthology.task.ansible.out: 2021-03-10T19:57:14.640 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-03-10T19:57:14.642 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615406234.3352401-14931-10909139558253/source", "state": "file", "uid": 0} 2021-03-10T19:57:14.705 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615406234.3898988-14937-147177848144161/source", "state": "file", "uid": 0} 2021-03-10T19:57:14.969 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615406234.6704502-14931-26383555497612/source", "state": "file", "uid": 0} 2021-03-10T19:57:15.002 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:14 +0000 (0:00:00.685) 0:02:16.903 ******* 2021-03-10T19:57:15.022 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615406234.7220502-14937-274115493526208/source", "state": "file", "uid": 0} 2021-03-10T19:57:15.048 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:15 +0000 (0:00:00.046) 0:02:16.949 ******* 2021-03-10T19:57:18.230 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** changed: [gibba023.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-z3tcx5js\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-z3tcx5js"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-z3tcx5js\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=7b5407cfd3d2ada3157a1e835bd2af8dcd5ab121e42fd558c226cd3bc099ad23\n Stored in directory: /tmp/pip-ephem-wheel-cache-w93ypk_s/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=bbb0bfd2c39e13609d6fbbe498c2c597c241e7a1783b26c9334a1924cc9d105d\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 regis 2021-03-10T19:57:18.232 INFO:teuthology.task.ansible.out:tries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-z3tcx5js", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=7b5407cfd3d2ada3157a1e835bd2af8dcd5ab121e42fd558c226cd3bc099ad23", " Stored in directory: /tmp/pip-ephem-wheel-cache-w93ypk_s/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=bbb0bfd2c39e13609d6fbbe498c2c597c241e7a1783b26c9334a1924cc9d105d", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-03-10T19:57:18.257 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:18 +0000 (0:00:03.208) 0:02:20.158 ******* 2021-03-10T19:57:18.390 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-03-10T19:57:18.392 INFO:teuthology.task.ansible.out:ok: [gibba023.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-03-10T19:57:18.417 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:18 +0000 (0:00:00.159) 0:02:20.317 ******* 2021-03-10T19:57:18.427 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-03-10T19:57:18.428 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-vyu1ai_p\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-vyu1ai_p"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-vyu1ai_p\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=7a35c3c375f42cfe7ba7eb329e27c32261a87073235c50b5010e550db3c85014\n Stored in directory: /tmp/pip-ephem-wheel-cache-luoiy9gd/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=b33a93d9bc9893068236d33140c9230392d9509f81d7cc2330ffeacd8da6be78\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.c 2021-03-10T19:57:18.430 INFO:teuthology.task.ansible.out:om/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-vyu1ai_p", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=7a35c3c375f42cfe7ba7eb329e27c32261a87073235c50b5010e550db3c85014", " Stored in directory: /tmp/pip-ephem-wheel-cache-luoiy9gd/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=b33a93d9bc9893068236d33140c9230392d9509f81d7cc2330ffeacd8da6be78", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-03-10T19:57:18.458 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:18 +0000 (0:00:00.040) 0:02:20.358 ******* 2021-03-10T19:57:18.605 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* ok: [gibba044.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-03-10T19:57:18.629 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:18 +0000 (0:00:00.170) 0:02:20.529 ******* 2021-03-10T19:57:18.753 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ changed: [gibba023.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615406238.4742024-15589-220788634098188/source", "state": "file", "uid": 0} 2021-03-10T19:57:18.783 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:18 +0000 (0:00:00.153) 0:02:20.683 ******* 2021-03-10T19:57:18.938 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-03-10T19:57:18.940 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.018799", "end": "2021-03-10 19:57:18.763773", "rc": 0, "start": "2021-03-10 19:57:18.744974", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:57:18.962 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:18 +0000 (0:00:00.179) 0:02:20.863 ******* 2021-03-10T19:57:18.970 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-03-10T19:57:18.971 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1615406238.680809-15644-234632026444771/source", "state": "file", "uid": 0} 2021-03-10T19:57:18.998 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:18 +0000 (0:00:00.036) 0:02:20.899 ******* 2021-03-10T19:57:19.154 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-03-10T19:57:19.156 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.018738", "end": "2021-03-10 19:57:19.491307", "rc": 0, "start": "2021-03-10 19:57:19.472569", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-03-10T19:57:19.178 INFO:teuthology.task.ansible.out:Wednesday 10 March 2021 19:57:19 +0000 (0:00:00.179) 0:02:21.079 ******* 2021-03-10T19:57:22.778 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-03-10T19:57:22.779 INFO:teuthology.task.ansible.out:changed: [gibba023.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "system.slice network-online.target basic.target firewalld.service docker.socket containerd.service sysinit.target systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-fire 2021-03-10T19:57:22.780 INFO:teuthology.task.ansible.out:wall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", " 2021-03-10T19:57:22.782 INFO:teuthology.task.ansible.out:LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", 2021-03-10T19:57:22.783 INFO:teuthology.task.ansible.out:"RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target docker.socket", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 19:54:38 UTC", "StateChangeTimestampMonotonic": "36949042", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T19:57:23.350 INFO:teuthology.task.ansible.out:changed: [gibba044.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "firewalld.service basic.target docker.socket systemd-journald.socket containerd.service sysinit.target system.slice network-online.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-fire 2021-03-10T19:57:23.352 INFO:teuthology.task.ansible.out:wall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", " 2021-03-10T19:57:23.354 INFO:teuthology.task.ansible.out:LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127828", "LimitSIGPENDINGSoft": "127828", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", 2021-03-10T19:57:23.356 INFO:teuthology.task.ansible.out:"RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket system.slice sysinit.target", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-03-10 19:54:36 UTC", "StateChangeTimestampMonotonic": "35224294", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-03-10T19:57:23.427 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-03-10T19:57:23.428 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-03-10T19:57:23.430 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* gibba023.front.sepia.ceph.com : ok=129 changed=35 unreachable=0 failed=0 skipped=182 rescued=0 ignored=0 gibba044.front.sepia.ceph.com : ok=129 changed=35 unreachable=0 failed=0 skipped=182 rescued=0 ignored=0 Wednesday 10 March 2021 19:57:23 +0000 (0:00:04.251) 0:02:25.331 ******* =============================================================================== 2021-03-10T19:57:23.431 INFO:teuthology.task.ansible.out:users : Update authorized_keys using the keys repo --------------------- 15.21s Create all admin users with sudo access. ------------------------------- 14.10s testnode : Install packages --------------------------------------------- 9.74s testnode : Ensure packages are not present. ----------------------------- 9.13s testnode : Zap all non-root disks --------------------------------------- 6.07s Remove revoked users ---------------------------------------------------- 4.74s container-host : Restart docker service --------------------------------- 4.25s container-host : Install registries-conf-ctl ---------------------------- 3.21s Gathering Facts --------------------------------------------------------- 1.78s 2021-03-10T19:57:23.431 INFO:teuthology.task.ansible.out:testnode : Install apt keys --------------------------------------------- 1.63s common : Update apt cache ----------------------------------------------- 1.48s testnode : Update apt cache. -------------------------------------------- 1.47s users : Update authorized_keys for each user with literal keys ---------- 1.11s testnode : Install packages via pip ------------------------------------- 0.97s Gathering Facts --------------------------------------------------------- 0.92s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 0.84s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.80s ansib 2021-03-10T19:57:23.433 INFO:teuthology.task.ansible.out:le-managed : Add authorized keys for the ansible user. ------------- 0.77s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 0.77s Gathering Facts --------------------------------------------------------- 0.74s 2021-03-10T19:57:23.794 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@gibba023.front.sepia.ceph.com'), Remote(name='ubuntu@gibba044.front.sepia.ceph.com')] 2021-03-10T19:57:23.796 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-10T19:57:23.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba023.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-10T19:57:23.834 DEBUG:teuthology.orchestra.run.gibba023:> true 2021-03-10T19:57:23.922 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-03-10T19:57:23.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba044.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-03-10T19:57:23.957 DEBUG:teuthology.orchestra.run.gibba044:> true 2021-03-10T19:57:24.038 INFO:teuthology.run_tasks:Running task clock... 2021-03-10T19:57:24.049 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-03-10T19:57:24.049 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-03-10T19:57:24.051 DEBUG:teuthology.orchestra.run.gibba023:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-03-10T19:57:24.072 INFO:teuthology.orchestra.run.gibba023.stdout:10 Mar 19:57:23 ntpd[8654]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-03-10T19:57:24.072 INFO:teuthology.orchestra.run.gibba023.stdout:10 Mar 19:57:23 ntpd[8654]: Command line: ntpd -gq 2021-03-10T19:57:24.072 INFO:teuthology.orchestra.run.gibba023.stdout:10 Mar 19:57:23 ntpd[8654]: proto: precision = 0.034 usec (-25) 2021-03-10T19:57:24.073 INFO:teuthology.orchestra.run.gibba023.stdout:10 Mar 19:57:23 ntpd[8654]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-03-10T19:57:24.073 INFO:teuthology.orchestra.run.gibba023.stdout:10 Mar 19:57:23 ntpd[8654]: restrict ::: KOD does nothing without LIMITED. 2021-03-10T19:57:24.073 INFO:teuthology.orchestra.run.gibba023.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-03-10T19:57:24.074 INFO:teuthology.orchestra.run.gibba023.stderr:restrict ::: KOD does nothing without LIMITED. 2021-03-10T19:57:24.074 INFO:teuthology.orchestra.run.gibba023.stdout:10 Mar 19:57:23 ntpd[8654]: Listen and drop on 0 v6wildcard [::]:123 2021-03-10T19:57:24.075 INFO:teuthology.orchestra.run.gibba023.stdout:10 Mar 19:57:23 ntpd[8654]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-03-10T19:57:24.075 INFO:teuthology.orchestra.run.gibba023.stdout:10 Mar 19:57:23 ntpd[8654]: Listen normally on 2 lo 127.0.0.1:123 2021-03-10T19:57:24.075 INFO:teuthology.orchestra.run.gibba023.stdout:10 Mar 19:57:23 ntpd[8654]: Listen normally on 3 enp1s0f0 172.21.2.123:123 2021-03-10T19:57:24.075 INFO:teuthology.orchestra.run.gibba023.stdout:10 Mar 19:57:23 ntpd[8654]: Listen normally on 4 lo [::1]:123 2021-03-10T19:57:24.076 INFO:teuthology.orchestra.run.gibba023.stdout:10 Mar 19:57:23 ntpd[8654]: Listen normally on 5 enp1s0f0 [fe80::3eec:efff:fe3d:8bf6%4]:123 2021-03-10T19:57:24.076 INFO:teuthology.orchestra.run.gibba023.stdout:10 Mar 19:57:23 ntpd[8654]: Listening on routing socket on fd #22 for interface updates 2021-03-10T19:57:25.074 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:24 ntpd[8654]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:25.074 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:24 ntpd[8654]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:25.074 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:24 ntpd[8654]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:25.075 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:24 ntpd[8654]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:25.075 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:24 ntpd[8654]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:25.075 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:24 ntpd[8654]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:25.075 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:24 ntpd[8654]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:25.075 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:24 ntpd[8654]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:25.076 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:24 ntpd[8654]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T19:57:25.076 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:24 ntpd[8654]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T19:57:25.076 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:24 ntpd[8654]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:25.077 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:24 ntpd[8654]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:25.078 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:24 ntpd[8654]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T19:57:25.078 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:24 ntpd[8654]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T19:57:25.078 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:24 ntpd[8654]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:25.079 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:24 ntpd[8654]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:25.079 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:24 ntpd[8654]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T19:57:25.079 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:24 ntpd[8654]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T19:57:26.073 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:25 ntpd[8654]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:26.073 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:25 ntpd[8654]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:26.073 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:25 ntpd[8654]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:26.073 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:25 ntpd[8654]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:26.074 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:25 ntpd[8654]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T19:57:26.074 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:25 ntpd[8654]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T19:57:27.073 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:26 ntpd[8654]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:27.074 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:26 ntpd[8654]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:27.074 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:26 ntpd[8654]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:27.074 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:26 ntpd[8654]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:27.075 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:26 ntpd[8654]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:27.075 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:26 ntpd[8654]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:27.075 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:26 ntpd[8654]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:27.075 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:26 ntpd[8654]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:27.076 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:26 ntpd[8654]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T19:57:27.076 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:26 ntpd[8654]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T19:57:27.076 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:26 ntpd[8654]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:27.077 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:26 ntpd[8654]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:27.077 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:26 ntpd[8654]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T19:57:27.077 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:26 ntpd[8654]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T19:57:27.077 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:26 ntpd[8654]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:27.078 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:26 ntpd[8654]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:27.078 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:26 ntpd[8654]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T19:57:27.078 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:26 ntpd[8654]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T19:57:28.073 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:27 ntpd[8654]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:28.073 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:27 ntpd[8654]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:28.073 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:27 ntpd[8654]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:28.073 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:27 ntpd[8654]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:28.074 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:27 ntpd[8654]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T19:57:28.074 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:27 ntpd[8654]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T19:57:29.074 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:28 ntpd[8654]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:29.074 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:28 ntpd[8654]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:29.074 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:28 ntpd[8654]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:29.075 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:28 ntpd[8654]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:29.075 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:28 ntpd[8654]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:29.075 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:28 ntpd[8654]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:29.075 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:28 ntpd[8654]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:29.076 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:28 ntpd[8654]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:29.076 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:28 ntpd[8654]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T19:57:29.076 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:28 ntpd[8654]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T19:57:29.076 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:28 ntpd[8654]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:29.076 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:28 ntpd[8654]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:29.077 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:28 ntpd[8654]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T19:57:29.077 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:28 ntpd[8654]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T19:57:29.077 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:28 ntpd[8654]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:29.077 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:28 ntpd[8654]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:29.078 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:28 ntpd[8654]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T19:57:29.078 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:28 ntpd[8654]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T19:57:30.073 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:29 ntpd[8654]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:30.073 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:29 ntpd[8654]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:30.073 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:29 ntpd[8654]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:30.074 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:29 ntpd[8654]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:30.074 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:29 ntpd[8654]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T19:57:30.074 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:29 ntpd[8654]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T19:57:31.074 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:30 ntpd[8654]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:31.075 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:30 ntpd[8654]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:31.075 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:30 ntpd[8654]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:31.076 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:30 ntpd[8654]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:31.076 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:30 ntpd[8654]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:31.077 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:30 ntpd[8654]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:31.078 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:30 ntpd[8654]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:31.079 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:30 ntpd[8654]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:31.079 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:30 ntpd[8654]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T19:57:31.080 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:30 ntpd[8654]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T19:57:31.080 INFO:teuthology.orchestra.run.gibba023.stdout:10 Mar 19:57:31 ntpd[8654]: ntpd: time set +0.154258 s 2021-03-10T19:57:31.081 INFO:teuthology.orchestra.run.gibba023.stdout:ntpd: time set +0.154258s 2021-03-10T19:57:31.082 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:31 ntpd[8654]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-03-10T19:57:31.082 INFO:teuthology.orchestra.run.gibba023.stderr:10 Mar 19:57:31 ntpd[8654]: can't open /var/log/ntpstats/loopstats.20210310: Permission denied 2021-03-10T19:57:31.104 INFO:teuthology.orchestra.run.gibba023.stdout: remote refid st t when poll reach delay offset jitter 2021-03-10T19:57:31.105 INFO:teuthology.orchestra.run.gibba023.stdout:============================================================================== 2021-03-10T19:57:31.105 INFO:teuthology.orchestra.run.gibba023.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T19:57:31.105 INFO:teuthology.orchestra.run.gibba023.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T19:57:31.105 INFO:teuthology.orchestra.run.gibba023.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T19:57:31.106 INFO:teuthology.orchestra.run.gibba023.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T19:57:31.106 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-03-10T19:57:31.106 DEBUG:teuthology.orchestra.run.gibba044:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-03-10T19:57:31.126 INFO:teuthology.orchestra.run.gibba044.stdout:10 Mar 19:57:31 ntpd[8729]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-03-10T19:57:31.127 INFO:teuthology.orchestra.run.gibba044.stdout:10 Mar 19:57:31 ntpd[8729]: Command line: ntpd -gq 2021-03-10T19:57:31.127 INFO:teuthology.orchestra.run.gibba044.stdout:10 Mar 19:57:31 ntpd[8729]: proto: precision = 0.034 usec (-25) 2021-03-10T19:57:31.127 INFO:teuthology.orchestra.run.gibba044.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-03-10T19:57:31.128 INFO:teuthology.orchestra.run.gibba044.stdout:10 Mar 19:57:31 ntpd[8729]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-03-10T19:57:31.128 INFO:teuthology.orchestra.run.gibba044.stderr:restrict ::: KOD does nothing without LIMITED. 2021-03-10T19:57:31.129 INFO:teuthology.orchestra.run.gibba044.stdout:10 Mar 19:57:31 ntpd[8729]: restrict ::: KOD does nothing without LIMITED. 2021-03-10T19:57:31.130 INFO:teuthology.orchestra.run.gibba044.stdout:10 Mar 19:57:31 ntpd[8729]: Listen and drop on 0 v6wildcard [::]:123 2021-03-10T19:57:31.130 INFO:teuthology.orchestra.run.gibba044.stdout:10 Mar 19:57:31 ntpd[8729]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-03-10T19:57:31.130 INFO:teuthology.orchestra.run.gibba044.stdout:10 Mar 19:57:31 ntpd[8729]: Listen normally on 2 lo 127.0.0.1:123 2021-03-10T19:57:31.130 INFO:teuthology.orchestra.run.gibba044.stdout:10 Mar 19:57:31 ntpd[8729]: Listen normally on 3 enp1s0f0 172.21.2.144:123 2021-03-10T19:57:31.131 INFO:teuthology.orchestra.run.gibba044.stdout:10 Mar 19:57:31 ntpd[8729]: Listen normally on 4 lo [::1]:123 2021-03-10T19:57:31.131 INFO:teuthology.orchestra.run.gibba044.stdout:10 Mar 19:57:31 ntpd[8729]: Listen normally on 5 enp1s0f0 [fe80::3eec:efff:fe3d:9198%4]:123 2021-03-10T19:57:31.131 INFO:teuthology.orchestra.run.gibba044.stdout:10 Mar 19:57:31 ntpd[8729]: Listening on routing socket on fd #22 for interface updates 2021-03-10T19:57:32.127 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:32 ntpd[8729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:32.128 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:32 ntpd[8729]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:32.128 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:32 ntpd[8729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:32.128 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:32 ntpd[8729]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:32.129 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:32 ntpd[8729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:32.130 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:32 ntpd[8729]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:32.130 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:32 ntpd[8729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T19:57:32.130 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:32 ntpd[8729]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T19:57:32.130 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:32 ntpd[8729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:32.132 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:32 ntpd[8729]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:32.133 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:32 ntpd[8729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T19:57:32.133 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:32 ntpd[8729]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T19:57:34.128 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:34 ntpd[8729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:34.129 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:34 ntpd[8729]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:34.129 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:34 ntpd[8729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:34.129 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:34 ntpd[8729]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:34.129 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:34 ntpd[8729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:34.130 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:34 ntpd[8729]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:34.130 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:34 ntpd[8729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T19:57:34.130 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:34 ntpd[8729]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T19:57:34.130 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:34 ntpd[8729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:34.131 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:34 ntpd[8729]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:34.131 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:34 ntpd[8729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T19:57:34.131 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:34 ntpd[8729]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T19:57:35.130 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:35 ntpd[8729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:35.131 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:35 ntpd[8729]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:35.131 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:35 ntpd[8729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:35.131 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:35 ntpd[8729]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:35.131 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:35 ntpd[8729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T19:57:35.132 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:35 ntpd[8729]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T19:57:36.128 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:36 ntpd[8729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:36.129 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:36 ntpd[8729]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:36.129 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:36 ntpd[8729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:36.129 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:36 ntpd[8729]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:36.129 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:36 ntpd[8729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:36.130 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:36 ntpd[8729]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:36.130 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:36 ntpd[8729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:36.130 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:36 ntpd[8729]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:36.130 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:36 ntpd[8729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T19:57:36.131 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:36 ntpd[8729]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T19:57:36.131 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:36 ntpd[8729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:36.131 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:36 ntpd[8729]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:36.132 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:36 ntpd[8729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T19:57:36.132 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:36 ntpd[8729]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T19:57:36.132 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:36 ntpd[8729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:36.132 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:36 ntpd[8729]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:36.133 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:36 ntpd[8729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T19:57:36.133 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:36 ntpd[8729]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T19:57:37.127 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:37 ntpd[8729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:37.128 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:37 ntpd[8729]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:37.128 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:37 ntpd[8729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:37.128 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:37 ntpd[8729]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:37.128 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:37 ntpd[8729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T19:57:37.129 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:37 ntpd[8729]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T19:57:38.128 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:38 ntpd[8729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:38.128 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:38 ntpd[8729]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:38.128 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:38 ntpd[8729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:38.128 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:38 ntpd[8729]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:38.129 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:38 ntpd[8729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:38.129 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:38 ntpd[8729]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:38.129 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:38 ntpd[8729]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-03-10T19:57:38.129 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:38 ntpd[8729]: can't open /var/log/ntpstats/rawstats.20210310: Permission denied 2021-03-10T19:57:38.130 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:38 ntpd[8729]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-03-10T19:57:38.130 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:38 ntpd[8729]: can't open /var/log/ntpstats/peerstats.20210310: Permission denied 2021-03-10T19:57:38.130 INFO:teuthology.orchestra.run.gibba044.stdout:10 Mar 19:57:38 ntpd[8729]: ntpd: time set -0.355783 s 2021-03-10T19:57:38.131 INFO:teuthology.orchestra.run.gibba044.stdout:ntpd: time set -0.355783s 2021-03-10T19:57:38.132 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:38 ntpd[8729]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-03-10T19:57:38.132 INFO:teuthology.orchestra.run.gibba044.stderr:10 Mar 19:57:38 ntpd[8729]: can't open /var/log/ntpstats/loopstats.20210310: Permission denied 2021-03-10T19:57:38.216 INFO:teuthology.orchestra.run.gibba044.stdout: remote refid st t when poll reach delay offset jitter 2021-03-10T19:57:38.216 INFO:teuthology.orchestra.run.gibba044.stdout:============================================================================== 2021-03-10T19:57:38.217 INFO:teuthology.orchestra.run.gibba044.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T19:57:38.217 INFO:teuthology.orchestra.run.gibba044.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T19:57:38.217 INFO:teuthology.orchestra.run.gibba044.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T19:57:38.217 INFO:teuthology.orchestra.run.gibba044.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-03-10T19:57:38.219 INFO:teuthology.run_tasks:Running task cephadm... 2021-03-10T19:57:38.298 INFO:tasks.cephadm:Config: {'allow_ptrace': False, 'cephadm_branch': 'v15.2.0', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'image': 'docker.io/ceph/ceph:v15.2.0', 'conf': {'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 1, 'debug osd': 25, 'osd shutdown pgref assert': True}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b26fc080937a021ce826cdc94d1adb52c064381a'} 2021-03-10T19:57:38.298 INFO:tasks.cephadm:Cluster image is docker.io/ceph/ceph:v15.2.0 2021-03-10T19:57:38.299 INFO:tasks.cephadm:Cluster fsid is dd719b26-81da-11eb-9080-001a4aab830c 2021-03-10T19:57:38.300 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2021-03-10T19:57:38.300 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.2.123', 'mon.c': '[v2:172.21.2.123:3301,v1:172.21.2.123:6790]', 'mon.b': '172.21.2.144'} 2021-03-10T19:57:38.300 INFO:tasks.cephadm:First mon is mon.a on gibba023 2021-03-10T19:57:38.301 INFO:tasks.cephadm:First mgr is y 2021-03-10T19:57:38.301 INFO:tasks.cephadm:Normalizing hostnames... 2021-03-10T19:57:38.302 DEBUG:teuthology.orchestra.run.gibba023:> sudo hostname $(hostname -s) 2021-03-10T19:57:38.319 DEBUG:teuthology.orchestra.run.gibba044:> sudo hostname $(hostname -s) 2021-03-10T19:57:38.333 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref v15.2.0)... 2021-03-10T19:57:38.334 DEBUG:teuthology.orchestra.run.gibba023:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v15.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2021-03-10T19:57:38.416 INFO:teuthology.orchestra.run.gibba023.stdout:-rw-rw-r-- 1 ubuntu ubuntu 151122 Mar 10 19:57 /home/ubuntu/cephtest/cephadm 2021-03-10T19:57:38.417 DEBUG:teuthology.orchestra.run.gibba044:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v15.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2021-03-10T19:57:38.677 INFO:teuthology.orchestra.run.gibba044.stdout:-rw-rw-r-- 1 ubuntu ubuntu 151122 Mar 10 19:57 /home/ubuntu/cephtest/cephadm 2021-03-10T19:57:38.677 DEBUG:teuthology.orchestra.run.gibba023:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2021-03-10T19:57:38.692 DEBUG:teuthology.orchestra.run.gibba044:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2021-03-10T19:57:38.715 DEBUG:teuthology.orchestra.run.gibba023:> sudo mkdir -p /etc/ceph 2021-03-10T19:57:38.739 DEBUG:teuthology.orchestra.run.gibba044:> sudo mkdir -p /etc/ceph 2021-03-10T19:57:38.756 DEBUG:teuthology.orchestra.run.gibba023:> sudo chmod 777 /etc/ceph 2021-03-10T19:57:38.802 DEBUG:teuthology.orchestra.run.gibba044:> sudo chmod 777 /etc/ceph 2021-03-10T19:57:38.811 INFO:tasks.cephadm:Writing seed config... 2021-03-10T19:57:38.812 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2021-03-10T19:57:38.813 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2021-03-10T19:57:38.813 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2021-03-10T19:57:38.813 INFO:tasks.cephadm: override: [mon] debug mon = 20 2021-03-10T19:57:38.814 INFO:tasks.cephadm: override: [mon] debug ms = 1 2021-03-10T19:57:38.814 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2021-03-10T19:57:38.814 INFO:tasks.cephadm: override: [osd] debug filestore = 20 2021-03-10T19:57:38.815 INFO:tasks.cephadm: override: [osd] debug journal = 20 2021-03-10T19:57:38.815 INFO:tasks.cephadm: override: [osd] debug ms = 1 2021-03-10T19:57:38.815 INFO:tasks.cephadm: override: [osd] debug osd = 25 2021-03-10T19:57:38.816 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2021-03-10T19:57:38.816 DEBUG:teuthology.orchestra.run.gibba023:> set -ex 2021-03-10T19:57:38.817 DEBUG:teuthology.orchestra.run.gibba023:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2021-03-10T19:57:38.828 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = dd719b26-81da-11eb-9080-001a4aab830c mon election default strategy = 1 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug filestore = 20 debug journal = 20 debug ms = 1 debug osd = 25 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2021-03-10T19:57:38.829 DEBUG:teuthology.orchestra.run.gibba023:mon.a> sudo journalctl -f -n 0 -u ceph-dd719b26-81da-11eb-9080-001a4aab830c@mon.a.service 2021-03-10T19:57:38.832 DEBUG:teuthology.orchestra.run.gibba023:mgr.y> sudo journalctl -f -n 0 -u ceph-dd719b26-81da-11eb-9080-001a4aab830c@mgr.y.service 2021-03-10T19:57:38.865 INFO:journalctl@ceph.mon.a.gibba023.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T19:57:38.866 INFO:tasks.cephadm:Bootstrapping... 2021-03-10T19:57:38.866 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 -v bootstrap --fsid dd719b26-81da-11eb-9080-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.2.123 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2021-03-10T19:57:38.891 INFO:journalctl@ceph.mgr.y.gibba023.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T19:57:38.958 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Could not locate podman: podman not found 2021-03-10T19:57:38.958 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Verifying podman|docker is present... 2021-03-10T19:57:38.958 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Verifying lvm2 is present... 2021-03-10T19:57:38.959 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Verifying time synchronization is in place... 2021-03-10T19:57:38.959 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chrony.service 2021-03-10T19:57:38.959 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chrony.service: No such file or directory 2021-03-10T19:57:38.960 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl is-active chrony.service 2021-03-10T19:57:38.961 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T19:57:38.962 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chronyd.service 2021-03-10T19:57:38.963 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chronyd.service: No such file or directory 2021-03-10T19:57:38.963 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl is-active chronyd.service 2021-03-10T19:57:38.965 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T19:57:38.965 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl is-enabled systemd-timesyncd.service 2021-03-10T19:57:38.967 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:systemctl:stdout masked 2021-03-10T19:57:38.967 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl is-active systemd-timesyncd.service 2021-03-10T19:57:38.968 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T19:57:38.969 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl is-enabled ntpd.service 2021-03-10T19:57:38.970 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for ntpd.service: No such file or directory 2021-03-10T19:57:38.971 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl is-active ntpd.service 2021-03-10T19:57:38.972 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T19:57:38.972 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl is-enabled ntp.service 2021-03-10T19:57:38.974 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:systemctl:stdout enabled 2021-03-10T19:57:38.974 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl is-active ntp.service 2021-03-10T19:57:38.977 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:systemctl:stdout active 2021-03-10T19:57:38.977 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Unit ntp.service is enabled and running 2021-03-10T19:57:38.978 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Repeating the final host check... 2021-03-10T19:57:38.979 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:podman|docker (/usr/bin/docker) is present 2021-03-10T19:57:38.979 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:systemctl is present 2021-03-10T19:57:38.993 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:lvcreate is present 2021-03-10T19:57:38.993 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chrony.service 2021-03-10T19:57:39.000 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chrony.service: No such file or directory 2021-03-10T19:57:39.000 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl is-active chrony.service 2021-03-10T19:57:39.001 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T19:57:39.001 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chronyd.service 2021-03-10T19:57:39.001 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chronyd.service: No such file or directory 2021-03-10T19:57:39.001 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl is-active chronyd.service 2021-03-10T19:57:39.002 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T19:57:39.002 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl is-enabled systemd-timesyncd.service 2021-03-10T19:57:39.002 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:systemctl:stdout masked 2021-03-10T19:57:39.002 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl is-active systemd-timesyncd.service 2021-03-10T19:57:39.003 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T19:57:39.003 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl is-enabled ntpd.service 2021-03-10T19:57:39.003 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for ntpd.service: No such file or directory 2021-03-10T19:57:39.003 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl is-active ntpd.service 2021-03-10T19:57:39.004 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:systemctl:stdout inactive 2021-03-10T19:57:39.004 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl is-enabled ntp.service 2021-03-10T19:57:39.004 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:systemctl:stdout enabled 2021-03-10T19:57:39.004 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl is-active ntp.service 2021-03-10T19:57:39.005 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:systemctl:stdout active 2021-03-10T19:57:39.005 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Unit ntp.service is enabled and running 2021-03-10T19:57:39.006 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Host looks OK 2021-03-10T19:57:39.006 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:root:Cluster fsid: dd719b26-81da-11eb-9080-001a4aab830c 2021-03-10T19:57:39.007 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Acquiring lock 140415154057568 on /run/cephadm/dd719b26-81da-11eb-9080-001a4aab830c.lock 2021-03-10T19:57:39.007 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Lock 140415154057568 acquired on /run/cephadm/dd719b26-81da-11eb-9080-001a4aab830c.lock 2021-03-10T19:57:39.007 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Verifying IP 172.21.2.123 port 3300 ... 2021-03-10T19:57:39.008 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Verifying IP 172.21.2.123 port 6789 ... 2021-03-10T19:57:39.008 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Base mon IP is 172.21.2.123, final addrv is [v2:172.21.2.123:3300,v1:172.21.2.123:6789] 2021-03-10T19:57:39.008 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: /usr/sbin/ip route ls 2021-03-10T19:57:39.009 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout default via 172.21.15.254 dev enp1s0f0 2021-03-10T19:57:39.009 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout default via 172.21.15.254 dev enp1s0f0 proto dhcp src 172.21.2.123 metric 100 2021-03-10T19:57:39.010 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2021-03-10T19:57:39.010 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout 172.21.0.0/20 dev enp1s0f0 proto kernel scope link src 172.21.2.123 2021-03-10T19:57:39.010 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/sbin/ip:stdout 172.21.15.254 dev enp1s0f0 proto dhcp scope link src 172.21.2.123 metric 100 2021-03-10T19:57:39.011 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Mon IP 172.21.2.123 is in CIDR network 172.21.0.0/20 2021-03-10T19:57:39.011 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Pulling latest docker.io/ceph/ceph:v15.2.0 container... 2021-03-10T19:57:39.011 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: /usr/bin/docker pull docker.io/ceph/ceph:v15.2.0 2021-03-10T19:57:40.072 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/docker:stdout v15.2.0: Pulling from ceph/ceph 2021-03-10T19:57:40.094 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 8a29a15cefae: Pulling fs layer 2021-03-10T19:57:40.095 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 120f0bd0d532: Pulling fs layer 2021-03-10T19:57:40.453 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 8a29a15cefae: Verifying Checksum 2021-03-10T19:57:40.454 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 8a29a15cefae: Download complete 2021-03-10T19:57:41.071 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 120f0bd0d532: Verifying Checksum 2021-03-10T19:57:41.071 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 120f0bd0d532: Download complete 2021-03-10T19:57:41.812 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 8a29a15cefae: Pull complete 2021-03-10T19:57:45.723 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/docker:stdout 120f0bd0d532: Pull complete 2021-03-10T19:57:45.798 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/docker:stdout Digest: sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60 2021-03-10T19:57:45.849 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/docker:stdout Status: Downloaded newer image for ceph/ceph:v15.2.0 2021-03-10T19:57:45.850 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/docker:stdout docker.io/ceph/ceph:v15.2.0 2021-03-10T19:57:45.856 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Extracting ceph user uid/gid from container image... 2021-03-10T19:57:45.857 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba023', '--entrypoint', 'stat', 'docker.io/ceph/ceph:v15.2.0', '-c', '%u %g', '/var/lib/ceph'] 2021-03-10T19:57:45.857 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba023 --entrypoint stat docker.io/ceph/ceph:v15.2.0 -c %u %g /var/lib/ceph 2021-03-10T19:57:54.896 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:stat:stdout 167 167 2021-03-10T19:57:55.531 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Creating initial keys... 2021-03-10T19:57:55.531 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba023', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2021-03-10T19:57:55.531 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba023 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2021-03-10T19:57:56.304 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQDEJElgJbMeEhAAKLlDhQNIbF5hYonV5UA76w== 2021-03-10T19:57:56.802 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba023', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2021-03-10T19:57:56.802 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba023 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2021-03-10T19:57:57.619 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQDFJElgag3nJBAAFEo2W8vzNxUX17O3zJcfyQ== 2021-03-10T19:57:58.221 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba023', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2021-03-10T19:57:58.227 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba023 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2021-03-10T19:57:58.994 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQDGJElg49VAOxAArR3FlmSHyBaSMumVUnIRpQ== 2021-03-10T19:57:59.560 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Creating initial monmap... 2021-03-10T19:57:59.560 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba023', '-v', '/tmp/ceph-tmpgq54umh2:/tmp/monmap:z', '--entrypoint', '/usr/bin/monmaptool', 'docker.io/ceph/ceph:v15.2.0', '--create', '--clobber', '--fsid', 'dd719b26-81da-11eb-9080-001a4aab830c', '--addv', 'a', '[v2:172.21.2.123:3300,v1:172.21.2.123:6789]', '/tmp/monmap'] 2021-03-10T19:57:59.561 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba023 -v /tmp/ceph-tmpgq54umh2:/tmp/monmap:z --entrypoint /usr/bin/monmaptool docker.io/ceph/ceph:v15.2.0 --create --clobber --fsid dd719b26-81da-11eb-9080-001a4aab830c --addv a [v2:172.21.2.123:3300,v1:172.21.2.123:6789] /tmp/monmap 2021-03-10T19:58:00.339 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2021-03-10T19:58:00.339 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: set fsid to dd719b26-81da-11eb-9080-001a4aab830c 2021-03-10T19:58:00.340 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2021-03-10T19:58:00.929 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Creating mon... 2021-03-10T19:58:00.930 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba023', '-v', '/var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/var/lib/ceph/dd719b26-81da-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z', '-v', '/tmp/ceph-tmphq7oegx_:/tmp/keyring:z', '-v', '/tmp/ceph-tmpgq54umh2:/tmp/monmap:z', '--entrypoint', '/usr/bin/ceph-mon', 'docker.io/ceph/ceph:v15.2.0', '--mkfs', '-i', 'a', '--fsid', 'dd719b26-81da-11eb-9080-001a4aab830c', '-c', '/dev/null', '--monmap', '/tmp/monmap', '--keyring', '/tmp/keyring', '--setuser', 'ceph', '--setgroup', 'ceph', '--default-log-to-file=false', '--default-log-to-stderr=true', '--default-log-stderr-prefix="debug "', '--default-mon-cluster-log-to-file=false', '--default-mon-cluster-log-to-stderr=true'] 2021-03-10T19:58:00.930 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba023 -v /var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z -v /var/lib/ceph/dd719b26-81da-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmphq7oegx_:/tmp/keyring:z -v /tmp/ceph-tmpgq54umh2:/tmp/monmap:z --entrypoint /usr/bin/ceph-mon docker.io/ceph/ceph:v15.2.0 --mkfs -i a --fsid dd719b26-81da-11eb-9080-001a4aab830c -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix="debug " --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2021-03-10T19:58:01.723 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T19:58:01.724 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 1 imported monmap: 2021-03-10T19:58:01.724 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr epoch 0 2021-03-10T19:58:01.725 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr fsid dd719b26-81da-11eb-9080-001a4aab830c 2021-03-10T19:58:01.725 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr last_changed 2021-03-10T19:58:00.338680+0000 2021-03-10T19:58:01.725 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr created 2021-03-10T19:58:00.338680+0000 2021-03-10T19:58:01.725 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr min_mon_release 0 (unknown) 2021-03-10T19:58:01.725 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 0: [v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0] mon.a 2021-03-10T19:58:01.726 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T19:58:01.726 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 0 /usr/bin/ceph-mon: set fsid to dd719b26-81da-11eb-9080-001a4aab830c 2021-03-10T19:58:01.726 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 0 set rocksdb option compression = kNoCompression 2021-03-10T19:58:01.726 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2021-03-10T19:58:01.727 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 0 set rocksdb option write_buffer_size = 33554432 2021-03-10T19:58:01.727 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 0 set rocksdb option compression = kNoCompression 2021-03-10T19:58:01.727 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2021-03-10T19:58:01.727 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 0 set rocksdb option write_buffer_size = 33554432 2021-03-10T19:58:01.727 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: RocksDB version: 6.1.2 2021-03-10T19:58:01.728 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T19:58:01.728 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T19:58:01.728 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Compile date Mar 23 2020 2021-03-10T19:58:01.728 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: DB SUMMARY 2021-03-10T19:58:01.729 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T19:58:01.729 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2021-03-10T19:58:01.729 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T19:58:01.729 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2021-03-10T19:58:01.729 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T19:58:01.730 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Options.error_if_exists: 0 2021-03-10T19:58:01.730 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Options.create_if_missing: 1 2021-03-10T19:58:01.730 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T19:58:01.730 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Options.env: 0x55e9550f31a0 2021-03-10T19:58:01.730 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Options.info_log: 0x55e95774ba80 2021-03-10T19:58:01.731 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T19:58:01.731 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Options.statistics: (nil) 2021-03-10T19:58:01.731 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Options.use_fsync: 0 2021-03-10T19:58:01.731 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T19:58:01.731 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T19:58:01.732 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T19:58:01.732 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T19:58:01.732 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T19:58:01.732 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T19:58:01.733 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T19:58:01.733 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T19:58:01.733 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T19:58:01.733 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T19:58:01.733 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T19:58:01.734 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Options.db_log_dir: 2021-03-10T19:58:01.734 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-03-10T19:58:01.734 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T19:58:01.734 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T19:58:01.734 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T19:58:01.735 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T19:58:01.735 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T19:58:01.735 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T19:58:01.735 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.693+0000 7fb673b656c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T19:58:01.735 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T19:58:01.736 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T19:58:01.736 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.write_buffer_manager: 0x55e9582ec120 2021-03-10T19:58:01.736 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T19:58:01.736 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T19:58:01.736 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T19:58:01.737 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T19:58:01.737 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T19:58:01.737 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T19:58:01.737 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T19:58:01.738 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T19:58:01.738 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T19:58:01.738 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T19:58:01.738 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T19:58:01.738 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T19:58:01.739 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T19:58:01.739 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.row_cache: None 2021-03-10T19:58:01.739 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.wal_filter: None 2021-03-10T19:58:01.739 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T19:58:01.739 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T19:58:01.740 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T19:58:01.740 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.two_write_queues: 0 2021-03-10T19:58:01.740 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T19:58:01.740 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.atomic_flush: 0 2021-03-10T19:58:01.740 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T19:58:01.741 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T19:58:01.741 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T19:58:01.741 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T19:58:01.741 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T19:58:01.741 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T19:58:01.742 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T19:58:01.742 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T19:58:01.742 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T19:58:01.742 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T19:58:01.743 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T19:58:01.743 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.max_open_files: -1 2021-03-10T19:58:01.743 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T19:58:01.743 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T19:58:01.743 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T19:58:01.744 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Compression algorithms supported: 2021-03-10T19:58:01.744 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T19:58:01.745 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: kZSTD supported: 0 2021-03-10T19:58:01.745 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: kXpressCompression supported: 0 2021-03-10T19:58:01.745 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T19:58:01.745 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T19:58:01.746 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T19:58:01.746 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: kZlibCompression supported: 1 2021-03-10T19:58:01.746 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T19:58:01.747 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T19:58:01.747 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: [db/db_impl_open.cc:228] Creating manifest 1 2021-03-10T19:58:01.747 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T19:58:01.747 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2021-03-10T19:58:01.747 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T19:58:01.748 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2021-03-10T19:58:01.748 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T19:58:01.748 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T19:58:01.748 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.merge_operator: 2021-03-10T19:58:01.748 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.compaction_filter: None 2021-03-10T19:58:01.749 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T19:58:01.749 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T19:58:01.749 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T19:58:01.749 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e957674130) 2021-03-10T19:58:01.749 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr cache_index_and_filter_blocks: 1 2021-03-10T19:58:01.750 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr cache_index_and_filter_blocks_with_high_priority: 1 2021-03-10T19:58:01.750 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T19:58:01.750 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr pin_top_level_index_and_filter: 1 2021-03-10T19:58:01.750 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr index_type: 0 2021-03-10T19:58:01.751 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr data_block_index_type: 0 2021-03-10T19:58:01.751 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr data_block_hash_table_util_ratio: 0.750000 2021-03-10T19:58:01.751 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr hash_index_allow_collision: 1 2021-03-10T19:58:01.751 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr checksum: 1 2021-03-10T19:58:01.751 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr no_block_cache: 0 2021-03-10T19:58:01.752 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache: 0x55e9576aa510 2021-03-10T19:58:01.752 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_name: BinnedLRUCache 2021-03-10T19:58:01.752 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_options: 2021-03-10T19:58:01.752 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr capacity : 536870912 2021-03-10T19:58:01.752 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr num_shard_bits : 4 2021-03-10T19:58:01.753 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr strict_capacity_limit : 0 2021-03-10T19:58:01.753 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr high_pri_pool_ratio: 0.000 2021-03-10T19:58:01.753 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_compressed: (nil) 2021-03-10T19:58:01.753 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr persistent_cache: (nil) 2021-03-10T19:58:01.753 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_size: 4096 2021-03-10T19:58:01.754 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_size_deviation: 10 2021-03-10T19:58:01.754 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_restart_interval: 16 2021-03-10T19:58:01.754 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr index_block_restart_interval: 1 2021-03-10T19:58:01.754 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr metadata_block_size: 4096 2021-03-10T19:58:01.754 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr partition_filters: 0 2021-03-10T19:58:01.755 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr use_delta_encoding: 1 2021-03-10T19:58:01.755 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T19:58:01.755 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr whole_key_filtering: 1 2021-03-10T19:58:01.755 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr verify_compression: 0 2021-03-10T19:58:01.755 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr read_amp_bytes_per_bit: 0 2021-03-10T19:58:01.756 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr format_version: 2 2021-03-10T19:58:01.756 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr enable_index_compression: 1 2021-03-10T19:58:01.756 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_align: 0 2021-03-10T19:58:01.756 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T19:58:01.757 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T19:58:01.757 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T19:58:01.757 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.compression: NoCompression 2021-03-10T19:58:01.757 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T19:58:01.757 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T19:58:01.758 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T19:58:01.758 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.num_levels: 7 2021-03-10T19:58:01.758 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T19:58:01.758 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T19:58:01.758 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T19:58:01.759 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T19:58:01.759 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T19:58:01.759 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T19:58:01.759 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T19:58:01.759 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T19:58:01.760 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T19:58:01.760 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T19:58:01.760 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T19:58:01.760 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T19:58:01.760 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T19:58:01.761 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T19:58:01.761 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T19:58:01.761 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T19:58:01.761 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T19:58:01.762 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T19:58:01.762 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T19:58:01.762 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T19:58:01.762 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T19:58:01.762 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T19:58:01.763 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T19:58:01.763 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T19:58:01.763 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T19:58:01.763 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T19:58:01.763 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T19:58:01.764 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T19:58:01.764 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T19:58:01.764 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T19:58:01.764 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T19:58:01.765 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T19:58:01.765 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T19:58:01.765 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T19:58:01.765 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T19:58:01.765 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T19:58:01.766 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T19:58:01.766 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T19:58:01.766 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T19:58:01.766 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T19:58:01.766 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T19:58:01.767 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T19:58:01.767 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T19:58:01.767 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T19:58:01.767 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T19:58:01.767 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T19:58:01.768 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.table_properties_collectors: 2021-03-10T19:58:01.768 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T19:58:01.768 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T19:58:01.768 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T19:58:01.768 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T19:58:01.769 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T19:58:01.769 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.bloom_locality: 0 2021-03-10T19:58:01.769 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T19:58:01.769 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T19:58:01.769 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T19:58:01.770 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T19:58:01.770 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T19:58:01.770 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: Options.ttl: 0 2021-03-10T19:58:01.770 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T19:58:01.771 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T19:58:01.771 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 0 2021-03-10T19:58:01.771 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T19:58:01.771 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb673b656c0 4 rocksdb: DB pointer 0x55e957746400 2021-03-10T19:58:01.771 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb65cd26700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2021-03-10T19:58:01.772 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.697+0000 7fb65cd26700 4 rocksdb: [db/db_impl.cc:778] 2021-03-10T19:58:01.772 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** DB Stats ** 2021-03-10T19:58:01.772 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T19:58:01.772 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T19:58:01.772 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T19:58:01.773 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T19:58:01.773 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T19:58:01.773 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T19:58:01.773 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T19:58:01.773 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T19:58:01.774 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2021-03-10T19:58:01.774 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T19:58:01.774 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T19:58:01.774 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T19:58:01.774 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T19:58:01.775 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T19:58:01.775 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2021-03-10T19:58:01.775 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T19:58:01.775 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T19:58:01.776 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T19:58:01.776 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Flush(GB): cumulative 0.000, interval 0.000 2021-03-10T19:58:01.776 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T19:58:01.776 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Total Files): cumulative 0, interval 0 2021-03-10T19:58:01.776 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T19:58:01.777 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Keys): cumulative 0, interval 0 2021-03-10T19:58:01.777 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T19:58:01.777 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T19:58:01.777 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T19:58:01.777 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T19:58:01.778 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** File Read Latency Histogram By Level [default] ** 2021-03-10T19:58:01.778 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T19:58:01.778 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2021-03-10T19:58:01.778 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T19:58:01.778 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T19:58:01.779 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T19:58:01.779 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T19:58:01.779 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T19:58:01.779 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2021-03-10T19:58:01.779 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T19:58:01.780 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T19:58:01.780 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T19:58:01.780 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Flush(GB): cumulative 0.000, interval 0.000 2021-03-10T19:58:01.780 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T19:58:01.781 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Total Files): cumulative 0, interval 0 2021-03-10T19:58:01.781 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T19:58:01.781 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Keys): cumulative 0, interval 0 2021-03-10T19:58:01.781 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T19:58:01.781 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T19:58:01.782 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T19:58:01.782 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T19:58:01.782 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** File Read Latency Histogram By Level [default] ** 2021-03-10T19:58:01.782 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2021-03-10T19:58:01.782 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.701+0000 7fb673b656c0 4 rocksdb: [db/db_impl.cc:390] Shutdown: canceling all background work 2021-03-10T19:58:01.783 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.701+0000 7fb673b656c0 4 rocksdb: [db/db_impl.cc:563] Shutdown complete 2021-03-10T19:58:01.783 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2021-03-10T19:58:01.701+0000 7fb673b656c0 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2021-03-10T19:58:02.253 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/dd719b26-81da-11eb-9080-001a4aab830c 2021-03-10T19:58:02.254 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl disable ceph.target 2021-03-10T19:58:02.376 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl enable ceph.target 2021-03-10T19:58:02.378 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2021-03-10T19:58:02.492 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl start ceph.target 2021-03-10T19:58:02.495 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-dd719b26-81da-11eb-9080-001a4aab830c.target 2021-03-10T19:58:02.497 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-dd719b26-81da-11eb-9080-001a4aab830c.target -> /etc/systemd/system/ceph-dd719b26-81da-11eb-9080-001a4aab830c.target. 2021-03-10T19:58:02.497 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-dd719b26-81da-11eb-9080-001a4aab830c.target -> /etc/systemd/system/ceph-dd719b26-81da-11eb-9080-001a4aab830c.target. 2021-03-10T19:58:02.617 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl start ceph-dd719b26-81da-11eb-9080-001a4aab830c.target 2021-03-10T19:58:02.620 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl daemon-reload 2021-03-10T19:58:02.739 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl stop ceph-dd719b26-81da-11eb-9080-001a4aab830c@mon.a 2021-03-10T19:58:02.745 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl reset-failed ceph-dd719b26-81da-11eb-9080-001a4aab830c@mon.a 2021-03-10T19:58:02.747 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:systemctl:stderr Failed to reset failed state of unit ceph-dd719b26-81da-11eb-9080-001a4aab830c@mon.a.service: Unit ceph-dd719b26-81da-11eb-9080-001a4aab830c@mon.a.service not loaded. 2021-03-10T19:58:02.747 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-dd719b26-81da-11eb-9080-001a4aab830c@mon.a 2021-03-10T19:58:02.749 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph-dd719b26-81da-11eb-9080-001a4aab830c.target.wants/ceph-dd719b26-81da-11eb-9080-001a4aab830c@mon.a.service -> /etc/systemd/system/ceph-dd719b26-81da-11eb-9080-001a4aab830c@.service. 2021-03-10T19:58:02.866 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl start ceph-dd719b26-81da-11eb-9080-001a4aab830c@mon.a 2021-03-10T19:58:02.892 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:firewalld does not appear to be present 2021-03-10T19:58:02.893 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Waiting for mon to start... 2021-03-10T19:58:02.893 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Waiting for mon... 2021-03-10T19:58:02.893 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba023 -v /var/lib/ceph/dd719b26-81da-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status 2021-03-10T19:58:03.085 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:02 gibba023 docker[9358]: Error: No such container: ceph-dd719b26-81da-11eb-9080-001a4aab830c-mon.a 2021-03-10T19:58:03.086 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:02 gibba023 systemd[1]: Started Ceph mon.a for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T19:58:04.093 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout cluster: 2021-03-10T19:58:04.093 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout id: dd719b26-81da-11eb-9080-001a4aab830c 2021-03-10T19:58:04.094 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout health: HEALTH_OK 2021-03-10T19:58:04.094 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T19:58:04.094 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout services: 2021-03-10T19:58:04.094 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon: 1 daemons, quorum a (age 0.121622s) 2021-03-10T19:58:04.095 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mgr: no daemons active 2021-03-10T19:58:04.095 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd: 0 osds: 0 up, 0 in 2021-03-10T19:58:04.095 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T19:58:04.095 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout data: 2021-03-10T19:58:04.096 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout pools: 0 pools, 0 pgs 2021-03-10T19:58:04.096 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout objects: 0 objects, 0 B 2021-03-10T19:58:04.096 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout usage: 0 B used, 0 B / 0 B avail 2021-03-10T19:58:04.096 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout pgs: 2021-03-10T19:58:04.096 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T19:58:04.133 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:03 gibba023 bash[9383]: cluster 2021-03-10T19:58:03.970981+0000 mon.a (mon.0) 0 : [INF] mkfs dd719b26-81da-11eb-9080-001a4aab830c 2021-03-10T19:58:04.133 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:03 gibba023 bash[9383]: cluster 2021-03-10T19:58:03.967267+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-03-10T19:58:04.702 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Assimilating anything we can from ceph.conf... 2021-03-10T19:58:04.702 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba023', '-v', '/var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z', '-v', '/var/lib/ceph/dd719b26-81da-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'assimilate-conf', '-i', '/var/lib/ceph/mon/ceph-a/config'] 2021-03-10T19:58:04.702 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba023 -v /var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z -v /var/lib/ceph/dd719b26-81da-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config assimilate-conf -i /var/lib/ceph/mon/ceph-a/config 2021-03-10T19:58:04.979 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:04 gibba023 bash[9383]: cluster 2021-03-10T19:58:03.970182+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-03-10T19:58:04.980 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:04 gibba023 bash[9383]: cluster 2021-03-10T19:58:03.970512+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0]} 2021-03-10T19:58:04.980 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:04 gibba023 bash[9383]: cluster 2021-03-10T19:58:03.972266+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-03-10T19:58:05.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:04 gibba023 bash[9383]: cluster 2021-03-10T19:58:03.974204+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2021-03-10T19:58:05.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:04 gibba023 bash[9383]: cluster 2021-03-10T19:58:03.974754+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2021-03-10T19:58:05.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:04 gibba023 bash[9383]: audit 2021-03-10T19:58:04.091785+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.2.123:0/1329446758' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2021-03-10T19:58:05.649 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T19:58:05.649 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [global] 2021-03-10T19:58:05.650 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout fsid = dd719b26-81da-11eb-9080-001a4aab830c 2021-03-10T19:58:05.650 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_election_default_strategy = 1 2021-03-10T19:58:05.650 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_host = [v2:172.21.2.123:3300,v1:172.21.2.123:6789] 2021-03-10T19:58:05.651 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_osd_allow_pg_remap = true 2021-03-10T19:58:05.651 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_osd_allow_primary_affinity = true 2021-03-10T19:58:05.652 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_warn_on_no_sortbitwise = false 2021-03-10T19:58:05.652 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_crush_chooseleaf_type = 0 2021-03-10T19:58:05.653 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T19:58:05.653 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [mgr] 2021-03-10T19:58:05.653 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mgr/telemetry/nag = false 2021-03-10T19:58:05.654 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T19:58:05.654 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [osd] 2021-03-10T19:58:05.655 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_map_max_advance = 10 2021-03-10T19:58:05.655 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_sloppy_crc = true 2021-03-10T19:58:06.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:05 gibba023 bash[9383]: audit 2021-03-10T19:58:05.639979+0000 mon.a (mon.0) 8 : audit [INF] from='client.? 172.21.2.123:0/2556341624' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2021-03-10T19:58:06.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:05 gibba023 bash[9383]: audit 2021-03-10T19:58:05.642190+0000 mon.a (mon.0) 9 : audit [INF] from='client.? 172.21.2.123:0/2556341624' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2021-03-10T19:58:06.228 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Generating new minimal ceph.conf... 2021-03-10T19:58:06.228 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba023', '-v', '/var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z', '-v', '/var/lib/ceph/dd719b26-81da-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'generate-minimal-conf', '-o', '/var/lib/ceph/mon/ceph-a/config'] 2021-03-10T19:58:06.229 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba023 -v /var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z -v /var/lib/ceph/dd719b26-81da-11eb-9080-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config generate-minimal-conf -o /var/lib/ceph/mon/ceph-a/config 2021-03-10T19:58:07.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:07 gibba023 bash[9383]: audit 2021-03-10T19:58:07.242923+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.2.123:0/1997610126' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T19:58:07.724 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Restarting the monitor... 2021-03-10T19:58:07.724 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl restart ceph-dd719b26-81da-11eb-9080-001a4aab830c@mon.a 2021-03-10T19:58:08.000 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:07 gibba023 systemd[1]: Stopping Ceph mon.a for dd719b26-81da-11eb-9080-001a4aab830c... 2021-03-10T19:58:08.000 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:07 gibba023 bash[9383]: debug 2021-03-10T19:58:07.797+0000 7fc4e8f68700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T19:58:08.000 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:07 gibba023 bash[9383]: debug 2021-03-10T19:58:07.797+0000 7fc4e8f68700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2021-03-10T19:58:08.543 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Setting mon public_network... 2021-03-10T19:58:08.544 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba023', '-v', '/var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'set', 'mon', 'public_network', '172.21.0.0/20'] 2021-03-10T19:58:08.544 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba023 -v /var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config set mon public_network 172.21.0.0/20 2021-03-10T19:58:08.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:08 gibba023 docker[9789]: ceph-dd719b26-81da-11eb-9080-001a4aab830c-mon.a 2021-03-10T19:58:08.934 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:08 gibba023 systemd[1]: ceph-dd719b26-81da-11eb-9080-001a4aab830c@mon.a.service: Succeeded. 2021-03-10T19:58:08.936 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:08 gibba023 systemd[1]: Stopped Ceph mon.a for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T19:58:08.936 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:08 gibba023 systemd[1]: Starting Ceph mon.a for dd719b26-81da-11eb-9080-001a4aab830c... 2021-03-10T19:58:08.937 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:08 gibba023 docker[9826]: Error: No such container: ceph-dd719b26-81da-11eb-9080-001a4aab830c-mon.a 2021-03-10T19:58:08.937 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:08 gibba023 systemd[1]: Started Ceph mon.a for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T19:58:09.792 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.565+0000 7f597d5346c0 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T19:58:09.792 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.565+0000 7f597d5346c0 0 ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc), process ceph-mon, pid 1 2021-03-10T19:58:09.792 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.565+0000 7f597d5346c0 0 pidfile_write: ignore empty --pid-file 2021-03-10T19:58:09.792 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 0 load: jerasure load: lrc load: isa 2021-03-10T19:58:09.793 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 0 set rocksdb option compression = kNoCompression 2021-03-10T19:58:09.793 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2021-03-10T19:58:09.793 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 0 set rocksdb option write_buffer_size = 33554432 2021-03-10T19:58:09.793 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 0 set rocksdb option compression = kNoCompression 2021-03-10T19:58:09.794 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2021-03-10T19:58:09.794 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 0 set rocksdb option write_buffer_size = 33554432 2021-03-10T19:58:09.794 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 1 rocksdb: do_open column families: [default] 2021-03-10T19:58:09.794 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: RocksDB version: 6.1.2 2021-03-10T19:58:09.794 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T19:58:09.795 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Compile date Mar 23 2020 2021-03-10T19:58:09.795 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: DB SUMMARY 2021-03-10T19:58:09.795 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: CURRENT file: CURRENT 2021-03-10T19:58:09.795 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: IDENTITY file: IDENTITY 2021-03-10T19:58:09.795 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 109 Bytes 2021-03-10T19:58:09.796 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000004.sst 2021-03-10T19:58:09.796 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000006.log size: 69025 ; 2021-03-10T19:58:09.796 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.error_if_exists: 0 2021-03-10T19:58:09.796 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.create_if_missing: 0 2021-03-10T19:58:09.797 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T19:58:09.797 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.env: 0x561e43e301a0 2021-03-10T19:58:09.797 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.info_log: 0x561e4553a9a0 2021-03-10T19:58:09.797 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T19:58:09.797 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.statistics: (nil) 2021-03-10T19:58:09.798 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.use_fsync: 0 2021-03-10T19:58:09.798 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T19:58:09.798 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T19:58:09.798 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T19:58:09.798 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T19:58:09.799 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T19:58:09.799 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T19:58:09.799 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T19:58:09.799 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T19:58:09.800 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T19:58:09.800 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T19:58:09.800 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T19:58:09.800 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.db_log_dir: 2021-03-10T19:58:09.800 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-03-10T19:58:09.801 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T19:58:09.801 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T19:58:09.801 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T19:58:09.801 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T19:58:09.801 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T19:58:09.802 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T19:58:09.802 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T19:58:09.802 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T19:58:09.802 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T19:58:09.803 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.write_buffer_manager: 0x561e460d4ae0 2021-03-10T19:58:09.803 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T19:58:09.803 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T19:58:09.803 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T19:58:09.803 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T19:58:09.804 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T19:58:09.804 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T19:58:09.804 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T19:58:09.804 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T19:58:09.805 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T19:58:09.805 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T19:58:09.805 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T19:58:09.805 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T19:58:09.806 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T19:58:09.806 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.row_cache: None 2021-03-10T19:58:09.806 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.wal_filter: None 2021-03-10T19:58:09.806 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T19:58:09.807 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T19:58:09.807 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T19:58:09.807 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.two_write_queues: 0 2021-03-10T19:58:09.807 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T19:58:09.807 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.atomic_flush: 0 2021-03-10T19:58:09.808 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T19:58:09.808 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T19:58:09.808 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T19:58:09.808 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T19:58:09.809 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T19:58:09.809 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T19:58:09.809 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T19:58:09.809 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T19:58:09.809 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T19:58:09.810 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T19:58:09.810 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T19:58:09.810 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.max_open_files: -1 2021-03-10T19:58:09.810 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T19:58:09.811 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T19:58:09.811 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T19:58:09.812 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Compression algorithms supported: 2021-03-10T19:58:09.812 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T19:58:09.812 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: kZSTD supported: 0 2021-03-10T19:58:09.812 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: kXpressCompression supported: 0 2021-03-10T19:58:09.813 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T19:58:09.813 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T19:58:09.813 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T19:58:09.814 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: kZlibCompression supported: 1 2021-03-10T19:58:09.814 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T19:58:09.814 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T19:58:09.814 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2021-03-10T19:58:09.814 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2021-03-10T19:58:09.815 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T19:58:09.815 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.merge_operator: 2021-03-10T19:58:09.815 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.compaction_filter: None 2021-03-10T19:58:09.815 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T19:58:09.816 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T19:58:09.816 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T19:58:09.816 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561e4545a138) 2021-03-10T19:58:09.816 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: cache_index_and_filter_blocks: 1 2021-03-10T19:58:09.816 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: cache_index_and_filter_blocks_with_high_priority: 1 2021-03-10T19:58:09.817 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T19:58:09.817 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: pin_top_level_index_and_filter: 1 2021-03-10T19:58:09.817 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: index_type: 0 2021-03-10T19:58:09.817 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: data_block_index_type: 0 2021-03-10T19:58:09.817 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: data_block_hash_table_util_ratio: 0.750000 2021-03-10T19:58:09.818 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: hash_index_allow_collision: 1 2021-03-10T19:58:09.818 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: checksum: 1 2021-03-10T19:58:09.818 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: no_block_cache: 0 2021-03-10T19:58:09.818 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: block_cache: 0x561e45490610 2021-03-10T19:58:09.820 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: block_cache_name: BinnedLRUCache 2021-03-10T19:58:09.820 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: block_cache_options: 2021-03-10T19:58:09.820 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: capacity : 536870912 2021-03-10T19:58:09.820 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: num_shard_bits : 4 2021-03-10T19:58:09.821 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: strict_capacity_limit : 0 2021-03-10T19:58:09.821 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: high_pri_pool_ratio: 0.000 2021-03-10T19:58:09.821 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: block_cache_compressed: (nil) 2021-03-10T19:58:09.821 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: persistent_cache: (nil) 2021-03-10T19:58:09.822 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: block_size: 4096 2021-03-10T19:58:09.822 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: block_size_deviation: 10 2021-03-10T19:58:09.822 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: block_restart_interval: 16 2021-03-10T19:58:09.823 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: index_block_restart_interval: 1 2021-03-10T19:58:09.823 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: metadata_block_size: 4096 2021-03-10T19:58:09.823 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: partition_filters: 0 2021-03-10T19:58:09.823 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: use_delta_encoding: 1 2021-03-10T19:58:09.824 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T19:58:09.824 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: whole_key_filtering: 1 2021-03-10T19:58:09.824 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: verify_compression: 0 2021-03-10T19:58:09.824 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: read_amp_bytes_per_bit: 0 2021-03-10T19:58:09.824 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: format_version: 2 2021-03-10T19:58:09.825 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: enable_index_compression: 1 2021-03-10T19:58:09.825 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: block_align: 0 2021-03-10T19:58:09.825 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T19:58:09.825 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T19:58:09.825 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.compression: NoCompression 2021-03-10T19:58:09.826 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T19:58:09.826 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T19:58:09.826 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T19:58:09.826 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.num_levels: 7 2021-03-10T19:58:09.827 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T19:58:09.827 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T19:58:09.827 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T19:58:09.827 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T19:58:09.827 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T19:58:09.828 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T19:58:09.828 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T19:58:09.828 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T19:58:09.828 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T19:58:09.828 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T19:58:09.829 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T19:58:09.829 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T19:58:09.829 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T19:58:09.829 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T19:58:09.829 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T19:58:09.830 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T19:58:09.830 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T19:58:09.830 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T19:58:09.830 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T19:58:09.831 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T19:58:09.831 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T19:58:09.831 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T19:58:09.831 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T19:58:09.831 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T19:58:09.832 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T19:58:09.832 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T19:58:09.832 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T19:58:09.832 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T19:58:09.832 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T19:58:09.833 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T19:58:09.833 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T19:58:09.833 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T19:58:09.833 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T19:58:09.834 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T19:58:09.834 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T19:58:09.834 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T19:58:09.834 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T19:58:09.835 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T19:58:09.835 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T19:58:09.835 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T19:58:09.835 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T19:58:09.836 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T19:58:09.836 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T19:58:09.836 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T19:58:09.836 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T19:58:09.836 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T19:58:09.837 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.table_properties_collectors: 2021-03-10T19:58:09.837 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T19:58:09.837 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T19:58:09.837 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T19:58:09.837 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T19:58:09.838 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T19:58:09.838 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.bloom_locality: 0 2021-03-10T19:58:09.838 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T19:58:09.838 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T19:58:09.839 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T19:58:09.839 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T19:58:09.839 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T19:58:09.839 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.569+0000 7f597d5346c0 4 rocksdb: Options.ttl: 0 2021-03-10T19:58:09.840 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.573+0000 7f597d5346c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T19:58:09.840 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.573+0000 7f597d5346c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 4 2021-03-10T19:58:09.840 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.573+0000 7f597d5346c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615406289576929, "job": 1, "event": "recovery_started", "log_files": [6]} 2021-03-10T19:58:09.840 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.573+0000 7f597d5346c0 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #6 mode 2 2021-03-10T19:58:09.840 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.573+0000 7f597d5346c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615406289577499, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 66120, "table_properties": {"data_size": 64415, "index_size": 310, "filter_size": 581, "raw_key_size": 8602, "raw_average_key_size": 46, "raw_value_size": 59469, "raw_average_value_size": 321, "num_data_blocks": 10, "num_entries": 185, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2021-03-10T19:58:09.841 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.573+0000 7f597d5346c0 4 rocksdb: [db/version_set.cc:3036] Creating manifest 8 2021-03-10T19:58:09.841 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.573+0000 7f597d5346c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615406289577870, "job": 1, "event": "recovery_finished"} 2021-03-10T19:58:09.841 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.577+0000 7f597d5346c0 4 rocksdb: DB pointer 0x561e4552b200 2021-03-10T19:58:09.841 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.577+0000 7f5964681700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2021-03-10T19:58:09.842 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.577+0000 7f5964681700 4 rocksdb: [db/db_impl.cc:778] 2021-03-10T19:58:09.842 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: ** DB Stats ** 2021-03-10T19:58:09.842 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T19:58:09.842 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T19:58:09.842 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T19:58:09.843 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T19:58:09.843 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T19:58:09.843 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T19:58:09.843 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T19:58:09.844 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: ** Compaction Stats [default] ** 2021-03-10T19:58:09.844 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T19:58:09.844 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T19:58:09.844 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: L0 2/0 66.19 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 160.5 0.00 0.00 1 0.000 0 0 2021-03-10T19:58:09.844 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: Sum 2/0 66.19 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 160.5 0.00 0.00 1 0.000 0 0 2021-03-10T19:58:09.845 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 160.5 0.00 0.00 1 0.000 0 0 2021-03-10T19:58:09.845 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: ** Compaction Stats [default] ** 2021-03-10T19:58:09.846 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T19:58:09.846 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T19:58:09.846 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 160.5 0.00 0.00 1 0.000 0 0 2021-03-10T19:58:09.846 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T19:58:09.846 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: Flush(GB): cumulative 0.000, interval 0.000 2021-03-10T19:58:09.847 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T19:58:09.847 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T19:58:09.847 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T19:58:09.847 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T19:58:09.849 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: Cumulative compaction: 0.00 GB write, 12.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T19:58:09.849 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: Interval compaction: 0.00 GB write, 12.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T19:58:09.849 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T19:58:09.849 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T19:58:09.850 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: ** Compaction Stats [default] ** 2021-03-10T19:58:09.850 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T19:58:09.850 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T19:58:09.850 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: L0 2/0 66.19 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 160.5 0.00 0.00 1 0.000 0 0 2021-03-10T19:58:09.850 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: Sum 2/0 66.19 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 160.5 0.00 0.00 1 0.000 0 0 2021-03-10T19:58:09.851 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T19:58:09.851 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: ** Compaction Stats [default] ** 2021-03-10T19:58:09.851 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T19:58:09.851 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T19:58:09.851 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 160.5 0.00 0.00 1 0.000 0 0 2021-03-10T19:58:09.852 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T19:58:09.852 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: Flush(GB): cumulative 0.000, interval 0.000 2021-03-10T19:58:09.852 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T19:58:09.852 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T19:58:09.853 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T19:58:09.853 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T19:58:09.853 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: Cumulative compaction: 0.00 GB write, 12.90 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T19:58:09.853 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T19:58:09.853 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T19:58:09.854 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T19:58:09.854 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.577+0000 7f597d5346c0 0 starting mon.a rank 0 at public addrs [v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0] at bind addrs [v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid dd719b26-81da-11eb-9080-001a4aab830c 2021-03-10T19:58:09.854 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.577+0000 7f597d5346c0 1 mon.a@-1(???) e1 preinit fsid dd719b26-81da-11eb-9080-001a4aab830c 2021-03-10T19:58:09.854 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.577+0000 7f597d5346c0 0 mon.a@-1(???).mds e1 new map 2021-03-10T19:58:09.854 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.577+0000 7f597d5346c0 0 mon.a@-1(???).mds e1 print_map 2021-03-10T19:58:09.855 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: e1 2021-03-10T19:58:09.855 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: enable_multiple, ever_enabled_multiple: 0,0 2021-03-10T19:58:09.855 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-03-10T19:58:09.855 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: legacy client fscid: -1 2021-03-10T19:58:09.856 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: 2021-03-10T19:58:09.856 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: No filesystems configured 2021-03-10T19:58:09.856 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.577+0000 7f597d5346c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-03-10T19:58:09.856 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.577+0000 7f597d5346c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-03-10T19:58:09.856 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.577+0000 7f597d5346c0 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2021-03-10T19:58:09.857 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.577+0000 7f597d5346c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-03-10T19:58:09.857 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: audit 2021-03-10T19:58:07.242923+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.2.123:0/1997610126' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T19:58:09.857 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: debug 2021-03-10T19:58:09.577+0000 7f597d5346c0 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2021-03-10T19:58:09.857 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: cluster 2021-03-10T19:58:09.582159+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-03-10T19:58:09.857 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: cluster 2021-03-10T19:58:09.582193+0000 mon.a (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0]} 2021-03-10T19:58:09.858 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: cluster 2021-03-10T19:58:09.582215+0000 mon.a (mon.0) 3 : cluster [DBG] fsmap 2021-03-10T19:58:09.858 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: cluster 2021-03-10T19:58:09.582230+0000 mon.a (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2021-03-10T19:58:09.858 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:09 gibba023 bash[9844]: cluster 2021-03-10T19:58:09.582701+0000 mon.a (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2021-03-10T19:58:10.338 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Creating mgr... 2021-03-10T19:58:10.339 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl daemon-reload 2021-03-10T19:58:10.460 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl stop ceph-dd719b26-81da-11eb-9080-001a4aab830c@mgr.y 2021-03-10T19:58:10.465 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl reset-failed ceph-dd719b26-81da-11eb-9080-001a4aab830c@mgr.y 2021-03-10T19:58:10.469 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:systemctl:stderr Failed to reset failed state of unit ceph-dd719b26-81da-11eb-9080-001a4aab830c@mgr.y.service: Unit ceph-dd719b26-81da-11eb-9080-001a4aab830c@mgr.y.service not loaded. 2021-03-10T19:58:10.469 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-dd719b26-81da-11eb-9080-001a4aab830c@mgr.y 2021-03-10T19:58:10.470 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph-dd719b26-81da-11eb-9080-001a4aab830c.target.wants/ceph-dd719b26-81da-11eb-9080-001a4aab830c@mgr.y.service -> /etc/systemd/system/ceph-dd719b26-81da-11eb-9080-001a4aab830c@.service. 2021-03-10T19:58:10.586 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: systemctl start ceph-dd719b26-81da-11eb-9080-001a4aab830c@mgr.y 2021-03-10T19:58:10.608 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 19:58:10 gibba023 systemd[1]: Starting Ceph mgr.y for dd719b26-81da-11eb-9080-001a4aab830c... 2021-03-10T19:58:10.612 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:firewalld does not appear to be present 2021-03-10T19:58:10.612 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2021-03-10T19:58:10.613 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Wrote config to /etc/ceph/ceph.conf 2021-03-10T19:58:10.613 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Waiting for mgr to start... 2021-03-10T19:58:10.613 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Waiting for mgr... 2021-03-10T19:58:10.613 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba023', '-v', '/var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2021-03-10T19:58:10.614 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba023 -v /var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2021-03-10T19:58:10.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:10 gibba023 bash[9844]: audit 2021-03-10T19:58:09.708211+0000 mon.a (mon.0) 6 : audit [INF] from='client.? 172.21.2.123:0/2211347110' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "public_network", "value": "172.21.0.0/20"}]: dispatch 2021-03-10T19:58:10.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:10 gibba023 bash[9844]: audit 2021-03-10T19:58:09.710121+0000 mon.a (mon.0) 7 : audit [INF] from='client.? 172.21.2.123:0/2211347110' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "public_network", "value": "172.21.0.0/20"}]': finished 2021-03-10T19:58:10.928 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 19:58:10 gibba023 docker[10059]: Error: No such container: ceph-dd719b26-81da-11eb-9080-001a4aab830c-mgr.y 2021-03-10T19:58:10.928 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 19:58:10 gibba023 systemd[1]: Started Ceph mgr.y for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T19:58:11.788 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T19:58:11.788 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:11.788 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "dd719b26-81da-11eb-9080-001a4aab830c", 2021-03-10T19:58:11.789 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2021-03-10T19:58:11.789 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2021-03-10T19:58:11.789 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2021-03-10T19:58:11.790 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2021-03-10T19:58:11.790 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:11.790 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2021-03-10T19:58:11.791 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2021-03-10T19:58:11.791 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2021-03-10T19:58:11.791 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:11.791 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2021-03-10T19:58:11.791 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2021-03-10T19:58:11.792 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:11.792 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 2, 2021-03-10T19:58:11.792 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2021-03-10T19:58:11.792 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T19:58:11.793 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2021-03-10T19:58:11.793 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2021-03-10T19:58:11.793 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:11.793 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2021-03-10T19:58:11.793 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T19:58:11.794 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2021-03-10T19:58:11.794 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2021-03-10T19:58:11.794 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2021-03-10T19:58:11.794 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2021-03-10T19:58:11.794 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2021-03-10T19:58:11.795 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2021-03-10T19:58:11.795 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:11.796 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2021-03-10T19:58:11.796 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2021-03-10T19:58:11.796 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2021-03-10T19:58:11.796 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2021-03-10T19:58:11.796 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2021-03-10T19:58:11.797 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2021-03-10T19:58:11.797 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2021-03-10T19:58:11.797 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2021-03-10T19:58:11.797 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2021-03-10T19:58:11.797 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:11.798 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2021-03-10T19:58:11.798 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T19:58:11.798 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2021-03-10T19:58:11.798 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2021-03-10T19:58:11.799 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:11.799 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2021-03-10T19:58:11.799 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": false, 2021-03-10T19:58:11.799 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2021-03-10T19:58:11.800 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2021-03-10T19:58:11.800 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2021-03-10T19:58:11.800 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2021-03-10T19:58:11.801 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:11.801 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T19:58:11.801 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:11.801 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2021-03-10T19:58:11.802 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T19:58:11.802 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2021-03-10T19:58:03.971224+0000", 2021-03-10T19:58:11.802 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T19:58:11.803 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:11.803 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2021-03-10T19:58:11.803 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:12.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:11 gibba023 bash[9844]: audit 2021-03-10T19:58:11.781219+0000 mon.a (mon.0) 8 : audit [DBG] from='client.? 172.21.2.123:0/3304009512' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-03-10T19:58:12.396 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:mgr not available, waiting (1/10)... 2021-03-10T19:58:13.397 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba023', '-v', '/var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2021-03-10T19:58:13.397 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba023 -v /var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2021-03-10T19:58:14.242 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T19:58:14.242 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:14.243 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "dd719b26-81da-11eb-9080-001a4aab830c", 2021-03-10T19:58:14.243 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2021-03-10T19:58:14.243 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2021-03-10T19:58:14.243 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2021-03-10T19:58:14.244 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2021-03-10T19:58:14.244 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:14.244 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2021-03-10T19:58:14.244 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2021-03-10T19:58:14.244 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2021-03-10T19:58:14.245 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:14.245 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2021-03-10T19:58:14.245 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2021-03-10T19:58:14.245 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:14.245 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 4, 2021-03-10T19:58:14.246 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2021-03-10T19:58:14.246 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T19:58:14.246 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2021-03-10T19:58:14.246 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2021-03-10T19:58:14.247 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:14.247 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2021-03-10T19:58:14.247 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T19:58:14.247 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2021-03-10T19:58:14.247 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2021-03-10T19:58:14.248 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2021-03-10T19:58:14.248 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2021-03-10T19:58:14.248 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2021-03-10T19:58:14.248 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2021-03-10T19:58:14.248 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:14.249 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2021-03-10T19:58:14.249 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2021-03-10T19:58:14.249 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2021-03-10T19:58:14.249 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2021-03-10T19:58:14.249 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2021-03-10T19:58:14.250 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2021-03-10T19:58:14.250 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2021-03-10T19:58:14.250 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2021-03-10T19:58:14.250 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2021-03-10T19:58:14.251 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:14.251 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2021-03-10T19:58:14.251 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T19:58:14.251 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2021-03-10T19:58:14.251 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2021-03-10T19:58:14.252 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:14.252 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2021-03-10T19:58:14.252 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": false, 2021-03-10T19:58:14.252 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2021-03-10T19:58:14.252 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2021-03-10T19:58:14.253 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2021-03-10T19:58:14.253 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2021-03-10T19:58:14.253 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:14.253 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T19:58:14.253 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:14.254 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2021-03-10T19:58:14.254 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T19:58:14.254 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2021-03-10T19:58:03.971224+0000", 2021-03-10T19:58:14.254 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T19:58:14.254 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:14.255 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2021-03-10T19:58:14.255 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:14.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:14 gibba023 bash[9844]: audit 2021-03-10T19:58:14.235907+0000 mon.a (mon.0) 9 : audit [DBG] from='client.? 172.21.2.123:0/3080161809' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-03-10T19:58:14.772 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:mgr not available, waiting (2/10)... 2021-03-10T19:58:15.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:15 gibba023 bash[9844]: cluster 2021-03-10T19:58:14.355941+0000 mon.a (mon.0) 10 : cluster [INF] Activating manager daemon y 2021-03-10T19:58:15.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:15 gibba023 bash[9844]: cluster 2021-03-10T19:58:14.357894+0000 mon.a (mon.0) 11 : cluster [DBG] mgrmap e2: y(active, starting, since 0.00201095s) 2021-03-10T19:58:15.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:15 gibba023 bash[9844]: audit 2021-03-10T19:58:14.358630+0000 mon.a (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.2.123:0/3836849476' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T19:58:15.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:15 gibba023 bash[9844]: audit 2021-03-10T19:58:14.358769+0000 mon.a (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.2.123:0/3836849476' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T19:58:15.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:15 gibba023 bash[9844]: audit 2021-03-10T19:58:14.358896+0000 mon.a (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.2.123:0/3836849476' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T19:58:15.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:15 gibba023 bash[9844]: audit 2021-03-10T19:58:14.358967+0000 mon.a (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.2.123:0/3836849476' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T19:58:15.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:15 gibba023 bash[9844]: audit 2021-03-10T19:58:14.359037+0000 mon.a (mon.0) 16 : audit [DBG] from='mgr.14100 172.21.2.123:0/3836849476' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T19:58:15.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:15 gibba023 bash[9844]: audit 2021-03-10T19:58:14.359125+0000 mon.a (mon.0) 17 : audit [DBG] from='mgr.14100 172.21.2.123:0/3836849476' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T19:58:15.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:15 gibba023 bash[9844]: audit 2021-03-10T19:58:14.359230+0000 mon.a (mon.0) 18 : audit [DBG] from='mgr.14100 172.21.2.123:0/3836849476' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T19:58:15.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:15 gibba023 bash[9844]: audit 2021-03-10T19:58:14.359329+0000 mon.a (mon.0) 19 : audit [DBG] from='mgr.14100 172.21.2.123:0/3836849476' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T19:58:15.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:15 gibba023 bash[9844]: cluster 2021-03-10T19:58:14.360653+0000 mon.a (mon.0) 20 : cluster [INF] Manager daemon y is now available 2021-03-10T19:58:15.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:15 gibba023 bash[9844]: audit 2021-03-10T19:58:14.367880+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.14100 172.21.2.123:0/3836849476' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T19:58:15.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:15 gibba023 bash[9844]: audit 2021-03-10T19:58:14.438537+0000 mon.a (mon.0) 22 : audit [INF] from='mgr.14100 172.21.2.123:0/3836849476' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2021-03-10T19:58:15.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:15 gibba023 bash[9844]: cluster 2021-03-10T19:58:14.438559+0000 mon.a (mon.0) 23 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2021-03-10T19:58:15.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:15 gibba023 bash[9844]: audit 2021-03-10T19:58:14.439296+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.14100 172.21.2.123:0/3836849476' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T19:58:15.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:15 gibba023 bash[9844]: audit 2021-03-10T19:58:14.442668+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.14100 172.21.2.123:0/3836849476' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/telemetry/report_id","val":"48e9ff12-7473-4ef1-aa51-2b719e81c11c"}]: dispatch 2021-03-10T19:58:15.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:15 gibba023 bash[9844]: audit 2021-03-10T19:58:14.444100+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.14100 172.21.2.123:0/3836849476' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/telemetry/report_id","val":"48e9ff12-7473-4ef1-aa51-2b719e81c11c"}]': finished 2021-03-10T19:58:15.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:15 gibba023 bash[9844]: audit 2021-03-10T19:58:14.444395+0000 mon.a (mon.0) 27 : audit [INF] from='mgr.14100 172.21.2.123:0/3836849476' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/telemetry/salt","val":"a0d619fe-5995-4c26-a820-f943f065be4f"}]: dispatch 2021-03-10T19:58:15.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:15 gibba023 bash[9844]: audit 2021-03-10T19:58:14.445576+0000 mon.a (mon.0) 28 : audit [INF] from='mgr.14100 172.21.2.123:0/3836849476' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/telemetry/salt","val":"a0d619fe-5995-4c26-a820-f943f065be4f"}]': finished 2021-03-10T19:58:15.771 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba023', '-v', '/var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2021-03-10T19:58:15.771 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba023 -v /var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2021-03-10T19:58:16.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:16 gibba023 bash[9844]: cluster 2021-03-10T19:58:15.366194+0000 mon.a (mon.0) 29 : cluster [DBG] mgrmap e3: y(active, since 1.01031s) 2021-03-10T19:58:16.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:16 gibba023 bash[9844]: audit 2021-03-10T19:58:15.442034+0000 mon.a (mon.0) 30 : audit [INF] from='mgr.14100 172.21.2.123:0/3836849476' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-03-10T19:58:16.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:16 gibba023 bash[9844]: cluster 2021-03-10T19:58:15.442126+0000 mon.a (mon.0) 31 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2021-03-10T19:58:16.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:16 gibba023 bash[9844]: audit 2021-03-10T19:58:15.447895+0000 mon.a (mon.0) 32 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-03-10T19:58:16.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:16 gibba023 bash[9844]: audit 2021-03-10T19:58:15.602731+0000 mon.a (mon.0) 33 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-03-10T19:58:16.794 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2021-03-10T19:58:16.794 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:16.795 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "dd719b26-81da-11eb-9080-001a4aab830c", 2021-03-10T19:58:16.795 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2021-03-10T19:58:16.795 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2021-03-10T19:58:16.795 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2021-03-10T19:58:16.796 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2021-03-10T19:58:16.796 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:16.796 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2021-03-10T19:58:16.796 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2021-03-10T19:58:16.796 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2021-03-10T19:58:16.797 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:16.797 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2021-03-10T19:58:16.797 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2021-03-10T19:58:16.797 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:16.797 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 7, 2021-03-10T19:58:16.798 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2021-03-10T19:58:16.798 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T19:58:16.798 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2021-03-10T19:58:16.798 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2021-03-10T19:58:16.798 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:16.799 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2021-03-10T19:58:16.799 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 3, 2021-03-10T19:58:16.799 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2021-03-10T19:58:16.799 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2021-03-10T19:58:16.800 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2021-03-10T19:58:16.800 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2021-03-10T19:58:16.800 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2021-03-10T19:58:16.801 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2021-03-10T19:58:16.801 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:16.802 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2021-03-10T19:58:16.802 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2021-03-10T19:58:16.802 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2021-03-10T19:58:16.802 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2021-03-10T19:58:16.805 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2021-03-10T19:58:16.806 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2021-03-10T19:58:16.806 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2021-03-10T19:58:16.806 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2021-03-10T19:58:16.806 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2021-03-10T19:58:16.807 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:16.807 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2021-03-10T19:58:16.807 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T19:58:16.807 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2021-03-10T19:58:16.807 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2021-03-10T19:58:16.808 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:16.808 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2021-03-10T19:58:16.808 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2021-03-10T19:58:16.808 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2021-03-10T19:58:16.808 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2021-03-10T19:58:16.809 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2021-03-10T19:58:16.809 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2021-03-10T19:58:16.809 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:16.809 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T19:58:16.810 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:16.810 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2021-03-10T19:58:16.810 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2021-03-10T19:58:16.810 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2021-03-10T19:58:03.971224+0000", 2021-03-10T19:58:16.810 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2021-03-10T19:58:16.811 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:16.811 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2021-03-10T19:58:16.811 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:17.326 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Enabling cephadm module... 2021-03-10T19:58:17.327 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba023', '-v', '/var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'module', 'enable', 'cephadm'] 2021-03-10T19:58:17.327 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba023 -v /var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr module enable cephadm 2021-03-10T19:58:17.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:17 gibba023 bash[9844]: audit 2021-03-10T19:58:16.790603+0000 mon.a (mon.0) 34 : audit [DBG] from='client.? 172.21.2.123:0/1922258909' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-03-10T19:58:18.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:18 gibba023 bash[9844]: cluster 2021-03-10T19:58:17.366087+0000 mon.a (mon.0) 35 : cluster [DBG] mgrmap e4: y(active, since 3s) 2021-03-10T19:58:18.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:18 gibba023 bash[9844]: audit 2021-03-10T19:58:18.345531+0000 mon.a (mon.0) 36 : audit [INF] from='client.? 172.21.2.123:0/932910175' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2021-03-10T19:58:18.676 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 19:58:18 gibba023 bash[10078]: ignoring --setuser ceph since I am not root 2021-03-10T19:58:18.676 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 19:58:18 gibba023 bash[10078]: ignoring --setgroup ceph since I am not root 2021-03-10T19:58:18.989 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba023', '-v', '/var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'dump'] 2021-03-10T19:58:18.990 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba023 -v /var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr dump 2021-03-10T19:58:19.652 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:19 gibba023 bash[9844]: audit 2021-03-10T19:58:18.373141+0000 mon.a (mon.0) 37 : audit [INF] from='client.? 172.21.2.123:0/932910175' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2021-03-10T19:58:19.652 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:19 gibba023 bash[9844]: cluster 2021-03-10T19:58:18.373330+0000 mon.a (mon.0) 38 : cluster [DBG] mgrmap e5: y(active, since 4s) 2021-03-10T19:58:20.403 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:20.404 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 5, 2021-03-10T19:58:20.404 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_gid": 14100, 2021-03-10T19:58:20.404 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_name": "y", 2021-03-10T19:58:20.404 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addrs": { 2021-03-10T19:58:20.405 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T19:58:20.405 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:20.405 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T19:58:20.405 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.123:6800", 2021-03-10T19:58:20.406 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1515571074 2021-03-10T19:58:20.406 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.406 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:20.406 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v1", 2021-03-10T19:58:20.406 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.123:6801", 2021-03-10T19:58:20.407 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1515571074 2021-03-10T19:58:20.407 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:20.407 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T19:58:20.407 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.407 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addr": "172.21.2.123:6801/1515571074", 2021-03-10T19:58:20.408 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_change": "2021-03-10T19:58:14.355875+0000", 2021-03-10T19:58:20.408 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_mgr_features": 4540138292836696063, 2021-03-10T19:58:20.408 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2021-03-10T19:58:20.408 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standbys": [], 2021-03-10T19:58:20.408 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2021-03-10T19:58:20.409 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2021-03-10T19:58:20.409 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2021-03-10T19:58:20.409 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2021-03-10T19:58:20.409 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:20.410 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available_modules": [ 2021-03-10T19:58:20.410 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:20.410 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "alerts", 2021-03-10T19:58:20.410 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:20.410 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:20.411 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:20.411 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T19:58:20.411 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T19:58:20.411 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:20.411 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.412 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.412 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T19:58:20.412 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.412 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.412 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.413 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "How frequently to reexamine health status", 2021-03-10T19:58:20.413 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.413 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.413 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.413 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.414 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:20.414 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:20.414 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.414 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.415 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.415 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.415 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.415 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.415 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:20.416 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:20.416 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:20.416 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:20.416 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:20.416 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:20.417 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:20.417 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:20.417 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.417 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.417 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.418 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.418 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.418 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:20.418 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:20.418 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.419 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.419 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.419 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.419 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.419 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.420 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.420 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.420 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.420 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.420 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.421 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.421 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:20.421 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:20.421 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.422 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.422 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.422 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:20.422 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.422 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.423 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:20.423 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:20.423 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:20.423 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:20.423 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:20.424 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:20.424 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:20.424 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:20.424 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.424 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.425 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.425 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.425 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.425 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:20.425 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:20.426 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.426 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.426 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.427 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.427 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.427 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.427 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.427 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.428 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.428 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.428 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.428 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.428 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_destination": { 2021-03-10T19:58:20.429 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_destination", 2021-03-10T19:58:20.429 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.429 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.429 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.430 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.430 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.430 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.430 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.430 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email address to send alerts to", 2021-03-10T19:58:20.431 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.431 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.431 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.431 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.431 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_from_name": { 2021-03-10T19:58:20.432 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_from_name", 2021-03-10T19:58:20.432 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.432 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.432 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.433 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "Ceph", 2021-03-10T19:58:20.433 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.433 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.433 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.433 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email From: name", 2021-03-10T19:58:20.434 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.434 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.434 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.434 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.435 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_host": { 2021-03-10T19:58:20.435 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_host", 2021-03-10T19:58:20.435 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.435 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.435 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.436 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.436 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.436 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.436 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.436 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP server", 2021-03-10T19:58:20.437 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.437 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.437 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.437 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.437 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_password": { 2021-03-10T19:58:20.438 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_password", 2021-03-10T19:58:20.438 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.438 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.438 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.438 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.439 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.439 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.439 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.439 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Password to authenticate with", 2021-03-10T19:58:20.440 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.440 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.440 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.440 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.440 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_port": { 2021-03-10T19:58:20.441 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_port", 2021-03-10T19:58:20.441 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:20.441 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.441 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.441 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "465", 2021-03-10T19:58:20.442 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.442 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.442 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.442 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP port", 2021-03-10T19:58:20.443 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.443 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.443 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.443 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.443 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_sender": { 2021-03-10T19:58:20.444 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_sender", 2021-03-10T19:58:20.444 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.444 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.445 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.445 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.445 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.445 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.446 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.446 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP envelope sender", 2021-03-10T19:58:20.446 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.446 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.446 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.447 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.447 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_ssl": { 2021-03-10T19:58:20.447 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_ssl", 2021-03-10T19:58:20.447 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.447 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.448 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.448 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:20.448 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.448 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.448 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.449 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Use SSL to connect to SMTP server", 2021-03-10T19:58:20.449 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.449 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.449 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.450 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.450 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_user": { 2021-03-10T19:58:20.450 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_user", 2021-03-10T19:58:20.450 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.450 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.451 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.451 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.451 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.451 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.451 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.452 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "User to authenticate as", 2021-03-10T19:58:20.452 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.452 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.452 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.452 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:20.453 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:20.453 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.453 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:20.453 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "balancer", 2021-03-10T19:58:20.453 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:20.454 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:20.454 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:20.454 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active": { 2021-03-10T19:58:20.454 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "active", 2021-03-10T19:58:20.455 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.455 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.455 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.455 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.455 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.456 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.456 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.456 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically balance PGs across cluster", 2021-03-10T19:58:20.457 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.457 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.457 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.457 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.457 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_time": { 2021-03-10T19:58:20.458 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_time", 2021-03-10T19:58:20.458 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.458 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.458 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.458 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0000", 2021-03-10T19:58:20.459 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.459 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.459 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.459 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "beginning time of day to automatically balance", 2021-03-10T19:58:20.459 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2021-03-10T19:58:20.460 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.460 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.460 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.460 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_weekday": { 2021-03-10T19:58:20.460 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_weekday", 2021-03-10T19:58:20.461 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T19:58:20.461 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.461 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.461 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T19:58:20.462 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2021-03-10T19:58:20.462 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2021-03-10T19:58:20.462 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.462 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to this day of the week or later", 2021-03-10T19:58:20.462 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-03-10T19:58:20.463 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.463 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.463 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.463 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_max_iterations": { 2021-03-10T19:58:20.464 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_max_iterations", 2021-03-10T19:58:20.464 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T19:58:20.464 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.464 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.464 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "25", 2021-03-10T19:58:20.465 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2021-03-10T19:58:20.465 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "250", 2021-03-10T19:58:20.465 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.465 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum number of iterations to attempt optimization", 2021-03-10T19:58:20.465 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.466 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.466 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.466 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.466 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_metrics": { 2021-03-10T19:58:20.466 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_metrics", 2021-03-10T19:58:20.467 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.467 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.467 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.467 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "pgs,objects,bytes", 2021-03-10T19:58:20.467 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.468 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.468 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.468 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "metrics with which to calculate OSD utilization", 2021-03-10T19:58:20.468 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2021-03-10T19:58:20.468 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.469 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.469 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.469 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_step": { 2021-03-10T19:58:20.469 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_step", 2021-03-10T19:58:20.469 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T19:58:20.470 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.471 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.471 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0.5", 2021-03-10T19:58:20.471 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0.001", 2021-03-10T19:58:20.472 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "0.999", 2021-03-10T19:58:20.472 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.472 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "aggressiveness of optimization", 2021-03-10T19:58:20.472 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": ".99 is very aggressive, .01 is less aggressive", 2021-03-10T19:58:20.473 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.473 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.473 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.474 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_time": { 2021-03-10T19:58:20.474 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_time", 2021-03-10T19:58:20.474 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.474 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.474 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.475 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2400", 2021-03-10T19:58:20.475 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.475 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.475 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.476 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "ending time of day to automatically balance", 2021-03-10T19:58:20.476 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2021-03-10T19:58:20.476 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.476 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.476 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.477 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_weekday": { 2021-03-10T19:58:20.477 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_weekday", 2021-03-10T19:58:20.477 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T19:58:20.477 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.477 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.478 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2021-03-10T19:58:20.478 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2021-03-10T19:58:20.479 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2021-03-10T19:58:20.479 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.479 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to days of the week earlier than this", 2021-03-10T19:58:20.480 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-03-10T19:58:20.480 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.480 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.480 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.480 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:20.481 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:20.481 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.481 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.481 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.482 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.482 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.482 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.482 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:20.482 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:20.483 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:20.483 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:20.484 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:20.485 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:20.485 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:20.485 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:20.485 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.485 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.486 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.486 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.487 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.487 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:20.487 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:20.487 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.488 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.488 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.489 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.489 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.489 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.490 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.490 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.491 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.491 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.491 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.491 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.491 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:20.492 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:20.492 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.492 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.492 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.492 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:20.493 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.493 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.493 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:20.493 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:20.494 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:20.495 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:20.495 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:20.495 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:20.496 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:20.496 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:20.496 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.496 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.496 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.497 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.497 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.497 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:20.497 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:20.497 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.498 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.498 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.498 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.498 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.499 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.499 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.499 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.499 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.499 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.500 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.500 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.500 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_score": { 2021-03-10T19:58:20.500 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_score", 2021-03-10T19:58:20.500 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T19:58:20.501 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.501 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.501 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T19:58:20.501 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.501 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.502 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.502 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "minimum score, below which no optimization is attempted", 2021-03-10T19:58:20.502 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.503 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.503 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.503 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.503 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2021-03-10T19:58:20.503 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2021-03-10T19:58:20.504 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.504 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.504 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.504 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "none", 2021-03-10T19:58:20.504 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.505 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.505 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:20.505 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush-compat", 2021-03-10T19:58:20.505 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "none", 2021-03-10T19:58:20.505 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap" 2021-03-10T19:58:20.506 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:20.506 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Balancer mode", 2021-03-10T19:58:20.506 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.506 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.506 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.507 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.507 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_ids": { 2021-03-10T19:58:20.507 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_ids", 2021-03-10T19:58:20.507 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.507 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.508 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.508 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.508 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.508 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.508 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.509 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "pools which the automatic balancing will be limited to", 2021-03-10T19:58:20.509 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.509 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.510 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.510 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.510 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T19:58:20.510 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T19:58:20.511 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:20.511 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.511 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.511 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T19:58:20.512 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.512 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.513 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.513 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and attempt optimization", 2021-03-10T19:58:20.513 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.513 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.514 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.514 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.514 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_deviation": { 2021-03-10T19:58:20.514 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_deviation", 2021-03-10T19:58:20.514 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:20.515 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.515 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.515 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T19:58:20.515 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2021-03-10T19:58:20.515 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.516 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.516 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "deviation below which no optimization is attempted", 2021-03-10T19:58:20.516 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2021-03-10T19:58:20.516 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.517 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.517 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.517 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_optimizations": { 2021-03-10T19:58:20.517 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_optimizations", 2021-03-10T19:58:20.517 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T19:58:20.518 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.518 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.518 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T19:58:20.518 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.518 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.519 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.519 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum upmap optimizations to make per attempt", 2021-03-10T19:58:20.519 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.519 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.519 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.520 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:20.520 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:20.520 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.520 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:20.520 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "cephadm", 2021-03-10T19:58:20.521 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:20.521 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:20.521 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:20.521 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "allow_ptrace": { 2021-03-10T19:58:20.521 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "allow_ptrace", 2021-03-10T19:58:20.522 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.522 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.522 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.522 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.523 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.523 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.523 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.523 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "allow SYS_PTRACE capability on ceph containers", 2021-03-10T19:58:20.523 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2021-03-10T19:58:20.524 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.524 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.524 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.524 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_base": { 2021-03-10T19:58:20.524 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_base", 2021-03-10T19:58:20.525 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.525 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.525 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.525 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph/ceph", 2021-03-10T19:58:20.525 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.526 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.526 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.526 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Container image name, without the tag", 2021-03-10T19:58:20.526 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.526 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.527 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.527 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.527 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "daemon_cache_timeout": { 2021-03-10T19:58:20.527 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "daemon_cache_timeout", 2021-03-10T19:58:20.528 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:20.528 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.528 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.528 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T19:58:20.528 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.529 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.529 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.529 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache service (daemon) inventory", 2021-03-10T19:58:20.529 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.529 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.530 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.530 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.530 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_cache_timeout": { 2021-03-10T19:58:20.530 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_cache_timeout", 2021-03-10T19:58:20.530 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:20.531 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.531 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.531 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1800", 2021-03-10T19:58:20.531 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.532 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.532 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.532 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache device inventory", 2021-03-10T19:58:20.532 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.532 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.533 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.533 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.533 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "host_check_interval": { 2021-03-10T19:58:20.533 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "host_check_interval", 2021-03-10T19:58:20.533 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:20.534 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.534 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.534 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T19:58:20.534 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.535 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.535 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.535 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to perform a host check", 2021-03-10T19:58:20.535 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.535 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.536 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.536 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.536 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:20.536 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:20.536 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.537 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.537 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.537 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.537 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.537 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.538 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:20.538 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:20.538 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:20.538 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:20.538 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:20.539 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:20.539 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:20.539 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:20.539 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.539 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.540 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.540 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.540 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.540 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:20.540 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:20.541 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.541 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.541 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.541 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:20.541 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.542 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.542 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.542 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "log to the \"cephadm\" cluster log channel\"", 2021-03-10T19:58:20.542 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.543 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.543 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.543 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.543 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:20.543 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:20.544 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.544 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.545 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.545 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:20.546 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.546 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.546 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:20.546 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:20.547 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:20.547 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:20.547 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:20.548 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:20.548 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:20.548 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:20.548 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.549 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.549 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.549 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.549 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.549 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:20.550 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:20.550 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.550 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.550 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.551 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.551 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.551 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.551 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.551 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.552 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.552 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.552 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.552 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.553 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2021-03-10T19:58:20.553 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2021-03-10T19:58:20.553 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.553 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.553 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.554 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "root", 2021-03-10T19:58:20.554 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.554 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.554 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:20.555 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm-package", 2021-03-10T19:58:20.555 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "root" 2021-03-10T19:58:20.555 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:20.555 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "mode for remote execution of cephadm", 2021-03-10T19:58:20.555 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.556 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.556 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.556 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.556 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssh_config_file": { 2021-03-10T19:58:20.556 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssh_config_file", 2021-03-10T19:58:20.557 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.557 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.557 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.557 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T19:58:20.557 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.558 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.558 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.558 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "customized SSH config file to connect to managed hosts", 2021-03-10T19:58:20.558 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.559 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.559 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.559 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.559 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_failed_host_check": { 2021-03-10T19:58:20.560 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_failed_host_check", 2021-03-10T19:58:20.560 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.560 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.560 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.560 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:20.561 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.561 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.561 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.561 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if the host check fails", 2021-03-10T19:58:20.561 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.562 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.562 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.562 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.562 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_daemons": { 2021-03-10T19:58:20.563 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_daemons", 2021-03-10T19:58:20.563 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.563 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.563 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.563 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:20.564 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.564 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.564 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.564 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2021-03-10T19:58:20.564 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.565 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.565 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.565 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.565 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_hosts": { 2021-03-10T19:58:20.566 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_hosts", 2021-03-10T19:58:20.566 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.566 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.566 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.566 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:20.567 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.567 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.567 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.567 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2021-03-10T19:58:20.568 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.568 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.568 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.568 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:20.568 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:20.569 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.569 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:20.569 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crash", 2021-03-10T19:58:20.569 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:20.569 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:20.570 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:20.570 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:20.570 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:20.570 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.571 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.571 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.571 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.571 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.571 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.572 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:20.572 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:20.572 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:20.572 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:20.572 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:20.573 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:20.573 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:20.573 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:20.574 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.574 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.574 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.574 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.575 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.575 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:20.575 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:20.575 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.575 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.576 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.576 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.576 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.576 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.576 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.577 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.577 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.577 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.577 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.578 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.578 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:20.578 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:20.578 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.578 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.579 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.579 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:20.579 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.579 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.579 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:20.580 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:20.580 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:20.580 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:20.580 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:20.581 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:20.581 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:20.581 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:20.581 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.581 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.582 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.582 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.582 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.582 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:20.583 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:20.583 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.583 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.583 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.583 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.584 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.584 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.584 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.584 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.585 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.585 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.585 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.585 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.585 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retain_interval": { 2021-03-10T19:58:20.586 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retain_interval", 2021-03-10T19:58:20.586 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:20.586 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.586 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.587 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "31536000", 2021-03-10T19:58:20.587 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.587 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.587 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.587 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain crashes before pruning them", 2021-03-10T19:58:20.588 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.588 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.588 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.588 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.588 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_recent_interval": { 2021-03-10T19:58:20.589 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_recent_interval", 2021-03-10T19:58:20.589 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:20.589 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.589 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.589 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1209600", 2021-03-10T19:58:20.590 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.590 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.590 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.590 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "time interval in which to warn about recent crashes", 2021-03-10T19:58:20.591 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.591 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.591 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.591 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:20.591 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:20.592 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.592 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:20.592 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "dashboard", 2021-03-10T19:58:20.592 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:20.592 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:20.593 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:20.593 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ALERTMANAGER_API_HOST": { 2021-03-10T19:58:20.593 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ALERTMANAGER_API_HOST", 2021-03-10T19:58:20.593 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.593 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.594 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.594 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.594 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.594 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.595 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.595 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.595 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.595 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.595 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.596 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.596 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_ENABLED": { 2021-03-10T19:58:20.596 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_ENABLED", 2021-03-10T19:58:20.596 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.596 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.597 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.597 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.597 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.597 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.598 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.598 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.598 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.598 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.598 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.599 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.599 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_LOG_PAYLOAD": { 2021-03-10T19:58:20.599 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_LOG_PAYLOAD", 2021-03-10T19:58:20.599 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.599 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.600 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.600 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:20.600 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.600 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.601 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.601 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.601 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.601 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.601 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.602 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.602 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ENABLE_BROWSABLE_API": { 2021-03-10T19:58:20.602 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ENABLE_BROWSABLE_API", 2021-03-10T19:58:20.602 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.602 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.603 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.603 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:20.603 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.603 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.604 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.604 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.604 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.604 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.605 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.605 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.605 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_cephfs": { 2021-03-10T19:58:20.605 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_cephfs", 2021-03-10T19:58:20.606 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.606 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.606 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.606 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:20.606 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.607 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.607 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.607 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.607 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.608 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.608 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.608 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.608 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_iscsi": { 2021-03-10T19:58:20.608 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_iscsi", 2021-03-10T19:58:20.609 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.609 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.609 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.609 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:20.609 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.610 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.610 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.610 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.610 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.611 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.611 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.611 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.611 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_mirroring": { 2021-03-10T19:58:20.612 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_mirroring", 2021-03-10T19:58:20.612 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.612 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.612 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.612 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:20.613 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.613 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.613 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.613 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.614 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.614 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.614 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.614 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.614 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_nfs": { 2021-03-10T19:58:20.615 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_nfs", 2021-03-10T19:58:20.615 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.615 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.615 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.615 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:20.616 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.616 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.616 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.616 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.616 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.617 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.617 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.617 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.617 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rbd": { 2021-03-10T19:58:20.618 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rbd", 2021-03-10T19:58:20.618 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.618 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.618 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.618 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:20.619 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.619 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.620 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.620 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.621 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.621 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.621 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.621 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.621 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rgw": { 2021-03-10T19:58:20.622 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rgw", 2021-03-10T19:58:20.622 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.622 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.622 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.623 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:20.623 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.623 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.623 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.623 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.624 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.624 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.624 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.624 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.624 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2021-03-10T19:58:20.625 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2021-03-10T19:58:20.625 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.625 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.625 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.625 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.626 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.626 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.626 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.626 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.627 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.627 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.627 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.627 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.627 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_PASSWORD": { 2021-03-10T19:58:20.628 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_PASSWORD", 2021-03-10T19:58:20.628 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.628 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.628 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.628 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T19:58:20.629 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.629 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.629 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.629 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.629 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.630 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.630 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.630 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.630 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_SSL_VERIFY": { 2021-03-10T19:58:20.631 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_SSL_VERIFY", 2021-03-10T19:58:20.631 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.631 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.631 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.631 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:20.632 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.632 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.632 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.632 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.632 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.633 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.633 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.633 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.633 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_URL": { 2021-03-10T19:58:20.633 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_URL", 2021-03-10T19:58:20.634 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.634 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.634 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.634 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.635 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.635 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.635 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.635 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.636 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.636 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.636 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.636 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.637 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_USERNAME": { 2021-03-10T19:58:20.637 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_USERNAME", 2021-03-10T19:58:20.637 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.637 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.637 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.638 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T19:58:20.638 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.638 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.638 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.638 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.639 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.639 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.639 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.639 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.640 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_UPDATE_DASHBOARDS": { 2021-03-10T19:58:20.640 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_UPDATE_DASHBOARDS", 2021-03-10T19:58:20.640 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.640 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.640 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.641 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.641 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.641 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.641 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.642 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.642 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.642 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.642 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.642 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.643 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ISCSI_API_SSL_VERIFICATION": { 2021-03-10T19:58:20.643 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ISCSI_API_SSL_VERIFICATION", 2021-03-10T19:58:20.643 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.643 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.644 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.644 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:20.644 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.644 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.644 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.645 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.645 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.645 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.645 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.645 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.646 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PROMETHEUS_API_HOST": { 2021-03-10T19:58:20.646 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PROMETHEUS_API_HOST", 2021-03-10T19:58:20.646 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.647 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.647 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.647 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.647 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.647 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.648 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.648 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.648 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.648 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.649 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.649 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.649 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2021-03-10T19:58:20.649 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2021-03-10T19:58:20.649 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.650 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.650 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.650 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.650 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.650 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.651 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.651 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.651 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.651 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.652 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.652 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.652 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2021-03-10T19:58:20.652 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2021-03-10T19:58:20.652 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.653 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.653 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.653 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.653 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.653 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.654 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.654 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.654 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.654 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.655 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.655 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.655 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2021-03-10T19:58:20.655 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2021-03-10T19:58:20.655 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.656 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.656 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.656 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:20.656 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.656 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.657 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.657 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.657 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.657 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.657 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.658 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.658 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2021-03-10T19:58:20.658 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2021-03-10T19:58:20.658 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.659 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.659 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.659 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:20.659 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.659 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.660 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.660 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.660 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.660 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.660 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.661 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.661 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2021-03-10T19:58:20.661 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2021-03-10T19:58:20.661 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.662 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.662 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.662 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.662 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.662 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.663 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.663 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.663 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.663 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.663 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.664 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.664 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2021-03-10T19:58:20.664 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2021-03-10T19:58:20.664 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.664 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.665 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.665 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.665 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.665 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.665 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.666 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.666 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.666 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.666 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.666 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.667 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2021-03-10T19:58:20.667 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2021-03-10T19:58:20.667 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.667 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.668 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.668 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.668 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.668 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.669 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.670 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.672 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.672 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.673 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.673 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.674 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_ENABLED": { 2021-03-10T19:58:20.674 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_ENABLED", 2021-03-10T19:58:20.675 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.676 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.676 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.677 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:20.677 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.678 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.678 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.678 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.679 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.680 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.680 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.681 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.681 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_EXCLUSION_LIST": { 2021-03-10T19:58:20.681 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_EXCLUSION_LIST", 2021-03-10T19:58:20.682 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.682 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.682 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.683 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2021-03-10T19:58:20.683 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.684 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.684 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.684 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.685 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.685 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.685 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.686 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.686 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_COMPLEXITY": { 2021-03-10T19:58:20.686 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_COMPLEXITY", 2021-03-10T19:58:20.686 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:20.687 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.687 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.687 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T19:58:20.687 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.688 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.688 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.688 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.688 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.689 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.689 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.690 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.691 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_LENGTH": { 2021-03-10T19:58:20.691 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_LENGTH", 2021-03-10T19:58:20.692 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:20.692 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.693 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.693 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8", 2021-03-10T19:58:20.694 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.694 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.694 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.695 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.695 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.696 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.696 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.697 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.697 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "REST_REQUESTS_TIMEOUT": { 2021-03-10T19:58:20.698 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "REST_REQUESTS_TIMEOUT", 2021-03-10T19:58:20.698 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:20.699 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.699 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.699 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "45", 2021-03-10T19:58:20.700 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.700 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.700 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.700 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.700 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.701 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.702 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.702 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.703 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ACCESS_KEY": { 2021-03-10T19:58:20.703 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ACCESS_KEY", 2021-03-10T19:58:20.704 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.704 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.704 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.705 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.705 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.706 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.706 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.707 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.707 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.707 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.707 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.707 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.708 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ADMIN_RESOURCE": { 2021-03-10T19:58:20.708 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ADMIN_RESOURCE", 2021-03-10T19:58:20.708 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.708 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.709 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.709 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T19:58:20.709 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.709 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.710 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.710 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.710 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.710 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.710 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.711 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.711 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_HOST": { 2021-03-10T19:58:20.711 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_HOST", 2021-03-10T19:58:20.712 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.712 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.712 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.713 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.713 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.713 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.713 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.714 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.714 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.714 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.714 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.714 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.715 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_PORT": { 2021-03-10T19:58:20.715 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_PORT", 2021-03-10T19:58:20.715 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:20.716 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.716 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.716 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "80", 2021-03-10T19:58:20.716 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.717 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.717 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.717 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.717 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.717 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.718 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.718 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.718 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SCHEME": { 2021-03-10T19:58:20.718 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SCHEME", 2021-03-10T19:58:20.718 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.719 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.719 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.719 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "http", 2021-03-10T19:58:20.719 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.720 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.720 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.720 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.721 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.721 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.722 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.722 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.722 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SECRET_KEY": { 2021-03-10T19:58:20.722 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SECRET_KEY", 2021-03-10T19:58:20.723 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.724 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.724 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.724 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.725 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.725 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.725 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.725 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.726 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.726 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.726 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.726 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.727 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SSL_VERIFY": { 2021-03-10T19:58:20.727 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SSL_VERIFY", 2021-03-10T19:58:20.727 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.727 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.727 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.728 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:20.728 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.728 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.728 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.728 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.729 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.729 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.729 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.729 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.730 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_USER_ID": { 2021-03-10T19:58:20.730 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_USER_ID", 2021-03-10T19:58:20.730 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.730 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.731 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.731 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.731 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.732 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.732 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.732 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.732 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.733 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.733 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.733 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.733 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_SPAN": { 2021-03-10T19:58:20.733 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_SPAN", 2021-03-10T19:58:20.734 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:20.734 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.734 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.734 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T19:58:20.735 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.735 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.735 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.735 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.736 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.736 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.736 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.736 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.737 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_1": { 2021-03-10T19:58:20.737 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_1", 2021-03-10T19:58:20.737 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:20.737 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.737 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.738 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T19:58:20.738 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.738 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.738 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.739 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.739 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.739 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.739 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.740 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.740 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_2": { 2021-03-10T19:58:20.740 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_2", 2021-03-10T19:58:20.740 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:20.740 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.741 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.741 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T19:58:20.741 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.741 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.742 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.742 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.742 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.742 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.743 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.743 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.743 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crt_file": { 2021-03-10T19:58:20.743 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crt_file", 2021-03-10T19:58:20.744 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.744 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.744 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.744 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.744 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.745 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.745 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.745 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.745 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.746 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.746 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.746 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.746 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug": { 2021-03-10T19:58:20.747 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "debug", 2021-03-10T19:58:20.747 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.747 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.747 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.747 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.748 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.748 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.748 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.748 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Enable/disable debug options", 2021-03-10T19:58:20.749 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.749 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.749 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.749 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.749 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "jwt_token_ttl": { 2021-03-10T19:58:20.750 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "jwt_token_ttl", 2021-03-10T19:58:20.750 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:20.750 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.751 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.751 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "28800", 2021-03-10T19:58:20.751 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.751 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.752 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.752 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.752 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.752 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.753 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.753 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.753 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2021-03-10T19:58:20.754 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2021-03-10T19:58:20.754 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.755 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.755 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.755 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.755 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.756 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.756 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.756 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.756 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.757 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.757 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.757 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.757 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:20.758 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:20.758 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.758 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.758 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.759 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.759 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.759 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.760 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:20.760 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:20.760 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:20.760 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:20.761 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:20.761 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:20.762 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:20.762 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:20.763 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.763 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.763 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.763 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.764 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.764 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:20.764 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:20.765 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.765 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.765 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.766 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.766 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.766 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.766 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.767 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.767 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.767 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.767 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.767 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.768 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:20.768 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:20.769 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.769 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.769 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.770 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:20.770 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.771 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.771 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:20.771 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:20.771 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:20.772 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:20.772 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:20.772 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:20.772 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:20.772 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:20.773 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.773 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.773 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.773 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.773 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.774 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:20.774 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:20.774 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.775 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.775 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.775 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.775 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.776 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.776 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.776 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.776 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.777 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.777 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.777 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.777 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2021-03-10T19:58:20.777 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2021-03-10T19:58:20.778 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.778 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.778 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.778 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.779 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.780 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.780 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.780 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.780 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.781 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.781 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.781 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.782 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T19:58:20.782 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T19:58:20.782 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.782 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.783 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.783 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "::", 2021-03-10T19:58:20.784 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.784 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.784 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.785 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.785 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.785 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.785 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.786 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.786 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T19:58:20.786 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T19:58:20.786 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:20.787 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.787 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.787 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8080", 2021-03-10T19:58:20.787 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.787 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.788 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.788 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.788 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.788 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.789 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.789 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.789 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2021-03-10T19:58:20.789 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2021-03-10T19:58:20.789 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.790 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.790 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.791 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:20.791 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.791 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.792 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.792 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.792 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.792 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.792 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.793 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.793 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl_server_port": { 2021-03-10T19:58:20.793 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl_server_port", 2021-03-10T19:58:20.793 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:20.794 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.794 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.794 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8443", 2021-03-10T19:58:20.794 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.794 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.795 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.795 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.795 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.796 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.796 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.796 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.796 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_behaviour": { 2021-03-10T19:58:20.797 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_behaviour", 2021-03-10T19:58:20.797 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.797 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.797 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.798 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "redirect", 2021-03-10T19:58:20.798 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.798 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.798 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:20.798 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:20.799 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "redirect" 2021-03-10T19:58:20.799 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:20.799 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.799 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.800 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.800 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.801 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.801 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_error_status_code": { 2021-03-10T19:58:20.801 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_error_status_code", 2021-03-10T19:58:20.801 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:20.802 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.802 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.802 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "500", 2021-03-10T19:58:20.803 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "400", 2021-03-10T19:58:20.803 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "599", 2021-03-10T19:58:20.803 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.803 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.803 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.804 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.804 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.804 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.804 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url_prefix": { 2021-03-10T19:58:20.805 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url_prefix", 2021-03-10T19:58:20.805 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.805 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.805 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.805 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.806 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.806 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.806 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.806 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.806 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.807 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.807 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.808 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.808 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2021-03-10T19:58:20.808 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2021-03-10T19:58:20.808 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.809 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.809 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.809 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.809 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.809 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.810 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.810 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.810 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.811 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.811 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.811 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:20.811 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:20.811 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.812 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:20.812 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "devicehealth", 2021-03-10T19:58:20.812 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:20.813 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:20.813 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:20.813 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enable_monitoring": { 2021-03-10T19:58:20.813 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enable_monitoring", 2021-03-10T19:58:20.814 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.814 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.814 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.814 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:20.814 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.815 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.815 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.815 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "monitor device health metrics", 2021-03-10T19:58:20.815 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.815 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.816 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.816 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.816 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:20.816 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:20.817 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.817 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.817 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.817 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.817 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.818 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.818 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:20.818 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:20.818 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:20.819 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:20.819 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:20.819 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:20.819 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:20.819 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:20.820 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.820 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.820 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.820 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.821 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.821 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:20.821 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:20.821 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.822 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.822 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.822 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.822 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.823 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.823 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.823 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.824 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.824 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.824 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.824 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.825 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:20.825 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:20.825 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.826 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.826 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.826 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:20.826 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.827 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.827 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:20.827 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:20.827 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:20.827 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:20.828 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:20.828 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:20.828 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:20.828 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:20.828 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.829 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.829 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.829 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.829 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.829 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:20.830 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:20.830 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.830 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.830 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.831 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.831 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.831 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.831 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.831 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.832 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.832 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.832 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.832 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.833 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mark_out_threshold": { 2021-03-10T19:58:20.833 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mark_out_threshold", 2021-03-10T19:58:20.833 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:20.833 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.833 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.834 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2419200", 2021-03-10T19:58:20.834 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.834 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.834 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.835 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically mark OSD if it may fail before this long", 2021-03-10T19:58:20.835 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.835 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.835 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.835 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.836 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_name": { 2021-03-10T19:58:20.836 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_name", 2021-03-10T19:58:20.836 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.836 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.836 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.837 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "device_health_metrics", 2021-03-10T19:58:20.837 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.837 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.837 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.838 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name of pool in which to store device health metrics", 2021-03-10T19:58:20.838 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.838 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.838 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.838 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.839 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retention_period": { 2021-03-10T19:58:20.839 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retention_period", 2021-03-10T19:58:20.839 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:20.839 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.840 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.840 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15552000", 2021-03-10T19:58:20.840 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.840 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.840 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.841 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain device health metrics", 2021-03-10T19:58:20.841 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.841 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.842 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.842 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.842 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_frequency": { 2021-03-10T19:58:20.843 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_frequency", 2021-03-10T19:58:20.843 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:20.843 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.843 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.844 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2021-03-10T19:58:20.844 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.844 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.844 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.845 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to scrape device health metrics", 2021-03-10T19:58:20.845 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.845 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.845 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.845 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.846 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "self_heal": { 2021-03-10T19:58:20.846 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "self_heal", 2021-03-10T19:58:20.846 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.846 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.847 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.847 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:20.847 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.847 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.847 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.848 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "preemptively heal cluster around devices that may fail", 2021-03-10T19:58:20.848 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.848 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.848 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.848 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.849 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T19:58:20.849 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T19:58:20.849 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:20.849 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.850 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.850 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T19:58:20.850 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.850 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.850 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.851 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and check device health", 2021-03-10T19:58:20.851 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.851 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.851 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.852 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.852 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_threshold": { 2021-03-10T19:58:20.852 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_threshold", 2021-03-10T19:58:20.853 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:20.853 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.853 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.854 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7257600", 2021-03-10T19:58:20.854 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.855 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.855 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.855 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise health warning if OSD may fail before this long", 2021-03-10T19:58:20.857 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.857 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.857 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.857 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:20.858 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:20.858 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.858 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:20.858 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "diskprediction_local", 2021-03-10T19:58:20.858 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:20.859 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:20.859 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:20.859 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:20.859 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:20.860 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.860 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.860 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.860 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.860 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.861 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.861 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:20.861 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:20.861 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:20.862 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:20.862 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:20.864 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:20.864 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:20.864 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:20.864 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.865 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.865 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.865 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.865 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.865 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:20.866 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:20.866 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.866 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.867 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.867 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.867 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.867 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.868 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.868 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.868 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.868 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.868 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.870 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.870 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:20.871 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:20.871 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.871 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.872 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.872 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:20.872 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.872 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.872 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:20.873 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:20.873 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:20.873 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:20.873 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:20.874 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:20.874 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:20.874 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:20.875 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.875 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.875 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.875 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.876 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.876 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:20.876 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:20.876 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.877 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.878 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.878 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.878 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.878 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.878 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.879 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.879 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.879 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.879 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.880 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.880 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predict_interval": { 2021-03-10T19:58:20.880 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predict_interval", 2021-03-10T19:58:20.880 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.881 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.881 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.881 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2021-03-10T19:58:20.881 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.882 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.882 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.882 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.882 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.882 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.883 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.883 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.883 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predictor_model": { 2021-03-10T19:58:20.883 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predictor_model", 2021-03-10T19:58:20.883 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.884 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.884 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.884 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prophetstor", 2021-03-10T19:58:20.884 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.885 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.885 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.886 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.886 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.886 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.886 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.887 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.887 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T19:58:20.887 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T19:58:20.887 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.887 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.888 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.888 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T19:58:20.888 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.888 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.888 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.889 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.889 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.889 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.889 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.889 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:20.890 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:20.890 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.890 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:20.890 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "influx", 2021-03-10T19:58:20.891 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": false, 2021-03-10T19:58:20.891 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "influxdb python module not found", 2021-03-10T19:58:20.891 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:20.891 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "batch_size": { 2021-03-10T19:58:20.891 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "batch_size", 2021-03-10T19:58:20.892 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.892 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.892 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.892 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5000", 2021-03-10T19:58:20.892 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.893 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.893 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.893 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.893 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.894 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.894 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.894 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.894 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "database": { 2021-03-10T19:58:20.895 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "database", 2021-03-10T19:58:20.895 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.895 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.895 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.896 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph", 2021-03-10T19:58:20.896 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.896 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.896 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.896 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.897 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.897 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.897 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.897 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.897 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "hostname": { 2021-03-10T19:58:20.898 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "hostname", 2021-03-10T19:58:20.898 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.898 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.898 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.899 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T19:58:20.899 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.899 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.899 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.899 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.900 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.900 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.900 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.900 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.900 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T19:58:20.901 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T19:58:20.901 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.901 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.901 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.902 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "30", 2021-03-10T19:58:20.902 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.902 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.902 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.902 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.903 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.903 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.903 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.903 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.903 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:20.904 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:20.904 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.904 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.904 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.904 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.905 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.905 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.905 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:20.905 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:20.906 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:20.906 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:20.906 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:20.906 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:20.907 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:20.907 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:20.907 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.908 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.908 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.908 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.908 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.909 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:20.909 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:20.909 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.909 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.909 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.910 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.910 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.910 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.910 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.910 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.911 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.911 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.911 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.911 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.911 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:20.912 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:20.912 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.912 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.912 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.913 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:20.913 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.913 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.913 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:20.913 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:20.914 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:20.914 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:20.914 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:20.914 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:20.915 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:20.915 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:20.915 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.915 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.915 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.916 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.916 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.916 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:20.916 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:20.916 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.917 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.917 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.917 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.917 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.918 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.918 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.918 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.918 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.918 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.919 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.919 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.919 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2021-03-10T19:58:20.919 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2021-03-10T19:58:20.919 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.920 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.920 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.920 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T19:58:20.920 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.920 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.921 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.921 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.921 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.921 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.922 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.922 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.922 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "port": { 2021-03-10T19:58:20.922 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "port", 2021-03-10T19:58:20.922 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.923 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.923 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.923 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8086", 2021-03-10T19:58:20.923 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.923 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.924 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.924 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.924 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.924 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.924 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.925 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.925 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2021-03-10T19:58:20.925 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2021-03-10T19:58:20.925 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.926 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.926 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.926 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "false", 2021-03-10T19:58:20.926 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.926 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.927 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.927 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.927 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.927 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.927 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.928 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.928 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "threads": { 2021-03-10T19:58:20.928 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "threads", 2021-03-10T19:58:20.928 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.928 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.929 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.929 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T19:58:20.929 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.929 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.930 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.930 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.930 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.930 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.930 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.931 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.931 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2021-03-10T19:58:20.931 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2021-03-10T19:58:20.931 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.931 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.932 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.932 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T19:58:20.932 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.932 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.933 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.933 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.933 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.933 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.933 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.934 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.934 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "verify_ssl": { 2021-03-10T19:58:20.934 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "verify_ssl", 2021-03-10T19:58:20.934 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.934 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.935 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.935 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "true", 2021-03-10T19:58:20.935 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.936 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.936 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.936 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.936 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.936 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.937 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.937 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:20.937 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:20.937 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.937 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:20.938 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "insights", 2021-03-10T19:58:20.938 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:20.938 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:20.938 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:20.939 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:20.939 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:20.939 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.939 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.939 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.940 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.940 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.940 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.940 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:20.941 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:20.941 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:20.941 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:20.941 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:20.941 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:20.942 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:20.942 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:20.942 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.942 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.942 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.943 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.943 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.943 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:20.943 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:20.943 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.944 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.944 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.944 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.944 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.945 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.945 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.945 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.945 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.945 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.946 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.946 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.946 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:20.946 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:20.946 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.947 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.947 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.947 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:20.947 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.948 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.948 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:20.948 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:20.948 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:20.948 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:20.949 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:20.949 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:20.949 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:20.949 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:20.949 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.950 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.950 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.950 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.950 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.951 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:20.951 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:20.951 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.951 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.951 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.952 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.952 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.952 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.952 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.952 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.953 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.953 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.953 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.953 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:20.953 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:20.954 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.954 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:20.954 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "iostat", 2021-03-10T19:58:20.954 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:20.955 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:20.955 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:20.955 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:20.955 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:20.955 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.956 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.956 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.956 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.956 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.956 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.957 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:20.957 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:20.957 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:20.957 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:20.957 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:20.958 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:20.958 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:20.958 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:20.958 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.959 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.959 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.959 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.959 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.959 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:20.960 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:20.960 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.960 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.960 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.960 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.961 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.961 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.961 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.961 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.961 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.962 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.962 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.962 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.962 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:20.963 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:20.963 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.963 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.963 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.963 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:20.964 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.964 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.964 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:20.964 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:20.964 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:20.965 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:20.965 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:20.965 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:20.965 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:20.966 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:20.966 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.966 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.966 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.967 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.967 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.967 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:20.967 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:20.968 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.968 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.968 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.968 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.969 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.969 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.969 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.969 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.969 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.970 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.970 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.970 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:20.970 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:20.970 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.971 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:20.971 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "k8sevents", 2021-03-10T19:58:20.971 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:20.971 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:20.972 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:20.972 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ceph_event_retention_days": { 2021-03-10T19:58:20.972 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ceph_event_retention_days", 2021-03-10T19:58:20.972 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:20.973 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.973 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.973 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2021-03-10T19:58:20.973 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.973 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.974 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.974 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Days to hold ceph event information within local cache", 2021-03-10T19:58:20.974 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.974 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.975 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.975 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.975 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "config_check_secs": { 2021-03-10T19:58:20.975 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "config_check_secs", 2021-03-10T19:58:20.975 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:20.976 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.976 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:20.976 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T19:58:20.976 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "10", 2021-03-10T19:58:20.977 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.977 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.977 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "interval (secs) to check for cluster configuration changes", 2021-03-10T19:58:20.977 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.978 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.978 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.978 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.978 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:20.978 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:20.979 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.979 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.979 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.979 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:20.979 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.980 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.980 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:20.980 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:20.981 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:20.981 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:20.981 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:20.981 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:20.981 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:20.982 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:20.982 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.982 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.982 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.983 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.983 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.983 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:20.983 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:20.983 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.984 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.984 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.984 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.984 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.984 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.985 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.985 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.985 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.986 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.986 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.986 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.986 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:20.987 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:20.987 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.987 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.987 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.987 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:20.988 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.988 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.989 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:20.989 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:20.989 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:20.989 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:20.989 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:20.990 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:20.990 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:20.990 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:20.990 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.991 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.991 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.991 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.991 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.991 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:20.992 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:20.992 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:20.992 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.992 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.993 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:20.993 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.993 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.993 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.993 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:20.994 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:20.994 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:20.994 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:20.994 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:20.995 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:20.995 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:20.996 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:20.996 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "localpool", 2021-03-10T19:58:20.996 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:20.996 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:20.997 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:20.997 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "failure_domain": { 2021-03-10T19:58:20.997 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "failure_domain", 2021-03-10T19:58:20.998 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:20.998 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:20.998 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:20.998 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "host", 2021-03-10T19:58:20.999 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:20.999 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:20.999 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:20.999 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "failure domain for any created local pool", 2021-03-10T19:58:20.999 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.000 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.000 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.000 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.000 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:21.000 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:21.001 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.001 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.001 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.002 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.002 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.002 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.003 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.003 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.003 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.003 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.003 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.004 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.004 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.004 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.004 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.005 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.005 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.006 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.006 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.006 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:21.007 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:21.007 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.007 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.007 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.007 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.008 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.008 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.008 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.008 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.009 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.010 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.011 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.011 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.011 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:21.011 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:21.012 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.012 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.013 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.013 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:21.013 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.013 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.014 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.014 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.014 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.015 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.015 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.015 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.015 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.016 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.016 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.016 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.016 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.017 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.017 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.017 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:21.017 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:21.017 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.018 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.018 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.018 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.018 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.019 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.019 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.019 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.019 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.019 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.020 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.020 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.020 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_size": { 2021-03-10T19:58:21.020 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_size", 2021-03-10T19:58:21.021 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:21.021 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.021 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.021 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.021 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.022 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.022 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.022 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default min_size for any created local pool", 2021-03-10T19:58:21.022 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.023 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.023 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.023 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.023 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_rep": { 2021-03-10T19:58:21.023 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "num_rep", 2021-03-10T19:58:21.024 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:21.024 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.024 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.024 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "3", 2021-03-10T19:58:21.025 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.025 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.025 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.026 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default replica count for any created local pool", 2021-03-10T19:58:21.026 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.026 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.026 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.027 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.027 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_num": { 2021-03-10T19:58:21.027 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_num", 2021-03-10T19:58:21.027 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:21.027 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.028 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.028 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "128", 2021-03-10T19:58:21.028 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.028 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.029 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.029 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default pg_num for any created local pool", 2021-03-10T19:58:21.029 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.029 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.029 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.030 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.030 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "prefix": { 2021-03-10T19:58:21.030 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prefix", 2021-03-10T19:58:21.030 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.031 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.031 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.031 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.031 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.032 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.032 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.032 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name prefix for any created local pool", 2021-03-10T19:58:21.032 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.033 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.033 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.033 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.033 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "subtree": { 2021-03-10T19:58:21.033 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "subtree", 2021-03-10T19:58:21.034 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.034 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.034 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.034 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "rack", 2021-03-10T19:58:21.035 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.035 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.035 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.035 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "CRUSH level for which to create a local pool", 2021-03-10T19:58:21.036 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.036 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.036 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.036 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.036 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.037 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.037 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:21.037 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2021-03-10T19:58:21.037 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:21.038 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:21.038 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:21.038 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:21.038 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:21.039 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.039 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.039 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.039 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.039 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.040 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.040 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.040 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.040 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.040 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.041 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.041 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.041 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.041 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.042 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.042 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.042 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.042 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.042 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.043 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:21.043 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:21.043 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.043 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.044 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.044 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.044 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.044 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.044 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.045 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.045 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.045 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.045 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.045 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.046 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:21.046 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:21.046 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.046 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.047 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.047 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:21.047 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.047 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.047 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.048 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.048 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.048 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.048 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.049 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.049 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.049 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.049 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.049 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.050 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.050 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.050 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.050 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:21.051 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:21.051 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.051 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.051 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.052 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.053 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.053 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.053 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.054 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.054 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.054 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.054 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.055 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.055 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator": { 2021-03-10T19:58:21.055 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2021-03-10T19:58:21.055 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.055 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.056 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.056 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T19:58:21.056 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.056 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.057 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.057 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2021-03-10T19:58:21.057 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rook", 2021-03-10T19:58:21.057 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "test_orchestrator" 2021-03-10T19:58:21.057 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.058 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Orchestrator backend", 2021-03-10T19:58:21.058 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.058 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.058 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.059 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.059 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.059 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.059 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:21.060 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "osd_support", 2021-03-10T19:58:21.060 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:21.060 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:21.061 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:21.061 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:21.061 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:21.061 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.062 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.062 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.062 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.063 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.063 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.063 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.063 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.063 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.064 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.064 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.064 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.064 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.065 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.065 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.065 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.065 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.065 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.066 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.066 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:21.066 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:21.066 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.067 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.067 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.067 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.068 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.068 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.068 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.068 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.069 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.069 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.069 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.070 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.070 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:21.070 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:21.070 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.070 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.071 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.071 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:21.071 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.071 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.072 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.072 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.072 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.072 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.072 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.073 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.073 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.073 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.073 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.074 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.074 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.074 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.074 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.074 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:21.075 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:21.075 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.077 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.077 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.077 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.077 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.078 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.078 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.078 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.079 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.079 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.079 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.079 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.079 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.080 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.080 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:21.080 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_autoscaler", 2021-03-10T19:58:21.080 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:21.081 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:21.081 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:21.081 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:21.081 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:21.081 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.082 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.082 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.082 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.082 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.082 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.083 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.083 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.083 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.083 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.084 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.084 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.084 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.084 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.084 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.085 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.085 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.085 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.085 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.086 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:21.086 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:21.086 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.086 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.086 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.087 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.087 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.087 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.087 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.087 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.088 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.088 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.088 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.088 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.089 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:21.089 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:21.089 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.089 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.089 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.090 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:21.090 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.090 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.090 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.090 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.091 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.091 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.091 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.091 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.091 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.092 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.092 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.092 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.092 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.093 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.093 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.093 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:21.093 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:21.093 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.094 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.094 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.094 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.094 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.094 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.095 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.095 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.095 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.095 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.096 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.096 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.096 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T19:58:21.096 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T19:58:21.096 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.097 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.097 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.097 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T19:58:21.097 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.097 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.098 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.098 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.098 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.099 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.099 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.099 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.099 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.099 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.100 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:21.100 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "progress", 2021-03-10T19:58:21.100 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:21.100 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:21.100 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:21.101 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:21.101 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:21.101 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.101 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.102 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.102 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.102 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.102 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.102 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.103 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.103 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.103 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.103 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.103 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.104 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.104 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.104 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.104 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.105 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.105 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.105 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.105 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:21.105 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:21.106 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.106 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.106 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.106 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.107 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.107 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.107 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.107 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.107 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.108 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.108 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.108 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.108 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:21.108 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:21.109 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.109 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.109 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.109 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:21.109 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.110 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.110 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.110 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.110 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.111 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.111 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.111 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.111 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.111 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.112 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.112 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.112 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.112 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.112 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.113 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:21.113 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:21.113 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.113 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.114 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.114 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.114 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.114 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.114 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.115 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.115 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.115 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.115 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.115 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.116 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max_completed_events": { 2021-03-10T19:58:21.116 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "max_completed_events", 2021-03-10T19:58:21.116 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:21.116 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.116 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.117 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "50", 2021-03-10T19:58:21.117 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.117 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.117 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.118 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "number of past completed events to remember", 2021-03-10T19:58:21.118 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.118 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.118 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.118 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.119 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "persist_interval": { 2021-03-10T19:58:21.119 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "persist_interval", 2021-03-10T19:58:21.119 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:21.119 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.119 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.120 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T19:58:21.120 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.120 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.120 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.120 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to persist completed events", 2021-03-10T19:58:21.121 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.121 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.121 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.121 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.122 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.122 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.122 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:21.122 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prometheus", 2021-03-10T19:58:21.122 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:21.123 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:21.123 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:21.123 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:21.123 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:21.124 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.124 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.124 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.124 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.124 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.125 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.125 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.125 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.125 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.126 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.126 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.126 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.126 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.127 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.127 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.127 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.127 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.127 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.128 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.128 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:21.128 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:21.128 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.128 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.129 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.129 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.129 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.129 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.129 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.130 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.130 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.130 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.130 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.131 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.131 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:21.131 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:21.131 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.131 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.132 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.132 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:21.132 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.132 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.132 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.133 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.133 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.133 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.133 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.134 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.134 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.134 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.135 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.135 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.135 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.135 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.135 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.136 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:21.136 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:21.136 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.136 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.136 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.137 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.137 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.137 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.137 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.137 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.138 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.138 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.138 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.138 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.139 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools": { 2021-03-10T19:58:21.139 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools", 2021-03-10T19:58:21.139 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.139 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.139 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.140 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.140 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.140 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.140 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.140 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.141 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.141 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.141 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.141 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.141 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools_refresh_interval": { 2021-03-10T19:58:21.142 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools_refresh_interval", 2021-03-10T19:58:21.142 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.142 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.142 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.143 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.143 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.143 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.143 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.143 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.144 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.144 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.144 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.144 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.144 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_interval": { 2021-03-10T19:58:21.145 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_interval", 2021-03-10T19:58:21.145 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.145 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.145 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.145 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.146 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.146 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.146 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.146 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.147 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.147 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.147 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.147 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.147 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T19:58:21.148 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T19:58:21.148 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.148 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.148 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.148 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.149 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.149 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.149 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.149 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.150 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.150 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.150 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.150 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.150 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T19:58:21.151 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T19:58:21.151 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.151 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.151 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.151 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.152 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.152 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.152 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.152 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.153 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.153 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.153 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.153 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.153 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.154 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.154 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:21.154 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_support", 2021-03-10T19:58:21.154 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:21.154 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:21.155 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:21.155 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:21.155 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:21.155 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.155 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.156 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.156 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.156 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.156 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.157 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.157 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.157 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.157 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.157 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.158 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.158 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.158 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.158 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.159 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.159 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.159 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.159 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.159 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:21.160 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:21.160 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.160 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.160 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.160 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.161 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.161 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.161 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.161 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.161 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.162 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.162 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.162 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.162 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:21.162 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:21.163 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.163 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.163 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.163 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:21.164 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.164 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.164 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.164 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.164 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.165 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.165 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.165 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.165 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.165 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.166 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.166 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.166 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.166 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.167 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.167 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:21.167 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:21.167 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.167 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.168 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.168 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.168 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.168 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.168 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.169 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.169 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.169 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.169 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.169 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.170 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mirror_snapshot_schedule": { 2021-03-10T19:58:21.170 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mirror_snapshot_schedule", 2021-03-10T19:58:21.170 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.170 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.171 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.171 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.171 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.171 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.171 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.172 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.172 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.172 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.172 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.172 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.173 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "trash_purge_schedule": { 2021-03-10T19:58:21.173 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "trash_purge_schedule", 2021-03-10T19:58:21.173 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.173 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.173 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.174 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.174 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.174 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.174 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.175 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.175 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.175 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.175 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.175 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.176 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.176 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.176 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:21.176 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "restful", 2021-03-10T19:58:21.176 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:21.177 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:21.177 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:21.177 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2021-03-10T19:58:21.177 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2021-03-10T19:58:21.177 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.178 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.178 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.178 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.178 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.179 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.179 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.179 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.179 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.179 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.180 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.180 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.180 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:21.180 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:21.180 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.181 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.181 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.181 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.181 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.181 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.182 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.182 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.182 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.182 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.183 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.183 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.183 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.183 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.183 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.184 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.184 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.184 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.184 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.184 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:21.185 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:21.185 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.185 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.185 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.186 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.186 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.186 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.186 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.186 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.187 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.187 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.187 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.187 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.187 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:21.188 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:21.188 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.188 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.188 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.188 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:21.189 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.189 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.189 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.189 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.190 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.190 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.190 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.190 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.190 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.191 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.191 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.191 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.191 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.191 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.192 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.192 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:21.192 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:21.192 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.192 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.193 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.193 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.193 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.193 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.193 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.194 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.194 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.194 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.194 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.195 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.195 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T19:58:21.195 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T19:58:21.195 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.195 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.196 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.196 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.196 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.196 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.196 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.197 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.197 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.197 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.197 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.197 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.198 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T19:58:21.198 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T19:58:21.198 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.198 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.199 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.199 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.199 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.199 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.199 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.200 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.200 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.200 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.200 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.200 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.201 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.201 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.201 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:21.201 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rook", 2021-03-10T19:58:21.201 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:21.202 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:21.202 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:21.202 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:21.202 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:21.203 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.203 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.203 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.203 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.203 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.204 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.204 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.204 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.204 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.204 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.205 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.205 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.205 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.205 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.205 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.206 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.206 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.206 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.206 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.206 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:21.207 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:21.207 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.207 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.207 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.208 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.208 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.208 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.208 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.208 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.209 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.209 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.209 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.209 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.209 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:21.210 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:21.210 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.210 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.210 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.211 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:21.211 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.211 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.211 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.211 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.212 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.212 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.212 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.212 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.212 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.213 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.213 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.213 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.213 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.213 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.214 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.214 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:21.214 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:21.214 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.214 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.215 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.215 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.215 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.215 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.216 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.216 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.216 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.216 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.216 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.217 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.217 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.217 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.217 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:21.217 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "selftest", 2021-03-10T19:58:21.218 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:21.218 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:21.218 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:21.218 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:21.218 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:21.219 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.219 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.219 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.219 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.219 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.220 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.220 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.220 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.220 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.221 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.221 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.221 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.221 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.221 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.222 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.222 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.222 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.222 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.222 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.223 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:21.223 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:21.223 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.223 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.223 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.224 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.224 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.224 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.224 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.225 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.225 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.225 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.225 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.226 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.226 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:21.226 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:21.226 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.227 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.227 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.227 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:21.227 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.227 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.228 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.228 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.228 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.228 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.228 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.229 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.229 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.229 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.229 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.229 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.230 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.230 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.230 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.230 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:21.230 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:21.231 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.231 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.231 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.231 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.232 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.232 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.232 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.232 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.232 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.233 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.233 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.233 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.233 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption1": { 2021-03-10T19:58:21.233 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption1", 2021-03-10T19:58:21.234 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.234 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.234 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.234 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.235 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.235 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.235 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.235 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.235 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.236 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.236 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.236 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.236 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption2": { 2021-03-10T19:58:21.236 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption2", 2021-03-10T19:58:21.237 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.237 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.237 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.237 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "xyz", 2021-03-10T19:58:21.237 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.238 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.238 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.239 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.239 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.239 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.240 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.240 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.241 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption1": { 2021-03-10T19:58:21.241 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption1", 2021-03-10T19:58:21.241 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.241 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.241 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.242 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.242 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.242 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.242 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.243 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.243 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.243 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.243 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.244 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.245 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption2": { 2021-03-10T19:58:21.245 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption2", 2021-03-10T19:58:21.245 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:21.245 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.245 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.246 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.246 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.246 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.246 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.247 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.247 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.248 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.248 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.248 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.248 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption3": { 2021-03-10T19:58:21.249 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption3", 2021-03-10T19:58:21.249 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T19:58:21.249 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.249 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.250 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.250 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.250 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.251 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.251 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.251 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.251 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.252 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.252 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.252 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption4": { 2021-03-10T19:58:21.252 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption4", 2021-03-10T19:58:21.252 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.253 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.253 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.253 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.253 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.254 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.254 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.254 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.254 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.254 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.255 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.255 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.255 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption5": { 2021-03-10T19:58:21.255 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption5", 2021-03-10T19:58:21.256 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.256 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.256 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.256 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.256 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.257 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.257 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.257 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.257 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.257 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.258 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.258 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.260 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption6": { 2021-03-10T19:58:21.260 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption6", 2021-03-10T19:58:21.260 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.260 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.261 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.261 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:21.261 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.262 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.262 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.262 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.262 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.263 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.263 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.263 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.263 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testkey": { 2021-03-10T19:58:21.263 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testkey", 2021-03-10T19:58:21.264 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.264 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.265 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.265 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.265 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.265 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.265 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.266 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.266 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.266 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.266 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.267 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.267 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testlkey": { 2021-03-10T19:58:21.267 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testlkey", 2021-03-10T19:58:21.267 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.267 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.268 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.268 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.268 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.268 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.268 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.269 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.269 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.269 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.269 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.269 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.270 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testnewline": { 2021-03-10T19:58:21.270 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testnewline", 2021-03-10T19:58:21.270 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.270 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.271 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.271 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.271 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.271 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.271 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.272 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.272 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.272 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.273 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.273 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.273 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.273 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.273 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:21.274 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "status", 2021-03-10T19:58:21.274 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:21.274 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:21.274 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:21.276 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:21.276 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:21.276 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.276 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.277 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.277 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.277 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.277 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.278 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.278 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.278 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.278 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.279 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.279 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.279 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.279 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.279 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.280 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.280 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.281 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.281 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.281 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:21.282 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:21.282 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.282 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.282 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.283 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.283 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.283 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.283 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.283 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.284 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.284 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.284 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.284 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.285 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:21.285 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:21.285 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.285 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.285 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.286 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:21.286 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.286 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.287 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.287 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.287 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.287 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.287 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.288 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.288 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.288 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.288 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.288 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.289 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.289 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.289 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.289 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:21.289 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:21.290 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.290 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.290 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.291 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.291 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.291 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.291 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.291 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.292 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.292 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.292 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.292 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.293 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.293 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.293 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:21.293 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telegraf", 2021-03-10T19:58:21.293 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:21.294 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:21.294 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:21.294 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "address": { 2021-03-10T19:58:21.294 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "address", 2021-03-10T19:58:21.295 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.295 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.295 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.295 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "unixgram:///tmp/telegraf.sock", 2021-03-10T19:58:21.295 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.296 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.296 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.296 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.296 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.296 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.297 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.297 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.297 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T19:58:21.297 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T19:58:21.298 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:21.298 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.298 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.298 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15", 2021-03-10T19:58:21.299 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.299 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.299 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.299 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.300 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.300 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.300 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.300 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.300 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:21.301 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:21.301 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.301 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.301 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.302 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.302 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.302 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.302 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.303 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.303 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.303 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.303 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.303 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.304 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.304 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.304 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.304 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.304 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.305 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.305 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.305 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:21.305 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:21.305 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.306 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.306 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.306 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.306 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.307 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.307 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.307 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.307 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.307 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.308 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.308 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.308 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:21.308 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:21.308 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.309 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.309 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.309 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:21.309 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.310 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.310 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.310 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.310 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.310 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.311 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.311 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.311 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.311 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.311 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.312 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.312 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.312 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.313 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.313 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:21.313 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:21.313 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.314 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.314 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.314 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.314 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.314 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.315 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.315 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.315 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.315 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.315 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.316 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.316 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.316 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.316 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:21.317 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telemetry", 2021-03-10T19:58:21.317 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:21.317 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:21.317 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:21.317 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_basic": { 2021-03-10T19:58:21.318 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_basic", 2021-03-10T19:58:21.318 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.318 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.318 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.319 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:21.319 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.319 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.319 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.320 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Share basic cluster information (size, version)", 2021-03-10T19:58:21.320 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.320 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.320 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.320 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.321 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_crash": { 2021-03-10T19:58:21.321 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_crash", 2021-03-10T19:58:21.321 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.321 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.322 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.322 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:21.322 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.322 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.322 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.323 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.323 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.323 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.323 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.323 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.324 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_device": { 2021-03-10T19:58:21.324 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_device", 2021-03-10T19:58:21.324 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.325 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.325 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.325 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:21.325 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.326 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.326 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.326 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.326 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.326 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.327 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.327 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.327 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_ident": { 2021-03-10T19:58:21.328 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_ident", 2021-03-10T19:58:21.328 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.328 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.328 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.328 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.329 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.329 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.329 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.329 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.329 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.330 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.330 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.330 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.330 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "contact": { 2021-03-10T19:58:21.331 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "contact", 2021-03-10T19:58:21.331 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.331 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.331 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.331 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T19:58:21.332 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.332 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.332 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.332 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.333 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.333 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.333 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.333 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.333 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "description": { 2021-03-10T19:58:21.334 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "description", 2021-03-10T19:58:21.334 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.334 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.334 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.334 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T19:58:21.335 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.335 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.335 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.335 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.336 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.336 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.336 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.336 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.337 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_url": { 2021-03-10T19:58:21.337 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_url", 2021-03-10T19:58:21.337 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.337 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.338 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.338 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/device", 2021-03-10T19:58:21.338 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.338 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.339 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.339 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.339 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.339 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.339 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.340 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.340 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enabled": { 2021-03-10T19:58:21.340 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enabled", 2021-03-10T19:58:21.340 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.340 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.341 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.341 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.341 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.341 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.344 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.344 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.346 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.346 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.346 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.346 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.347 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T19:58:21.347 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T19:58:21.347 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:21.347 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.347 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.348 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "24", 2021-03-10T19:58:21.348 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "8", 2021-03-10T19:58:21.348 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.348 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.349 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.349 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.349 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.349 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.350 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.350 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_opt_revision": { 2021-03-10T19:58:21.350 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "last_opt_revision", 2021-03-10T19:58:21.350 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:21.351 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.351 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.351 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1", 2021-03-10T19:58:21.352 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.352 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.352 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.352 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.352 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.353 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.353 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.353 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.353 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "leaderboard": { 2021-03-10T19:58:21.353 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "leaderboard", 2021-03-10T19:58:21.354 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.354 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.354 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.354 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.355 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.355 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.355 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.355 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.355 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.356 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.356 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.356 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.356 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:21.356 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:21.357 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.357 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.357 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.357 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.358 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.358 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.358 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.358 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.358 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.359 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.359 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.359 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.359 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.359 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.360 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.360 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.360 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.360 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.361 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.361 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:21.361 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:21.361 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.361 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.362 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.362 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.362 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.363 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.363 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.364 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.364 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.365 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.365 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.365 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.365 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:21.366 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:21.366 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.366 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.366 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.366 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:21.367 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.367 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.367 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.367 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.368 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.368 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.368 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.368 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.368 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.369 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.369 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.369 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.369 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.369 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.370 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.370 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:21.370 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:21.370 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.371 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.371 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.371 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.371 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.371 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.372 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.372 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.372 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.372 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.372 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.373 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.373 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "organization": { 2021-03-10T19:58:21.373 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "organization", 2021-03-10T19:58:21.373 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.374 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.374 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.374 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T19:58:21.374 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.374 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.375 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.375 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.375 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.375 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.376 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.376 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.376 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "proxy": { 2021-03-10T19:58:21.376 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "proxy", 2021-03-10T19:58:21.377 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.377 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.377 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.377 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T19:58:21.378 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.378 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.378 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.378 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.378 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.379 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.379 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.379 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.379 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url": { 2021-03-10T19:58:21.380 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url", 2021-03-10T19:58:21.380 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.380 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.380 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.380 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/report", 2021-03-10T19:58:21.381 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.381 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.381 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.382 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.382 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.382 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.382 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.382 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.383 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.383 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.383 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:21.383 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "test_orchestrator", 2021-03-10T19:58:21.383 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:21.384 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:21.384 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:21.384 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:21.384 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:21.385 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.385 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.385 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.385 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.385 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.386 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.386 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.386 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.386 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.387 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.387 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.387 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.387 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.388 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.388 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.388 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.388 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.388 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.389 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.389 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:21.389 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:21.389 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.389 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.390 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.390 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.390 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.390 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.391 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.391 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.391 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.391 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.392 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.392 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.392 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:21.392 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:21.393 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.393 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.393 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.393 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:21.393 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.394 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.394 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.394 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.394 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.394 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.395 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.395 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.395 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.395 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.396 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.396 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.396 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.396 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.396 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.397 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:21.397 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:21.397 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.397 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.397 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.398 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.398 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.398 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.398 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.398 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.399 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.399 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.399 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.400 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.400 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.400 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.400 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:21.400 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "volumes", 2021-03-10T19:58:21.401 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:21.401 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:21.401 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:21.401 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:21.402 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:21.402 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.402 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.402 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.402 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.403 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.403 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.403 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.403 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.404 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.404 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.404 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.404 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.404 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.405 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.405 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.405 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.405 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.405 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.406 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.406 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:21.406 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:21.406 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.407 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.407 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.407 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.407 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.407 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.408 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.408 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.408 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.408 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.408 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.409 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.409 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:21.409 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:21.409 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.410 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.410 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.410 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:21.410 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.410 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.411 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.411 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.411 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.411 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.411 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.412 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.412 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.412 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.412 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.413 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.413 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.413 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.414 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.414 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:21.414 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:21.414 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.414 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.415 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.415 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.415 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.415 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.415 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.416 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.416 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.416 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.416 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.417 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.417 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.417 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.417 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:21.417 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix", 2021-03-10T19:58:21.418 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:21.418 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:21.418 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:21.418 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "discovery_interval": { 2021-03-10T19:58:21.418 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "discovery_interval", 2021-03-10T19:58:21.419 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.419 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.419 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.420 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "100", 2021-03-10T19:58:21.420 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.420 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.420 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.420 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.421 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.421 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.421 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.421 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.422 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "identifier": { 2021-03-10T19:58:21.422 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "identifier", 2021-03-10T19:58:21.422 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.422 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.422 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.423 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.423 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.423 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.423 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.423 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.424 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.424 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.424 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.425 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.425 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T19:58:21.425 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T19:58:21.425 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:21.426 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.426 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.426 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T19:58:21.426 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.426 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.427 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.427 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.427 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.427 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.427 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.428 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.428 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:21.428 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:21.429 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.429 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.429 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.429 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:21.429 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.430 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.430 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.430 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.430 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.431 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.431 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.431 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.431 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.431 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.432 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.432 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.432 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.432 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.432 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.433 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:21.433 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:21.433 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.433 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.433 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.434 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.434 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.434 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.434 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.435 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.435 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.435 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.435 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.435 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.436 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:21.436 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:21.436 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.436 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.437 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.437 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:21.437 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.437 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.438 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:21.438 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:21.438 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:21.438 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:21.439 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:21.439 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:21.439 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:21.439 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.439 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.440 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.440 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.440 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.440 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.440 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:21.441 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:21.441 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:21.441 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.441 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:21.442 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:21.442 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.442 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.442 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.443 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.443 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.443 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.443 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.444 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.444 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_host": { 2021-03-10T19:58:21.444 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_host", 2021-03-10T19:58:21.444 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.444 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.445 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.445 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T19:58:21.445 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.446 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.446 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.446 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.446 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.447 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.447 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.447 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.447 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_port": { 2021-03-10T19:58:21.448 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_port", 2021-03-10T19:58:21.448 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:21.448 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.448 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.448 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10051", 2021-03-10T19:58:21.449 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.449 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.449 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.449 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.450 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.450 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.450 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.451 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.451 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_sender": { 2021-03-10T19:58:21.451 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_sender", 2021-03-10T19:58:21.451 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:21.452 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:21.452 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:21.452 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "/usr/bin/zabbix_sender", 2021-03-10T19:58:21.452 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:21.453 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:21.453 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:21.453 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:21.453 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:21.453 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:21.454 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:21.454 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.454 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.454 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.454 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.455 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {}, 2021-03-10T19:58:21.455 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "always_on_modules": { 2021-03-10T19:58:21.455 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nautilus": [ 2021-03-10T19:58:21.455 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2021-03-10T19:58:21.456 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2021-03-10T19:58:21.456 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2021-03-10T19:58:21.456 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator_cli", 2021-03-10T19:58:21.456 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2021-03-10T19:58:21.456 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2021-03-10T19:58:21.457 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2021-03-10T19:58:21.457 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2021-03-10T19:58:21.457 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.457 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "octopus": [ 2021-03-10T19:58:21.457 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2021-03-10T19:58:21.458 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2021-03-10T19:58:21.458 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2021-03-10T19:58:21.458 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator", 2021-03-10T19:58:21.458 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_support", 2021-03-10T19:58:21.458 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_autoscaler", 2021-03-10T19:58:21.459 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2021-03-10T19:58:21.459 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2021-03-10T19:58:21.459 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2021-03-10T19:58:21.459 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "telemetry", 2021-03-10T19:58:21.460 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2021-03-10T19:58:21.460 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:21.460 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_failure_osd_epoch": 0, 2021-03-10T19:58:21.460 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_clients": [ 2021-03-10T19:58:21.460 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:21.461 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T19:58:21.461 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:21.461 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T19:58:21.461 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.123:0", 2021-03-10T19:58:21.462 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 3654852492 2021-03-10T19:58:21.462 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.462 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T19:58:21.462 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.463 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:21.463 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T19:58:21.463 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:21.463 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T19:58:21.464 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.123:0", 2021-03-10T19:58:21.464 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1668334859 2021-03-10T19:58:21.464 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.464 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T19:58:21.465 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:21.465 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:21.465 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T19:58:21.465 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:21.466 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T19:58:21.466 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.123:0", 2021-03-10T19:58:21.466 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 2479556364 2021-03-10T19:58:21.466 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.466 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T19:58:21.467 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.467 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T19:58:21.467 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.467 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:21.469 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Waiting for the mgr to restart... 2021-03-10T19:58:21.469 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Waiting for Mgr epoch 5... 2021-03-10T19:58:21.469 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba023', '-v', '/var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'tell', 'mgr', 'mgr_status'] 2021-03-10T19:58:21.469 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba023 -v /var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 tell mgr mgr_status 2021-03-10T19:58:21.470 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:20 gibba023 bash[9844]: audit 2021-03-10T19:58:19.984353+0000 mon.a (mon.0) 39 : audit [DBG] from='client.? 172.21.2.123:0/452342152' entity='client.admin' cmd=[{"prefix": "mgr dump"}]: dispatch 2021-03-10T19:58:21.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:21 gibba023 bash[9844]: cluster 2021-03-10T19:58:21.167422+0000 mon.a (mon.0) 40 : cluster [INF] Active manager daemon y restarted 2021-03-10T19:58:21.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:21 gibba023 bash[9844]: cluster 2021-03-10T19:58:21.168054+0000 mon.a (mon.0) 41 : cluster [INF] Activating manager daemon y 2021-03-10T19:58:21.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:21 gibba023 bash[9844]: cluster 2021-03-10T19:58:21.169676+0000 mon.a (mon.0) 42 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2021-03-10T19:58:22.609 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:22.609 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap_epoch": 7, 2021-03-10T19:58:22.609 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "initialized": true 2021-03-10T19:58:22.609 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:22.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:22 gibba023 bash[9844]: cluster 2021-03-10T19:58:21.590858+0000 mon.a (mon.0) 43 : cluster [DBG] mgrmap e6: y(active, starting, since 0.422896s) 2021-03-10T19:58:22.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:22 gibba023 bash[9844]: audit 2021-03-10T19:58:21.593161+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14117 172.21.2.123:0/3725512189' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T19:58:22.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:22 gibba023 bash[9844]: audit 2021-03-10T19:58:21.594063+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.14117 172.21.2.123:0/3725512189' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T19:58:22.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:22 gibba023 bash[9844]: audit 2021-03-10T19:58:21.594289+0000 mon.a (mon.0) 46 : audit [DBG] from='mgr.14117 172.21.2.123:0/3725512189' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T19:58:22.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:22 gibba023 bash[9844]: audit 2021-03-10T19:58:21.594467+0000 mon.a (mon.0) 47 : audit [DBG] from='mgr.14117 172.21.2.123:0/3725512189' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T19:58:22.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:22 gibba023 bash[9844]: audit 2021-03-10T19:58:21.595128+0000 mon.a (mon.0) 48 : audit [DBG] from='mgr.14117 172.21.2.123:0/3725512189' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T19:58:22.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:22 gibba023 bash[9844]: audit 2021-03-10T19:58:21.596250+0000 mon.a (mon.0) 49 : audit [DBG] from='mgr.14117 172.21.2.123:0/3725512189' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T19:58:22.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:22 gibba023 bash[9844]: audit 2021-03-10T19:58:21.596941+0000 mon.a (mon.0) 50 : audit [DBG] from='mgr.14117 172.21.2.123:0/3725512189' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T19:58:22.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:22 gibba023 bash[9844]: cluster 2021-03-10T19:58:21.600150+0000 mon.a (mon.0) 51 : cluster [INF] Manager daemon y is now available 2021-03-10T19:58:22.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:22 gibba023 bash[9844]: audit 2021-03-10T19:58:21.630728+0000 mon.a (mon.0) 52 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-03-10T19:58:22.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:22 gibba023 bash[9844]: audit 2021-03-10T19:58:21.785777+0000 mon.a (mon.0) 53 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-03-10T19:58:23.270 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Setting orchestrator backend to cephadm... 2021-03-10T19:58:23.271 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba023', '-v', '/var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'orch', 'set', 'backend', 'cephadm'] 2021-03-10T19:58:23.271 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba023 -v /var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 orch set backend cephadm 2021-03-10T19:58:23.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:23 gibba023 bash[9844]: cluster 2021-03-10T19:58:22.599508+0000 mon.a (mon.0) 54 : cluster [DBG] mgrmap e7: y(active, since 1.43153s) 2021-03-10T19:58:24.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:24 gibba023 bash[9844]: cluster 2021-03-10T19:58:23.609898+0000 mon.a (mon.0) 55 : cluster [DBG] mgrmap e8: y(active, since 2s) 2021-03-10T19:58:24.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:24 gibba023 bash[9844]: audit 2021-03-10T19:58:24.247824+0000 mgr.y (mgr.14117) 1 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T19:58:24.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:24 gibba023 bash[9844]: audit 2021-03-10T19:58:24.248791+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.14117 172.21.2.123:0/3725512189' entity='mgr.y' cmd=[{"prefix":"config set","value":"cephadm","who":"mgr","name":"mgr/orchestrator/orchestrator"}]: dispatch 2021-03-10T19:58:24.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:24 gibba023 bash[9844]: audit 2021-03-10T19:58:24.251045+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.14117 172.21.2.123:0/3725512189' entity='mgr.y' cmd='[{"prefix":"config set","value":"cephadm","who":"mgr","name":"mgr/orchestrator/orchestrator"}]': finished 2021-03-10T19:58:24.868 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Generating ssh key... 2021-03-10T19:58:24.869 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba023', '-v', '/var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'cephadm', 'generate-key'] 2021-03-10T19:58:24.869 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba023 -v /var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 cephadm generate-key 2021-03-10T19:58:26.426 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 19:58:26 gibba023 bash[10078]: Generating public/private rsa key pair. 2021-03-10T19:58:26.426 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 19:58:26 gibba023 bash[10078]: Your identification has been saved in /tmp/tmpr4hzct8i/key. 2021-03-10T19:58:26.427 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 19:58:26 gibba023 bash[10078]: Your public key has been saved in /tmp/tmpr4hzct8i/key.pub. 2021-03-10T19:58:26.427 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 19:58:26 gibba023 bash[10078]: The key fingerprint is: 2021-03-10T19:58:26.427 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 19:58:26 gibba023 bash[10078]: SHA256:YL/aS2cl7Fx0NvviFa+fTCSz91EennkRppspoTnJcAo ceph-dd719b26-81da-11eb-9080-001a4aab830c 2021-03-10T19:58:26.427 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 19:58:26 gibba023 bash[10078]: The key's randomart image is: 2021-03-10T19:58:26.428 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 19:58:26 gibba023 bash[10078]: +---[RSA 3072]----+ 2021-03-10T19:58:26.428 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 19:58:26 gibba023 bash[10078]: | | 2021-03-10T19:58:26.428 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 19:58:26 gibba023 bash[10078]: | | 2021-03-10T19:58:26.428 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 19:58:26 gibba023 bash[10078]: | o . +o | 2021-03-10T19:58:26.429 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 19:58:26 gibba023 bash[10078]: | . o . . ooo.| 2021-03-10T19:58:26.429 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 19:58:26 gibba023 bash[10078]: | E .S.o.o+.=.| 2021-03-10T19:58:26.429 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 19:58:26 gibba023 bash[10078]: | . =+++. XoO| 2021-03-10T19:58:26.429 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 19:58:26 gibba023 bash[10078]: | .o*=. =.B*| 2021-03-10T19:58:26.429 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 19:58:26 gibba023 bash[10078]: | + o. ..++=| 2021-03-10T19:58:26.430 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 19:58:26 gibba023 bash[10078]: | . o. o+o| 2021-03-10T19:58:26.430 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 19:58:26 gibba023 bash[10078]: +----[SHA256]-----+ 2021-03-10T19:58:26.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:26 gibba023 bash[9844]: audit 2021-03-10T19:58:26.154733+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14117 172.21.2.123:0/3725512189' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_key","val":"-----BEGIN OPENSSH PRIVATE KEY-----\nb3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAABlwAAAAdzc2gtcn\nNhAAAAAwEAAQAAAYEAvAZlFEhpdV0DQfuS2dXaZnMWRKdVb2x+SvfnXMVjbP09iVDtZl10\nqtlxJQta6ilREgr+LoO7K6ZtwTyGKqMcdN5HcYteHQUBcDf6dyfLnhxbs+flaCTUDMBpVM\nk/ZgDhLQ675YXj521mATm6SrLOePTb/WOxD+RJOgQWfp3eL0iXNeGwHUkwfS+/YvqitTHN\n0nze7+B/RpZlCKqx3CaoC0qNgZecQtrzk/xRhwUdi3Tc2mV5QK66KhvMl5eN1EEcPl1VuM\nBqIfbcfFuwwBT00iyVP5M4VHHBa1Kt6t0F6MG7XfDR1VDDsegnw5Q5PACP45OIKzt6bkbs\noKkRXWQ0QVzxrmrwp9TFxOTbfLJN/p+sJNDdXwdDWcy5zirmoRsGS4NvX5g3JKmq1zFf7S\n8PyN9Hj9lsEsBjuvjUuPULmSQt+8Nqwon7o1FvlvD1cxrajqslRfqbuiD+IxX/9DkLM8It\n9zF5LsiBUb46ftUPMIuNjxtX/s5QDUMhYVDr73mnAAAFoGpSOF9qUjhfAAAAB3NzaC1yc2\nEAAAGBALwGZRRIaXVdA0H7ktnV2mZzFkSnVW9sfkr351zFY2z9PYlQ7WZddKrZcSULWuop\nURIK/i6DuyumbcE8hiqjHHTeR3GLXh0FAXA3+ncny54cW7Pn5Wgk1AzAaVTJP2YA4S0Ou+\nWF4+dtZgE5ukqyznj02/1jsQ/kSToEFn6d3i9IlzXhsB1JMH0vv2L6orUxzdJ83u/gf0aW\nZQiqsdwmqAtKjYGXnELa85P8UYcFHYt03NpleUCuuiobzJeXjdRBHD5dVbjAaiH23HxbsM\nAU9NIslT+TOFRxwWtSrerdBejBu13w0dVQw7HoJ8OUOTwAj+OTiCs7em5G7KCpEV1kNEFc\n8a5q8KfUxcTk23yyTf6frCTQ3V8HQ1nMuc4q5qEbBkuDb1+YNySpqtcxX+0vD8jfR4/ZbB\nLAY7r41Lj1C5kkLfvDasKJ+6NRb5bw9XMa2o6rJUX6m7og/iMV//Q5CzPCLfcxeS7IgVG+\nOn7VDzCLjY8bV/7OUA1DIWFQ6+95pwAAAAMBAAEAAAGAINL4+GZ/ypZXSECT7WVxACudOp\nT/zDjjf1Dx2fc3mUJIaN1w5EryYBUftHjcAT7/QSgcIaCrnz4psO9Q+MaK5Dgdvsu2vVgv\nXRjYp86RtGN8+tZD7T9oqWU5vix33eXPaZ9F3BbYp4EoqpQaWooGk4UjloO92GlhAzjNeI\nM004pXo3dn2GT7iw832R6qIvmz1cgo3zWQ4pDEyJOMA0PYWEhGldYS2HUCytXkoa6Z7suS\n9ql6VnlqVImP2PMDNoe7CnmeXxjNGd4WJ228Yi1At4vtZz8ozV3buQrEX75CBvIXbpJ2M1\nFSmj9ruYBKvc8dXSU6wATq5WOjl+58/8MLzExM+wCxzvVyUaCDJtIMr09Px2jQUDxd2ANe\n3W0P73Qfwllg1+7dtFtbtiJ2fS68zB9peX8PkF4hiZ+ijknwSKa8YI0uA+XgncL30MSEyh\nDWR6m3WY48fj4M05WyIVaohONz3b0hMuQHh5p0JGFy8APi/GtWs6l518D0THMnmzlpAAAA\nwEB/k8rWOk5tII1qtvTPQpC1VBTPwBYlHLgGMtMIFmGC5d2ljxTA2uWgjbhiMfX4EzqNGc\nItjhmDSKRSSrF4gaj7286vS+jEEJAkoxffNteFucYhCXyys8sTYLCxtOJV8spVlJSZHjtK\nUBFBbIhHoAQ/MabbGNIQPMYDunvpGPTNp66m6FXtvrxqGYRES6/lCSyOPNVayz3fL49Ron\nkyWbZwKXdFs6oaroNbSmS4FNWbU83UPq1wdlMyWEWnlq2dnQAAAMEA9CqqKM3yAnn98G5G\nQ9nstl0ReAAk+DjOzvLJQyMEz3vsbojaloeO8bYs/Pd6+tVZYkNCozX10avHpi6/ep+2mK\nUIu8te6hVS1Edb9Gf21QYxTdpFVbMTf+mbpgCr9e+YhXNsaATbqtxZACavk0ggE2saCJdR\nlHL6ICyNdDUApDALlkk3Dmf1IH5bbUWglv0Ln9pf4hBXHv6yxuqqjUWBBUkumi2HC83BAY\ntl6BhfSM2mrJ+McXt6QzB5ltconsiFAAAAwQDFIzCMGDwkKPuC9QzeEK1KULDLqBuPcqzH\nUyyryOlgPuLEffGcjPj4+/Fm9LgIKKiA2k825RM/77mP/XzRsaNU/IemzKkWNyzKYQWOID\n2UPfYdDY66IEvEeAfUnag7EPQhBDzYkcbaBBgCoCqv14rXqVn37hqYfR6bYDjns3osT4QV\nBj0TypHf8GDCthqly/NN9Pl/RHaVIAhrkw0bCRF/UQpBicauwVNrS72ANsL7NmrOBmMlrO\n49pdGrS9MPJzsAAAApY2VwaC1kZDcxOWIyNi04MWRhLTExZWItOTA4MC0wMDFhNGFhYjgz\nMGMBAg==\n-----END OPENSSH PRIVATE KEY-----\n"}]: dispatch 2021-03-10T19:58:26.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:26 gibba023 bash[9844]: audit 2021-03-10T19:58:26.156434+0000 mon.a (mon.0) 59 : audit [INF] from='mgr.14117 172.21.2.123:0/3725512189' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_key","val":"-----BEGIN OPENSSH PRIVATE KEY-----\nb3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAABlwAAAAdzc2gtcn\nNhAAAAAwEAAQAAAYEAvAZlFEhpdV0DQfuS2dXaZnMWRKdVb2x+SvfnXMVjbP09iVDtZl10\nqtlxJQta6ilREgr+LoO7K6ZtwTyGKqMcdN5HcYteHQUBcDf6dyfLnhxbs+flaCTUDMBpVM\nk/ZgDhLQ675YXj521mATm6SrLOePTb/WOxD+RJOgQWfp3eL0iXNeGwHUkwfS+/YvqitTHN\n0nze7+B/RpZlCKqx3CaoC0qNgZecQtrzk/xRhwUdi3Tc2mV5QK66KhvMl5eN1EEcPl1VuM\nBqIfbcfFuwwBT00iyVP5M4VHHBa1Kt6t0F6MG7XfDR1VDDsegnw5Q5PACP45OIKzt6bkbs\noKkRXWQ0QVzxrmrwp9TFxOTbfLJN/p+sJNDdXwdDWcy5zirmoRsGS4NvX5g3JKmq1zFf7S\n8PyN9Hj9lsEsBjuvjUuPULmSQt+8Nqwon7o1FvlvD1cxrajqslRfqbuiD+IxX/9DkLM8It\n9zF5LsiBUb46ftUPMIuNjxtX/s5QDUMhYVDr73mnAAAFoGpSOF9qUjhfAAAAB3NzaC1yc2\nEAAAGBALwGZRRIaXVdA0H7ktnV2mZzFkSnVW9sfkr351zFY2z9PYlQ7WZddKrZcSULWuop\nURIK/i6DuyumbcE8hiqjHHTeR3GLXh0FAXA3+ncny54cW7Pn5Wgk1AzAaVTJP2YA4S0Ou+\nWF4+dtZgE5ukqyznj02/1jsQ/kSToEFn6d3i9IlzXhsB1JMH0vv2L6orUxzdJ83u/gf0aW\nZQiqsdwmqAtKjYGXnELa85P8UYcFHYt03NpleUCuuiobzJeXjdRBHD5dVbjAaiH23HxbsM\nAU9NIslT+TOFRxwWtSrerdBejBu13w0dVQw7HoJ8OUOTwAj+OTiCs7em5G7KCpEV1kNEFc\n8a5q8KfUxcTk23yyTf6frCTQ3V8HQ1nMuc4q5qEbBkuDb1+YNySpqtcxX+0vD8jfR4/ZbB\nLAY7r41Lj1C5kkLfvDasKJ+6NRb5bw9XMa2o6rJUX6m7og/iMV//Q5CzPCLfcxeS7IgVG+\nOn7VDzCLjY8bV/7OUA1DIWFQ6+95pwAAAAMBAAEAAAGAINL4+GZ/ypZXSECT7WVxACudOp\nT/zDjjf1Dx2fc3mUJIaN1w5EryYBUftHjcAT7/QSgcIaCrnz4psO9Q+MaK5Dgdvsu2vVgv\nXRjYp86RtGN8+tZD7T9oqWU5vix33eXPaZ9F3BbYp4EoqpQaWooGk4UjloO92GlhAzjNeI\nM004pXo3dn2GT7iw832R6qIvmz1cgo3zWQ4pDEyJOMA0PYWEhGldYS2HUCytXkoa6Z7suS\n9ql6VnlqVImP2PMDNoe7CnmeXxjNGd4WJ228Yi1At4vtZz8ozV3buQrEX75CBvIXbpJ2M1\nFSmj9ruYBKvc8dXSU6wATq5WOjl+58/8MLzExM+wCxzvVyUaCDJtIMr09Px2jQUDxd2ANe\n3W0P73Qfwllg1+7dtFtbtiJ2fS68zB9peX8PkF4hiZ+ijknwSKa8YI0uA+XgncL30MSEyh\nDWR6m3WY48fj4M05WyIVaohONz3b0hMuQHh5p0JGFy8APi/GtWs6l518D0THMnmzlpAAAA\nwEB/k8rWOk5tII1qtvTPQpC1VBTPwBYlHLgGMtMIFmGC5d2ljxTA2uWgjbhiMfX4EzqNGc\nItjhmDSKRSSrF4gaj7286vS+jEEJAkoxffNteFucYhCXyys8sTYLCxtOJV8spVlJSZHjtK\nUBFBbIhHoAQ/MabbGNIQPMYDunvpGPTNp66m6FXtvrxqGYRES6/lCSyOPNVayz3fL49Ron\nkyWbZwKXdFs6oaroNbSmS4FNWbU83UPq1wdlMyWEWnlq2dnQAAAMEA9CqqKM3yAnn98G5G\nQ9nstl0ReAAk+DjOzvLJQyMEz3vsbojaloeO8bYs/Pd6+tVZYkNCozX10avHpi6/ep+2mK\nUIu8te6hVS1Edb9Gf21QYxTdpFVbMTf+mbpgCr9e+YhXNsaATbqtxZACavk0ggE2saCJdR\nlHL6ICyNdDUApDALlkk3Dmf1IH5bbUWglv0Ln9pf4hBXHv6yxuqqjUWBBUkumi2HC83BAY\ntl6BhfSM2mrJ+McXt6QzB5ltconsiFAAAAwQDFIzCMGDwkKPuC9QzeEK1KULDLqBuPcqzH\nUyyryOlgPuLEffGcjPj4+/Fm9LgIKKiA2k825RM/77mP/XzRsaNU/IemzKkWNyzKYQWOID\n2UPfYdDY66IEvEeAfUnag7EPQhBDzYkcbaBBgCoCqv14rXqVn37hqYfR6bYDjns3osT4QV\nBj0TypHf8GDCthqly/NN9Pl/RHaVIAhrkw0bCRF/UQpBicauwVNrS72ANsL7NmrOBmMlrO\n49pdGrS9MPJzsAAAApY2VwaC1kZDcxOWIyNi04MWRhLTExZWItOTA4MC0wMDFhNGFhYjgz\nMGMBAg==\n-----END OPENSSH PRIVATE KEY-----\n"}]': finished 2021-03-10T19:58:26.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:26 gibba023 bash[9844]: audit 2021-03-10T19:58:26.157028+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14117 172.21.2.123:0/3725512189' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_pub","val":"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8BmUUSGl1XQNB+5LZ1dpmcxZEp1VvbH5K9+dcxWNs/T2JUO1mXXSq2XElC1rqKVESCv4ug7srpm3BPIYqoxx03kdxi14dBQFwN/p3J8ueHFuz5+VoJNQMwGlUyT9mAOEtDrvlhePnbWYBObpKss549Nv9Y7EP5Ek6BBZ+nd4vSJc14bAdSTB9L79i+qK1Mc3SfN7v4H9GlmUIqrHcJqgLSo2Bl5xC2vOT/FGHBR2LdNzaZXlArroqG8yXl43UQRw+XVW4wGoh9tx8W7DAFPTSLJU/kzhUccFrUq3q3QXowbtd8NHVUMOx6CfDlDk8AI/jk4grO3puRuygqRFdZDRBXPGuavCn1MXE5Nt8sk3+n6wk0N1fB0NZzLnOKuahGwZLg29fmDckqarXMV/tLw/I30eP2WwSwGO6+NS49QuZJC37w2rCifujUW+W8PVzGtqOqyVF+pu6IP4jFf/0OQszwi33MXkuyIFRvjp+1Q8wi42PG1f+zlANQyFhUOvveac= ceph-dd719b26-81da-11eb-9080-001a4aab830c\n"}]: dispatch 2021-03-10T19:58:26.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:26 gibba023 bash[9844]: audit 2021-03-10T19:58:26.158418+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.14117 172.21.2.123:0/3725512189' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_pub","val":"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8BmUUSGl1XQNB+5LZ1dpmcxZEp1VvbH5K9+dcxWNs/T2JUO1mXXSq2XElC1rqKVESCv4ug7srpm3BPIYqoxx03kdxi14dBQFwN/p3J8ueHFuz5+VoJNQMwGlUyT9mAOEtDrvlhePnbWYBObpKss549Nv9Y7EP5Ek6BBZ+nd4vSJc14bAdSTB9L79i+qK1Mc3SfN7v4H9GlmUIqrHcJqgLSo2Bl5xC2vOT/FGHBR2LdNzaZXlArroqG8yXl43UQRw+XVW4wGoh9tx8W7DAFPTSLJU/kzhUccFrUq3q3QXowbtd8NHVUMOx6CfDlDk8AI/jk4grO3puRuygqRFdZDRBXPGuavCn1MXE5Nt8sk3+n6wk0N1fB0NZzLnOKuahGwZLg29fmDckqarXMV/tLw/I30eP2WwSwGO6+NS49QuZJC37w2rCifujUW+W8PVzGtqOqyVF+pu6IP4jFf/0OQszwi33MXkuyIFRvjp+1Q8wi42PG1f+zlANQyFhUOvveac= ceph-dd719b26-81da-11eb-9080-001a4aab830c\n"}]': finished 2021-03-10T19:58:26.769 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba023', '-v', '/var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'cephadm', 'get-pub-key'] 2021-03-10T19:58:26.770 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba023 -v /var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 cephadm get-pub-key 2021-03-10T19:58:27.479 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:27 gibba023 bash[9844]: audit 2021-03-10T19:58:25.930211+0000 mgr.y (mgr.14117) 2 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T19:58:27.479 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:27 gibba023 bash[9844]: cephadm 2021-03-10T19:58:25.930386+0000 mgr.y (mgr.14117) 3 : cephadm [INF] Generating ssh key... 2021-03-10T19:58:27.729 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8BmUUSGl1XQNB+5LZ1dpmcxZEp1VvbH5K9+dcxWNs/T2JUO1mXXSq2XElC1rqKVESCv4ug7srpm3BPIYqoxx03kdxi14dBQFwN/p3J8ueHFuz5+VoJNQMwGlUyT9mAOEtDrvlhePnbWYBObpKss549Nv9Y7EP5Ek6BBZ+nd4vSJc14bAdSTB9L79i+qK1Mc3SfN7v4H9GlmUIqrHcJqgLSo2Bl5xC2vOT/FGHBR2LdNzaZXlArroqG8yXl43UQRw+XVW4wGoh9tx8W7DAFPTSLJU/kzhUccFrUq3q3QXowbtd8NHVUMOx6CfDlDk8AI/jk4grO3puRuygqRFdZDRBXPGuavCn1MXE5Nt8sk3+n6wk0N1fB0NZzLnOKuahGwZLg29fmDckqarXMV/tLw/I30eP2WwSwGO6+NS49QuZJC37w2rCifujUW+W8PVzGtqOqyVF+pu6IP4jFf/0OQszwi33MXkuyIFRvjp+1Q8wi42PG1f+zlANQyFhUOvveac= ceph-dd719b26-81da-11eb-9080-001a4aab830c 2021-03-10T19:58:28.339 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Wrote public SSH key to to /home/ubuntu/cephtest/ceph.pub 2021-03-10T19:58:28.339 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Adding key to root@localhost's authorized_keys... 2021-03-10T19:58:28.340 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Adding host gibba023... 2021-03-10T19:58:28.340 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba023', '-v', '/var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'orch', 'host', 'add', 'gibba023'] 2021-03-10T19:58:28.340 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba023 -v /var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 orch host add gibba023 2021-03-10T19:58:28.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:28 gibba023 bash[9844]: audit 2021-03-10T19:58:27.727378+0000 mgr.y (mgr.14117) 4 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T19:58:29.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:29 gibba023 bash[9844]: audit 2021-03-10T19:58:29.353347+0000 mgr.y (mgr.14117) 5 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "gibba023", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T19:58:29.676 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 19:58:29 gibba023 bash[10078]: Warning: Permanently added 'gibba023,172.21.2.123' (ECDSA) to the list of known hosts. 2021-03-10T19:58:30.357 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout Added host 'gibba023' 2021-03-10T19:58:30.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:30 gibba023 bash[9844]: audit 2021-03-10T19:58:29.755996+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.14117 172.21.2.123:0/3725512189' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"gibba023\": {\"hostname\": \"gibba023\", \"addr\": \"gibba023\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2021-03-10T19:58:30.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:30 gibba023 bash[9844]: audit 2021-03-10T19:58:29.757690+0000 mon.a (mon.0) 63 : audit [INF] from='mgr.14117 172.21.2.123:0/3725512189' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"gibba023\": {\"hostname\": \"gibba023\", \"addr\": \"gibba023\", \"labels\": [], \"status\": \"\"}}"}]': finished 2021-03-10T19:58:30.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:30 gibba023 bash[9844]: cephadm 2021-03-10T19:58:29.758028+0000 mgr.y (mgr.14117) 6 : cephadm [INF] Added host gibba023 2021-03-10T19:58:30.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:30 gibba023 bash[9844]: audit 2021-03-10T19:58:29.871361+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.14117 172.21.2.123:0/3725512189' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T19:58:30.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:30 gibba023 bash[9844]: audit 2021-03-10T19:58:29.873116+0000 mon.a (mon.0) 65 : audit [INF] from='mgr.14117 172.21.2.123:0/3725512189' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T19:58:30.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:30 gibba023 bash[9844]: audit 2021-03-10T19:58:29.873581+0000 mon.a (mon.0) 66 : audit [DBG] from='mgr.14117 172.21.2.123:0/3725512189' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T19:58:30.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:30 gibba023 bash[9844]: audit 2021-03-10T19:58:30.167009+0000 mon.a (mon.0) 67 : audit [INF] from='mgr.14117 172.21.2.123:0/3725512189' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:58:30.165576\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:58:30.166591\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T19:58:30.166652\", \"networks\": {}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T19:58:30.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:30 gibba023 bash[9844]: audit 2021-03-10T19:58:30.168846+0000 mon.a (mon.0) 68 : audit [INF] from='mgr.14117 172.21.2.123:0/3725512189' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:58:30.165576\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:58:30.166591\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T19:58:30.166652\", \"networks\": {}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T19:58:30.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:30 gibba023 bash[9844]: audit 2021-03-10T19:58:30.169332+0000 mon.a (mon.0) 69 : audit [DBG] from='mgr.14117 172.21.2.123:0/3725512189' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T19:58:31.297 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Enabling the dashboard module... 2021-03-10T19:58:31.297 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba023', '-v', '/var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'module', 'enable', 'dashboard'] 2021-03-10T19:58:31.297 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba023 -v /var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr module enable dashboard 2021-03-10T19:58:33.297 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:33 gibba023 bash[9844]: audit 2021-03-10T19:58:32.951702+0000 mon.a (mon.0) 70 : audit [INF] from='client.? 172.21.2.123:0/585302516' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2021-03-10T19:58:33.297 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 19:58:33 gibba023 bash[10078]: ignoring --setuser ceph since I am not root 2021-03-10T19:58:33.298 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 19:58:33 gibba023 bash[10078]: ignoring --setgroup ceph since I am not root 2021-03-10T19:58:33.791 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba023', '-v', '/var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'dump'] 2021-03-10T19:58:33.791 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba023 -v /var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr dump 2021-03-10T19:58:34.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:34 gibba023 bash[9844]: audit 2021-03-10T19:58:33.004795+0000 mon.a (mon.0) 71 : audit [INF] from='client.? 172.21.2.123:0/585302516' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2021-03-10T19:58:34.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:34 gibba023 bash[9844]: cluster 2021-03-10T19:58:33.004830+0000 mon.a (mon.0) 72 : cluster [DBG] mgrmap e9: y(active, since 11s) 2021-03-10T19:58:35.420 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:35.421 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 9, 2021-03-10T19:58:35.421 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_gid": 14117, 2021-03-10T19:58:35.421 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_name": "y", 2021-03-10T19:58:35.421 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addrs": { 2021-03-10T19:58:35.422 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T19:58:35.422 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:35.422 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T19:58:35.422 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.123:6800", 2021-03-10T19:58:35.422 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 3266400770 2021-03-10T19:58:35.423 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.423 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:35.423 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v1", 2021-03-10T19:58:35.423 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.123:6801", 2021-03-10T19:58:35.424 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 3266400770 2021-03-10T19:58:35.424 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:35.424 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T19:58:35.424 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.424 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addr": "172.21.2.123:6801/3266400770", 2021-03-10T19:58:35.425 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_change": "2021-03-10T19:58:21.167950+0000", 2021-03-10T19:58:35.425 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_mgr_features": 4540138292836696063, 2021-03-10T19:58:35.425 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2021-03-10T19:58:35.425 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standbys": [], 2021-03-10T19:58:35.425 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2021-03-10T19:58:35.426 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2021-03-10T19:58:35.426 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "dashboard", 2021-03-10T19:58:35.426 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2021-03-10T19:58:35.426 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2021-03-10T19:58:35.427 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:35.427 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available_modules": [ 2021-03-10T19:58:35.427 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:35.427 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "alerts", 2021-03-10T19:58:35.427 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:35.428 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:35.428 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:35.428 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T19:58:35.428 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T19:58:35.428 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:35.429 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.429 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.429 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T19:58:35.429 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.430 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.430 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.430 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "How frequently to reexamine health status", 2021-03-10T19:58:35.430 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.430 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.431 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.431 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.431 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:35.431 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:35.431 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.432 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.432 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.432 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.432 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.433 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.433 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:35.433 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:35.433 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:35.433 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:35.434 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:35.434 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:35.434 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:35.434 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:35.434 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.435 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.435 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.435 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.435 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.435 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:35.436 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:35.436 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.436 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.436 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.437 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.437 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.437 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.437 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.437 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.438 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.438 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.438 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.438 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.438 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:35.439 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:35.439 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.439 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.439 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.440 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:35.440 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.440 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.440 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:35.440 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:35.441 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:35.441 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:35.441 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:35.441 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:35.441 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:35.442 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:35.442 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.442 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.442 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.442 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.443 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.443 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:35.443 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:35.443 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.444 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.444 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.444 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.444 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.444 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.445 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.445 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.445 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.445 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.445 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.446 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.446 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_destination": { 2021-03-10T19:58:35.446 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_destination", 2021-03-10T19:58:35.446 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.447 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.447 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.447 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.447 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.448 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.448 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.448 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email address to send alerts to", 2021-03-10T19:58:35.448 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.448 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.449 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.449 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.449 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_from_name": { 2021-03-10T19:58:35.449 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_from_name", 2021-03-10T19:58:35.449 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.450 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.450 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.450 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "Ceph", 2021-03-10T19:58:35.450 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.451 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.451 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.451 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email From: name", 2021-03-10T19:58:35.451 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.451 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.452 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.452 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.452 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_host": { 2021-03-10T19:58:35.452 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_host", 2021-03-10T19:58:35.452 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.453 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.453 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.453 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.453 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.454 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.454 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.454 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP server", 2021-03-10T19:58:35.454 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.454 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.455 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.455 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.455 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_password": { 2021-03-10T19:58:35.455 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_password", 2021-03-10T19:58:35.456 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.456 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.456 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.456 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.456 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.457 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.457 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.457 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Password to authenticate with", 2021-03-10T19:58:35.457 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.457 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.458 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.458 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.458 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_port": { 2021-03-10T19:58:35.458 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_port", 2021-03-10T19:58:35.459 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:35.459 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.459 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.459 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "465", 2021-03-10T19:58:35.459 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.460 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.460 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.460 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP port", 2021-03-10T19:58:35.460 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.460 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.461 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.461 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.461 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_sender": { 2021-03-10T19:58:35.461 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_sender", 2021-03-10T19:58:35.461 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.462 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.462 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.462 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.462 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.463 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.463 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.463 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP envelope sender", 2021-03-10T19:58:35.463 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.463 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.464 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.464 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.464 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_ssl": { 2021-03-10T19:58:35.464 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_ssl", 2021-03-10T19:58:35.464 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.465 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.465 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.465 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:35.465 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.465 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.466 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.466 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Use SSL to connect to SMTP server", 2021-03-10T19:58:35.466 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.466 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.467 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.467 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.467 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_user": { 2021-03-10T19:58:35.467 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_user", 2021-03-10T19:58:35.467 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.468 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.468 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.468 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.468 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.469 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.469 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.469 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "User to authenticate as", 2021-03-10T19:58:35.469 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.469 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.470 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.470 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:35.470 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:35.470 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.470 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:35.471 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "balancer", 2021-03-10T19:58:35.471 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:35.471 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:35.471 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:35.471 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active": { 2021-03-10T19:58:35.472 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "active", 2021-03-10T19:58:35.472 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.472 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.472 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.473 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.473 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.473 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.473 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.473 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically balance PGs across cluster", 2021-03-10T19:58:35.474 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.474 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.474 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.474 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.475 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_time": { 2021-03-10T19:58:35.475 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_time", 2021-03-10T19:58:35.475 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.475 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.475 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.476 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0000", 2021-03-10T19:58:35.476 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.476 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.476 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.477 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "beginning time of day to automatically balance", 2021-03-10T19:58:35.477 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2021-03-10T19:58:35.477 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.477 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.477 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.478 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_weekday": { 2021-03-10T19:58:35.478 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_weekday", 2021-03-10T19:58:35.478 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T19:58:35.478 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.478 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.479 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T19:58:35.479 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2021-03-10T19:58:35.479 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2021-03-10T19:58:35.479 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.480 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to this day of the week or later", 2021-03-10T19:58:35.480 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-03-10T19:58:35.480 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.480 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.480 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.481 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_max_iterations": { 2021-03-10T19:58:35.481 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_max_iterations", 2021-03-10T19:58:35.481 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T19:58:35.481 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.481 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.482 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "25", 2021-03-10T19:58:35.482 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2021-03-10T19:58:35.482 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "250", 2021-03-10T19:58:35.482 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.483 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum number of iterations to attempt optimization", 2021-03-10T19:58:35.483 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.483 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.483 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.483 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.484 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_metrics": { 2021-03-10T19:58:35.484 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_metrics", 2021-03-10T19:58:35.484 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.484 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.484 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.485 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "pgs,objects,bytes", 2021-03-10T19:58:35.485 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.485 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.485 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.485 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "metrics with which to calculate OSD utilization", 2021-03-10T19:58:35.486 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2021-03-10T19:58:35.486 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.486 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.486 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.487 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_step": { 2021-03-10T19:58:35.487 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_step", 2021-03-10T19:58:35.487 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T19:58:35.487 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.487 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.488 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0.5", 2021-03-10T19:58:35.488 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0.001", 2021-03-10T19:58:35.488 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "0.999", 2021-03-10T19:58:35.488 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.488 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "aggressiveness of optimization", 2021-03-10T19:58:35.489 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": ".99 is very aggressive, .01 is less aggressive", 2021-03-10T19:58:35.489 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.489 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.489 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.490 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_time": { 2021-03-10T19:58:35.490 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_time", 2021-03-10T19:58:35.490 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.490 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.490 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.491 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2400", 2021-03-10T19:58:35.491 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.491 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.491 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.491 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "ending time of day to automatically balance", 2021-03-10T19:58:35.492 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2021-03-10T19:58:35.492 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.492 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.492 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.493 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_weekday": { 2021-03-10T19:58:35.493 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_weekday", 2021-03-10T19:58:35.493 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T19:58:35.493 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.493 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.494 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2021-03-10T19:58:35.494 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2021-03-10T19:58:35.494 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2021-03-10T19:58:35.494 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.495 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to days of the week earlier than this", 2021-03-10T19:58:35.495 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-03-10T19:58:35.495 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.495 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.495 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.496 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:35.496 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:35.496 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.496 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.497 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.497 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.497 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.497 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.497 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:35.498 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:35.498 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:35.498 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:35.498 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:35.498 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:35.499 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:35.499 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:35.499 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.499 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.500 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.500 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.500 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.500 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:35.500 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:35.501 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.501 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.501 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.501 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.501 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.502 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.502 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.502 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.502 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.502 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.503 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.503 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.503 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:35.503 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:35.504 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.504 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.504 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.504 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:35.504 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.505 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.505 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:35.505 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:35.505 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:35.505 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:35.506 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:35.506 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:35.506 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:35.506 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:35.507 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.507 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.507 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.507 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.507 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.508 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:35.508 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:35.508 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.508 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.508 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.509 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.509 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.509 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.509 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.509 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.510 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.510 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.510 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.510 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.511 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_score": { 2021-03-10T19:58:35.511 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_score", 2021-03-10T19:58:35.511 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T19:58:35.511 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.511 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.512 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T19:58:35.512 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.512 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.512 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.512 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "minimum score, below which no optimization is attempted", 2021-03-10T19:58:35.513 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.513 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.513 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.513 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.513 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2021-03-10T19:58:35.514 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2021-03-10T19:58:35.514 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.514 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.514 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.515 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "none", 2021-03-10T19:58:35.515 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.515 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.515 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:35.515 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush-compat", 2021-03-10T19:58:35.516 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "none", 2021-03-10T19:58:35.516 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap" 2021-03-10T19:58:35.516 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:35.516 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Balancer mode", 2021-03-10T19:58:35.516 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.517 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.517 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.517 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.517 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_ids": { 2021-03-10T19:58:35.517 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_ids", 2021-03-10T19:58:35.518 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.518 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.518 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.518 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.519 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.519 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.519 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.520 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "pools which the automatic balancing will be limited to", 2021-03-10T19:58:35.520 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.520 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.520 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.520 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.521 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T19:58:35.521 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T19:58:35.521 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:35.521 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.522 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.522 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T19:58:35.522 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.522 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.522 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.523 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and attempt optimization", 2021-03-10T19:58:35.523 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.523 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.523 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.523 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.524 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_deviation": { 2021-03-10T19:58:35.524 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_deviation", 2021-03-10T19:58:35.524 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:35.524 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.525 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.525 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T19:58:35.525 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2021-03-10T19:58:35.525 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.525 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.526 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "deviation below which no optimization is attempted", 2021-03-10T19:58:35.526 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2021-03-10T19:58:35.526 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.526 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.527 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.527 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_optimizations": { 2021-03-10T19:58:35.527 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_optimizations", 2021-03-10T19:58:35.527 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2021-03-10T19:58:35.527 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.528 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.528 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T19:58:35.528 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.528 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.528 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.529 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum upmap optimizations to make per attempt", 2021-03-10T19:58:35.529 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.529 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.529 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.529 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:35.530 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:35.530 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.530 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:35.530 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "cephadm", 2021-03-10T19:58:35.531 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:35.531 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:35.531 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:35.531 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "allow_ptrace": { 2021-03-10T19:58:35.531 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "allow_ptrace", 2021-03-10T19:58:35.532 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.532 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.532 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.532 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.532 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.533 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.533 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.533 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "allow SYS_PTRACE capability on ceph containers", 2021-03-10T19:58:35.533 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2021-03-10T19:58:35.534 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.534 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.534 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.534 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_base": { 2021-03-10T19:58:35.534 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_base", 2021-03-10T19:58:35.535 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.535 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.535 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.535 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph/ceph", 2021-03-10T19:58:35.535 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.536 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.536 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.536 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Container image name, without the tag", 2021-03-10T19:58:35.536 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.537 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.537 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.537 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.537 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "daemon_cache_timeout": { 2021-03-10T19:58:35.537 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "daemon_cache_timeout", 2021-03-10T19:58:35.538 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:35.538 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.538 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.538 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T19:58:35.538 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.539 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.539 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.539 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache service (daemon) inventory", 2021-03-10T19:58:35.539 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.540 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.540 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.540 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.540 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_cache_timeout": { 2021-03-10T19:58:35.540 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_cache_timeout", 2021-03-10T19:58:35.541 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:35.541 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.541 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.541 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1800", 2021-03-10T19:58:35.541 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.542 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.542 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.542 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache device inventory", 2021-03-10T19:58:35.542 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.542 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.543 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.543 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.543 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "host_check_interval": { 2021-03-10T19:58:35.543 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "host_check_interval", 2021-03-10T19:58:35.544 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:35.544 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.544 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.544 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T19:58:35.544 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.545 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.545 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.545 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to perform a host check", 2021-03-10T19:58:35.545 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.546 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.546 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.546 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.546 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:35.546 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:35.547 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.547 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.547 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.547 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.547 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.548 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.548 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:35.548 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:35.548 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:35.548 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:35.549 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:35.549 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:35.549 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:35.549 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:35.550 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.550 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.550 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.550 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.550 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.551 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:35.551 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:35.551 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.551 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.551 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.552 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:35.552 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.552 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.552 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.553 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "log to the \"cephadm\" cluster log channel\"", 2021-03-10T19:58:35.553 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.553 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.553 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.553 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.554 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:35.554 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:35.554 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.554 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.554 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.555 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:35.555 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.555 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.555 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:35.556 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:35.556 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:35.556 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:35.556 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:35.556 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:35.557 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:35.557 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:35.557 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.557 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.557 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.558 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.558 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.558 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:35.558 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:35.558 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.559 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.559 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.559 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.559 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.560 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.560 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.560 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.560 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.560 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.561 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.561 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.561 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2021-03-10T19:58:35.561 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2021-03-10T19:58:35.561 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.562 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.562 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.562 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "root", 2021-03-10T19:58:35.562 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.562 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.563 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:35.563 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm-package", 2021-03-10T19:58:35.563 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "root" 2021-03-10T19:58:35.563 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:35.564 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "mode for remote execution of cephadm", 2021-03-10T19:58:35.564 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.564 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.564 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.564 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.565 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssh_config_file": { 2021-03-10T19:58:35.565 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssh_config_file", 2021-03-10T19:58:35.565 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.565 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.565 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.566 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T19:58:35.566 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.566 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.566 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.567 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "customized SSH config file to connect to managed hosts", 2021-03-10T19:58:35.567 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.567 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.567 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.567 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.568 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_failed_host_check": { 2021-03-10T19:58:35.568 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_failed_host_check", 2021-03-10T19:58:35.568 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.568 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.569 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.569 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:35.569 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.569 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.569 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.570 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if the host check fails", 2021-03-10T19:58:35.570 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.570 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.570 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.571 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.571 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_daemons": { 2021-03-10T19:58:35.571 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_daemons", 2021-03-10T19:58:35.571 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.571 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.572 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.572 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:35.572 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.572 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.572 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.573 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2021-03-10T19:58:35.573 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.573 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.573 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.573 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.574 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_hosts": { 2021-03-10T19:58:35.574 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_hosts", 2021-03-10T19:58:35.574 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.574 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.575 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.575 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:35.575 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.575 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.575 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.576 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2021-03-10T19:58:35.576 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.576 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.576 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.576 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:35.577 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:35.577 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.577 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:35.577 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crash", 2021-03-10T19:58:35.578 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:35.578 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:35.578 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:35.578 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:35.578 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:35.579 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.579 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.579 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.579 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.579 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.580 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.580 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:35.580 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:35.580 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:35.580 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:35.581 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:35.581 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:35.581 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:35.581 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:35.582 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.582 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.582 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.582 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.582 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.583 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:35.583 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:35.583 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.583 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.583 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.584 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.584 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.584 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.584 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.585 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.585 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.585 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.585 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.585 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.586 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:35.586 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:35.586 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.586 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.586 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.587 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:35.587 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.587 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.587 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:35.588 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:35.588 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:35.588 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:35.588 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:35.588 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:35.589 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:35.589 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:35.589 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.589 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.589 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.590 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.590 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.590 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:35.590 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:35.590 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.591 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.591 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.591 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.591 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.591 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.592 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.592 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.592 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.592 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.593 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.593 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.593 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retain_interval": { 2021-03-10T19:58:35.593 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retain_interval", 2021-03-10T19:58:35.593 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:35.594 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.594 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.594 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "31536000", 2021-03-10T19:58:35.594 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.595 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.595 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.595 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain crashes before pruning them", 2021-03-10T19:58:35.595 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.595 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.596 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.596 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.596 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_recent_interval": { 2021-03-10T19:58:35.596 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_recent_interval", 2021-03-10T19:58:35.596 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:35.597 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.597 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.597 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1209600", 2021-03-10T19:58:35.597 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.597 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.598 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.598 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "time interval in which to warn about recent crashes", 2021-03-10T19:58:35.598 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.598 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.599 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.599 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:35.599 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:35.599 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.599 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:35.600 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "dashboard", 2021-03-10T19:58:35.600 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:35.600 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:35.600 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:35.600 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ALERTMANAGER_API_HOST": { 2021-03-10T19:58:35.601 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ALERTMANAGER_API_HOST", 2021-03-10T19:58:35.601 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.601 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.601 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.602 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.602 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.602 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.602 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.602 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.603 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.603 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.603 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.603 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.603 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_ENABLED": { 2021-03-10T19:58:35.604 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_ENABLED", 2021-03-10T19:58:35.604 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.604 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.604 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.604 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.605 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.605 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.605 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.605 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.606 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.606 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.606 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.606 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.606 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_LOG_PAYLOAD": { 2021-03-10T19:58:35.607 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_LOG_PAYLOAD", 2021-03-10T19:58:35.607 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.607 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.607 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.607 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:35.608 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.608 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.608 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.608 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.608 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.609 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.609 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.609 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.609 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ENABLE_BROWSABLE_API": { 2021-03-10T19:58:35.610 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ENABLE_BROWSABLE_API", 2021-03-10T19:58:35.610 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.610 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.610 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.610 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:35.611 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.611 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.611 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.611 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.611 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.612 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.612 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.612 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.612 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_cephfs": { 2021-03-10T19:58:35.612 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_cephfs", 2021-03-10T19:58:35.613 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.613 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.613 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.613 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:35.614 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.614 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.614 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.614 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.614 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.615 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.615 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.615 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.615 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_iscsi": { 2021-03-10T19:58:35.615 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_iscsi", 2021-03-10T19:58:35.616 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.616 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.616 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.616 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:35.616 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.617 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.617 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.617 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.617 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.618 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.618 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.618 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.618 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_mirroring": { 2021-03-10T19:58:35.619 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_mirroring", 2021-03-10T19:58:35.619 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.619 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.619 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.619 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:35.620 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.620 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.620 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.620 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.620 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.621 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.621 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.621 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.621 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_nfs": { 2021-03-10T19:58:35.621 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_nfs", 2021-03-10T19:58:35.622 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.622 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.622 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.622 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:35.623 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.623 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.623 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.623 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.623 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.624 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.624 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.624 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.624 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rbd": { 2021-03-10T19:58:35.624 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rbd", 2021-03-10T19:58:35.625 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.625 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.625 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.625 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:35.625 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.626 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.626 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.626 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.626 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.627 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.627 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.627 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.627 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rgw": { 2021-03-10T19:58:35.627 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rgw", 2021-03-10T19:58:35.628 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.628 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.628 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.628 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:35.628 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.629 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.629 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.629 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.629 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.630 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.630 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.630 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.630 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2021-03-10T19:58:35.630 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2021-03-10T19:58:35.631 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.631 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.631 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.631 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.631 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.632 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.632 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.632 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.632 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.632 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.633 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.633 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.633 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_PASSWORD": { 2021-03-10T19:58:35.633 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_PASSWORD", 2021-03-10T19:58:35.634 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.634 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.634 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.634 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T19:58:35.634 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.635 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.635 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.635 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.635 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.635 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.636 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.636 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.636 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_SSL_VERIFY": { 2021-03-10T19:58:35.636 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_SSL_VERIFY", 2021-03-10T19:58:35.636 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.637 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.637 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.637 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:35.637 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.638 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.638 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.638 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.638 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.638 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.639 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.639 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.639 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_URL": { 2021-03-10T19:58:35.639 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_URL", 2021-03-10T19:58:35.639 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.640 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.640 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.640 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.640 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.640 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.641 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.641 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.641 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.641 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.642 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.642 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.642 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_USERNAME": { 2021-03-10T19:58:35.642 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_USERNAME", 2021-03-10T19:58:35.642 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.643 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.643 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.643 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T19:58:35.643 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.644 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.644 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.644 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.644 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.644 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.645 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.645 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.645 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_UPDATE_DASHBOARDS": { 2021-03-10T19:58:35.645 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_UPDATE_DASHBOARDS", 2021-03-10T19:58:35.645 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.646 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.646 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.646 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.646 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.647 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.647 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.647 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.647 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.647 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.648 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.648 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.648 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ISCSI_API_SSL_VERIFICATION": { 2021-03-10T19:58:35.648 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ISCSI_API_SSL_VERIFICATION", 2021-03-10T19:58:35.648 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.649 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.649 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.649 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:35.649 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.650 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.650 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.650 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.650 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.650 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.651 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.651 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.651 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PROMETHEUS_API_HOST": { 2021-03-10T19:58:35.651 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PROMETHEUS_API_HOST", 2021-03-10T19:58:35.651 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.652 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.652 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.652 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.652 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.653 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.653 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.653 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.653 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.653 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.654 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.654 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.654 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2021-03-10T19:58:35.654 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2021-03-10T19:58:35.654 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.655 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.655 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.655 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.655 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.656 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.656 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.656 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.656 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.656 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.657 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.657 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.657 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2021-03-10T19:58:35.657 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2021-03-10T19:58:35.657 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.658 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.658 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.658 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.658 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.658 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.659 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.659 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.659 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.659 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.660 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.660 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.660 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2021-03-10T19:58:35.660 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2021-03-10T19:58:35.660 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.661 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.661 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.661 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:35.661 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.661 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.662 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.662 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.662 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.662 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.663 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.663 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.663 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2021-03-10T19:58:35.663 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2021-03-10T19:58:35.663 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.664 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.664 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.664 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:35.664 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.664 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.665 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.665 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.665 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.665 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.666 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.666 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.666 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2021-03-10T19:58:35.666 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2021-03-10T19:58:35.666 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.667 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.667 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.667 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.667 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.667 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.668 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.668 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.668 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.668 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.668 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.669 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.669 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2021-03-10T19:58:35.669 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2021-03-10T19:58:35.669 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.670 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.670 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.670 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.670 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.670 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.671 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.671 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.671 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.671 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.671 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.672 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.672 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2021-03-10T19:58:35.672 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2021-03-10T19:58:35.672 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.673 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.673 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.673 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.673 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.673 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.674 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.674 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.674 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.674 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.674 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.675 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.675 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_ENABLED": { 2021-03-10T19:58:35.675 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_ENABLED", 2021-03-10T19:58:35.675 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.675 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.676 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.676 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:35.676 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.676 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.676 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.677 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.677 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.677 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.677 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.678 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.678 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_EXCLUSION_LIST": { 2021-03-10T19:58:35.678 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_EXCLUSION_LIST", 2021-03-10T19:58:35.678 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.678 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.679 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.679 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2021-03-10T19:58:35.679 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.679 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.679 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.680 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.680 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.680 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.680 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.681 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.681 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_COMPLEXITY": { 2021-03-10T19:58:35.681 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_COMPLEXITY", 2021-03-10T19:58:35.681 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:35.681 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.682 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.682 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T19:58:35.682 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.682 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.682 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.683 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.683 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.683 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.683 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.683 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.684 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_LENGTH": { 2021-03-10T19:58:35.684 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_LENGTH", 2021-03-10T19:58:35.684 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:35.684 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.684 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.685 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8", 2021-03-10T19:58:35.685 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.685 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.685 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.686 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.686 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.686 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.686 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.686 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.687 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "REST_REQUESTS_TIMEOUT": { 2021-03-10T19:58:35.687 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "REST_REQUESTS_TIMEOUT", 2021-03-10T19:58:35.687 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:35.687 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.687 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.688 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "45", 2021-03-10T19:58:35.688 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.688 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.688 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.689 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.689 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.689 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.689 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.689 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.690 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ACCESS_KEY": { 2021-03-10T19:58:35.690 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ACCESS_KEY", 2021-03-10T19:58:35.690 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.690 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.691 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.691 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.691 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.691 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.691 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.692 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.692 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.692 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.692 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.692 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.693 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ADMIN_RESOURCE": { 2021-03-10T19:58:35.693 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ADMIN_RESOURCE", 2021-03-10T19:58:35.693 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.693 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.693 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.694 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2021-03-10T19:58:35.694 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.694 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.694 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.695 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.695 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.695 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.695 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.695 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.696 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_HOST": { 2021-03-10T19:58:35.696 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_HOST", 2021-03-10T19:58:35.696 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.696 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.697 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.697 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.697 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.697 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.697 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.698 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.698 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.698 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.698 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.698 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.699 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_PORT": { 2021-03-10T19:58:35.699 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_PORT", 2021-03-10T19:58:35.699 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:35.699 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.699 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.700 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "80", 2021-03-10T19:58:35.700 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.700 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.700 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.701 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.701 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.701 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.701 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.701 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.702 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SCHEME": { 2021-03-10T19:58:35.702 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SCHEME", 2021-03-10T19:58:35.702 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.702 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.702 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.703 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "http", 2021-03-10T19:58:35.703 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.703 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.703 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.704 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.704 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.704 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.704 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.704 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.705 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SECRET_KEY": { 2021-03-10T19:58:35.705 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SECRET_KEY", 2021-03-10T19:58:35.705 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.705 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.705 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.706 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.706 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.706 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.706 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.706 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.707 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.707 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.707 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.707 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.708 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SSL_VERIFY": { 2021-03-10T19:58:35.708 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SSL_VERIFY", 2021-03-10T19:58:35.708 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.708 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.708 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.709 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:35.709 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.709 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.709 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.709 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.710 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.710 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.710 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.710 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.710 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_USER_ID": { 2021-03-10T19:58:35.711 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_USER_ID", 2021-03-10T19:58:35.711 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.711 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.711 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.712 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.712 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.712 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.712 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.712 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.713 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.713 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.713 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.713 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.713 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_SPAN": { 2021-03-10T19:58:35.714 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_SPAN", 2021-03-10T19:58:35.714 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:35.714 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.714 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.715 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2021-03-10T19:58:35.715 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.715 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.715 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.715 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.716 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.716 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.716 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.716 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.716 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_1": { 2021-03-10T19:58:35.717 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_1", 2021-03-10T19:58:35.717 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:35.717 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.717 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.717 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T19:58:35.718 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.718 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.718 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.718 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.719 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.719 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.719 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.719 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.719 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_2": { 2021-03-10T19:58:35.720 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_2", 2021-03-10T19:58:35.720 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:35.720 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.720 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.720 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T19:58:35.721 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.721 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.721 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.721 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.721 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.722 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.722 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.722 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.722 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crt_file": { 2021-03-10T19:58:35.723 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crt_file", 2021-03-10T19:58:35.723 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.723 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.723 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.723 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.724 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.724 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.724 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.724 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.724 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.725 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.725 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.725 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.725 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug": { 2021-03-10T19:58:35.725 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "debug", 2021-03-10T19:58:35.726 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.726 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.726 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.726 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.727 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.727 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.727 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.727 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Enable/disable debug options", 2021-03-10T19:58:35.727 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.728 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.728 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.728 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.728 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "jwt_token_ttl": { 2021-03-10T19:58:35.728 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "jwt_token_ttl", 2021-03-10T19:58:35.729 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:35.729 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.729 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.729 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "28800", 2021-03-10T19:58:35.729 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.730 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.730 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.730 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.730 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.731 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.731 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.731 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.731 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2021-03-10T19:58:35.731 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2021-03-10T19:58:35.732 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.732 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.732 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.732 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.732 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.733 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.733 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.733 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.733 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.734 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.734 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.734 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.734 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:35.734 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:35.735 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.735 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.735 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.735 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.735 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.736 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.736 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:35.736 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:35.736 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:35.736 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:35.737 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:35.737 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:35.737 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:35.737 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:35.738 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.738 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.738 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.738 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.738 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.739 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:35.739 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:35.739 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.739 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.739 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.740 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.740 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.740 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.740 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.741 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.741 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.741 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.741 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.741 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.742 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:35.742 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:35.742 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.742 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.742 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.743 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:35.743 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.743 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.743 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:35.743 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:35.744 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:35.744 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:35.744 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:35.744 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:35.745 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:35.745 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:35.745 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.745 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.745 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.746 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.746 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.746 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:35.746 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:35.746 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.747 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.747 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.747 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.747 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.747 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.748 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.748 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.748 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.748 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.749 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.749 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.749 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2021-03-10T19:58:35.749 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2021-03-10T19:58:35.749 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.750 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.750 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.750 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.750 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.750 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.751 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.751 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.751 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.751 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.751 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.752 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.752 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T19:58:35.752 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T19:58:35.752 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.753 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.753 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.753 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "::", 2021-03-10T19:58:35.753 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.753 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.754 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.754 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.754 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.754 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.754 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.755 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.755 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T19:58:35.755 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T19:58:35.755 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:35.755 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.756 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.756 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8080", 2021-03-10T19:58:35.756 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.756 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.756 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.757 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.757 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.757 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.757 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.758 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.758 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2021-03-10T19:58:35.758 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2021-03-10T19:58:35.758 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.758 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.759 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.759 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:35.759 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.759 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.759 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.760 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.760 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.760 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.760 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.761 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.761 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl_server_port": { 2021-03-10T19:58:35.761 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl_server_port", 2021-03-10T19:58:35.761 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:35.761 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.762 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.762 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8443", 2021-03-10T19:58:35.762 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.762 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.762 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.763 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.763 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.763 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.763 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.764 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.764 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_behaviour": { 2021-03-10T19:58:35.764 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_behaviour", 2021-03-10T19:58:35.764 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.764 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.765 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.765 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "redirect", 2021-03-10T19:58:35.765 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.765 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.765 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:35.766 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:35.766 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "redirect" 2021-03-10T19:58:35.766 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:35.766 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.767 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.767 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.767 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.767 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.767 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_error_status_code": { 2021-03-10T19:58:35.768 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_error_status_code", 2021-03-10T19:58:35.768 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:35.768 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.768 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.768 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "500", 2021-03-10T19:58:35.769 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "400", 2021-03-10T19:58:35.769 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "599", 2021-03-10T19:58:35.769 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.769 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.769 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.770 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.770 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.770 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.770 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url_prefix": { 2021-03-10T19:58:35.771 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url_prefix", 2021-03-10T19:58:35.771 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.771 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.771 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.771 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.772 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.772 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.772 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.772 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.772 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.773 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.773 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.773 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.773 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2021-03-10T19:58:35.773 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2021-03-10T19:58:35.774 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.774 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.774 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.774 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.775 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.775 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.775 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.775 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.775 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.776 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.776 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.776 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:35.776 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:35.776 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.777 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:35.777 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "devicehealth", 2021-03-10T19:58:35.777 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:35.777 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:35.777 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:35.778 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enable_monitoring": { 2021-03-10T19:58:35.778 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enable_monitoring", 2021-03-10T19:58:35.778 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.778 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.779 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.779 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:35.779 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.779 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.779 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.780 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "monitor device health metrics", 2021-03-10T19:58:35.780 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.780 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.780 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.780 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.781 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:35.781 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:35.781 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.782 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.782 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.782 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.782 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.783 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.783 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:35.783 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:35.783 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:35.783 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:35.784 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:35.784 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:35.784 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:35.784 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:35.785 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.785 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.785 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.785 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.786 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.786 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:35.786 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:35.786 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.787 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.787 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.787 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.787 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.787 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.788 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.788 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.788 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.788 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.789 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.789 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.789 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:35.789 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:35.790 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.790 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.790 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.790 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:35.791 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.791 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.791 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:35.791 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:35.791 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:35.792 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:35.792 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:35.792 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:35.792 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:35.793 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:35.793 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.793 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.793 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.794 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.794 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.794 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:35.794 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:35.794 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.795 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.795 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.795 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.795 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.796 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.796 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.796 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.796 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.797 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.797 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.797 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.797 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mark_out_threshold": { 2021-03-10T19:58:35.797 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mark_out_threshold", 2021-03-10T19:58:35.798 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:35.798 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.798 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.798 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2419200", 2021-03-10T19:58:35.799 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.799 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.799 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.799 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically mark OSD if it may fail before this long", 2021-03-10T19:58:35.800 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.800 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.800 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.800 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.800 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_name": { 2021-03-10T19:58:35.801 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_name", 2021-03-10T19:58:35.801 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.801 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.801 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.802 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "device_health_metrics", 2021-03-10T19:58:35.802 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.802 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.802 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.802 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name of pool in which to store device health metrics", 2021-03-10T19:58:35.803 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.803 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.803 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.803 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.804 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retention_period": { 2021-03-10T19:58:35.804 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retention_period", 2021-03-10T19:58:35.804 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:35.804 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.805 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.805 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15552000", 2021-03-10T19:58:35.805 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.805 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.806 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.806 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain device health metrics", 2021-03-10T19:58:35.806 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.806 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.807 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.807 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.807 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_frequency": { 2021-03-10T19:58:35.807 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_frequency", 2021-03-10T19:58:35.807 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:35.808 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.808 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.808 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2021-03-10T19:58:35.808 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.809 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.809 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.809 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to scrape device health metrics", 2021-03-10T19:58:35.809 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.810 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.810 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.810 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.810 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "self_heal": { 2021-03-10T19:58:35.811 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "self_heal", 2021-03-10T19:58:35.811 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.811 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.811 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.812 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:35.812 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.812 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.812 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.812 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "preemptively heal cluster around devices that may fail", 2021-03-10T19:58:35.813 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.813 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.813 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.813 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.814 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T19:58:35.814 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T19:58:35.814 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:35.814 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.815 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.815 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T19:58:35.815 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.815 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.816 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.816 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and check device health", 2021-03-10T19:58:35.816 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.816 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.817 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.817 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.817 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_threshold": { 2021-03-10T19:58:35.817 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_threshold", 2021-03-10T19:58:35.817 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:35.818 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.818 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.818 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7257600", 2021-03-10T19:58:35.818 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.819 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.819 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.819 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise health warning if OSD may fail before this long", 2021-03-10T19:58:35.819 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.820 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.820 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.820 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:35.820 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:35.821 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.821 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:35.821 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "diskprediction_local", 2021-03-10T19:58:35.821 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:35.822 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:35.822 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:35.822 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:35.822 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:35.823 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.823 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.823 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.823 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.824 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.824 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.824 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:35.824 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:35.825 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:35.825 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:35.825 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:35.825 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:35.825 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:35.826 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:35.826 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.826 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.826 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.827 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.827 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.827 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:35.827 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:35.828 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.828 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.828 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.828 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.828 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.829 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.829 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.829 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.829 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.830 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.830 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.830 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.830 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:35.831 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:35.831 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.831 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.831 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.831 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:35.832 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.832 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.832 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:35.832 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:35.833 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:35.833 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:35.833 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:35.833 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:35.833 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:35.834 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:35.834 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.834 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.834 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.835 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.835 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.835 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:35.835 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:35.835 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.836 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.836 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.836 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.836 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.837 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.837 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.837 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.837 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.838 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.838 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.838 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.838 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predict_interval": { 2021-03-10T19:58:35.838 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predict_interval", 2021-03-10T19:58:35.839 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.839 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.839 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.839 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2021-03-10T19:58:35.840 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.840 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.840 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.840 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.841 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.841 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.841 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.841 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.842 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predictor_model": { 2021-03-10T19:58:35.842 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predictor_model", 2021-03-10T19:58:35.842 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.842 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.843 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.843 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prophetstor", 2021-03-10T19:58:35.843 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.843 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.843 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.844 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.844 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.844 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.844 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.845 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.845 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T19:58:35.845 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T19:58:35.845 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.846 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.846 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.846 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2021-03-10T19:58:35.846 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.847 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.847 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.847 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.847 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.847 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.848 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.848 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:35.848 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:35.848 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.849 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:35.849 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "influx", 2021-03-10T19:58:35.849 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": false, 2021-03-10T19:58:35.849 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "influxdb python module not found", 2021-03-10T19:58:35.849 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:35.850 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "batch_size": { 2021-03-10T19:58:35.850 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "batch_size", 2021-03-10T19:58:35.850 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.850 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.851 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.851 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5000", 2021-03-10T19:58:35.851 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.851 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.852 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.852 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.852 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.852 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.853 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.853 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.853 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "database": { 2021-03-10T19:58:35.853 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "database", 2021-03-10T19:58:35.853 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.854 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.854 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.854 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph", 2021-03-10T19:58:35.854 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.855 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.855 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.855 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.855 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.856 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.856 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.856 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.856 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "hostname": { 2021-03-10T19:58:35.856 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "hostname", 2021-03-10T19:58:35.857 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.857 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.857 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.858 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T19:58:35.858 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.858 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.858 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.858 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.859 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.859 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.859 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.859 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.860 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T19:58:35.860 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T19:58:35.860 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.860 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.860 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.861 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "30", 2021-03-10T19:58:35.861 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.861 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.861 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.862 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.862 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.862 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.862 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.863 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.863 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:35.863 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:35.863 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.864 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.864 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.864 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.864 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.865 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.865 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:35.865 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:35.865 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:35.865 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:35.866 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:35.866 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:35.866 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:35.866 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:35.867 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.867 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.867 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.867 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.868 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.868 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:35.868 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:35.868 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.868 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.869 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.869 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.869 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.869 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.870 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.870 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.870 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.870 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.870 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.871 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.871 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:35.871 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:35.871 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.872 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.872 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.872 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:35.872 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.873 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.873 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:35.873 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:35.873 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:35.873 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:35.874 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:35.874 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:35.874 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:35.874 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:35.875 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.875 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.875 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.875 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.875 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.876 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:35.876 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:35.876 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.876 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.877 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.877 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.877 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.877 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.878 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.878 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.878 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.878 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.878 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.879 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.879 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2021-03-10T19:58:35.879 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2021-03-10T19:58:35.879 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.880 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.880 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.880 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T19:58:35.880 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.880 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.881 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.881 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.881 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.881 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.882 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.882 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.882 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "port": { 2021-03-10T19:58:35.882 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "port", 2021-03-10T19:58:35.883 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.883 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.883 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.883 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8086", 2021-03-10T19:58:35.883 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.884 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.884 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.884 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.884 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.885 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.885 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.885 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.885 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2021-03-10T19:58:35.885 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2021-03-10T19:58:35.886 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.886 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.886 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.886 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "false", 2021-03-10T19:58:35.887 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.887 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.887 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.887 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.888 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.888 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.888 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.888 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.889 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "threads": { 2021-03-10T19:58:35.889 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "threads", 2021-03-10T19:58:35.889 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.889 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.889 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.890 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T19:58:35.890 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.890 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.890 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.891 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.891 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.891 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.891 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.892 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.892 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2021-03-10T19:58:35.892 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2021-03-10T19:58:35.892 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.892 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.893 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.893 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T19:58:35.893 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.893 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.894 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.894 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.894 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.894 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.895 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.895 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.895 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "verify_ssl": { 2021-03-10T19:58:35.895 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "verify_ssl", 2021-03-10T19:58:35.895 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.896 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.896 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.896 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "true", 2021-03-10T19:58:35.896 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.897 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.897 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.897 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.897 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.898 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.898 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.898 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:35.898 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:35.899 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.899 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:35.899 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "insights", 2021-03-10T19:58:35.899 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:35.900 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:35.900 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:35.900 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:35.900 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:35.900 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.901 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.901 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.901 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.901 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.902 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.902 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:35.902 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:35.902 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:35.903 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:35.903 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:35.903 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:35.903 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:35.904 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:35.904 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.904 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.904 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.904 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.905 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.905 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:35.905 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:35.905 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.906 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.906 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.906 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.906 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.906 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.907 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.907 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.907 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.907 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.908 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.908 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.908 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:35.908 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:35.909 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.909 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.909 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.909 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:35.909 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.910 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.910 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:35.910 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:35.910 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:35.911 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:35.911 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:35.911 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:35.911 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:35.912 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:35.912 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.912 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.912 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.912 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.913 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.913 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:35.913 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:35.913 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.914 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.914 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.914 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.914 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.915 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.915 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.915 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.915 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.915 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.916 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.916 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:35.916 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:35.916 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.917 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:35.917 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "iostat", 2021-03-10T19:58:35.917 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:35.917 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:35.917 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:35.918 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:35.918 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:35.918 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.918 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.919 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.919 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.919 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.919 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.920 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:35.920 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:35.920 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:35.920 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:35.920 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:35.921 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:35.921 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:35.921 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:35.921 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.922 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.922 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.922 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.922 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.923 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:35.923 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:35.923 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.923 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.923 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.924 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.924 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.924 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.924 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.925 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.925 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.925 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.925 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.926 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.926 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:35.926 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:35.926 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.927 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.927 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.927 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:35.927 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.927 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.928 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:35.928 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:35.928 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:35.928 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:35.929 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:35.929 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:35.929 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:35.929 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:35.929 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.930 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.930 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.930 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.930 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.931 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:35.931 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:35.931 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.931 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.931 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.932 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.932 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.932 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.932 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.933 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.933 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.933 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.933 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.934 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:35.934 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:35.934 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.934 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:35.934 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "k8sevents", 2021-03-10T19:58:35.935 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:35.935 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:35.935 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:35.935 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ceph_event_retention_days": { 2021-03-10T19:58:35.936 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ceph_event_retention_days", 2021-03-10T19:58:35.936 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:35.936 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.936 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.937 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2021-03-10T19:58:35.937 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.937 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.937 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.937 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Days to hold ceph event information within local cache", 2021-03-10T19:58:35.938 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.938 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.938 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.938 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.939 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "config_check_secs": { 2021-03-10T19:58:35.939 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "config_check_secs", 2021-03-10T19:58:35.939 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:35.939 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.940 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:35.940 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2021-03-10T19:58:35.940 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "10", 2021-03-10T19:58:35.940 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.940 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.941 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "interval (secs) to check for cluster configuration changes", 2021-03-10T19:58:35.941 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.941 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.941 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.942 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.942 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:35.942 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:35.942 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.942 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.943 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.943 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.943 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.943 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.944 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:35.944 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:35.944 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:35.944 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:35.945 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:35.945 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:35.945 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:35.945 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:35.945 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.946 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.946 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.946 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.946 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.947 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:35.947 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:35.947 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.947 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.948 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.948 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.948 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.948 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.949 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.949 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.949 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.949 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.950 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.950 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.950 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:35.950 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:35.951 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.951 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.951 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.951 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:35.952 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.952 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.952 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:35.952 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:35.953 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:35.953 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:35.953 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:35.953 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:35.954 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:35.954 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:35.954 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.954 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.955 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.955 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.955 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.955 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:35.956 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:35.956 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.956 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.956 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.957 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.957 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.957 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.958 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.958 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.958 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.958 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.959 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.959 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:35.959 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:35.959 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.960 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:35.960 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "localpool", 2021-03-10T19:58:35.960 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:35.960 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:35.960 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:35.961 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "failure_domain": { 2021-03-10T19:58:35.961 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "failure_domain", 2021-03-10T19:58:35.961 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.961 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.962 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.962 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "host", 2021-03-10T19:58:35.962 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.962 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.963 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.963 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "failure domain for any created local pool", 2021-03-10T19:58:35.963 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.963 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.963 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.964 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.964 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:35.964 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:35.964 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.965 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.965 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.965 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.965 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.965 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.966 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:35.966 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:35.966 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:35.966 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:35.967 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:35.967 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:35.967 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:35.967 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:35.968 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.968 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.968 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.968 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.968 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.969 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:35.969 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:35.969 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.969 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.970 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.970 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.970 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.971 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.971 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.971 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.971 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.972 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.972 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.972 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.972 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:35.973 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:35.973 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.973 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.973 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.974 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:35.974 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.974 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.975 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:35.975 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:35.975 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:35.975 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:35.975 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:35.976 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:35.976 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:35.976 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:35.977 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.977 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.977 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.977 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.978 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.978 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:35.978 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:35.978 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:35.979 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.979 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.979 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:35.979 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.980 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.980 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.980 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:35.980 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.981 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.981 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.981 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.981 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_size": { 2021-03-10T19:58:35.982 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_size", 2021-03-10T19:58:35.982 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:35.982 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.982 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.983 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.983 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.983 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.983 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.984 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default min_size for any created local pool", 2021-03-10T19:58:35.984 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.984 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.985 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.985 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.985 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_rep": { 2021-03-10T19:58:35.985 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "num_rep", 2021-03-10T19:58:35.985 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:35.986 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.986 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.986 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "3", 2021-03-10T19:58:35.986 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.987 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.987 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.987 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default replica count for any created local pool", 2021-03-10T19:58:35.987 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.988 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.988 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.988 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.988 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_num": { 2021-03-10T19:58:35.989 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_num", 2021-03-10T19:58:35.989 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:35.989 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.989 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.990 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "128", 2021-03-10T19:58:35.990 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.990 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.990 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.990 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default pg_num for any created local pool", 2021-03-10T19:58:35.991 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.991 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.991 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.991 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.992 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "prefix": { 2021-03-10T19:58:35.992 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prefix", 2021-03-10T19:58:35.992 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.992 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.993 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.993 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:35.993 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.993 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.994 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.994 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name prefix for any created local pool", 2021-03-10T19:58:35.994 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.994 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.995 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.995 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:35.995 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "subtree": { 2021-03-10T19:58:35.995 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "subtree", 2021-03-10T19:58:35.996 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:35.996 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:35.996 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:35.997 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "rack", 2021-03-10T19:58:35.997 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:35.997 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:35.997 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:35.998 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "CRUSH level for which to create a local pool", 2021-03-10T19:58:35.998 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:35.998 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:35.999 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:35.999 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:35.999 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:35.999 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.000 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:36.000 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2021-03-10T19:58:36.000 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:36.000 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:36.001 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:36.001 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:36.001 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:36.001 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.001 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.002 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.002 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.002 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.002 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.003 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.003 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.003 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.003 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.004 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.004 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.004 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.004 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.005 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.005 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.005 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.005 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.005 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.006 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:36.006 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:36.006 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.006 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.007 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.007 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.007 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.007 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.008 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.008 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.008 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.008 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.009 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.009 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.009 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:36.009 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:36.010 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.010 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.010 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.010 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:36.011 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.011 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.011 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.011 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.012 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.012 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.012 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.012 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.013 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.013 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.013 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.014 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.014 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.014 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.014 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.015 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:36.015 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:36.015 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.016 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.016 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.016 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.017 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.017 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.017 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.017 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.018 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.018 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.018 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.019 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.019 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator": { 2021-03-10T19:58:36.019 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2021-03-10T19:58:36.019 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.020 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.020 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.020 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T19:58:36.020 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.021 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.021 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.021 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2021-03-10T19:58:36.021 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rook", 2021-03-10T19:58:36.022 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "test_orchestrator" 2021-03-10T19:58:36.022 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.022 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Orchestrator backend", 2021-03-10T19:58:36.022 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.022 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.023 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.023 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.023 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.023 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.024 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:36.024 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "osd_support", 2021-03-10T19:58:36.024 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:36.024 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:36.025 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:36.025 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:36.025 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:36.025 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.025 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.026 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.026 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.026 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.027 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.027 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.027 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.027 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.028 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.028 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.028 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.028 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.029 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.029 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.029 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.029 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.030 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.030 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.030 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:36.030 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:36.031 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.031 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.031 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.031 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.032 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.032 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.032 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.032 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.033 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.033 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.033 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.033 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.034 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:36.034 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:36.034 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.035 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.035 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.035 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:36.035 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.036 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.036 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.036 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.036 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.037 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.037 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.037 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.037 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.037 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.038 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.038 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.038 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.038 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.039 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.039 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:36.039 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:36.039 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.040 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.040 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.040 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.040 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.041 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.041 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.041 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.041 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.042 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.042 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.042 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.042 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.043 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.043 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:36.043 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_autoscaler", 2021-03-10T19:58:36.044 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:36.044 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:36.044 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:36.044 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:36.045 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:36.045 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.045 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.045 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.046 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.046 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.046 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.047 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.047 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.047 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.047 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.048 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.048 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.048 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.048 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.049 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.049 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.049 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.049 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.050 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.050 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:36.050 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:36.050 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.051 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.051 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.051 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.051 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.052 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.052 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.052 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.053 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.053 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.053 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.053 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.054 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:36.054 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:36.054 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.054 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.055 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.055 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:36.055 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.055 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.056 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.056 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.056 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.056 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.056 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.057 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.057 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.057 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.057 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.058 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.058 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.058 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.058 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.059 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:36.059 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:36.059 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.059 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.060 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.060 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.060 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.060 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.060 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.061 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.061 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.061 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.061 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.062 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.062 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2021-03-10T19:58:36.062 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2021-03-10T19:58:36.062 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.063 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.063 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.063 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T19:58:36.063 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.064 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.064 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.064 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.064 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.064 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.065 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.065 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.065 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.065 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.066 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:36.066 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "progress", 2021-03-10T19:58:36.066 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:36.066 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:36.067 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:36.067 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:36.067 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:36.067 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.068 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.068 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.068 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.068 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.069 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.069 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.069 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.069 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.070 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.070 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.070 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.070 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.071 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.071 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.071 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.071 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.072 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.072 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.072 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:36.072 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:36.073 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.073 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.073 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.073 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.074 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.074 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.074 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.074 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.075 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.075 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.075 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.076 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.076 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:36.076 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:36.076 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.076 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.077 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.077 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:36.077 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.077 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.078 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.078 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.078 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.078 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.079 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.079 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.079 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.079 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.080 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.080 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.080 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.081 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.081 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.081 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:36.081 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:36.082 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.082 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.082 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.082 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.083 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.083 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.083 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.083 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.084 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.084 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.084 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.084 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.085 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max_completed_events": { 2021-03-10T19:58:36.085 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "max_completed_events", 2021-03-10T19:58:36.085 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:36.086 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.086 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.086 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "50", 2021-03-10T19:58:36.086 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.087 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.087 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.087 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "number of past completed events to remember", 2021-03-10T19:58:36.087 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.088 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.088 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.088 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.088 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "persist_interval": { 2021-03-10T19:58:36.089 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "persist_interval", 2021-03-10T19:58:36.089 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:36.089 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.089 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.089 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2021-03-10T19:58:36.090 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.090 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.090 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.090 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to persist completed events", 2021-03-10T19:58:36.091 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.091 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.091 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.091 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.092 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.092 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.092 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:36.093 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prometheus", 2021-03-10T19:58:36.093 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:36.093 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:36.093 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:36.094 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:36.094 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:36.094 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.094 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.095 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.095 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.095 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.095 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.096 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.096 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.096 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.097 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.097 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.097 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.097 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.097 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.098 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.098 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.098 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.098 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.099 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.099 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:36.099 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:36.099 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.100 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.100 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.100 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.100 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.100 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.101 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.101 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.101 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.102 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.102 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.102 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.102 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:36.103 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:36.103 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.103 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.103 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.104 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:36.104 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.104 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.104 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.105 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.105 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.105 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.105 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.106 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.106 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.106 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.106 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.107 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.107 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.107 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.107 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.108 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:36.108 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:36.108 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.108 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.109 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.109 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.109 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.109 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.110 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.110 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.110 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.111 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.111 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.111 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.111 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools": { 2021-03-10T19:58:36.112 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools", 2021-03-10T19:58:36.112 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.112 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.112 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.113 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.113 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.113 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.113 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.114 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.114 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.114 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.114 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.115 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.115 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools_refresh_interval": { 2021-03-10T19:58:36.115 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools_refresh_interval", 2021-03-10T19:58:36.115 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.115 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.116 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.116 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.116 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.116 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.117 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.117 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.117 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.117 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.118 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.118 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.118 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_interval": { 2021-03-10T19:58:36.118 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_interval", 2021-03-10T19:58:36.119 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.119 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.119 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.119 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.120 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.120 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.120 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.120 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.120 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.121 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.121 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.121 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.121 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T19:58:36.122 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T19:58:36.122 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.122 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.122 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.123 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.123 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.123 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.123 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.124 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.124 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.124 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.124 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.125 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.125 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T19:58:36.125 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T19:58:36.125 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.126 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.126 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.126 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.127 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.127 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.127 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.128 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.128 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.128 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.128 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.129 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.129 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.129 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.129 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:36.130 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_support", 2021-03-10T19:58:36.130 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:36.130 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:36.130 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:36.131 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:36.131 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:36.131 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.131 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.132 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.132 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.132 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.132 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.133 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.133 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.133 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.133 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.134 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.134 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.134 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.134 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.135 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.135 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.135 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.135 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.136 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.136 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:36.136 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:36.136 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.137 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.137 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.137 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.137 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.138 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.138 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.138 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.139 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.139 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.139 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.139 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.140 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:36.140 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:36.140 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.140 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.141 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.141 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:36.141 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.141 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.142 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.142 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.142 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.143 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.143 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.143 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.143 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.144 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.144 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.144 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.144 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.145 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.145 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.145 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:36.145 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:36.146 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.146 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.146 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.146 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.147 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.147 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.147 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.147 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.148 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.148 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.148 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.148 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.149 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mirror_snapshot_schedule": { 2021-03-10T19:58:36.149 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mirror_snapshot_schedule", 2021-03-10T19:58:36.149 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.149 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.150 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.150 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.150 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.151 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.151 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.151 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.151 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.152 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.152 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.152 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.152 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "trash_purge_schedule": { 2021-03-10T19:58:36.152 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "trash_purge_schedule", 2021-03-10T19:58:36.153 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.153 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.153 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.153 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.154 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.154 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.154 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.154 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.155 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.155 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.155 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.155 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.156 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.156 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.156 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:36.156 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "restful", 2021-03-10T19:58:36.156 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:36.157 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:36.157 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:36.157 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2021-03-10T19:58:36.157 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2021-03-10T19:58:36.158 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.158 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.158 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.158 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.159 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.159 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.159 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.159 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.160 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.160 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.160 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.160 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.161 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:36.161 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:36.161 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.162 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.162 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.162 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.162 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.163 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.163 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.163 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.163 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.164 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.164 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.164 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.164 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.164 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.165 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.165 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.165 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.165 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.166 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.166 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:36.166 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:36.166 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.167 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.167 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.167 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.167 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.167 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.168 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.168 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.168 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.168 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.169 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.169 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.169 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:36.169 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:36.169 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.170 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.170 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.170 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:36.170 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.171 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.171 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.171 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.172 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.172 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.172 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.172 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.172 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.173 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.173 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.173 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.173 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.174 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.174 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.174 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:36.174 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:36.175 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.175 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.175 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.176 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.176 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.176 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.176 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.177 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.177 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.177 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.177 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.178 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.178 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2021-03-10T19:58:36.178 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2021-03-10T19:58:36.178 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.179 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.179 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.179 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.179 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.180 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.180 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.180 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.180 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.181 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.181 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.181 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.181 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2021-03-10T19:58:36.182 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2021-03-10T19:58:36.182 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.182 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.182 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.182 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.183 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.183 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.183 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.183 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.184 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.184 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.184 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.184 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.184 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.185 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.185 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:36.185 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rook", 2021-03-10T19:58:36.185 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:36.186 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:36.186 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:36.186 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:36.186 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:36.187 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.187 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.187 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.187 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.188 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.188 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.188 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.188 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.189 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.189 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.189 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.189 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.189 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.190 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.190 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.190 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.190 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.191 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.191 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.191 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:36.192 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:36.192 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.192 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.192 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.192 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.193 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.193 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.193 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.193 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.194 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.194 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.194 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.194 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.195 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:36.195 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:36.195 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.195 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.196 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.196 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:36.196 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.196 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.197 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.197 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.197 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.198 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.198 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.198 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.198 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.199 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.199 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.199 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.199 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.200 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.200 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.200 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:36.200 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:36.201 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.201 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.201 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.201 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.202 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.202 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.202 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.202 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.203 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.203 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.203 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.203 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.204 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.204 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.204 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:36.204 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "selftest", 2021-03-10T19:58:36.204 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:36.205 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:36.205 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:36.205 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:36.205 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:36.206 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.206 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.206 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.206 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.207 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.207 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.207 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.207 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.207 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.208 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.208 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.208 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.208 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.209 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.209 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.209 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.209 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.209 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.210 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.210 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:36.210 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:36.210 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.211 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.211 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.211 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.211 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.212 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.212 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.212 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.212 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.212 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.213 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.213 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.213 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:36.213 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:36.214 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.214 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.214 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.214 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:36.215 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.215 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.215 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.215 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.215 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.216 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.216 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.216 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.216 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.217 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.217 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.217 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.217 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.218 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.218 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.218 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:36.218 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:36.219 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.219 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.219 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.219 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.219 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.220 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.220 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.220 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.221 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.221 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.221 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.222 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.222 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption1": { 2021-03-10T19:58:36.222 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption1", 2021-03-10T19:58:36.222 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.223 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.223 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.223 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.223 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.224 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.224 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.224 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.224 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.225 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.225 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.225 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.225 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption2": { 2021-03-10T19:58:36.226 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption2", 2021-03-10T19:58:36.226 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.226 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.226 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.227 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "xyz", 2021-03-10T19:58:36.227 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.227 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.228 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.228 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.228 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.228 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.229 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.229 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.229 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption1": { 2021-03-10T19:58:36.229 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption1", 2021-03-10T19:58:36.230 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.230 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.230 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.231 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.231 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.231 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.231 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.232 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.232 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.232 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.232 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.233 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.233 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption2": { 2021-03-10T19:58:36.233 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption2", 2021-03-10T19:58:36.233 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:36.233 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.234 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.234 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.234 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.235 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.235 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.235 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.235 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.236 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.236 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.236 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.236 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption3": { 2021-03-10T19:58:36.237 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption3", 2021-03-10T19:58:36.237 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2021-03-10T19:58:36.237 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.237 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.238 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.238 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.238 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.238 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.239 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.239 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.239 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.239 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.240 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.240 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption4": { 2021-03-10T19:58:36.240 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption4", 2021-03-10T19:58:36.240 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.240 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.241 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.241 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.241 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.241 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.242 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.242 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.242 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.242 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.243 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.243 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.243 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption5": { 2021-03-10T19:58:36.243 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption5", 2021-03-10T19:58:36.244 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.244 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.244 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.244 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.245 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.245 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.245 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.246 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.246 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.246 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.246 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.247 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.247 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption6": { 2021-03-10T19:58:36.247 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption6", 2021-03-10T19:58:36.247 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.248 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.248 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.248 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:36.248 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.249 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.249 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.249 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.249 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.250 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.250 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.250 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.250 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testkey": { 2021-03-10T19:58:36.251 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testkey", 2021-03-10T19:58:36.251 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.251 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.251 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.252 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.252 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.252 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.252 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.253 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.253 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.253 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.253 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.254 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.254 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testlkey": { 2021-03-10T19:58:36.254 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testlkey", 2021-03-10T19:58:36.254 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.255 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.255 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.255 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.255 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.255 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.256 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.256 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.256 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.256 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.257 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.257 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.257 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testnewline": { 2021-03-10T19:58:36.257 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testnewline", 2021-03-10T19:58:36.258 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.258 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.258 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.259 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.259 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.259 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.259 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.260 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.260 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.260 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.260 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.261 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.261 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.261 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.261 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:36.262 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "status", 2021-03-10T19:58:36.262 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:36.262 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:36.262 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:36.263 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:36.263 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:36.263 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.263 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.264 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.264 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.264 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.264 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.265 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.265 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.265 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.265 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.266 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.266 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.266 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.266 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.267 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.267 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.267 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.267 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.267 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.268 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:36.268 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:36.268 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.268 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.269 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.269 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.269 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.269 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.270 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.270 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.270 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.270 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.271 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.271 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.271 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:36.271 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:36.271 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.272 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.272 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.272 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:36.272 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.273 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.273 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.273 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.273 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.274 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.274 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.274 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.274 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.274 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.275 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.275 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.275 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.275 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.276 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.276 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:36.276 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:36.276 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.277 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.277 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.277 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.277 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.278 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.278 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.278 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.278 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.279 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.279 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.279 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.279 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.279 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.280 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:36.280 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telegraf", 2021-03-10T19:58:36.280 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:36.280 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:36.281 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:36.281 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "address": { 2021-03-10T19:58:36.281 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "address", 2021-03-10T19:58:36.281 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.282 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.282 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.282 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "unixgram:///tmp/telegraf.sock", 2021-03-10T19:58:36.283 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.283 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.283 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.284 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.284 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.284 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.284 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.285 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.285 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T19:58:36.285 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T19:58:36.285 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:36.286 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.286 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.286 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15", 2021-03-10T19:58:36.286 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.287 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.287 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.287 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.287 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.288 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.288 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.288 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.288 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:36.289 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:36.289 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.289 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.289 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.290 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.290 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.290 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.290 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.291 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.291 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.291 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.291 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.292 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.292 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.292 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.293 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.293 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.293 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.294 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.294 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.294 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:36.294 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:36.295 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.295 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.295 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.296 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.296 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.296 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.296 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.297 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.297 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.297 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.297 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.298 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.298 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:36.298 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:36.298 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.299 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.299 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.299 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:36.299 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.300 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.300 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.300 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.300 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.301 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.301 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.301 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.301 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.302 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.302 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.302 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.302 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.303 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.303 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.303 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:36.303 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:36.304 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.304 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.304 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.304 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.305 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.305 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.305 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.305 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.306 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.306 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.306 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.306 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.307 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.307 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.307 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:36.307 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telemetry", 2021-03-10T19:58:36.308 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:36.308 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:36.308 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:36.308 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_basic": { 2021-03-10T19:58:36.309 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_basic", 2021-03-10T19:58:36.309 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.309 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.310 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.310 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:36.310 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.310 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.311 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.311 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Share basic cluster information (size, version)", 2021-03-10T19:58:36.311 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.311 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.312 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.312 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.312 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_crash": { 2021-03-10T19:58:36.312 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_crash", 2021-03-10T19:58:36.312 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.313 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.313 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.313 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:36.313 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.314 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.314 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.314 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.314 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.315 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.315 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.315 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.315 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_device": { 2021-03-10T19:58:36.316 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_device", 2021-03-10T19:58:36.316 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.316 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.316 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.316 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2021-03-10T19:58:36.317 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.317 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.317 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.317 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.318 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.318 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.318 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.318 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.319 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_ident": { 2021-03-10T19:58:36.319 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_ident", 2021-03-10T19:58:36.319 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.319 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.319 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.320 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.320 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.320 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.320 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.321 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.321 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.321 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.321 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.321 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.322 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "contact": { 2021-03-10T19:58:36.322 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "contact", 2021-03-10T19:58:36.322 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.322 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.323 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.323 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T19:58:36.323 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.323 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.324 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.324 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.324 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.324 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.325 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.325 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.325 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "description": { 2021-03-10T19:58:36.326 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "description", 2021-03-10T19:58:36.326 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.326 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.326 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.327 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T19:58:36.327 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.327 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.327 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.328 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.328 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.328 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.328 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.329 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.329 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_url": { 2021-03-10T19:58:36.329 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_url", 2021-03-10T19:58:36.329 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.330 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.330 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.330 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/device", 2021-03-10T19:58:36.330 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.331 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.331 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.331 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.331 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.331 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.332 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.332 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.332 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enabled": { 2021-03-10T19:58:36.332 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enabled", 2021-03-10T19:58:36.333 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.333 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.333 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.333 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.334 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.334 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.334 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.334 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.335 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.335 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.335 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.335 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.335 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T19:58:36.336 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T19:58:36.336 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:36.336 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.336 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.337 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "24", 2021-03-10T19:58:36.337 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "8", 2021-03-10T19:58:36.337 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.337 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.338 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.338 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.338 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.338 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.339 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.339 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_opt_revision": { 2021-03-10T19:58:36.339 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "last_opt_revision", 2021-03-10T19:58:36.339 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:36.340 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.340 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.340 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1", 2021-03-10T19:58:36.340 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.340 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.341 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.341 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.341 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.341 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.342 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.342 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.342 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "leaderboard": { 2021-03-10T19:58:36.342 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "leaderboard", 2021-03-10T19:58:36.343 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.343 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.343 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.343 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.344 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.344 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.344 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.344 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.345 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.345 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.345 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.345 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.346 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:36.346 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:36.346 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.346 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.347 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.347 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.347 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.347 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.348 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.348 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.348 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.349 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.349 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.349 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.349 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.350 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.350 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.350 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.351 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.351 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.351 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.351 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:36.352 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:36.352 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.352 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.352 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.353 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.353 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.353 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.354 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.354 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.354 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.354 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.355 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.355 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.355 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:36.355 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:36.356 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.356 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.356 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.357 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:36.357 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.357 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.357 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.358 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.358 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.358 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.358 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.359 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.359 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.359 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.359 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.360 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.360 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.360 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.360 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.361 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:36.361 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:36.361 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.362 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.362 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.362 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.362 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.363 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.363 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.363 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.364 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.364 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.364 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.364 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.364 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "organization": { 2021-03-10T19:58:36.365 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "organization", 2021-03-10T19:58:36.365 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.365 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.365 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.366 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T19:58:36.366 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.366 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.367 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.367 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.367 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.367 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.368 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.368 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.368 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "proxy": { 2021-03-10T19:58:36.368 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "proxy", 2021-03-10T19:58:36.369 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.369 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.369 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.369 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T19:58:36.370 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.370 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.370 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.370 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.371 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.371 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.371 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.371 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.372 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url": { 2021-03-10T19:58:36.372 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url", 2021-03-10T19:58:36.372 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.372 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.373 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.373 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/report", 2021-03-10T19:58:36.373 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.373 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.374 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.374 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.374 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.374 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.375 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.375 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.375 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.375 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.376 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:36.376 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "test_orchestrator", 2021-03-10T19:58:36.376 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:36.376 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:36.377 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:36.377 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:36.377 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:36.377 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.378 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.378 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.378 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.378 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.379 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.379 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.379 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.379 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.379 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.380 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.380 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.380 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.380 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.381 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.381 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.381 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.381 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.382 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.382 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:36.382 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:36.383 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.383 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.383 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.383 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.384 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.384 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.384 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.385 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.385 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.385 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.385 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.386 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.386 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:36.386 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:36.386 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.387 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.387 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.387 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:36.388 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.388 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.388 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.388 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.389 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.389 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.389 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.389 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.390 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.390 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.390 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.390 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.391 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.391 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.391 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.391 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:36.392 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:36.392 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.392 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.392 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.393 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.393 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.393 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.393 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.394 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.394 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.394 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.394 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.395 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.395 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.395 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.395 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:36.395 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "volumes", 2021-03-10T19:58:36.396 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:36.396 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:36.396 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:36.396 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:36.397 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:36.397 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.397 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.397 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.398 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.398 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.398 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.398 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.399 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.399 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.399 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.399 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.400 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.400 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.400 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.400 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.401 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.401 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.401 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.401 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.402 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:36.402 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:36.403 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.404 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.404 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.405 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.407 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.407 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.407 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.407 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.408 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.408 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.408 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.409 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.409 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:36.409 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:36.409 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.410 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.410 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.410 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:36.410 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.411 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.411 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.411 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.411 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.412 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.412 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.412 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.412 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.413 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.413 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.413 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.413 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.414 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.415 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.415 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:36.416 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:36.416 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.417 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.417 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.417 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.418 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.418 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.418 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.418 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.419 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.419 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.419 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.419 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.420 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.420 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.420 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:36.420 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix", 2021-03-10T19:58:36.421 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2021-03-10T19:58:36.421 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2021-03-10T19:58:36.422 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2021-03-10T19:58:36.422 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "discovery_interval": { 2021-03-10T19:58:36.422 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "discovery_interval", 2021-03-10T19:58:36.422 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.423 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.423 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.423 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "100", 2021-03-10T19:58:36.423 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.424 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.424 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.424 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.424 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.425 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.426 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.426 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.427 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "identifier": { 2021-03-10T19:58:36.427 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "identifier", 2021-03-10T19:58:36.428 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.428 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.428 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.429 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.429 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.429 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.430 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.430 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.431 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.431 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.432 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.432 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.432 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2021-03-10T19:58:36.433 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2021-03-10T19:58:36.433 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2021-03-10T19:58:36.434 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.434 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.434 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2021-03-10T19:58:36.435 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.435 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.436 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.436 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.437 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.437 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.437 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.438 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.438 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2021-03-10T19:58:36.439 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2021-03-10T19:58:36.439 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.439 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.440 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.440 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2021-03-10T19:58:36.440 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.441 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.441 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.442 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.442 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.442 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.442 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.443 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.443 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.443 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.443 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.444 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.444 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.444 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.444 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.444 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2021-03-10T19:58:36.445 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2021-03-10T19:58:36.445 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.445 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.445 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.446 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.446 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.447 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.447 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.447 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.448 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.448 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.449 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.449 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.450 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2021-03-10T19:58:36.450 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2021-03-10T19:58:36.450 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.451 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.451 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.452 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2021-03-10T19:58:36.452 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.453 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.453 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2021-03-10T19:58:36.453 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2021-03-10T19:58:36.454 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2021-03-10T19:58:36.454 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2021-03-10T19:58:36.455 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2021-03-10T19:58:36.455 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2021-03-10T19:58:36.456 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2021-03-10T19:58:36.456 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.456 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.457 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.457 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.458 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.458 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.459 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2021-03-10T19:58:36.459 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2021-03-10T19:58:36.460 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2021-03-10T19:58:36.460 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.461 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2021-03-10T19:58:36.461 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2021-03-10T19:58:36.461 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.462 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.462 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.463 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.463 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.464 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.464 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.464 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.465 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_host": { 2021-03-10T19:58:36.465 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_host", 2021-03-10T19:58:36.465 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.466 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.466 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.466 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2021-03-10T19:58:36.466 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.467 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.467 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.467 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.467 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.467 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.468 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.468 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.468 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_port": { 2021-03-10T19:58:36.468 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_port", 2021-03-10T19:58:36.469 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2021-03-10T19:58:36.469 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.469 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.469 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10051", 2021-03-10T19:58:36.469 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.470 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.470 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.470 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.470 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.470 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.471 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.471 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.471 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_sender": { 2021-03-10T19:58:36.471 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_sender", 2021-03-10T19:58:36.472 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2021-03-10T19:58:36.472 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2021-03-10T19:58:36.472 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2021-03-10T19:58:36.472 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "/usr/bin/zabbix_sender", 2021-03-10T19:58:36.472 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2021-03-10T19:58:36.473 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2021-03-10T19:58:36.473 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2021-03-10T19:58:36.473 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2021-03-10T19:58:36.473 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2021-03-10T19:58:36.474 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2021-03-10T19:58:36.474 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2021-03-10T19:58:36.475 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.475 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.475 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.475 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.475 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {}, 2021-03-10T19:58:36.476 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "always_on_modules": { 2021-03-10T19:58:36.476 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nautilus": [ 2021-03-10T19:58:36.476 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2021-03-10T19:58:36.476 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2021-03-10T19:58:36.477 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2021-03-10T19:58:36.477 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator_cli", 2021-03-10T19:58:36.477 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2021-03-10T19:58:36.477 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2021-03-10T19:58:36.477 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2021-03-10T19:58:36.478 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2021-03-10T19:58:36.478 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.478 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "octopus": [ 2021-03-10T19:58:36.478 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2021-03-10T19:58:36.478 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2021-03-10T19:58:36.479 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2021-03-10T19:58:36.479 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator", 2021-03-10T19:58:36.479 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_support", 2021-03-10T19:58:36.479 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_autoscaler", 2021-03-10T19:58:36.479 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2021-03-10T19:58:36.480 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2021-03-10T19:58:36.480 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2021-03-10T19:58:36.480 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "telemetry", 2021-03-10T19:58:36.480 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2021-03-10T19:58:36.481 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2021-03-10T19:58:36.481 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_failure_osd_epoch": 4, 2021-03-10T19:58:36.481 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_clients": [ 2021-03-10T19:58:36.481 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:36.481 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T19:58:36.482 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:36.482 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T19:58:36.482 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.123:0", 2021-03-10T19:58:36.482 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 2011847773 2021-03-10T19:58:36.482 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.483 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T19:58:36.483 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.483 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:36.483 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T19:58:36.484 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:36.484 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T19:58:36.484 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.123:0", 2021-03-10T19:58:36.484 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1355182290 2021-03-10T19:58:36.484 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.485 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T19:58:36.485 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2021-03-10T19:58:36.485 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:36.485 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2021-03-10T19:58:36.485 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:36.486 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2021-03-10T19:58:36.486 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.2.123:0", 2021-03-10T19:58:36.486 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1029094703 2021-03-10T19:58:36.486 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.486 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T19:58:36.487 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.487 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2021-03-10T19:58:36.487 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.487 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:36.488 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Waiting for the mgr to restart... 2021-03-10T19:58:36.489 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Waiting for Mgr epoch 9... 2021-03-10T19:58:36.489 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba023', '-v', '/var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'tell', 'mgr', 'mgr_status'] 2021-03-10T19:58:36.489 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba023 -v /var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 tell mgr mgr_status 2021-03-10T19:58:36.489 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:35 gibba023 bash[9844]: audit 2021-03-10T19:58:34.950594+0000 mon.a (mon.0) 73 : audit [DBG] from='client.? 172.21.2.123:0/3179004602' entity='client.admin' cmd=[{"prefix": "mgr dump"}]: dispatch 2021-03-10T19:58:36.724 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:36 gibba023 bash[9844]: cluster 2021-03-10T19:58:35.850562+0000 mon.a (mon.0) 74 : cluster [INF] Active manager daemon y restarted 2021-03-10T19:58:36.724 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:36 gibba023 bash[9844]: cluster 2021-03-10T19:58:35.851093+0000 mon.a (mon.0) 75 : cluster [INF] Activating manager daemon y 2021-03-10T19:58:36.725 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:36 gibba023 bash[9844]: cluster 2021-03-10T19:58:35.852805+0000 mon.a (mon.0) 76 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2021-03-10T19:58:37.175 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 19:58:36 gibba023 bash[10078]: Warning: Permanently added 'gibba023,172.21.2.123' (ECDSA) to the list of known hosts. 2021-03-10T19:58:37.622 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2021-03-10T19:58:37.623 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap_epoch": 11, 2021-03-10T19:58:37.623 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "initialized": true 2021-03-10T19:58:37.623 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2021-03-10T19:58:37.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:37 gibba023 bash[9844]: cluster 2021-03-10T19:58:36.596049+0000 mon.a (mon.0) 77 : cluster [DBG] mgrmap e10: y(active, starting, since 0.744996s) 2021-03-10T19:58:37.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:37 gibba023 bash[9844]: audit 2021-03-10T19:58:36.598937+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T19:58:37.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:37 gibba023 bash[9844]: audit 2021-03-10T19:58:36.600283+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T19:58:37.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:37 gibba023 bash[9844]: audit 2021-03-10T19:58:36.600558+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T19:58:37.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:37 gibba023 bash[9844]: audit 2021-03-10T19:58:36.600922+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T19:58:37.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:37 gibba023 bash[9844]: audit 2021-03-10T19:58:36.601903+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T19:58:37.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:37 gibba023 bash[9844]: audit 2021-03-10T19:58:36.603949+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba023"}]: dispatch 2021-03-10T19:58:37.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:37 gibba023 bash[9844]: audit 2021-03-10T19:58:36.605065+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T19:58:37.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:37 gibba023 bash[9844]: audit 2021-03-10T19:58:36.606257+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T19:58:37.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:37 gibba023 bash[9844]: audit 2021-03-10T19:58:36.607582+0000 mon.a (mon.0) 86 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T19:58:37.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:37 gibba023 bash[9844]: audit 2021-03-10T19:58:36.608893+0000 mon.a (mon.0) 87 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T19:58:37.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:37 gibba023 bash[9844]: audit 2021-03-10T19:58:36.610152+0000 mon.a (mon.0) 88 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T19:58:37.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:37 gibba023 bash[9844]: cluster 2021-03-10T19:58:36.616032+0000 mon.a (mon.0) 89 : cluster [INF] Manager daemon y is now available 2021-03-10T19:58:37.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:37 gibba023 bash[9844]: audit 2021-03-10T19:58:36.688238+0000 mon.a (mon.0) 90 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-03-10T19:58:37.932 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:37 gibba023 bash[9844]: audit 2021-03-10T19:58:36.879038+0000 mon.a (mon.0) 91 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-03-10T19:58:37.932 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:37 gibba023 bash[9844]: audit 2021-03-10T19:58:36.879267+0000 mon.a (mon.0) 92 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T19:58:37.933 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:37 gibba023 bash[9844]: audit 2021-03-10T19:58:37.186525+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:58:37.186012\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:58:37.186087\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T19:58:37.186154\", \"networks\": {}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T19:58:37.933 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:37 gibba023 bash[9844]: audit 2021-03-10T19:58:37.188553+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:58:37.186012\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:58:37.186087\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T19:58:37.186154\", \"networks\": {}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T19:58:37.934 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:37 gibba023 bash[9844]: audit 2021-03-10T19:58:37.189072+0000 mon.a (mon.0) 95 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T19:58:38.436 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Generating a dashboard self-signed certificate... 2021-03-10T19:58:38.436 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba023', '-v', '/var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'dashboard', 'create-self-signed-cert'] 2021-03-10T19:58:38.436 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba023 -v /var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 dashboard create-self-signed-cert 2021-03-10T19:58:38.723 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:38 gibba023 bash[9844]: cluster 2021-03-10T19:58:37.613920+0000 mon.a (mon.0) 96 : cluster [DBG] mgrmap e11: y(active, since 1.76289s) 2021-03-10T19:58:39.891 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:39 gibba023 bash[9844]: cluster 2021-03-10T19:58:38.621785+0000 mon.a (mon.0) 97 : cluster [DBG] mgrmap e12: y(active, since 2s) 2021-03-10T19:58:40.163 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout Self-signed certificate created 2021-03-10T19:58:40.840 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Creating initial admin user... 2021-03-10T19:58:40.840 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba023', '-v', '/var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'dashboard', 'ac-user-create', 'admin', '6up7gssg54', 'administrator', '--force-password', '--pwd-update-required'] 2021-03-10T19:58:40.841 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba023 -v /var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 dashboard ac-user-create admin 6up7gssg54 administrator --force-password --pwd-update-required 2021-03-10T19:58:40.863 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:40 gibba023 bash[9844]: audit 2021-03-10T19:58:40.157896+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/crt","val":"-----BEGIN CERTIFICATE-----\nMIIC0DCCAbgCEQDJ1BP8xPpCopyGjMcH+gmhMA0GCSqGSIb3DQEBDQUAMCYxCzAJ\nBgNVBAoMAklUMRcwFQYDVQQDDA5jZXBoLWRhc2hib2FyZDAeFw0yMTAzMTAxOTU4\nNDBaFw0zMTAzMDgxOTU4NDBaMCYxCzAJBgNVBAoMAklUMRcwFQYDVQQDDA5jZXBo\nLWRhc2hib2FyZDCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBAMHzTwZF\nJD+PQgAsnLYuOZvd2kWr5X6N390ILRwg7DUY0L4Ygjz9yURfi34ED67cduo47+X0\neFBgxekX2Z/dBRkvWHyCupkys1GlLfVdqsYyGBc6Cs71rPg9DoL/w2oE1I0RzttV\novna5e+8z+l8ex3fksX+xp8oi2XUbaOK4AV5XXYsL4qQOTwA0qdzmWWNUd0h/igb\na8L/5/buJB4l9DYm6kN4H/L6OrXN6YcfaIEDxvb7NswLMsg4hc9yDFrrto9nl1Qn\n378lByT1J6dW67e6UqX+CfisrO6SqUvAoZOlulRncCoW5XgFqitwfSwpH9L+AtV6\nGKgLm+YH/DnKqOkCAwEAATANBgkqhkiG9w0BAQ0FAAOCAQEAMYUqE8dZFMldd1td\nbqn2MKyPNEYrlBQYFzvW79hjK95zxMnynV9qoGKYZTuNfHev44eREkAEnoQtuXsP\nv0rVY+5nCb5bOFMrX866+dPHh5kFbG3dF9kOjkZYK1z94cfQGZKXEkXHg6nJBIF9\n/vjCZpGl7nE7A8qMhAIrTI2gshSdMfO/gK3dn9ZrA6gToLeNXvKCdDEwxUK3Zn7O\nkS0nbIssCnXm0pHiXBiJ9JL2Bcir9eBMDIzvu2o7us8oG62SxJodJLcZADXXDClR\nMLKmp1dVgTYyVqHH+JB9UlMnwZdn3/aXN+DfuVgG3Ic2JxReBMqoYNRvYDW3iw+b\nVYy0Xw==\n-----END CERTIFICATE-----\n"}]: dispatch 2021-03-10T19:58:40.863 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:40 gibba023 bash[9844]: audit 2021-03-10T19:58:40.159647+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/crt","val":"-----BEGIN CERTIFICATE-----\nMIIC0DCCAbgCEQDJ1BP8xPpCopyGjMcH+gmhMA0GCSqGSIb3DQEBDQUAMCYxCzAJ\nBgNVBAoMAklUMRcwFQYDVQQDDA5jZXBoLWRhc2hib2FyZDAeFw0yMTAzMTAxOTU4\nNDBaFw0zMTAzMDgxOTU4NDBaMCYxCzAJBgNVBAoMAklUMRcwFQYDVQQDDA5jZXBo\nLWRhc2hib2FyZDCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBAMHzTwZF\nJD+PQgAsnLYuOZvd2kWr5X6N390ILRwg7DUY0L4Ygjz9yURfi34ED67cduo47+X0\neFBgxekX2Z/dBRkvWHyCupkys1GlLfVdqsYyGBc6Cs71rPg9DoL/w2oE1I0RzttV\novna5e+8z+l8ex3fksX+xp8oi2XUbaOK4AV5XXYsL4qQOTwA0qdzmWWNUd0h/igb\na8L/5/buJB4l9DYm6kN4H/L6OrXN6YcfaIEDxvb7NswLMsg4hc9yDFrrto9nl1Qn\n378lByT1J6dW67e6UqX+CfisrO6SqUvAoZOlulRncCoW5XgFqitwfSwpH9L+AtV6\nGKgLm+YH/DnKqOkCAwEAATANBgkqhkiG9w0BAQ0FAAOCAQEAMYUqE8dZFMldd1td\nbqn2MKyPNEYrlBQYFzvW79hjK95zxMnynV9qoGKYZTuNfHev44eREkAEnoQtuXsP\nv0rVY+5nCb5bOFMrX866+dPHh5kFbG3dF9kOjkZYK1z94cfQGZKXEkXHg6nJBIF9\n/vjCZpGl7nE7A8qMhAIrTI2gshSdMfO/gK3dn9ZrA6gToLeNXvKCdDEwxUK3Zn7O\nkS0nbIssCnXm0pHiXBiJ9JL2Bcir9eBMDIzvu2o7us8oG62SxJodJLcZADXXDClR\nMLKmp1dVgTYyVqHH+JB9UlMnwZdn3/aXN+DfuVgG3Ic2JxReBMqoYNRvYDW3iw+b\nVYy0Xw==\n-----END CERTIFICATE-----\n"}]': finished 2021-03-10T19:58:40.863 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:40 gibba023 bash[9844]: audit 2021-03-10T19:58:40.160082+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQDB808GRSQ/j0IA\nLJy2Ljmb3dpFq+V+jd/dCC0cIOw1GNC+GII8/clEX4t+BA+u3HbqOO/l9HhQYMXp\nF9mf3QUZL1h8grqZMrNRpS31XarGMhgXOgrO9az4PQ6C/8NqBNSNEc7bVaL52uXv\nvM/pfHsd35LF/safKItl1G2jiuAFeV12LC+KkDk8ANKnc5lljVHdIf4oG2vC/+f2\n7iQeJfQ2JupDeB/y+jq1zemHH2iBA8b2+zbMCzLIOIXPcgxa67aPZ5dUJ9+/JQck\n9SenVuu3ulKl/gn4rKzukqlLwKGTpbpUZ3AqFuV4BaorcH0sKR/S/gLVehioC5vm\nB/w5yqjpAgMBAAECggEBALvwm7kFsvRsS5aDpG/dJzHkrygoREB4Fl/HFn9VX86r\n90rd0QZtHmVE+JTqNpBJTmn1NnJsjVHGFMGkvNtufwxClspAm7TsLluFZp2HYH6h\n+Do5olOeOThrYe6LDL9lYto4UWy09TKMbZf8LLSiTWNLTJzUH4AG9917FasOXbqu\niin/NkjivclLi2MFm63x5FTlE+Z90nVYQz6zdpDWFG459sHir0WKfG+PzfrdjTlG\n+OhXpgkrN+mm2WmW4+M7L4fnUuv0mTTj+i0spz73g9rUJ0sk0u9vn5P1D+nbg5cE\nCvoxxjZwD1e/1QkQzBxVVI7+I6UqOHpmv+dm7mPbZAECgYEA6GNruZmX6NJqPunz\nbaO6PQ6ikhjhXiOFkifZhh334Hx4IhzNsgkfGm9FVbVbQBR7a7T5BmOEGiOkZOAe\nc/RuUqKAb2f29hh+s5yfsKsYfudC3nzMKWM7nik8Wv+KxxwytbsBsbcc6k3Tn78d\naD7T0N38iW4BlyRxvwM7uS7Su6kCgYEA1agXTEBINUZb467bC6nG0UhDlL5EWEhW\noAzTiKSElGW0eEVkpWWYlq1f1S9tU8ugOE2C2Dp4oNWqnjQ7s3LaWlOzdSVD+aYE\nHjROUeieCB+tkSOwF1dkd+2fG7pJSyyoTzCkUDKAcaHLPn5UAyESIV0kjOjWew/Q\ne7QEePvqy0ECgYA25r4dhA7if0uAf472GRc3s4xuzZf4wJWe2PFIAS59h4puLLXf\n2M3TVfRgck8TjYM3B/NJMhuUfVUqS9SF+npR5XhIWZx7uX+9eUQ03ccUvBgNLhih\nsoL0M7PBn9uufJfyXTLiRGt9Y1OayvDsnuM11iwCX83aYk7JHL9wWYKJuQKBgAv2\n68cTWnfRRtgLNK0EhuO1XkN4HC+tbVxtG3Ntcxc0UtThXe99LvxRHSq9CyxEHObK\nQGeHbrXjATj2x9kWt2+TfFs1CQdz6osedrxTgHYIABo+m1/TPwcQQXa2CeCx0YMN\nwEXVbifu3YjUXjQGqBNCOgfCCjC+A/jJbe6wfMeBAoGABitTlAKT/2y1SLs+akdg\nJyu7nGIamUK5x0ftUKDsowxSX2xbe9iShFE6w8ugXsKxWwF7UmsuzH4IBcOtvlm3\nU8dBOW+KqNqk6151711MPCkLSCZtjIAavk5j6s4iBS+lfO/o0SSSc0z6gH3Kpu1s\niBNufejoxfhX/E6wzhxWy0o=\n-----END PRIVATE KEY-----\n"}]: dispatch 2021-03-10T19:58:40.864 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:40 gibba023 bash[9844]: audit 2021-03-10T19:58:40.161493+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQDB808GRSQ/j0IA\nLJy2Ljmb3dpFq+V+jd/dCC0cIOw1GNC+GII8/clEX4t+BA+u3HbqOO/l9HhQYMXp\nF9mf3QUZL1h8grqZMrNRpS31XarGMhgXOgrO9az4PQ6C/8NqBNSNEc7bVaL52uXv\nvM/pfHsd35LF/safKItl1G2jiuAFeV12LC+KkDk8ANKnc5lljVHdIf4oG2vC/+f2\n7iQeJfQ2JupDeB/y+jq1zemHH2iBA8b2+zbMCzLIOIXPcgxa67aPZ5dUJ9+/JQck\n9SenVuu3ulKl/gn4rKzukqlLwKGTpbpUZ3AqFuV4BaorcH0sKR/S/gLVehioC5vm\nB/w5yqjpAgMBAAECggEBALvwm7kFsvRsS5aDpG/dJzHkrygoREB4Fl/HFn9VX86r\n90rd0QZtHmVE+JTqNpBJTmn1NnJsjVHGFMGkvNtufwxClspAm7TsLluFZp2HYH6h\n+Do5olOeOThrYe6LDL9lYto4UWy09TKMbZf8LLSiTWNLTJzUH4AG9917FasOXbqu\niin/NkjivclLi2MFm63x5FTlE+Z90nVYQz6zdpDWFG459sHir0WKfG+PzfrdjTlG\n+OhXpgkrN+mm2WmW4+M7L4fnUuv0mTTj+i0spz73g9rUJ0sk0u9vn5P1D+nbg5cE\nCvoxxjZwD1e/1QkQzBxVVI7+I6UqOHpmv+dm7mPbZAECgYEA6GNruZmX6NJqPunz\nbaO6PQ6ikhjhXiOFkifZhh334Hx4IhzNsgkfGm9FVbVbQBR7a7T5BmOEGiOkZOAe\nc/RuUqKAb2f29hh+s5yfsKsYfudC3nzMKWM7nik8Wv+KxxwytbsBsbcc6k3Tn78d\naD7T0N38iW4BlyRxvwM7uS7Su6kCgYEA1agXTEBINUZb467bC6nG0UhDlL5EWEhW\noAzTiKSElGW0eEVkpWWYlq1f1S9tU8ugOE2C2Dp4oNWqnjQ7s3LaWlOzdSVD+aYE\nHjROUeieCB+tkSOwF1dkd+2fG7pJSyyoTzCkUDKAcaHLPn5UAyESIV0kjOjWew/Q\ne7QEePvqy0ECgYA25r4dhA7if0uAf472GRc3s4xuzZf4wJWe2PFIAS59h4puLLXf\n2M3TVfRgck8TjYM3B/NJMhuUfVUqS9SF+npR5XhIWZx7uX+9eUQ03ccUvBgNLhih\nsoL0M7PBn9uufJfyXTLiRGt9Y1OayvDsnuM11iwCX83aYk7JHL9wWYKJuQKBgAv2\n68cTWnfRRtgLNK0EhuO1XkN4HC+tbVxtG3Ntcxc0UtThXe99LvxRHSq9CyxEHObK\nQGeHbrXjATj2x9kWt2+TfFs1CQdz6osedrxTgHYIABo+m1/TPwcQQXa2CeCx0YMN\nwEXVbifu3YjUXjQGqBNCOgfCCjC+A/jJbe6wfMeBAoGABitTlAKT/2y1SLs+akdg\nJyu7nGIamUK5x0ftUKDsowxSX2xbe9iShFE6w8ugXsKxWwF7UmsuzH4IBcOtvlm3\nU8dBOW+KqNqk6151711MPCkLSCZtjIAavk5j6s4iBS+lfO/o0SSSc0z6gH3Kpu1s\niBNufejoxfhX/E6wzhxWy0o=\n-----END PRIVATE KEY-----\n"}]': finished 2021-03-10T19:58:41.880 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:41 gibba023 bash[9844]: audit 2021-03-10T19:58:40.123247+0000 mgr.y (mgr.14140) 1 : audit [DBG] from='client.14153 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T19:58:42.293 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout {"username": "admin", "password": "$2b$12$6JY//0YhX0ooAstTON1gQeNCObH.Ft0zUGRzh3F7FD2bRUJ0qYh3K", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1615406322, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2021-03-10T19:58:42.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:42 gibba023 bash[9844]: audit 2021-03-10T19:58:42.289958+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/accessdb_v2","val":"{\"users\": {\"admin\": {\"username\": \"admin\", \"password\": \"$2b$12$6JY//0YhX0ooAstTON1gQeNCObH.Ft0zUGRzh3F7FD2bRUJ0qYh3K\", \"roles\": [\"administrator\"], \"name\": null, \"email\": null, \"lastUpdate\": 1615406322, \"enabled\": true, \"pwdExpirationDate\": null, \"pwdUpdateRequired\": true}}, \"roles\": {}, \"version\": 2}"}]: dispatch 2021-03-10T19:58:42.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:42 gibba023 bash[9844]: audit 2021-03-10T19:58:42.292094+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/accessdb_v2","val":"{\"users\": {\"admin\": {\"username\": \"admin\", \"password\": \"$2b$12$6JY//0YhX0ooAstTON1gQeNCObH.Ft0zUGRzh3F7FD2bRUJ0qYh3K\", \"roles\": [\"administrator\"], \"name\": null, \"email\": null, \"lastUpdate\": 1615406322, \"enabled\": true, \"pwdExpirationDate\": null, \"pwdUpdateRequired\": true}}, \"roles\": {}, \"version\": 2}"}]': finished 2021-03-10T19:58:43.223 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Fetching dashboard port number... 2021-03-10T19:58:43.223 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:['/usr/bin/docker', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=gibba023', '-v', '/var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z', '-v', '/tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'get', 'mgr', 'mgr/dashboard/ssl_server_port'] 2021-03-10T19:58:43.224 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Running command: /usr/bin/docker run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=gibba023 -v /var/log/ceph/dd719b26-81da-11eb-9080-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmplnu_y0b4:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpofbrukwg:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config get mgr mgr/dashboard/ssl_server_port 2021-03-10T19:58:43.909 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:43 gibba023 bash[9844]: audit 2021-03-10T19:58:42.125003+0000 mgr.y (mgr.14140) 2 : audit [DBG] from='client.14155 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "password": "6up7gssg54", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T19:58:43.909 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:43 gibba023 bash[9844]: cluster 2021-03-10T19:58:42.635176+0000 mon.a (mon.0) 104 : cluster [DBG] mgrmap e13: y(active, since 6s) 2021-03-10T19:58:43.910 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:43 gibba023 bash[9844]: audit 2021-03-10T19:58:43.151064+0000 mon.a (mon.0) 105 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T19:58:43.910 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:43 gibba023 bash[9844]: audit 2021-03-10T19:58:43.250604+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:58:37.186012\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:58:37.186087\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T19:58:37.186154\", \"last_device_update\": \"2021-03-10T19:58:43.250094\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T19:58:43.910 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:43 gibba023 bash[9844]: audit 2021-03-10T19:58:43.252466+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:58:37.186012\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:58:37.186087\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T19:58:37.186154\", \"last_device_update\": \"2021-03-10T19:58:43.250094\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T19:58:44.197 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 8443 2021-03-10T19:58:44.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:44 gibba023 bash[9844]: audit 2021-03-10T19:58:44.196133+0000 mon.a (mon.0) 108 : audit [DBG] from='client.? 172.21.2.123:0/1437928604' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2021-03-10T19:58:44.828 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Ceph Dashboard is now available at: 2021-03-10T19:58:44.828 INFO:teuthology.orchestra.run.gibba023.stderr: 2021-03-10T19:58:44.828 INFO:teuthology.orchestra.run.gibba023.stderr: URL: https://gibba023:8443/ 2021-03-10T19:58:44.829 INFO:teuthology.orchestra.run.gibba023.stderr: User: admin 2021-03-10T19:58:44.829 INFO:teuthology.orchestra.run.gibba023.stderr: Password: 6up7gssg54 2021-03-10T19:58:44.829 INFO:teuthology.orchestra.run.gibba023.stderr: 2021-03-10T19:58:44.829 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:You can access the Ceph CLI with: 2021-03-10T19:58:44.830 INFO:teuthology.orchestra.run.gibba023.stderr: 2021-03-10T19:58:44.830 INFO:teuthology.orchestra.run.gibba023.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid dd719b26-81da-11eb-9080-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2021-03-10T19:58:44.830 INFO:teuthology.orchestra.run.gibba023.stderr: 2021-03-10T19:58:44.830 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Please consider enabling telemetry to help improve Ceph: 2021-03-10T19:58:44.830 INFO:teuthology.orchestra.run.gibba023.stderr: 2021-03-10T19:58:44.831 INFO:teuthology.orchestra.run.gibba023.stderr: ceph telemetry on 2021-03-10T19:58:44.831 INFO:teuthology.orchestra.run.gibba023.stderr: 2021-03-10T19:58:44.831 INFO:teuthology.orchestra.run.gibba023.stderr:For more information see: 2021-03-10T19:58:44.831 INFO:teuthology.orchestra.run.gibba023.stderr: 2021-03-10T19:58:44.831 INFO:teuthology.orchestra.run.gibba023.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2021-03-10T19:58:44.832 INFO:teuthology.orchestra.run.gibba023.stderr: 2021-03-10T19:58:44.832 INFO:teuthology.orchestra.run.gibba023.stderr:INFO:cephadm:Bootstrap complete. 2021-03-10T19:58:44.832 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Releasing lock 140415154057568 on /run/cephadm/dd719b26-81da-11eb-9080-001a4aab830c.lock 2021-03-10T19:58:44.832 INFO:teuthology.orchestra.run.gibba023.stderr:DEBUG:cephadm:Lock 140415154057568 released on /run/cephadm/dd719b26-81da-11eb-9080-001a4aab830c.lock 2021-03-10T19:58:44.836 INFO:tasks.cephadm:Fetching config... 2021-03-10T19:58:44.837 DEBUG:teuthology.orchestra.run.gibba023:> set -ex 2021-03-10T19:58:44.837 DEBUG:teuthology.orchestra.run.gibba023:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2021-03-10T19:58:44.845 INFO:tasks.cephadm:Fetching client.admin keyring... 2021-03-10T19:58:44.845 DEBUG:teuthology.orchestra.run.gibba023:> set -ex 2021-03-10T19:58:44.846 DEBUG:teuthology.orchestra.run.gibba023:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2021-03-10T19:58:44.851 INFO:tasks.cephadm:Fetching mon keyring... 2021-03-10T19:58:44.851 DEBUG:teuthology.orchestra.run.gibba023:> set -ex 2021-03-10T19:58:44.852 DEBUG:teuthology.orchestra.run.gibba023:> sudo dd if=/var/lib/ceph/dd719b26-81da-11eb-9080-001a4aab830c/mon.a/keyring of=/dev/stdout 2021-03-10T19:58:44.859 INFO:tasks.cephadm:Fetching pub ssh key... 2021-03-10T19:58:44.860 DEBUG:teuthology.orchestra.run.gibba023:> set -ex 2021-03-10T19:58:44.860 DEBUG:teuthology.orchestra.run.gibba023:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2021-03-10T19:58:44.910 INFO:tasks.cephadm:Installing pub ssh key for root users... 2021-03-10T19:58:44.911 DEBUG:teuthology.orchestra.run.gibba023:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8BmUUSGl1XQNB+5LZ1dpmcxZEp1VvbH5K9+dcxWNs/T2JUO1mXXSq2XElC1rqKVESCv4ug7srpm3BPIYqoxx03kdxi14dBQFwN/p3J8ueHFuz5+VoJNQMwGlUyT9mAOEtDrvlhePnbWYBObpKss549Nv9Y7EP5Ek6BBZ+nd4vSJc14bAdSTB9L79i+qK1Mc3SfN7v4H9GlmUIqrHcJqgLSo2Bl5xC2vOT/FGHBR2LdNzaZXlArroqG8yXl43UQRw+XVW4wGoh9tx8W7DAFPTSLJU/kzhUccFrUq3q3QXowbtd8NHVUMOx6CfDlDk8AI/jk4grO3puRuygqRFdZDRBXPGuavCn1MXE5Nt8sk3+n6wk0N1fB0NZzLnOKuahGwZLg29fmDckqarXMV/tLw/I30eP2WwSwGO6+NS49QuZJC37w2rCifujUW+W8PVzGtqOqyVF+pu6IP4jFf/0OQszwi33MXkuyIFRvjp+1Q8wi42PG1f+zlANQyFhUOvveac= ceph-dd719b26-81da-11eb-9080-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2021-03-10T19:58:44.928 INFO:teuthology.orchestra.run.gibba023.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8BmUUSGl1XQNB+5LZ1dpmcxZEp1VvbH5K9+dcxWNs/T2JUO1mXXSq2XElC1rqKVESCv4ug7srpm3BPIYqoxx03kdxi14dBQFwN/p3J8ueHFuz5+VoJNQMwGlUyT9mAOEtDrvlhePnbWYBObpKss549Nv9Y7EP5Ek6BBZ+nd4vSJc14bAdSTB9L79i+qK1Mc3SfN7v4H9GlmUIqrHcJqgLSo2Bl5xC2vOT/FGHBR2LdNzaZXlArroqG8yXl43UQRw+XVW4wGoh9tx8W7DAFPTSLJU/kzhUccFrUq3q3QXowbtd8NHVUMOx6CfDlDk8AI/jk4grO3puRuygqRFdZDRBXPGuavCn1MXE5Nt8sk3+n6wk0N1fB0NZzLnOKuahGwZLg29fmDckqarXMV/tLw/I30eP2WwSwGO6+NS49QuZJC37w2rCifujUW+W8PVzGtqOqyVF+pu6IP4jFf/0OQszwi33MXkuyIFRvjp+1Q8wi42PG1f+zlANQyFhUOvveac= ceph-dd719b26-81da-11eb-9080-001a4aab830c 2021-03-10T19:58:44.932 DEBUG:teuthology.orchestra.run.gibba044:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8BmUUSGl1XQNB+5LZ1dpmcxZEp1VvbH5K9+dcxWNs/T2JUO1mXXSq2XElC1rqKVESCv4ug7srpm3BPIYqoxx03kdxi14dBQFwN/p3J8ueHFuz5+VoJNQMwGlUyT9mAOEtDrvlhePnbWYBObpKss549Nv9Y7EP5Ek6BBZ+nd4vSJc14bAdSTB9L79i+qK1Mc3SfN7v4H9GlmUIqrHcJqgLSo2Bl5xC2vOT/FGHBR2LdNzaZXlArroqG8yXl43UQRw+XVW4wGoh9tx8W7DAFPTSLJU/kzhUccFrUq3q3QXowbtd8NHVUMOx6CfDlDk8AI/jk4grO3puRuygqRFdZDRBXPGuavCn1MXE5Nt8sk3+n6wk0N1fB0NZzLnOKuahGwZLg29fmDckqarXMV/tLw/I30eP2WwSwGO6+NS49QuZJC37w2rCifujUW+W8PVzGtqOqyVF+pu6IP4jFf/0OQszwi33MXkuyIFRvjp+1Q8wi42PG1f+zlANQyFhUOvveac= ceph-dd719b26-81da-11eb-9080-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2021-03-10T19:58:44.951 INFO:teuthology.orchestra.run.gibba044.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8BmUUSGl1XQNB+5LZ1dpmcxZEp1VvbH5K9+dcxWNs/T2JUO1mXXSq2XElC1rqKVESCv4ug7srpm3BPIYqoxx03kdxi14dBQFwN/p3J8ueHFuz5+VoJNQMwGlUyT9mAOEtDrvlhePnbWYBObpKss549Nv9Y7EP5Ek6BBZ+nd4vSJc14bAdSTB9L79i+qK1Mc3SfN7v4H9GlmUIqrHcJqgLSo2Bl5xC2vOT/FGHBR2LdNzaZXlArroqG8yXl43UQRw+XVW4wGoh9tx8W7DAFPTSLJU/kzhUccFrUq3q3QXowbtd8NHVUMOx6CfDlDk8AI/jk4grO3puRuygqRFdZDRBXPGuavCn1MXE5Nt8sk3+n6wk0N1fB0NZzLnOKuahGwZLg29fmDckqarXMV/tLw/I30eP2WwSwGO6+NS49QuZJC37w2rCifujUW+W8PVzGtqOqyVF+pu6IP4jFf/0OQszwi33MXkuyIFRvjp+1Q8wi42PG1f+zlANQyFhUOvveac= ceph-dd719b26-81da-11eb-9080-001a4aab830c 2021-03-10T19:58:44.953 INFO:tasks.cephadm:Writing (initial) conf and keyring to gibba044 2021-03-10T19:58:44.954 DEBUG:teuthology.orchestra.run.gibba044:> set -ex 2021-03-10T19:58:44.954 DEBUG:teuthology.orchestra.run.gibba044:> dd of=/etc/ceph/ceph.conf 2021-03-10T19:58:44.998 DEBUG:teuthology.orchestra.run.gibba044:> set -ex 2021-03-10T19:58:44.998 DEBUG:teuthology.orchestra.run.gibba044:> dd of=/etc/ceph/ceph.client.admin.keyring 2021-03-10T19:58:45.003 INFO:tasks.cephadm:Adding host gibba044 to orchestrator... 2021-03-10T19:58:45.004 DEBUG:teuthology.orchestra.run.gibba044:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph orch host add gibba044 2021-03-10T19:58:57.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:57 gibba023 bash[9844]: cluster 2021-03-10T19:58:56.603970+0000 mgr.y (mgr.14140) 3 : cluster [DBG] pgmap v3: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:58:59.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:58:59 gibba023 bash[9844]: cluster 2021-03-10T19:58:58.604862+0000 mgr.y (mgr.14140) 4 : cluster [DBG] pgmap v4: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:01.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:01 gibba023 bash[9844]: cluster 2021-03-10T19:59:00.605786+0000 mgr.y (mgr.14140) 5 : cluster [DBG] pgmap v5: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:02.926 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 19:59:02 gibba023 bash[10078]: Warning: Permanently added 'gibba044,172.21.2.144' (ECDSA) to the list of known hosts. 2021-03-10T19:59:03.496 INFO:teuthology.orchestra.run.gibba044.stdout:Added host 'gibba044' 2021-03-10T19:59:03.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:03 gibba023 bash[9844]: audit 2021-03-10T19:59:02.489067+0000 mgr.y (mgr.14140) 6 : audit [DBG] from='client.14159 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "gibba044", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T19:59:03.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:03 gibba023 bash[9844]: cluster 2021-03-10T19:59:02.606875+0000 mgr.y (mgr.14140) 7 : cluster [DBG] pgmap v6: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:03.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:03 gibba023 bash[9844]: audit 2021-03-10T19:59:02.928533+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"gibba023\": {\"hostname\": \"gibba023\", \"addr\": \"gibba023\", \"labels\": [], \"status\": \"\"}, \"gibba044\": {\"hostname\": \"gibba044\", \"addr\": \"gibba044\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2021-03-10T19:59:03.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:03 gibba023 bash[9844]: audit 2021-03-10T19:59:02.934346+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"gibba023\": {\"hostname\": \"gibba023\", \"addr\": \"gibba023\", \"labels\": [], \"status\": \"\"}, \"gibba044\": {\"hostname\": \"gibba044\", \"addr\": \"gibba044\", \"labels\": [], \"status\": \"\"}}"}]': finished 2021-03-10T19:59:03.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:03 gibba023 bash[9844]: cephadm 2021-03-10T19:59:02.935545+0000 mgr.y (mgr.14140) 8 : cephadm [INF] Added host gibba044 2021-03-10T19:59:03.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:03 gibba023 bash[9844]: audit 2021-03-10T19:59:03.081386+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T19:59:03.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:03 gibba023 bash[9844]: audit 2021-03-10T19:59:03.087317+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T19:59:03.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:03 gibba023 bash[9844]: audit 2021-03-10T19:59:03.089514+0000 mon.a (mon.0) 113 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T19:59:03.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:03 gibba023 bash[9844]: audit 2021-03-10T19:59:03.216287+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T19:59:03.215289\", \"networks\": {}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T19:59:03.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:03 gibba023 bash[9844]: audit 2021-03-10T19:59:03.222319+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T19:59:03.215289\", \"networks\": {}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T19:59:03.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:03 gibba023 bash[9844]: audit 2021-03-10T19:59:03.224115+0000 mon.a (mon.0) 116 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T19:59:04.315 DEBUG:teuthology.orchestra.run.gibba044:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph orch host ls --format=json 2021-03-10T19:59:05.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:05 gibba023 bash[9844]: cluster 2021-03-10T19:59:04.607636+0000 mgr.y (mgr.14140) 9 : cluster [DBG] pgmap v7: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:07.752 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-03-10T19:59:07.752 INFO:teuthology.orchestra.run.gibba044.stdout:[{"addr": "gibba023", "hostname": "gibba023", "labels": [], "status": ""}, {"addr": "gibba044", "hostname": "gibba044", "labels": [], "status": ""}] 2021-03-10T19:59:07.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:07 gibba023 bash[9844]: cluster 2021-03-10T19:59:06.608214+0000 mgr.y (mgr.14140) 10 : cluster [DBG] pgmap v8: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:08.425 INFO:tasks.cephadm:Setting crush tunables to default 2021-03-10T19:59:08.426 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph osd crush tunables default 2021-03-10T19:59:08.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:08 gibba023 bash[9844]: audit 2021-03-10T19:59:07.747708+0000 mgr.y (mgr.14140) 11 : audit [DBG] from='client.14161 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T19:59:09.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:09 gibba023 bash[9844]: cluster 2021-03-10T19:59:08.608966+0000 mgr.y (mgr.14140) 12 : cluster [DBG] pgmap v9: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:09.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:09 gibba023 bash[9844]: audit 2021-03-10T19:59:08.765113+0000 mon.a (mon.0) 117 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T19:59:09.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:09 gibba023 bash[9844]: audit 2021-03-10T19:59:08.898350+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T19:59:03.215289\", \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T19:59:09.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:09 gibba023 bash[9844]: audit 2021-03-10T19:59:08.904406+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2021-03-10T19:59:03.215289\", \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T19:59:11.697 INFO:teuthology.orchestra.run.gibba023.stderr:adjusted tunables profile to default 2021-03-10T19:59:12.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:11 gibba023 bash[9844]: cluster 2021-03-10T19:59:10.609658+0000 mgr.y (mgr.14140) 13 : cluster [DBG] pgmap v10: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:12.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:11 gibba023 bash[9844]: audit 2021-03-10T19:59:11.019853+0000 mon.a (mon.0) 120 : audit [INF] from='client.? 172.21.2.123:0/1871778360' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2021-03-10T19:59:12.326 INFO:tasks.cephadm:Adding mon.c on gibba023 2021-03-10T19:59:12.327 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph orch daemon add mon 'gibba023:[v2:172.21.2.123:3301,v1:172.21.2.123:6790]=c' 2021-03-10T19:59:13.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:12 gibba023 bash[9844]: audit 2021-03-10T19:59:11.687675+0000 mon.a (mon.0) 121 : audit [INF] from='client.? 172.21.2.123:0/1871778360' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2021-03-10T19:59:13.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:12 gibba023 bash[9844]: cluster 2021-03-10T19:59:11.687807+0000 mon.a (mon.0) 122 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T19:59:13.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:13 gibba023 bash[9844]: cluster 2021-03-10T19:59:12.610306+0000 mgr.y (mgr.14140) 14 : cluster [DBG] pgmap v12: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:15.907 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:15 gibba023 bash[9844]: cluster 2021-03-10T19:59:14.610877+0000 mgr.y (mgr.14140) 15 : cluster [DBG] pgmap v13: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:15.908 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:15 gibba023 bash[9844]: audit 2021-03-10T19:59:14.974207+0000 mgr.y (mgr.14140) 16 : audit [DBG] from='client.14165 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "gibba023:[v2:172.21.2.123:3301,v1:172.21.2.123:6790]=c", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T19:59:15.908 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:15 gibba023 bash[9844]: audit 2021-03-10T19:59:14.975433+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T19:59:15.908 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:15 gibba023 bash[9844]: audit 2021-03-10T19:59:14.976344+0000 mon.a (mon.0) 124 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T19:59:15.908 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:15 gibba023 bash[9844]: cephadm 2021-03-10T19:59:14.977032+0000 mgr.y (mgr.14140) 17 : cephadm [INF] Deploying daemon mon.c on gibba023 2021-03-10T19:59:15.909 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:15 gibba023 bash[9844]: audit 2021-03-10T19:59:14.977235+0000 mon.a (mon.0) 125 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2021-03-10T19:59:17.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:17 gibba023 bash[9844]: cluster 2021-03-10T19:59:16.611381+0000 mgr.y (mgr.14140) 18 : cluster [DBG] pgmap v14: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:18.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:18 gibba023 bash[9844]: audit 2021-03-10T19:59:18.298060+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:58:37.186012\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:58:37.186087\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}}, \"last_device_update\": \"2021-03-10T19:58:43.250094\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T19:59:18.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:18 gibba023 bash[9844]: audit 2021-03-10T19:59:18.298496+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T19:59:18.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:18 gibba023 bash[9844]: audit 2021-03-10T19:59:18.299702+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:58:37.186012\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:58:37.186087\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}}, \"last_device_update\": \"2021-03-10T19:58:43.250094\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T19:59:18.985 INFO:teuthology.orchestra.run.gibba023.stdout:Deployed mon.c on host 'gibba023' 2021-03-10T19:59:19.723 DEBUG:teuthology.orchestra.run.gibba023:mon.c> sudo journalctl -f -n 0 -u ceph-dd719b26-81da-11eb-9080-001a4aab830c@mon.c.service 2021-03-10T19:59:19.726 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2021-03-10T19:59:19.730 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph mon dump -f json 2021-03-10T19:59:19.747 INFO:journalctl@ceph.mon.c.gibba023.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T19:59:24.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:24 gibba023 bash[9844]: cluster 2021-03-10T19:59:19.276398+0000 mon.a (mon.0) 131 : cluster [INF] mon.a calling monitor election 2021-03-10T19:59:24.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:24 gibba023 bash[9844]: cluster 2021-03-10T19:59:20.612179+0000 mgr.y (mgr.14140) 20 : cluster [DBG] pgmap v16: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:24.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:24 gibba023 bash[9844]: cluster 2021-03-10T19:59:21.279027+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-03-10T19:59:24.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:24 gibba023 bash[9844]: cluster 2021-03-10T19:59:22.613083+0000 mgr.y (mgr.14140) 21 : cluster [DBG] pgmap v17: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:24.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:24 gibba023 bash[9844]: cluster 2021-03-10T19:59:24.282483+0000 mon.a (mon.0) 132 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-03-10T19:59:24.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:24 gibba023 bash[9844]: cluster 2021-03-10T19:59:24.291150+0000 mon.a (mon.0) 133 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0],c=[v2:172.21.2.123:3301/0,v1:172.21.2.123:6790/0]} 2021-03-10T19:59:24.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:24 gibba023 bash[9844]: cluster 2021-03-10T19:59:24.291326+0000 mon.a (mon.0) 134 : cluster [DBG] fsmap 2021-03-10T19:59:24.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:24 gibba023 bash[9844]: cluster 2021-03-10T19:59:24.291412+0000 mon.a (mon.0) 135 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T19:59:24.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:24 gibba023 bash[9844]: cluster 2021-03-10T19:59:24.291627+0000 mon.a (mon.0) 136 : cluster [DBG] mgrmap e13: y(active, since 48s) 2021-03-10T19:59:24.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:24 gibba023 bash[9844]: cluster 2021-03-10T19:59:24.294193+0000 mon.a (mon.0) 137 : cluster [INF] overall HEALTH_OK 2021-03-10T19:59:24.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:24 gibba023 bash[13032]: cluster 2021-03-10T19:59:19.276398+0000 mon.a (mon.0) 131 : cluster [INF] mon.a calling monitor election 2021-03-10T19:59:24.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:24 gibba023 bash[13032]: cluster 2021-03-10T19:59:20.612179+0000 mgr.y (mgr.14140) 20 : cluster [DBG] pgmap v16: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:24.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:24 gibba023 bash[13032]: cluster 2021-03-10T19:59:21.279027+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-03-10T19:59:24.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:24 gibba023 bash[13032]: cluster 2021-03-10T19:59:22.613083+0000 mgr.y (mgr.14140) 21 : cluster [DBG] pgmap v17: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:24.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:24 gibba023 bash[13032]: cluster 2021-03-10T19:59:24.282483+0000 mon.a (mon.0) 132 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-03-10T19:59:24.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:24 gibba023 bash[13032]: cluster 2021-03-10T19:59:24.291150+0000 mon.a (mon.0) 133 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0],c=[v2:172.21.2.123:3301/0,v1:172.21.2.123:6790/0]} 2021-03-10T19:59:24.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:24 gibba023 bash[13032]: cluster 2021-03-10T19:59:24.291326+0000 mon.a (mon.0) 134 : cluster [DBG] fsmap 2021-03-10T19:59:24.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:24 gibba023 bash[13032]: cluster 2021-03-10T19:59:24.291412+0000 mon.a (mon.0) 135 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T19:59:24.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:24 gibba023 bash[13032]: cluster 2021-03-10T19:59:24.291627+0000 mon.a (mon.0) 136 : cluster [DBG] mgrmap e13: y(active, since 48s) 2021-03-10T19:59:24.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:24 gibba023 bash[13032]: cluster 2021-03-10T19:59:24.294193+0000 mon.a (mon.0) 137 : cluster [INF] overall HEALTH_OK 2021-03-10T19:59:24.836 INFO:teuthology.orchestra.run.gibba023.stdout: 2021-03-10T19:59:24.837 INFO:teuthology.orchestra.run.gibba023.stdout:{"epoch":2,"fsid":"dd719b26-81da-11eb-9080-001a4aab830c","modified":"2021-03-10T19:59:19.274672Z","created":"2021-03-10T19:58:00.338680Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:3300","nonce":0},{"type":"v1","addr":"172.21.2.123:6789","nonce":0}]},"addr":"172.21.2.123:6789/0","public_addr":"172.21.2.123:6789/0","priority":0,"weight":0},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:3301","nonce":0},{"type":"v1","addr":"172.21.2.123:6790","nonce":0}]},"addr":"172.21.2.123:6790/0","public_addr":"172.21.2.123:6790/0","priority":0,"weight":0}],"quorum":[0,1]} 2021-03-10T19:59:24.838 INFO:teuthology.orchestra.run.gibba023.stderr:dumped monmap epoch 2 2021-03-10T19:59:25.466 INFO:tasks.cephadm:Adding mon.b on gibba044 2021-03-10T19:59:25.467 DEBUG:teuthology.orchestra.run.gibba044:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph orch daemon add mon gibba044:172.21.2.144=b 2021-03-10T19:59:25.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:25 gibba023 bash[9844]: cluster 2021-03-10T19:59:24.613882+0000 mgr.y (mgr.14140) 22 : cluster [DBG] pgmap v18: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:25.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:25 gibba023 bash[9844]: audit 2021-03-10T19:59:24.834857+0000 mon.a (mon.0) 138 : audit [DBG] from='client.? 172.21.2.123:0/3930775491' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-03-10T19:59:25.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:25 gibba023 bash[13032]: cluster 2021-03-10T19:59:24.613882+0000 mgr.y (mgr.14140) 22 : cluster [DBG] pgmap v18: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:25.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:25 gibba023 bash[13032]: audit 2021-03-10T19:59:24.834857+0000 mon.a (mon.0) 138 : audit [DBG] from='client.? 172.21.2.123:0/3930775491' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-03-10T19:59:27.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:27 gibba023 bash[9844]: cluster 2021-03-10T19:59:26.614891+0000 mgr.y (mgr.14140) 23 : cluster [DBG] pgmap v19: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:27.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:27 gibba023 bash[13032]: cluster 2021-03-10T19:59:26.614891+0000 mgr.y (mgr.14140) 23 : cluster [DBG] pgmap v19: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:28.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:28 gibba023 bash[9844]: audit 2021-03-10T19:59:28.042820+0000 mgr.y (mgr.14140) 24 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "gibba044:172.21.2.144=b", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T19:59:28.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:28 gibba023 bash[9844]: audit 2021-03-10T19:59:28.046378+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T19:59:28.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:28 gibba023 bash[9844]: audit 2021-03-10T19:59:28.049404+0000 mon.a (mon.0) 140 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T19:59:28.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:28 gibba023 bash[9844]: audit 2021-03-10T19:59:28.052948+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-03-10T19:59:28.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:28 gibba023 bash[13032]: audit 2021-03-10T19:59:28.042820+0000 mgr.y (mgr.14140) 24 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "gibba044:172.21.2.144=b", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T19:59:28.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:28 gibba023 bash[13032]: audit 2021-03-10T19:59:28.046378+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T19:59:28.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:28 gibba023 bash[13032]: audit 2021-03-10T19:59:28.049404+0000 mon.a (mon.0) 140 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T19:59:28.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:28 gibba023 bash[13032]: audit 2021-03-10T19:59:28.052948+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-03-10T19:59:29.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:29 gibba023 bash[9844]: cephadm 2021-03-10T19:59:28.051958+0000 mgr.y (mgr.14140) 25 : cephadm [INF] Deploying daemon mon.b on gibba044 2021-03-10T19:59:29.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:29 gibba023 bash[9844]: cluster 2021-03-10T19:59:28.615889+0000 mgr.y (mgr.14140) 26 : cluster [DBG] pgmap v20: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:29.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:29 gibba023 bash[13032]: cephadm 2021-03-10T19:59:28.051958+0000 mgr.y (mgr.14140) 25 : cephadm [INF] Deploying daemon mon.b on gibba044 2021-03-10T19:59:29.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:29 gibba023 bash[13032]: cluster 2021-03-10T19:59:28.615889+0000 mgr.y (mgr.14140) 26 : cluster [DBG] pgmap v20: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:31.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:31 gibba023 bash[9844]: cluster 2021-03-10T19:59:30.616770+0000 mgr.y (mgr.14140) 27 : cluster [DBG] pgmap v21: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:31.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:31 gibba023 bash[9844]: audit 2021-03-10T19:59:31.567455+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}}, \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T19:59:31.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:31 gibba023 bash[9844]: audit 2021-03-10T19:59:31.568875+0000 mon.a (mon.0) 143 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T19:59:31.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:31 gibba023 bash[9844]: audit 2021-03-10T19:59:31.575242+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}}, \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T19:59:31.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:31 gibba023 bash[13032]: cluster 2021-03-10T19:59:30.616770+0000 mgr.y (mgr.14140) 27 : cluster [DBG] pgmap v21: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:31.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:31 gibba023 bash[13032]: audit 2021-03-10T19:59:31.567455+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}}, \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T19:59:31.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:31 gibba023 bash[13032]: audit 2021-03-10T19:59:31.568875+0000 mon.a (mon.0) 143 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T19:59:31.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:31 gibba023 bash[13032]: audit 2021-03-10T19:59:31.575242+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}}, \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T19:59:32.056 INFO:teuthology.orchestra.run.gibba044.stdout:Deployed mon.b on host 'gibba044' 2021-03-10T19:59:32.814 DEBUG:teuthology.orchestra.run.gibba044:mon.b> sudo journalctl -f -n 0 -u ceph-dd719b26-81da-11eb-9080-001a4aab830c@mon.b.service 2021-03-10T19:59:32.816 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2021-03-10T19:59:32.816 DEBUG:teuthology.orchestra.run.gibba044:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph mon dump -f json 2021-03-10T19:59:32.861 INFO:journalctl@ceph.mon.b.gibba044.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T19:59:32.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:32 gibba023 bash[9844]: audit 2021-03-10T19:59:31.719385+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:31.717462\", \"created\": \"2021-03-10T19:59:31.557503\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}}, \"last_daemon_update\": \"2021-03-10T19:59:31.717792\", \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T19:59:32.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:32 gibba023 bash[9844]: audit 2021-03-10T19:59:31.727106+0000 mon.a (mon.0) 146 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:31.717462\", \"created\": \"2021-03-10T19:59:31.557503\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}}, \"last_daemon_update\": \"2021-03-10T19:59:31.717792\", \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T19:59:32.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:32 gibba023 bash[13032]: audit 2021-03-10T19:59:31.719385+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:31.717462\", \"created\": \"2021-03-10T19:59:31.557503\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}}, \"last_daemon_update\": \"2021-03-10T19:59:31.717792\", \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T19:59:32.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:32 gibba023 bash[13032]: audit 2021-03-10T19:59:31.727106+0000 mon.a (mon.0) 146 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:31.717462\", \"created\": \"2021-03-10T19:59:31.557503\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}}, \"last_daemon_update\": \"2021-03-10T19:59:31.717792\", \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T19:59:32.994 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: debug 2021-03-10T19:59:32.853+0000 7f4a75fa1700 0 mon.b@-1(synchronizing).mds e1 new map 2021-03-10T19:59:32.994 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: debug 2021-03-10T19:59:32.853+0000 7f4a75fa1700 0 mon.b@-1(synchronizing).mds e1 print_map 2021-03-10T19:59:32.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: e1 2021-03-10T19:59:32.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: enable_multiple, ever_enabled_multiple: 0,0 2021-03-10T19:59:32.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-03-10T19:59:32.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: legacy client fscid: -1 2021-03-10T19:59:32.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: 2021-03-10T19:59:32.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: No filesystems configured 2021-03-10T19:59:32.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: debug 2021-03-10T19:59:32.853+0000 7f4a75fa1700 1 mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2021-03-10T19:59:32.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: debug 2021-03-10T19:59:32.853+0000 7f4a75fa1700 1 mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2021-03-10T19:59:32.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: debug 2021-03-10T19:59:32.853+0000 7f4a75fa1700 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2021-03-10T19:59:32.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: debug 2021-03-10T19:59:32.853+0000 7f4a75fa1700 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2021-03-10T19:59:32.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: debug 2021-03-10T19:59:32.853+0000 7f4a75fa1700 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2021-03-10T19:59:32.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: debug 2021-03-10T19:59:32.853+0000 7f4a75fa1700 1 mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2021-03-10T19:59:32.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: debug 2021-03-10T19:59:32.853+0000 7f4a75fa1700 1 mon.b@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2021-03-10T19:59:32.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: debug 2021-03-10T19:59:32.853+0000 7f4a75fa1700 1 mon.b@-1(synchronizing).osd e6 e6: 0 total, 0 up, 0 in 2021-03-10T19:59:32.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: debug 2021-03-10T19:59:32.853+0000 7f4a75fa1700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T19:59:32.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: debug 2021-03-10T19:59:32.853+0000 7f4a75fa1700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T19:59:32.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: debug 2021-03-10T19:59:32.853+0000 7f4a75fa1700 0 mon.b@-1(synchronizing).osd e6 crush map has features 3314933000852226048, adjusting msgr requires 2021-03-10T19:59:32.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: debug 2021-03-10T19:59:32.853+0000 7f4a75fa1700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T19:59:32.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: audit 2021-03-10T19:59:31.719385+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:31.717462\", \"created\": \"2021-03-10T19:59:31.557503\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}}, \"last_daemon_update\": \"2021-03-10T19:59:31.717792\", \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T19:59:32.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: audit 2021-03-10T19:59:31.727106+0000 mon.a (mon.0) 146 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:31.717462\", \"created\": \"2021-03-10T19:59:31.557503\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}}, \"last_daemon_update\": \"2021-03-10T19:59:31.717792\", \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T19:59:32.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: debug 2021-03-10T19:59:32.857+0000 7f4a75fa1700 1 mon.b@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2021-03-10T19:59:32.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: debug 2021-03-10T19:59:32.861+0000 7f4a75fa1700 10 mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2021-03-10T19:59:33.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: debug 2021-03-10T19:59:32.861+0000 7f4a75fa1700 20 expand_channel_meta expand map: {default=false} 2021-03-10T19:59:33.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: debug 2021-03-10T19:59:32.861+0000 7f4a75fa1700 20 expand_channel_meta from 'false' to 'false' 2021-03-10T19:59:33.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: debug 2021-03-10T19:59:32.861+0000 7f4a75fa1700 20 expand_channel_meta expanded map: {default=false} 2021-03-10T19:59:33.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: debug 2021-03-10T19:59:32.861+0000 7f4a75fa1700 20 expand_channel_meta expand map: {default=info} 2021-03-10T19:59:33.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: debug 2021-03-10T19:59:32.861+0000 7f4a75fa1700 20 expand_channel_meta from 'info' to 'info' 2021-03-10T19:59:33.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: debug 2021-03-10T19:59:32.861+0000 7f4a75fa1700 20 expand_channel_meta expanded map: {default=info} 2021-03-10T19:59:33.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: debug 2021-03-10T19:59:32.861+0000 7f4a75fa1700 20 expand_channel_meta expand map: {default=daemon} 2021-03-10T19:59:33.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: debug 2021-03-10T19:59:32.861+0000 7f4a75fa1700 20 expand_channel_meta from 'daemon' to 'daemon' 2021-03-10T19:59:33.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: debug 2021-03-10T19:59:32.861+0000 7f4a75fa1700 20 expand_channel_meta expanded map: {default=daemon} 2021-03-10T19:59:33.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: debug 2021-03-10T19:59:32.861+0000 7f4a75fa1700 20 expand_channel_meta expand map: {default=debug} 2021-03-10T19:59:33.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: debug 2021-03-10T19:59:32.861+0000 7f4a75fa1700 20 expand_channel_meta from 'debug' to 'debug' 2021-03-10T19:59:33.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:32 gibba044 bash[9859]: debug 2021-03-10T19:59:32.861+0000 7f4a75fa1700 20 expand_channel_meta expanded map: {default=debug} 2021-03-10T19:59:38.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:37 gibba023 bash[9844]: cluster 2021-03-10T19:59:32.617634+0000 mgr.y (mgr.14140) 28 : cluster [DBG] pgmap v22: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:38.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:37 gibba023 bash[9844]: cluster 2021-03-10T19:59:32.880317+0000 mon.a (mon.0) 147 : cluster [INF] mon.a calling monitor election 2021-03-10T19:59:38.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:37 gibba023 bash[9844]: cluster 2021-03-10T19:59:32.880515+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-03-10T19:59:38.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:37 gibba023 bash[9844]: cluster 2021-03-10T19:59:34.618494+0000 mgr.y (mgr.14140) 29 : cluster [DBG] pgmap v23: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:38.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:37 gibba023 bash[9844]: cluster 2021-03-10T19:59:36.619162+0000 mgr.y (mgr.14140) 30 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:38.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:37 gibba023 bash[9844]: cluster 2021-03-10T19:59:37.882665+0000 mon.a (mon.0) 148 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-03-10T19:59:38.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:37 gibba023 bash[9844]: cluster 2021-03-10T19:59:37.890224+0000 mon.a (mon.0) 149 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0],b=[v2:172.21.2.144:3300/0,v1:172.21.2.144:6789/0],c=[v2:172.21.2.123:3301/0,v1:172.21.2.123:6790/0]} 2021-03-10T19:59:38.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:37 gibba023 bash[9844]: cluster 2021-03-10T19:59:37.890418+0000 mon.a (mon.0) 150 : cluster [DBG] fsmap 2021-03-10T19:59:38.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:37 gibba023 bash[9844]: cluster 2021-03-10T19:59:37.890496+0000 mon.a (mon.0) 151 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T19:59:38.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:37 gibba023 bash[9844]: cluster 2021-03-10T19:59:37.890747+0000 mon.a (mon.0) 152 : cluster [DBG] mgrmap e13: y(active, since 62s) 2021-03-10T19:59:38.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:37 gibba023 bash[9844]: cluster 2021-03-10T19:59:37.890830+0000 mon.a (mon.0) 153 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2021-03-10T19:59:38.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:37 gibba023 bash[9844]: cluster 2021-03-10T19:59:37.893498+0000 mon.a (mon.0) 154 : cluster [WRN] overall HEALTH_WARN 1/3 mons down, quorum a,c 2021-03-10T19:59:38.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:37 gibba023 bash[13032]: cluster 2021-03-10T19:59:32.617634+0000 mgr.y (mgr.14140) 28 : cluster [DBG] pgmap v22: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:38.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:37 gibba023 bash[13032]: cluster 2021-03-10T19:59:32.880317+0000 mon.a (mon.0) 147 : cluster [INF] mon.a calling monitor election 2021-03-10T19:59:38.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:37 gibba023 bash[13032]: cluster 2021-03-10T19:59:32.880515+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-03-10T19:59:38.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:37 gibba023 bash[13032]: cluster 2021-03-10T19:59:34.618494+0000 mgr.y (mgr.14140) 29 : cluster [DBG] pgmap v23: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:38.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:37 gibba023 bash[13032]: cluster 2021-03-10T19:59:36.619162+0000 mgr.y (mgr.14140) 30 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:38.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:37 gibba023 bash[13032]: cluster 2021-03-10T19:59:37.882665+0000 mon.a (mon.0) 148 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-03-10T19:59:38.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:37 gibba023 bash[13032]: cluster 2021-03-10T19:59:37.890224+0000 mon.a (mon.0) 149 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0],b=[v2:172.21.2.144:3300/0,v1:172.21.2.144:6789/0],c=[v2:172.21.2.123:3301/0,v1:172.21.2.123:6790/0]} 2021-03-10T19:59:38.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:37 gibba023 bash[13032]: cluster 2021-03-10T19:59:37.890418+0000 mon.a (mon.0) 150 : cluster [DBG] fsmap 2021-03-10T19:59:38.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:37 gibba023 bash[13032]: cluster 2021-03-10T19:59:37.890496+0000 mon.a (mon.0) 151 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T19:59:38.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:37 gibba023 bash[13032]: cluster 2021-03-10T19:59:37.890747+0000 mon.a (mon.0) 152 : cluster [DBG] mgrmap e13: y(active, since 62s) 2021-03-10T19:59:38.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:37 gibba023 bash[13032]: cluster 2021-03-10T19:59:37.890830+0000 mon.a (mon.0) 153 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2021-03-10T19:59:38.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:37 gibba023 bash[13032]: cluster 2021-03-10T19:59:37.893498+0000 mon.a (mon.0) 154 : cluster [WRN] overall HEALTH_WARN 1/3 mons down, quorum a,c 2021-03-10T19:59:39.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:38 gibba023 bash[9844]: cluster 2021-03-10T19:59:37.942071+0000 mon.a (mon.0) 155 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T19:59:39.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:38 gibba023 bash[13032]: cluster 2021-03-10T19:59:37.942071+0000 mon.a (mon.0) 155 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T19:59:39.541 INFO:teuthology.orchestra.run.gibba044.stdout: 2021-03-10T19:59:39.542 INFO:teuthology.orchestra.run.gibba044.stdout:{"epoch":3,"fsid":"dd719b26-81da-11eb-9080-001a4aab830c","modified":"2021-03-10T19:59:32.871236Z","created":"2021-03-10T19:58:00.338680Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:3300","nonce":0},{"type":"v1","addr":"172.21.2.123:6789","nonce":0}]},"addr":"172.21.2.123:6789/0","public_addr":"172.21.2.123:6789/0","priority":0,"weight":0},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:3301","nonce":0},{"type":"v1","addr":"172.21.2.123:6790","nonce":0}]},"addr":"172.21.2.123:6790/0","public_addr":"172.21.2.123:6790/0","priority":0,"weight":0},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:3300","nonce":0},{"type":"v1","addr":"172.21.2.144:6789","nonce":0}]},"addr":"172.21.2.144:6789/0","public_addr":"172.21.2.144:6789/0","priority":0,"weight":0}],"quorum":[0,1]} 2021-03-10T19:59:39.544 INFO:teuthology.orchestra.run.gibba044.stderr:dumped monmap epoch 3 2021-03-10T19:59:40.086 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:39 gibba044 bash[9859]: cluster 2021-03-10T19:59:37.942071+0000 mon.a (mon.0) 155 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T19:59:40.087 INFO:tasks.cephadm:Generating final ceph.conf file... 2021-03-10T19:59:40.087 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph config generate-minimal-conf 2021-03-10T19:59:40.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:40 gibba023 bash[9844]: cluster 2021-03-10T19:59:34.877334+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-03-10T19:59:40.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:40 gibba023 bash[9844]: cluster 2021-03-10T19:59:39.880600+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2021-03-10T19:59:40.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:40 gibba023 bash[9844]: cluster 2021-03-10T19:59:39.880707+0000 mon.a (mon.0) 157 : cluster [INF] mon.a calling monitor election 2021-03-10T19:59:40.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:40 gibba023 bash[9844]: cluster 2021-03-10T19:59:39.881608+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-03-10T19:59:40.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:40 gibba023 bash[9844]: cluster 2021-03-10T19:59:39.904609+0000 mon.a (mon.0) 158 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T19:59:40.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:40 gibba023 bash[9844]: cluster 2021-03-10T19:59:39.914682+0000 mon.a (mon.0) 159 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0],b=[v2:172.21.2.144:3300/0,v1:172.21.2.144:6789/0],c=[v2:172.21.2.123:3301/0,v1:172.21.2.123:6790/0]} 2021-03-10T19:59:40.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:40 gibba023 bash[9844]: cluster 2021-03-10T19:59:39.914748+0000 mon.a (mon.0) 160 : cluster [DBG] fsmap 2021-03-10T19:59:40.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:40 gibba023 bash[9844]: cluster 2021-03-10T19:59:39.914761+0000 mon.a (mon.0) 161 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T19:59:40.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:40 gibba023 bash[9844]: cluster 2021-03-10T19:59:39.914902+0000 mon.a (mon.0) 162 : cluster [DBG] mgrmap e13: y(active, since 64s) 2021-03-10T19:59:40.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:40 gibba023 bash[9844]: cluster 2021-03-10T19:59:39.914987+0000 mon.a (mon.0) 163 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2021-03-10T19:59:40.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:40 gibba023 bash[9844]: cluster 2021-03-10T19:59:39.921450+0000 mon.a (mon.0) 164 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2021-03-10T19:59:40.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:40 gibba023 bash[13032]: cluster 2021-03-10T19:59:34.877334+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-03-10T19:59:40.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:40 gibba023 bash[13032]: cluster 2021-03-10T19:59:39.880600+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2021-03-10T19:59:40.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:40 gibba023 bash[13032]: cluster 2021-03-10T19:59:39.880707+0000 mon.a (mon.0) 157 : cluster [INF] mon.a calling monitor election 2021-03-10T19:59:40.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:40 gibba023 bash[13032]: cluster 2021-03-10T19:59:39.881608+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-03-10T19:59:40.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:40 gibba023 bash[13032]: cluster 2021-03-10T19:59:39.904609+0000 mon.a (mon.0) 158 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T19:59:40.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:40 gibba023 bash[13032]: cluster 2021-03-10T19:59:39.914682+0000 mon.a (mon.0) 159 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0],b=[v2:172.21.2.144:3300/0,v1:172.21.2.144:6789/0],c=[v2:172.21.2.123:3301/0,v1:172.21.2.123:6790/0]} 2021-03-10T19:59:40.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:40 gibba023 bash[13032]: cluster 2021-03-10T19:59:39.914748+0000 mon.a (mon.0) 160 : cluster [DBG] fsmap 2021-03-10T19:59:40.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:40 gibba023 bash[13032]: cluster 2021-03-10T19:59:39.914761+0000 mon.a (mon.0) 161 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T19:59:40.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:40 gibba023 bash[13032]: cluster 2021-03-10T19:59:39.914902+0000 mon.a (mon.0) 162 : cluster [DBG] mgrmap e13: y(active, since 64s) 2021-03-10T19:59:40.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:40 gibba023 bash[13032]: cluster 2021-03-10T19:59:39.914987+0000 mon.a (mon.0) 163 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2021-03-10T19:59:40.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:40 gibba023 bash[13032]: cluster 2021-03-10T19:59:39.921450+0000 mon.a (mon.0) 164 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2021-03-10T19:59:41.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:40 gibba044 bash[9859]: cluster 2021-03-10T19:59:34.877334+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-03-10T19:59:41.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:40 gibba044 bash[9859]: cluster 2021-03-10T19:59:39.880600+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2021-03-10T19:59:41.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:40 gibba044 bash[9859]: cluster 2021-03-10T19:59:39.880707+0000 mon.a (mon.0) 157 : cluster [INF] mon.a calling monitor election 2021-03-10T19:59:41.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:40 gibba044 bash[9859]: cluster 2021-03-10T19:59:39.881608+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-03-10T19:59:41.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:40 gibba044 bash[9859]: cluster 2021-03-10T19:59:39.904609+0000 mon.a (mon.0) 158 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T19:59:41.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:40 gibba044 bash[9859]: cluster 2021-03-10T19:59:39.914682+0000 mon.a (mon.0) 159 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0],b=[v2:172.21.2.144:3300/0,v1:172.21.2.144:6789/0],c=[v2:172.21.2.123:3301/0,v1:172.21.2.123:6790/0]} 2021-03-10T19:59:41.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:40 gibba044 bash[9859]: cluster 2021-03-10T19:59:39.914748+0000 mon.a (mon.0) 160 : cluster [DBG] fsmap 2021-03-10T19:59:41.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:40 gibba044 bash[9859]: cluster 2021-03-10T19:59:39.914761+0000 mon.a (mon.0) 161 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-03-10T19:59:41.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:40 gibba044 bash[9859]: cluster 2021-03-10T19:59:39.914902+0000 mon.a (mon.0) 162 : cluster [DBG] mgrmap e13: y(active, since 64s) 2021-03-10T19:59:41.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:40 gibba044 bash[9859]: cluster 2021-03-10T19:59:39.914987+0000 mon.a (mon.0) 163 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2021-03-10T19:59:41.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:40 gibba044 bash[9859]: cluster 2021-03-10T19:59:39.921450+0000 mon.a (mon.0) 164 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2021-03-10T19:59:41.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:41 gibba023 bash[9844]: cluster 2021-03-10T19:59:40.620527+0000 mgr.y (mgr.14140) 32 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:41.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:41 gibba023 bash[13032]: cluster 2021-03-10T19:59:40.620527+0000 mgr.y (mgr.14140) 32 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:42.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:41 gibba044 bash[9859]: cluster 2021-03-10T19:59:40.620527+0000 mgr.y (mgr.14140) 32 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:42.729 INFO:teuthology.orchestra.run.gibba023.stdout:# minimal ceph.conf for dd719b26-81da-11eb-9080-001a4aab830c 2021-03-10T19:59:42.730 INFO:teuthology.orchestra.run.gibba023.stdout:[global] 2021-03-10T19:59:42.730 INFO:teuthology.orchestra.run.gibba023.stdout: fsid = dd719b26-81da-11eb-9080-001a4aab830c 2021-03-10T19:59:42.730 INFO:teuthology.orchestra.run.gibba023.stdout: mon_host = [v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0] [v2:172.21.2.144:3300/0,v1:172.21.2.144:6789/0] [v2:172.21.2.123:3301/0,v1:172.21.2.123:6790/0] 2021-03-10T19:59:43.351 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2021-03-10T19:59:43.352 DEBUG:teuthology.orchestra.run.gibba023:> set -ex 2021-03-10T19:59:43.352 DEBUG:teuthology.orchestra.run.gibba023:> sudo dd of=/etc/ceph/ceph.conf 2021-03-10T19:59:43.360 DEBUG:teuthology.orchestra.run.gibba023:> set -ex 2021-03-10T19:59:43.362 DEBUG:teuthology.orchestra.run.gibba023:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-03-10T19:59:43.413 DEBUG:teuthology.orchestra.run.gibba044:> set -ex 2021-03-10T19:59:43.413 DEBUG:teuthology.orchestra.run.gibba044:> sudo dd of=/etc/ceph/ceph.conf 2021-03-10T19:59:43.427 DEBUG:teuthology.orchestra.run.gibba044:> set -ex 2021-03-10T19:59:43.427 DEBUG:teuthology.orchestra.run.gibba044:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-03-10T19:59:43.434 INFO:tasks.cephadm:Adding mgr.y on gibba023 2021-03-10T19:59:43.434 INFO:tasks.cephadm:Adding mgr.x on gibba044 2021-03-10T19:59:43.435 DEBUG:teuthology.orchestra.run.gibba044:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph orch apply mgr '3;gibba023=y;gibba044=x' 2021-03-10T19:59:43.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:43 gibba044 bash[9859]: cluster 2021-03-10T19:59:42.620865+0000 mgr.y (mgr.14140) 33 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:43.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:43 gibba044 bash[9859]: audit 2021-03-10T19:59:42.727914+0000 mon.a (mon.0) 165 : audit [DBG] from='client.? 172.21.2.123:0/46123278' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T19:59:43.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:43 gibba023 bash[9844]: cluster 2021-03-10T19:59:42.620865+0000 mgr.y (mgr.14140) 33 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:43.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:43 gibba023 bash[9844]: audit 2021-03-10T19:59:42.727914+0000 mon.a (mon.0) 165 : audit [DBG] from='client.? 172.21.2.123:0/46123278' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T19:59:43.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:43 gibba023 bash[13032]: cluster 2021-03-10T19:59:42.620865+0000 mgr.y (mgr.14140) 33 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:43.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:43 gibba023 bash[13032]: audit 2021-03-10T19:59:42.727914+0000 mon.a (mon.0) 165 : audit [DBG] from='client.? 172.21.2.123:0/46123278' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T19:59:45.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:45 gibba023 bash[9844]: cluster 2021-03-10T19:59:44.621374+0000 mgr.y (mgr.14140) 34 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:45.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:45 gibba023 bash[13032]: cluster 2021-03-10T19:59:44.621374+0000 mgr.y (mgr.14140) 34 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:45.947 INFO:teuthology.orchestra.run.gibba044.stdout:Scheduled mgr update... 2021-03-10T19:59:46.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:45 gibba044 bash[9859]: cluster 2021-03-10T19:59:44.621374+0000 mgr.y (mgr.14140) 34 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:46.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:46 gibba044 bash[9859]: audit 2021-03-10T19:59:45.930205+0000 mgr.y (mgr.14140) 35 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;gibba023=y;gibba044=x", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T19:59:46.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:46 gibba044 bash[9859]: cephadm 2021-03-10T19:59:45.931673+0000 mgr.y (mgr.14140) 36 : cephadm [INF] Saving service mgr spec with placement count:3 gibba023=y,gibba044=x 2021-03-10T19:59:46.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:46 gibba044 bash[9859]: audit 2021-03-10T19:59:45.932705+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T19:59:45.931710\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba023\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba044\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T19:59:46.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:46 gibba044 bash[9859]: audit 2021-03-10T19:59:45.940349+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T19:59:45.931710\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba023\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba044\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T19:59:46.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:46 gibba044 bash[9859]: audit 2021-03-10T19:59:45.944311+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T19:59:46.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:46 gibba044 bash[9859]: audit 2021-03-10T19:59:45.952596+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T19:59:46.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:46 gibba044 bash[9859]: audit 2021-03-10T19:59:45.955273+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T19:59:46.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:46 gibba044 bash[9859]: cephadm 2021-03-10T19:59:45.957554+0000 mgr.y (mgr.14140) 37 : cephadm [INF] Deploying daemon mgr.x on gibba044 2021-03-10T19:59:46.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:46 gibba044 bash[9859]: audit 2021-03-10T19:59:45.958464+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T19:59:46.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:46 gibba023 bash[9844]: audit 2021-03-10T19:59:45.930205+0000 mgr.y (mgr.14140) 35 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;gibba023=y;gibba044=x", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T19:59:46.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:46 gibba023 bash[9844]: cephadm 2021-03-10T19:59:45.931673+0000 mgr.y (mgr.14140) 36 : cephadm [INF] Saving service mgr spec with placement count:3 gibba023=y,gibba044=x 2021-03-10T19:59:46.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:46 gibba023 bash[9844]: audit 2021-03-10T19:59:45.932705+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T19:59:45.931710\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba023\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba044\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T19:59:46.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:46 gibba023 bash[9844]: audit 2021-03-10T19:59:45.940349+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T19:59:45.931710\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba023\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba044\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T19:59:46.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:46 gibba023 bash[9844]: audit 2021-03-10T19:59:45.944311+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T19:59:46.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:46 gibba023 bash[9844]: audit 2021-03-10T19:59:45.952596+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T19:59:46.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:46 gibba023 bash[9844]: audit 2021-03-10T19:59:45.955273+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T19:59:46.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:46 gibba023 bash[9844]: cephadm 2021-03-10T19:59:45.957554+0000 mgr.y (mgr.14140) 37 : cephadm [INF] Deploying daemon mgr.x on gibba044 2021-03-10T19:59:46.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:46 gibba023 bash[9844]: audit 2021-03-10T19:59:45.958464+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T19:59:46.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:46 gibba023 bash[13032]: audit 2021-03-10T19:59:45.930205+0000 mgr.y (mgr.14140) 35 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;gibba023=y;gibba044=x", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T19:59:46.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:46 gibba023 bash[13032]: cephadm 2021-03-10T19:59:45.931673+0000 mgr.y (mgr.14140) 36 : cephadm [INF] Saving service mgr spec with placement count:3 gibba023=y,gibba044=x 2021-03-10T19:59:46.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:46 gibba023 bash[13032]: audit 2021-03-10T19:59:45.932705+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T19:59:45.931710\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba023\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba044\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T19:59:46.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:46 gibba023 bash[13032]: audit 2021-03-10T19:59:45.940349+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T19:59:45.931710\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [{\"hostname\": \"gibba023\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"gibba044\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T19:59:46.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:46 gibba023 bash[13032]: audit 2021-03-10T19:59:45.944311+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T19:59:46.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:46 gibba023 bash[13032]: audit 2021-03-10T19:59:45.952596+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T19:59:46.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:46 gibba023 bash[13032]: audit 2021-03-10T19:59:45.955273+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T19:59:46.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:46 gibba023 bash[13032]: cephadm 2021-03-10T19:59:45.957554+0000 mgr.y (mgr.14140) 37 : cephadm [INF] Deploying daemon mgr.x on gibba044 2021-03-10T19:59:46.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:46 gibba023 bash[13032]: audit 2021-03-10T19:59:45.958464+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T19:59:46.987 DEBUG:teuthology.orchestra.run.gibba044:mgr.x> sudo journalctl -f -n 0 -u ceph-dd719b26-81da-11eb-9080-001a4aab830c@mgr.x.service 2021-03-10T19:59:46.990 INFO:tasks.cephadm:Deploying OSDs... 2021-03-10T19:59:46.991 DEBUG:teuthology.orchestra.run.gibba023:> set -ex 2021-03-10T19:59:46.991 DEBUG:teuthology.orchestra.run.gibba023:> dd if=/scratch_devs of=/dev/stdout 2021-03-10T19:59:46.997 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-03-10T19:59:46.997 DEBUG:teuthology.orchestra.run.gibba023:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-03-10T19:59:47.001 INFO:teuthology.orchestra.run.gibba023.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-03-10T19:59:47.002 INFO:teuthology.orchestra.run.gibba023.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T19:59:47.002 INFO:teuthology.orchestra.run.gibba023.stdout:Device: 6h/6d Inode: 342 Links: 1 2021-03-10T19:59:47.002 INFO:teuthology.orchestra.run.gibba023.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T19:59:47.002 INFO:teuthology.orchestra.run.gibba023.stdout:Access: 2021-03-10 19:56:58.271958722 +0000 2021-03-10T19:59:47.003 INFO:teuthology.orchestra.run.gibba023.stdout:Modify: 2021-03-10 19:56:58.099958722 +0000 2021-03-10T19:59:47.003 INFO:teuthology.orchestra.run.gibba023.stdout:Change: 2021-03-10 19:56:58.099958722 +0000 2021-03-10T19:59:47.003 INFO:teuthology.orchestra.run.gibba023.stdout: Birth: - 2021-03-10T19:59:47.005 INFO:teuthology.orchestra.run.gibba023.stderr:1+0 records in 2021-03-10T19:59:47.005 INFO:teuthology.orchestra.run.gibba023.stderr:1+0 records out 2021-03-10T19:59:47.005 INFO:teuthology.orchestra.run.gibba023.stderr:512 bytes copied, 0.000221823 s, 2.3 MB/s 2021-03-10T19:59:47.008 DEBUG:teuthology.orchestra.run.gibba023:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-03-10T19:59:47.013 INFO:teuthology.orchestra.run.gibba023.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-03-10T19:59:47.013 INFO:teuthology.orchestra.run.gibba023.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T19:59:47.013 INFO:teuthology.orchestra.run.gibba023.stdout:Device: 6h/6d Inode: 347 Links: 1 2021-03-10T19:59:47.014 INFO:teuthology.orchestra.run.gibba023.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T19:59:47.014 INFO:teuthology.orchestra.run.gibba023.stdout:Access: 2021-03-10 19:56:58.579958721 +0000 2021-03-10T19:59:47.014 INFO:teuthology.orchestra.run.gibba023.stdout:Modify: 2021-03-10 19:56:58.447958721 +0000 2021-03-10T19:59:47.014 INFO:teuthology.orchestra.run.gibba023.stdout:Change: 2021-03-10 19:56:58.447958721 +0000 2021-03-10T19:59:47.015 INFO:teuthology.orchestra.run.gibba023.stdout: Birth: - 2021-03-10T19:59:47.017 INFO:teuthology.orchestra.run.gibba023.stderr:1+0 records in 2021-03-10T19:59:47.018 INFO:teuthology.orchestra.run.gibba023.stderr:1+0 records out 2021-03-10T19:59:47.018 INFO:teuthology.orchestra.run.gibba023.stderr:512 bytes copied, 0.000197437 s, 2.6 MB/s 2021-03-10T19:59:47.020 INFO:journalctl@ceph.mgr.x.gibba044.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T19:59:47.021 DEBUG:teuthology.orchestra.run.gibba023:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-03-10T19:59:47.072 INFO:teuthology.orchestra.run.gibba023.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-03-10T19:59:47.073 INFO:teuthology.orchestra.run.gibba023.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T19:59:47.073 INFO:teuthology.orchestra.run.gibba023.stdout:Device: 6h/6d Inode: 355 Links: 1 2021-03-10T19:59:47.073 INFO:teuthology.orchestra.run.gibba023.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T19:59:47.073 INFO:teuthology.orchestra.run.gibba023.stdout:Access: 2021-03-10 19:56:58.935958719 +0000 2021-03-10T19:59:47.074 INFO:teuthology.orchestra.run.gibba023.stdout:Modify: 2021-03-10 19:56:58.803958720 +0000 2021-03-10T19:59:47.074 INFO:teuthology.orchestra.run.gibba023.stdout:Change: 2021-03-10 19:56:58.803958720 +0000 2021-03-10T19:59:47.074 INFO:teuthology.orchestra.run.gibba023.stdout: Birth: - 2021-03-10T19:59:47.080 INFO:teuthology.orchestra.run.gibba023.stderr:1+0 records in 2021-03-10T19:59:47.080 INFO:teuthology.orchestra.run.gibba023.stderr:1+0 records out 2021-03-10T19:59:47.080 INFO:teuthology.orchestra.run.gibba023.stderr:512 bytes copied, 0.000247248 s, 2.1 MB/s 2021-03-10T19:59:47.081 DEBUG:teuthology.orchestra.run.gibba023:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-03-10T19:59:47.085 INFO:teuthology.orchestra.run.gibba023.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-03-10T19:59:47.085 INFO:teuthology.orchestra.run.gibba023.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T19:59:47.086 INFO:teuthology.orchestra.run.gibba023.stdout:Device: 6h/6d Inode: 360 Links: 1 2021-03-10T19:59:47.086 INFO:teuthology.orchestra.run.gibba023.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T19:59:47.086 INFO:teuthology.orchestra.run.gibba023.stdout:Access: 2021-03-10 19:56:59.255958718 +0000 2021-03-10T19:59:47.086 INFO:teuthology.orchestra.run.gibba023.stdout:Modify: 2021-03-10 19:56:59.151958719 +0000 2021-03-10T19:59:47.087 INFO:teuthology.orchestra.run.gibba023.stdout:Change: 2021-03-10 19:56:59.151958719 +0000 2021-03-10T19:59:47.087 INFO:teuthology.orchestra.run.gibba023.stdout: Birth: - 2021-03-10T19:59:47.090 INFO:teuthology.orchestra.run.gibba023.stderr:1+0 records in 2021-03-10T19:59:47.091 INFO:teuthology.orchestra.run.gibba023.stderr:1+0 records out 2021-03-10T19:59:47.091 INFO:teuthology.orchestra.run.gibba023.stderr:512 bytes copied, 0.000220093 s, 2.3 MB/s 2021-03-10T19:59:47.092 DEBUG:teuthology.orchestra.run.gibba044:> set -ex 2021-03-10T19:59:47.092 DEBUG:teuthology.orchestra.run.gibba044:> dd if=/scratch_devs of=/dev/stdout 2021-03-10T19:59:47.101 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-03-10T19:59:47.102 DEBUG:teuthology.orchestra.run.gibba044:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-03-10T19:59:47.145 INFO:teuthology.orchestra.run.gibba044.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-03-10T19:59:47.145 INFO:teuthology.orchestra.run.gibba044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T19:59:47.146 INFO:teuthology.orchestra.run.gibba044.stdout:Device: 6h/6d Inode: 340 Links: 1 2021-03-10T19:59:47.146 INFO:teuthology.orchestra.run.gibba044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T19:59:47.146 INFO:teuthology.orchestra.run.gibba044.stdout:Access: 2021-03-10 19:56:57.149392797 +0000 2021-03-10T19:59:47.146 INFO:teuthology.orchestra.run.gibba044.stdout:Modify: 2021-03-10 19:56:56.997392795 +0000 2021-03-10T19:59:47.147 INFO:teuthology.orchestra.run.gibba044.stdout:Change: 2021-03-10 19:56:56.997392795 +0000 2021-03-10T19:59:47.147 INFO:teuthology.orchestra.run.gibba044.stdout: Birth: - 2021-03-10T19:59:47.149 INFO:teuthology.orchestra.run.gibba044.stderr:1+0 records in 2021-03-10T19:59:47.150 INFO:teuthology.orchestra.run.gibba044.stderr:1+0 records out 2021-03-10T19:59:47.150 INFO:teuthology.orchestra.run.gibba044.stderr:512 bytes copied, 0.000223039 s, 2.3 MB/s 2021-03-10T19:59:47.152 DEBUG:teuthology.orchestra.run.gibba044:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-03-10T19:59:47.157 INFO:teuthology.orchestra.run.gibba044.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-03-10T19:59:47.157 INFO:teuthology.orchestra.run.gibba044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T19:59:47.157 INFO:teuthology.orchestra.run.gibba044.stdout:Device: 6h/6d Inode: 349 Links: 1 2021-03-10T19:59:47.158 INFO:teuthology.orchestra.run.gibba044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T19:59:47.158 INFO:teuthology.orchestra.run.gibba044.stdout:Access: 2021-03-10 19:56:57.553392803 +0000 2021-03-10T19:59:47.158 INFO:teuthology.orchestra.run.gibba044.stdout:Modify: 2021-03-10 19:56:57.381392801 +0000 2021-03-10T19:59:47.158 INFO:teuthology.orchestra.run.gibba044.stdout:Change: 2021-03-10 19:56:57.381392801 +0000 2021-03-10T19:59:47.158 INFO:teuthology.orchestra.run.gibba044.stdout: Birth: - 2021-03-10T19:59:47.163 INFO:teuthology.orchestra.run.gibba044.stderr:1+0 records in 2021-03-10T19:59:47.163 INFO:teuthology.orchestra.run.gibba044.stderr:1+0 records out 2021-03-10T19:59:47.163 INFO:teuthology.orchestra.run.gibba044.stderr:512 bytes copied, 0.000296977 s, 1.7 MB/s 2021-03-10T19:59:47.167 DEBUG:teuthology.orchestra.run.gibba044:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-03-10T19:59:47.173 INFO:teuthology.orchestra.run.gibba044.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-03-10T19:59:47.173 INFO:teuthology.orchestra.run.gibba044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T19:59:47.174 INFO:teuthology.orchestra.run.gibba044.stdout:Device: 6h/6d Inode: 355 Links: 1 2021-03-10T19:59:47.174 INFO:teuthology.orchestra.run.gibba044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T19:59:47.174 INFO:teuthology.orchestra.run.gibba044.stdout:Access: 2021-03-10 19:56:57.929392808 +0000 2021-03-10T19:59:47.174 INFO:teuthology.orchestra.run.gibba044.stdout:Modify: 2021-03-10 19:56:57.821392806 +0000 2021-03-10T19:59:47.175 INFO:teuthology.orchestra.run.gibba044.stdout:Change: 2021-03-10 19:56:57.821392806 +0000 2021-03-10T19:59:47.175 INFO:teuthology.orchestra.run.gibba044.stdout: Birth: - 2021-03-10T19:59:47.181 INFO:teuthology.orchestra.run.gibba044.stderr:1+0 records in 2021-03-10T19:59:47.181 INFO:teuthology.orchestra.run.gibba044.stderr:1+0 records out 2021-03-10T19:59:47.181 INFO:teuthology.orchestra.run.gibba044.stderr:512 bytes copied, 0.00016444 s, 3.1 MB/s 2021-03-10T19:59:47.183 DEBUG:teuthology.orchestra.run.gibba044:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-03-10T19:59:47.186 INFO:teuthology.orchestra.run.gibba044.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-03-10T19:59:47.186 INFO:teuthology.orchestra.run.gibba044.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-03-10T19:59:47.186 INFO:teuthology.orchestra.run.gibba044.stdout:Device: 6h/6d Inode: 362 Links: 1 2021-03-10T19:59:47.187 INFO:teuthology.orchestra.run.gibba044.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-03-10T19:59:47.187 INFO:teuthology.orchestra.run.gibba044.stdout:Access: 2021-03-10 19:56:58.357392814 +0000 2021-03-10T19:59:47.187 INFO:teuthology.orchestra.run.gibba044.stdout:Modify: 2021-03-10 19:56:58.193392811 +0000 2021-03-10T19:59:47.187 INFO:teuthology.orchestra.run.gibba044.stdout:Change: 2021-03-10 19:56:58.193392811 +0000 2021-03-10T19:59:47.187 INFO:teuthology.orchestra.run.gibba044.stdout: Birth: - 2021-03-10T19:59:47.189 INFO:teuthology.orchestra.run.gibba044.stderr:1+0 records in 2021-03-10T19:59:47.189 INFO:teuthology.orchestra.run.gibba044.stderr:1+0 records out 2021-03-10T19:59:47.190 INFO:teuthology.orchestra.run.gibba044.stderr:512 bytes copied, 0.000222598 s, 2.3 MB/s 2021-03-10T19:59:47.191 INFO:tasks.cephadm:Deploying osd.0 on gibba023 with /dev/vg_nvme/lv_4... 2021-03-10T19:59:47.192 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-03-10T19:59:48.133 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:47 gibba044 bash[9859]: cluster 2021-03-10T19:59:46.622251+0000 mgr.y (mgr.14140) 38 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:48.211 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:47 gibba023 bash[9844]: cluster 2021-03-10T19:59:46.622251+0000 mgr.y (mgr.14140) 38 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:48.211 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:47 gibba023 bash[13032]: cluster 2021-03-10T19:59:46.622251+0000 mgr.y (mgr.14140) 38 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:48.501 INFO:journalctl@ceph.mgr.x.gibba044.stdout:Mar 10 19:59:48 gibba044 docker[10464]: Error: No such container: ceph-dd719b26-81da-11eb-9080-001a4aab830c-mgr.x 2021-03-10T19:59:48.501 INFO:journalctl@ceph.mgr.x.gibba044.stdout:Mar 10 19:59:48 gibba044 systemd[1]: Started Ceph mgr.x for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T19:59:49.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:48 gibba044 bash[9859]: audit 2021-03-10T19:59:48.164070+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:31.717462\", \"created\": \"2021-03-10T19:59:31.557503\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}}, \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T19:59:49.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:48 gibba044 bash[9859]: audit 2021-03-10T19:59:48.172407+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:31.717462\", \"created\": \"2021-03-10T19:59:31.557503\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}}, \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T19:59:49.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:48 gibba044 bash[9859]: audit 2021-03-10T19:59:48.174195+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba044.wflcwh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T19:59:49.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:48 gibba044 bash[9859]: audit 2021-03-10T19:59:48.182553+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.gibba044.wflcwh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T19:59:49.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:48 gibba044 bash[9859]: audit 2021-03-10T19:59:48.185175+0000 mon.a (mon.0) 176 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T19:59:49.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:48 gibba044 bash[9859]: audit 2021-03-10T19:59:48.188713+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba044.wflcwh", "key": "container_image"}]: dispatch 2021-03-10T19:59:49.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:48 gibba023 bash[9844]: audit 2021-03-10T19:59:48.164070+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:31.717462\", \"created\": \"2021-03-10T19:59:31.557503\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}}, \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T19:59:49.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:48 gibba023 bash[13032]: audit 2021-03-10T19:59:48.164070+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:31.717462\", \"created\": \"2021-03-10T19:59:31.557503\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}}, \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T19:59:49.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:48 gibba023 bash[9844]: audit 2021-03-10T19:59:48.172407+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:31.717462\", \"created\": \"2021-03-10T19:59:31.557503\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}}, \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T19:59:49.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:48 gibba023 bash[9844]: audit 2021-03-10T19:59:48.174195+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba044.wflcwh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T19:59:49.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:48 gibba023 bash[9844]: audit 2021-03-10T19:59:48.182553+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.gibba044.wflcwh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T19:59:49.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:48 gibba023 bash[9844]: audit 2021-03-10T19:59:48.185175+0000 mon.a (mon.0) 176 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T19:59:49.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:48 gibba023 bash[9844]: audit 2021-03-10T19:59:48.188713+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba044.wflcwh", "key": "container_image"}]: dispatch 2021-03-10T19:59:49.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:48 gibba023 bash[13032]: audit 2021-03-10T19:59:48.172407+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:31.717462\", \"created\": \"2021-03-10T19:59:31.557503\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}}, \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T19:59:49.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:48 gibba023 bash[13032]: audit 2021-03-10T19:59:48.174195+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba044.wflcwh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T19:59:49.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:48 gibba023 bash[13032]: audit 2021-03-10T19:59:48.182553+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.gibba044.wflcwh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-03-10T19:59:49.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:48 gibba023 bash[13032]: audit 2021-03-10T19:59:48.185175+0000 mon.a (mon.0) 176 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T19:59:49.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:48 gibba023 bash[13032]: audit 2021-03-10T19:59:48.188713+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba044.wflcwh", "key": "container_image"}]: dispatch 2021-03-10T19:59:49.750 INFO:journalctl@ceph.mgr.x.gibba044.stdout:Mar 10 19:59:49 gibba044 bash[10483]: debug 2021-03-10T19:59:49.537+0000 7fe4c07c2040 1 -- 172.21.2.144:0/1575358004 >> [v2:172.21.2.144:3300/0,v1:172.21.2.144:6789/0] conn(0x56270c33cc00 msgr2=0x56270cfb2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-10T19:59:49.751 INFO:journalctl@ceph.mgr.x.gibba044.stdout:Mar 10 19:59:49 gibba044 bash[10483]: debug 2021-03-10T19:59:49.537+0000 7fe4c07c2040 1 --2- 172.21.2.144:0/1575358004 >> [v2:172.21.2.144:3300/0,v1:172.21.2.144:6789/0] conn(0x56270c33cc00 0x56270cfb2000 secure :-1 s=READY pgs=7 cs=0 l=1 rx=0x56270c32f140 tx=0x56270c3317c0).stop 2021-03-10T19:59:50.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:49 gibba023 bash[9844]: cephadm 2021-03-10T19:59:48.187413+0000 mgr.y (mgr.14140) 39 : cephadm [INF] Deploying daemon mgr.gibba044.wflcwh on gibba044 2021-03-10T19:59:50.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:49 gibba023 bash[9844]: cluster 2021-03-10T19:59:48.623007+0000 mgr.y (mgr.14140) 40 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:50.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:49 gibba023 bash[13032]: cephadm 2021-03-10T19:59:48.187413+0000 mgr.y (mgr.14140) 39 : cephadm [INF] Deploying daemon mgr.gibba044.wflcwh on gibba044 2021-03-10T19:59:50.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:49 gibba023 bash[13032]: cluster 2021-03-10T19:59:48.623007+0000 mgr.y (mgr.14140) 40 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:50.184 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:49 gibba044 bash[9859]: cephadm 2021-03-10T19:59:48.187413+0000 mgr.y (mgr.14140) 39 : cephadm [INF] Deploying daemon mgr.gibba044.wflcwh on gibba044 2021-03-10T19:59:50.184 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:49 gibba044 bash[9859]: cluster 2021-03-10T19:59:48.623007+0000 mgr.y (mgr.14140) 40 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:50.231 INFO:teuthology.orchestra.run.gibba023.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-03-10T19:59:50.231 INFO:teuthology.orchestra.run.gibba023.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-03-10T19:59:50.232 INFO:teuthology.orchestra.run.gibba023.stderr: stderr: 10+0 records in 2021-03-10T19:59:50.232 INFO:teuthology.orchestra.run.gibba023.stderr:10+0 records out 2021-03-10T19:59:50.232 INFO:teuthology.orchestra.run.gibba023.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00891942 s, 1.2 GB/s 2021-03-10T19:59:50.232 INFO:teuthology.orchestra.run.gibba023.stderr:--> Zapping successful for: 2021-03-10T19:59:50.863 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba023:vg_nvme/lv_4 2021-03-10T19:59:51.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:50 gibba023 bash[9844]: audit 2021-03-10T19:59:50.498592+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:31.717462\", \"created\": \"2021-03-10T19:59:31.557503\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}}, \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T19:59:51.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:51 gibba023 bash[13032]: audit 2021-03-10T19:59:50.498592+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:31.717462\", \"created\": \"2021-03-10T19:59:31.557503\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}}, \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T19:59:51.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:51 gibba023 bash[13032]: audit 2021-03-10T19:59:50.506459+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:31.717462\", \"created\": \"2021-03-10T19:59:31.557503\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}}, \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T19:59:51.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:51 gibba023 bash[13032]: audit 2021-03-10T19:59:50.508713+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T19:59:51.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:51 gibba023 bash[9844]: audit 2021-03-10T19:59:50.506459+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:31.717462\", \"created\": \"2021-03-10T19:59:31.557503\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}}, \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T19:59:51.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:51 gibba023 bash[9844]: audit 2021-03-10T19:59:50.508713+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T19:59:51.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:51 gibba023 bash[13032]: audit 2021-03-10T19:59:50.929503+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:50.928772\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:50.928831\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:50.928859\", \"created\": \"2021-03-10T19:59:50.485504\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}}, \"last_daemon_update\": \"2021-03-10T19:59:50.928906\", \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T19:59:51.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:51 gibba023 bash[9844]: audit 2021-03-10T19:59:50.929503+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:50.928772\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:50.928831\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:50.928859\", \"created\": \"2021-03-10T19:59:50.485504\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}}, \"last_daemon_update\": \"2021-03-10T19:59:50.928906\", \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T19:59:51.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:51 gibba023 bash[13032]: audit 2021-03-10T19:59:50.932542+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:50.928772\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:50.928831\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:50.928859\", \"created\": \"2021-03-10T19:59:50.485504\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}}, \"last_daemon_update\": \"2021-03-10T19:59:50.928906\", \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T19:59:51.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:51 gibba023 bash[13032]: audit 2021-03-10T19:59:50.933627+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-03-10T19:59:51.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:51 gibba023 bash[13032]: audit 2021-03-10T19:59:50.934296+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T19:59:51.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:51 gibba023 bash[13032]: audit 2021-03-10T19:59:50.934993+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-03-10T19:59:51.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:51 gibba023 bash[9844]: audit 2021-03-10T19:59:50.932542+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:50.928772\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:50.928831\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:50.928859\", \"created\": \"2021-03-10T19:59:50.485504\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}}, \"last_daemon_update\": \"2021-03-10T19:59:50.928906\", \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T19:59:51.183 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:51 gibba023 bash[9844]: audit 2021-03-10T19:59:50.933627+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-03-10T19:59:51.183 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:51 gibba023 bash[9844]: audit 2021-03-10T19:59:50.934296+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T19:59:51.183 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:51 gibba023 bash[9844]: audit 2021-03-10T19:59:50.934993+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-03-10T19:59:51.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:50 gibba044 bash[9859]: audit 2021-03-10T19:59:50.498592+0000 mon.a (mon.0) 178 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:31.717462\", \"created\": \"2021-03-10T19:59:31.557503\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}}, \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T19:59:51.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:50 gibba044 bash[9859]: audit 2021-03-10T19:59:50.506459+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:31.717462\", \"created\": \"2021-03-10T19:59:31.557503\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}}, \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T19:59:51.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:50 gibba044 bash[9859]: audit 2021-03-10T19:59:50.508713+0000 mon.a (mon.0) 180 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T19:59:51.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:50 gibba044 bash[9859]: audit 2021-03-10T19:59:50.929503+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:50.928772\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:50.928831\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:50.928859\", \"created\": \"2021-03-10T19:59:50.485504\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}}, \"last_daemon_update\": \"2021-03-10T19:59:50.928906\", \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T19:59:51.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:50 gibba044 bash[9859]: audit 2021-03-10T19:59:50.932542+0000 mon.a (mon.0) 182 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:50.928772\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:50.928831\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:50.928859\", \"created\": \"2021-03-10T19:59:50.485504\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}}, \"last_daemon_update\": \"2021-03-10T19:59:50.928906\", \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T19:59:51.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:50 gibba044 bash[9859]: audit 2021-03-10T19:59:50.933627+0000 mon.a (mon.0) 183 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-03-10T19:59:51.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:50 gibba044 bash[9859]: audit 2021-03-10T19:59:50.934296+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T19:59:51.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:50 gibba044 bash[9859]: audit 2021-03-10T19:59:50.934993+0000 mon.a (mon.0) 185 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-03-10T19:59:52.234 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:51 gibba023 bash[9844]: cluster 2021-03-10T19:59:50.623605+0000 mgr.y (mgr.14140) 41 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:52.235 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:51 gibba023 bash[9844]: cephadm 2021-03-10T19:59:50.933404+0000 mgr.y (mgr.14140) 42 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2021-03-10T19:59:52.235 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:51 gibba023 bash[9844]: cephadm 2021-03-10T19:59:50.934802+0000 mgr.y (mgr.14140) 43 : cephadm [INF] Reconfiguring daemon mgr.y on gibba023 2021-03-10T19:59:52.235 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:51 gibba023 bash[13032]: cluster 2021-03-10T19:59:50.623605+0000 mgr.y (mgr.14140) 41 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:52.236 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:51 gibba023 bash[13032]: cephadm 2021-03-10T19:59:50.933404+0000 mgr.y (mgr.14140) 42 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2021-03-10T19:59:52.236 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:51 gibba023 bash[13032]: cephadm 2021-03-10T19:59:50.934802+0000 mgr.y (mgr.14140) 43 : cephadm [INF] Reconfiguring daemon mgr.y on gibba023 2021-03-10T19:59:52.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:51 gibba044 bash[9859]: cluster 2021-03-10T19:59:50.623605+0000 mgr.y (mgr.14140) 41 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:52.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:51 gibba044 bash[9859]: cephadm 2021-03-10T19:59:50.933404+0000 mgr.y (mgr.14140) 42 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2021-03-10T19:59:52.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:51 gibba044 bash[9859]: cephadm 2021-03-10T19:59:50.934802+0000 mgr.y (mgr.14140) 43 : cephadm [INF] Reconfiguring daemon mgr.y on gibba023 2021-03-10T19:59:53.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:52 gibba044 bash[9859]: cluster 2021-03-10T19:59:52.376081+0000 mon.a (mon.0) 186 : cluster [DBG] Standby manager daemon x started 2021-03-10T19:59:53.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:52 gibba044 bash[9859]: audit 2021-03-10T19:59:52.378184+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.2.144:0/3594315970' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T19:59:53.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:52 gibba044 bash[9859]: audit 2021-03-10T19:59:52.379168+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.2.144:0/3594315970' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T19:59:53.254 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:52 gibba023 bash[9844]: cluster 2021-03-10T19:59:52.376081+0000 mon.a (mon.0) 186 : cluster [DBG] Standby manager daemon x started 2021-03-10T19:59:53.254 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:52 gibba023 bash[9844]: audit 2021-03-10T19:59:52.378184+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.2.144:0/3594315970' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T19:59:53.255 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:52 gibba023 bash[9844]: audit 2021-03-10T19:59:52.379168+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.2.144:0/3594315970' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T19:59:53.255 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:52 gibba023 bash[13032]: cluster 2021-03-10T19:59:52.376081+0000 mon.a (mon.0) 186 : cluster [DBG] Standby manager daemon x started 2021-03-10T19:59:53.255 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:52 gibba023 bash[13032]: audit 2021-03-10T19:59:52.378184+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.2.144:0/3594315970' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T19:59:53.255 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:52 gibba023 bash[13032]: audit 2021-03-10T19:59:52.379168+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.2.144:0/3594315970' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T19:59:54.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:53 gibba044 bash[9859]: cluster 2021-03-10T19:59:52.624166+0000 mgr.y (mgr.14140) 44 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:54.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:53 gibba044 bash[9859]: cluster 2021-03-10T19:59:52.991536+0000 mon.a (mon.0) 187 : cluster [DBG] mgrmap e14: y(active, since 77s), standbys: x 2021-03-10T19:59:54.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:53 gibba044 bash[9859]: audit 2021-03-10T19:59:52.991660+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T19:59:54.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:53 gibba044 bash[9859]: audit 2021-03-10T19:59:53.215049+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:18.708708\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:18.708803\", \"created\": \"2021-03-10T19:59:18.289146\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}}, \"last_device_update\": \"2021-03-10T19:58:43.250094\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T19:59:54.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:53 gibba044 bash[9859]: audit 2021-03-10T19:59:53.217718+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:18.708708\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:18.708803\", \"created\": \"2021-03-10T19:59:18.289146\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}}, \"last_device_update\": \"2021-03-10T19:58:43.250094\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T19:59:54.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:53 gibba044 bash[9859]: audit 2021-03-10T19:59:53.218184+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T19:59:54.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:53 gibba044 bash[9859]: audit 2021-03-10T19:59:53.732894+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732286\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732347\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732377\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}}, \"last_daemon_update\": \"2021-03-10T19:59:53.732436\", \"last_device_update\": \"2021-03-10T19:58:43.250094\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T19:59:54.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:53 gibba044 bash[9859]: audit 2021-03-10T19:59:53.735342+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732286\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732347\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732377\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}}, \"last_daemon_update\": \"2021-03-10T19:59:53.732436\", \"last_device_update\": \"2021-03-10T19:58:43.250094\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T19:59:54.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:53 gibba044 bash[9859]: audit 2021-03-10T19:59:53.735796+0000 mon.a (mon.0) 194 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T19:59:54.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:53 gibba023 bash[9844]: cluster 2021-03-10T19:59:52.624166+0000 mgr.y (mgr.14140) 44 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:54.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:53 gibba023 bash[9844]: cluster 2021-03-10T19:59:52.991536+0000 mon.a (mon.0) 187 : cluster [DBG] mgrmap e14: y(active, since 77s), standbys: x 2021-03-10T19:59:54.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:53 gibba023 bash[9844]: audit 2021-03-10T19:59:52.991660+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T19:59:54.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:53 gibba023 bash[9844]: audit 2021-03-10T19:59:53.215049+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:18.708708\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:18.708803\", \"created\": \"2021-03-10T19:59:18.289146\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}}, \"last_device_update\": \"2021-03-10T19:58:43.250094\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T19:59:54.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:53 gibba023 bash[13032]: cluster 2021-03-10T19:59:52.624166+0000 mgr.y (mgr.14140) 44 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:54.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:53 gibba023 bash[13032]: cluster 2021-03-10T19:59:52.991536+0000 mon.a (mon.0) 187 : cluster [DBG] mgrmap e14: y(active, since 77s), standbys: x 2021-03-10T19:59:54.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:53 gibba023 bash[13032]: audit 2021-03-10T19:59:52.991660+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T19:59:54.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:53 gibba023 bash[13032]: audit 2021-03-10T19:59:53.215049+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:18.708708\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:18.708803\", \"created\": \"2021-03-10T19:59:18.289146\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}}, \"last_device_update\": \"2021-03-10T19:58:43.250094\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T19:59:54.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:53 gibba023 bash[9844]: audit 2021-03-10T19:59:53.217718+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:18.708708\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:18.708803\", \"created\": \"2021-03-10T19:59:18.289146\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}}, \"last_device_update\": \"2021-03-10T19:58:43.250094\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T19:59:54.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:53 gibba023 bash[9844]: audit 2021-03-10T19:59:53.218184+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T19:59:54.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:53 gibba023 bash[13032]: audit 2021-03-10T19:59:53.217718+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:18.708708\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:18.708803\", \"created\": \"2021-03-10T19:59:18.289146\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}}, \"last_device_update\": \"2021-03-10T19:58:43.250094\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T19:59:54.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:53 gibba023 bash[13032]: audit 2021-03-10T19:59:53.218184+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T19:59:54.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:53 gibba023 bash[9844]: audit 2021-03-10T19:59:53.732894+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732286\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732347\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732377\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}}, \"last_daemon_update\": \"2021-03-10T19:59:53.732436\", \"last_device_update\": \"2021-03-10T19:58:43.250094\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T19:59:54.432 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:53 gibba023 bash[9844]: audit 2021-03-10T19:59:53.735342+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732286\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732347\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732377\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}}, \"last_daemon_update\": \"2021-03-10T19:59:53.732436\", \"last_device_update\": \"2021-03-10T19:58:43.250094\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T19:59:54.432 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:53 gibba023 bash[9844]: audit 2021-03-10T19:59:53.735796+0000 mon.a (mon.0) 194 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T19:59:54.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:53 gibba023 bash[13032]: audit 2021-03-10T19:59:53.732894+0000 mon.a (mon.0) 192 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732286\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732347\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732377\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}}, \"last_daemon_update\": \"2021-03-10T19:59:53.732436\", \"last_device_update\": \"2021-03-10T19:58:43.250094\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T19:59:54.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:53 gibba023 bash[13032]: audit 2021-03-10T19:59:53.735342+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732286\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732347\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732377\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}}, \"last_daemon_update\": \"2021-03-10T19:59:53.732436\", \"last_device_update\": \"2021-03-10T19:58:43.250094\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T19:59:54.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:53 gibba023 bash[13032]: audit 2021-03-10T19:59:53.735796+0000 mon.a (mon.0) 194 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T19:59:55.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:54 gibba044 bash[9859]: audit 2021-03-10T19:59:54.075981+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073317\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073577\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073746\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}}, \"last_daemon_update\": \"2021-03-10T19:59:54.074061\", \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T19:59:55.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:55 gibba044 bash[9859]: audit 2021-03-10T19:59:54.084424+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073317\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073577\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073746\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}}, \"last_daemon_update\": \"2021-03-10T19:59:54.074061\", \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T19:59:55.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:55 gibba044 bash[9859]: cluster 2021-03-10T19:59:54.179091+0000 mon.a (mon.0) 197 : cluster [DBG] Standby manager daemon gibba044.wflcwh started 2021-03-10T19:59:55.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:55 gibba044 bash[9859]: audit 2021-03-10T19:59:54.180975+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.2.144:0/3711068846' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T19:59:55.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:55 gibba044 bash[9859]: audit 2021-03-10T19:59:54.181840+0000 mon.b (mon.2) 6 : audit [DBG] from='mgr.? 172.21.2.144:0/3711068846' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T19:59:55.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:55 gibba044 bash[9859]: audit 2021-03-10T19:59:54.394512+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T19:59:55.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:55 gibba044 bash[9859]: audit 2021-03-10T19:59:54.395409+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T19:59:55.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:55 gibba044 bash[9859]: audit 2021-03-10T19:59:54.396361+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T19:59:55.276 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:54 gibba023 bash[9844]: audit 2021-03-10T19:59:54.075981+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073317\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073577\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073746\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}}, \"last_daemon_update\": \"2021-03-10T19:59:54.074061\", \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T19:59:55.277 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:54 gibba023 bash[13032]: audit 2021-03-10T19:59:54.075981+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073317\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073577\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073746\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}}, \"last_daemon_update\": \"2021-03-10T19:59:54.074061\", \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T19:59:55.278 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:54 gibba023 bash[9844]: audit 2021-03-10T19:59:54.084424+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073317\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073577\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073746\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}}, \"last_daemon_update\": \"2021-03-10T19:59:54.074061\", \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T19:59:55.278 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:54 gibba023 bash[9844]: cluster 2021-03-10T19:59:54.179091+0000 mon.a (mon.0) 197 : cluster [DBG] Standby manager daemon gibba044.wflcwh started 2021-03-10T19:59:55.278 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:54 gibba023 bash[9844]: audit 2021-03-10T19:59:54.180975+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.2.144:0/3711068846' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T19:59:55.278 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:54 gibba023 bash[9844]: audit 2021-03-10T19:59:54.181840+0000 mon.b (mon.2) 6 : audit [DBG] from='mgr.? 172.21.2.144:0/3711068846' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T19:59:55.279 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:54 gibba023 bash[9844]: audit 2021-03-10T19:59:54.394512+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T19:59:55.279 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:54 gibba023 bash[9844]: audit 2021-03-10T19:59:54.395409+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T19:59:55.279 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:54 gibba023 bash[9844]: audit 2021-03-10T19:59:54.396361+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T19:59:55.279 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:54 gibba023 bash[13032]: audit 2021-03-10T19:59:54.084424+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073317\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073577\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073746\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}}, \"last_daemon_update\": \"2021-03-10T19:59:54.074061\", \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T19:59:55.280 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:54 gibba023 bash[13032]: cluster 2021-03-10T19:59:54.179091+0000 mon.a (mon.0) 197 : cluster [DBG] Standby manager daemon gibba044.wflcwh started 2021-03-10T19:59:55.280 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:54 gibba023 bash[13032]: audit 2021-03-10T19:59:54.180975+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.2.144:0/3711068846' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T19:59:55.280 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:54 gibba023 bash[13032]: audit 2021-03-10T19:59:54.181840+0000 mon.b (mon.2) 6 : audit [DBG] from='mgr.? 172.21.2.144:0/3711068846' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T19:59:55.280 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:54 gibba023 bash[13032]: audit 2021-03-10T19:59:54.394512+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T19:59:55.281 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:54 gibba023 bash[13032]: audit 2021-03-10T19:59:54.395409+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T19:59:55.281 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:54 gibba023 bash[13032]: audit 2021-03-10T19:59:54.396361+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T19:59:56.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:55 gibba023 bash[9844]: audit 2021-03-10T19:59:54.393714+0000 mgr.y (mgr.14140) 45 : audit [DBG] from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba023:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T19:59:56.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:55 gibba023 bash[9844]: cephadm 2021-03-10T19:59:54.394317+0000 mgr.y (mgr.14140) 46 : cephadm [INF] Applying osd on host gibba023... 2021-03-10T19:59:56.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:56 gibba023 bash[9844]: cluster 2021-03-10T19:59:54.624726+0000 mgr.y (mgr.14140) 47 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:56.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:56 gibba023 bash[9844]: cluster 2021-03-10T19:59:55.093705+0000 mon.a (mon.0) 201 : cluster [DBG] mgrmap e15: y(active, since 79s), standbys: x, gibba044.wflcwh 2021-03-10T19:59:56.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:56 gibba023 bash[9844]: audit 2021-03-10T19:59:55.093783+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "gibba044.wflcwh", "id": "gibba044.wflcwh"}]: dispatch 2021-03-10T19:59:56.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:56 gibba023 bash[9844]: cluster 2021-03-10T19:59:55.208330+0000 mgr.gibba044.wflcwh (mgr.34115) 1 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba044.wflcwh: Timeout('Port 8443 not free on ::.',) 2021-03-10T19:59:56.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:56 gibba023 bash[13032]: audit 2021-03-10T19:59:54.393714+0000 mgr.y (mgr.14140) 45 : audit [DBG] from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba023:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T19:59:56.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:56 gibba023 bash[13032]: cephadm 2021-03-10T19:59:54.394317+0000 mgr.y (mgr.14140) 46 : cephadm [INF] Applying osd on host gibba023... 2021-03-10T19:59:56.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:56 gibba023 bash[13032]: cluster 2021-03-10T19:59:54.624726+0000 mgr.y (mgr.14140) 47 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:56.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:56 gibba023 bash[13032]: cluster 2021-03-10T19:59:55.093705+0000 mon.a (mon.0) 201 : cluster [DBG] mgrmap e15: y(active, since 79s), standbys: x, gibba044.wflcwh 2021-03-10T19:59:56.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:56 gibba023 bash[13032]: audit 2021-03-10T19:59:55.093783+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "gibba044.wflcwh", "id": "gibba044.wflcwh"}]: dispatch 2021-03-10T19:59:56.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:56 gibba023 bash[13032]: cluster 2021-03-10T19:59:55.208330+0000 mgr.gibba044.wflcwh (mgr.34115) 1 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba044.wflcwh: Timeout('Port 8443 not free on ::.',) 2021-03-10T19:59:56.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:56 gibba044 bash[9859]: audit 2021-03-10T19:59:54.393714+0000 mgr.y (mgr.14140) 45 : audit [DBG] from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba023:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T19:59:56.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:56 gibba044 bash[9859]: cephadm 2021-03-10T19:59:54.394317+0000 mgr.y (mgr.14140) 46 : cephadm [INF] Applying osd on host gibba023... 2021-03-10T19:59:56.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:56 gibba044 bash[9859]: cluster 2021-03-10T19:59:54.624726+0000 mgr.y (mgr.14140) 47 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:56.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:56 gibba044 bash[9859]: cluster 2021-03-10T19:59:55.093705+0000 mon.a (mon.0) 201 : cluster [DBG] mgrmap e15: y(active, since 79s), standbys: x, gibba044.wflcwh 2021-03-10T19:59:56.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:56 gibba044 bash[9859]: audit 2021-03-10T19:59:55.093783+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "gibba044.wflcwh", "id": "gibba044.wflcwh"}]: dispatch 2021-03-10T19:59:56.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:56 gibba044 bash[9859]: cluster 2021-03-10T19:59:55.208330+0000 mgr.gibba044.wflcwh (mgr.34115) 1 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba044.wflcwh: Timeout('Port 8443 not free on ::.',) 2021-03-10T19:59:58.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:58 gibba023 bash[9844]: cluster 2021-03-10T19:59:56.625564+0000 mgr.y (mgr.14140) 48 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:58.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:58 gibba023 bash[9844]: audit 2021-03-10T19:59:57.543960+0000 mon.c (mon.1) 4 : audit [INF] from='client.? 172.21.2.123:0/516788651' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "44017fc6-e3eb-486e-b88f-073ab24f2838"}]: dispatch 2021-03-10T19:59:58.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:58 gibba023 bash[9844]: audit 2021-03-10T19:59:57.544403+0000 mon.a (mon.0) 203 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "44017fc6-e3eb-486e-b88f-073ab24f2838"}]: dispatch 2021-03-10T19:59:58.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:58 gibba023 bash[9844]: audit 2021-03-10T19:59:57.550022+0000 mon.a (mon.0) 204 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "44017fc6-e3eb-486e-b88f-073ab24f2838"}]': finished 2021-03-10T19:59:58.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:58 gibba023 bash[9844]: cluster 2021-03-10T19:59:57.550052+0000 mon.a (mon.0) 205 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-03-10T19:59:58.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 19:59:58 gibba023 bash[9844]: audit 2021-03-10T19:59:57.550187+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T19:59:58.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:58 gibba023 bash[13032]: cluster 2021-03-10T19:59:56.625564+0000 mgr.y (mgr.14140) 48 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:58.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:58 gibba023 bash[13032]: audit 2021-03-10T19:59:57.543960+0000 mon.c (mon.1) 4 : audit [INF] from='client.? 172.21.2.123:0/516788651' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "44017fc6-e3eb-486e-b88f-073ab24f2838"}]: dispatch 2021-03-10T19:59:58.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:58 gibba023 bash[13032]: audit 2021-03-10T19:59:57.544403+0000 mon.a (mon.0) 203 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "44017fc6-e3eb-486e-b88f-073ab24f2838"}]: dispatch 2021-03-10T19:59:58.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:58 gibba023 bash[13032]: audit 2021-03-10T19:59:57.550022+0000 mon.a (mon.0) 204 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "44017fc6-e3eb-486e-b88f-073ab24f2838"}]': finished 2021-03-10T19:59:58.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:58 gibba023 bash[13032]: cluster 2021-03-10T19:59:57.550052+0000 mon.a (mon.0) 205 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-03-10T19:59:58.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 19:59:58 gibba023 bash[13032]: audit 2021-03-10T19:59:57.550187+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T19:59:58.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:58 gibba044 bash[9859]: cluster 2021-03-10T19:59:56.625564+0000 mgr.y (mgr.14140) 48 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T19:59:58.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:58 gibba044 bash[9859]: audit 2021-03-10T19:59:57.543960+0000 mon.c (mon.1) 4 : audit [INF] from='client.? 172.21.2.123:0/516788651' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "44017fc6-e3eb-486e-b88f-073ab24f2838"}]: dispatch 2021-03-10T19:59:58.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:58 gibba044 bash[9859]: audit 2021-03-10T19:59:57.544403+0000 mon.a (mon.0) 203 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "44017fc6-e3eb-486e-b88f-073ab24f2838"}]: dispatch 2021-03-10T19:59:58.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:58 gibba044 bash[9859]: audit 2021-03-10T19:59:57.550022+0000 mon.a (mon.0) 204 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "44017fc6-e3eb-486e-b88f-073ab24f2838"}]': finished 2021-03-10T19:59:58.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:58 gibba044 bash[9859]: cluster 2021-03-10T19:59:57.550052+0000 mon.a (mon.0) 205 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-03-10T19:59:58.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 19:59:58 gibba044 bash[9859]: audit 2021-03-10T19:59:57.550187+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:00:00.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:00 gibba023 bash[9844]: cluster 2021-03-10T19:59:58.626236+0000 mgr.y (mgr.14140) 49 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:00.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:00 gibba023 bash[9844]: audit 2021-03-10T19:59:59.572126+0000 mon.a (mon.0) 207 : audit [DBG] from='client.? 172.21.2.123:0/2945694581' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:00:00.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:00 gibba023 bash[9844]: cluster 2021-03-10T20:00:00.000300+0000 mon.a (mon.0) 208 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2021-03-10T20:00:00.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:00 gibba023 bash[13032]: cluster 2021-03-10T19:59:58.626236+0000 mgr.y (mgr.14140) 49 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:00.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:00 gibba023 bash[13032]: audit 2021-03-10T19:59:59.572126+0000 mon.a (mon.0) 207 : audit [DBG] from='client.? 172.21.2.123:0/2945694581' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:00:00.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:00 gibba023 bash[13032]: cluster 2021-03-10T20:00:00.000300+0000 mon.a (mon.0) 208 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2021-03-10T20:00:00.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:00 gibba044 bash[9859]: cluster 2021-03-10T19:59:58.626236+0000 mgr.y (mgr.14140) 49 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:00.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:00 gibba044 bash[9859]: audit 2021-03-10T19:59:59.572126+0000 mon.a (mon.0) 207 : audit [DBG] from='client.? 172.21.2.123:0/2945694581' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:00:00.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:00 gibba044 bash[9859]: cluster 2021-03-10T20:00:00.000300+0000 mon.a (mon.0) 208 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2021-03-10T20:00:02.295 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:02 gibba023 bash[9844]: cluster 2021-03-10T20:00:00.627157+0000 mgr.y (mgr.14140) 50 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:02.296 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:02 gibba023 bash[13032]: cluster 2021-03-10T20:00:00.627157+0000 mgr.y (mgr.14140) 50 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:02.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:02 gibba044 bash[9859]: cluster 2021-03-10T20:00:00.627157+0000 mgr.y (mgr.14140) 50 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:03.367 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:03 gibba023 bash[9844]: audit 2021-03-10T20:00:02.183670+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:00:03.368 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:03 gibba023 bash[13032]: audit 2021-03-10T20:00:02.183670+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:00:03.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:03 gibba044 bash[9859]: audit 2021-03-10T20:00:02.183670+0000 mon.a (mon.0) 209 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:00:04.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:04 gibba023 bash[9844]: cluster 2021-03-10T20:00:02.627820+0000 mgr.y (mgr.14140) 51 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:04.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:04 gibba023 bash[13032]: cluster 2021-03-10T20:00:02.627820+0000 mgr.y (mgr.14140) 51 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:04.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:04 gibba044 bash[9859]: cluster 2021-03-10T20:00:02.627820+0000 mgr.y (mgr.14140) 51 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:05.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:05 gibba023 bash[9844]: cluster 2021-03-10T20:00:04.628137+0000 mgr.y (mgr.14140) 52 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:05.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:05 gibba023 bash[9844]: audit 2021-03-10T20:00:05.609976+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-03-10T20:00:05.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:05 gibba023 bash[9844]: audit 2021-03-10T20:00:05.610827+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:00:05.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:05 gibba023 bash[9844]: audit 2021-03-10T20:00:05.611713+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-03-10T20:00:05.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:05 gibba023 bash[13032]: cluster 2021-03-10T20:00:04.628137+0000 mgr.y (mgr.14140) 52 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:05.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:05 gibba023 bash[13032]: audit 2021-03-10T20:00:05.609976+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-03-10T20:00:05.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:05 gibba023 bash[13032]: audit 2021-03-10T20:00:05.610827+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:00:05.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:05 gibba023 bash[13032]: audit 2021-03-10T20:00:05.611713+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-03-10T20:00:06.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:05 gibba044 bash[9859]: cluster 2021-03-10T20:00:04.628137+0000 mgr.y (mgr.14140) 52 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:06.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:05 gibba044 bash[9859]: audit 2021-03-10T20:00:05.609976+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-03-10T20:00:06.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:05 gibba044 bash[9859]: audit 2021-03-10T20:00:05.610827+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:00:06.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:05 gibba044 bash[9859]: audit 2021-03-10T20:00:05.611713+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-03-10T20:00:06.817 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:06 gibba023 bash[9844]: cephadm 2021-03-10T20:00:05.611503+0000 mgr.y (mgr.14140) 53 : cephadm [INF] Deploying daemon osd.0 on gibba023 2021-03-10T20:00:06.817 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:06 gibba023 bash[13032]: cephadm 2021-03-10T20:00:05.611503+0000 mgr.y (mgr.14140) 53 : cephadm [INF] Deploying daemon osd.0 on gibba023 2021-03-10T20:00:07.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:06 gibba044 bash[9859]: cephadm 2021-03-10T20:00:05.611503+0000 mgr.y (mgr.14140) 53 : cephadm [INF] Deploying daemon osd.0 on gibba023 2021-03-10T20:00:07.583 INFO:teuthology.orchestra.run.gibba023.stdout:Created osd(s) 0 on host 'gibba023' 2021-03-10T20:00:07.828 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:07 gibba023 bash[13032]: cluster 2021-03-10T20:00:06.628702+0000 mgr.y (mgr.14140) 54 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:07.828 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:07 gibba023 bash[9844]: cluster 2021-03-10T20:00:06.628702+0000 mgr.y (mgr.14140) 54 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:07.829 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:07 gibba023 bash[9844]: audit 2021-03-10T20:00:07.576611+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732286\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732347\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732377\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}}, \"last_device_update\": \"2021-03-10T19:58:43.250094\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:00:07.829 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:07 gibba023 bash[9844]: audit 2021-03-10T20:00:07.577153+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:00:07.829 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:07 gibba023 bash[9844]: audit 2021-03-10T20:00:07.580529+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732286\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732347\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732377\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}}, \"last_device_update\": \"2021-03-10T19:58:43.250094\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:00:07.830 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:07 gibba023 bash[13032]: audit 2021-03-10T20:00:07.576611+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732286\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732347\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732377\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}}, \"last_device_update\": \"2021-03-10T19:58:43.250094\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:00:07.830 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:07 gibba023 bash[13032]: audit 2021-03-10T20:00:07.577153+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:00:07.830 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:07 gibba023 bash[13032]: audit 2021-03-10T20:00:07.580529+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732286\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732347\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732377\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}}, \"last_device_update\": \"2021-03-10T19:58:43.250094\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:00:08.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:07 gibba044 bash[9859]: cluster 2021-03-10T20:00:06.628702+0000 mgr.y (mgr.14140) 54 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:08.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:07 gibba044 bash[9859]: audit 2021-03-10T20:00:07.576611+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732286\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732347\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732377\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}}, \"last_device_update\": \"2021-03-10T19:58:43.250094\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:00:08.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:07 gibba044 bash[9859]: audit 2021-03-10T20:00:07.577153+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:00:08.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:07 gibba044 bash[9859]: audit 2021-03-10T20:00:07.580529+0000 mon.a (mon.0) 215 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732286\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732347\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:53.732377\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}}, \"last_device_update\": \"2021-03-10T19:58:43.250094\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:00:08.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:08 gibba023 bash[9844]: audit 2021-03-10T20:00:08.072763+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072087\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072145\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072174\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072201\", \"created\": \"2021-03-10T20:00:07.565145\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}}, \"last_daemon_update\": \"2021-03-10T20:00:08.072247\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:00:08.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:08 gibba023 bash[13032]: audit 2021-03-10T20:00:08.072763+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072087\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072145\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072174\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072201\", \"created\": \"2021-03-10T20:00:07.565145\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}}, \"last_daemon_update\": \"2021-03-10T20:00:08.072247\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:00:08.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:08 gibba023 bash[13032]: audit 2021-03-10T20:00:08.077057+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072087\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072145\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072174\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072201\", \"created\": \"2021-03-10T20:00:07.565145\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}}, \"last_daemon_update\": \"2021-03-10T20:00:08.072247\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:00:08.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:08 gibba023 bash[13032]: audit 2021-03-10T20:00:08.077650+0000 mon.a (mon.0) 218 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:00:08.932 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:08 gibba023 bash[9844]: audit 2021-03-10T20:00:08.077057+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072087\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072145\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072174\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072201\", \"created\": \"2021-03-10T20:00:07.565145\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}}, \"last_daemon_update\": \"2021-03-10T20:00:08.072247\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:00:08.932 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:08 gibba023 bash[9844]: audit 2021-03-10T20:00:08.077650+0000 mon.a (mon.0) 218 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:00:09.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:08 gibba044 bash[9859]: audit 2021-03-10T20:00:08.072763+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072087\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072145\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072174\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072201\", \"created\": \"2021-03-10T20:00:07.565145\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}}, \"last_daemon_update\": \"2021-03-10T20:00:08.072247\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:00:09.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:08 gibba044 bash[9859]: audit 2021-03-10T20:00:08.077057+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072087\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072145\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072174\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072201\", \"created\": \"2021-03-10T20:00:07.565145\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}}, \"last_daemon_update\": \"2021-03-10T20:00:08.072247\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:00:09.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:08 gibba044 bash[9859]: audit 2021-03-10T20:00:08.077650+0000 mon.a (mon.0) 218 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:00:09.012 DEBUG:teuthology.orchestra.run.gibba023:osd.0> sudo journalctl -f -n 0 -u ceph-dd719b26-81da-11eb-9080-001a4aab830c@osd.0.service 2021-03-10T20:00:09.015 INFO:tasks.cephadm:Deploying osd.1 on gibba023 with /dev/vg_nvme/lv_3... 2021-03-10T20:00:09.015 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-03-10T20:00:09.059 INFO:journalctl@ceph.osd.0.gibba023.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:00:09.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:09 gibba023 bash[9844]: cluster 2021-03-10T20:00:08.629340+0000 mgr.y (mgr.14140) 55 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:09.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:09 gibba023 bash[13032]: cluster 2021-03-10T20:00:08.629340+0000 mgr.y (mgr.14140) 55 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:10.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:09 gibba044 bash[9859]: cluster 2021-03-10T20:00:08.629340+0000 mgr.y (mgr.14140) 55 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:10.927 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:00:10 gibba023 bash[14629]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-03-10T20:00:10.928 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:00:10 gibba023 bash[14629]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2021-03-10T20:00:10.928 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:00:10 gibba023 bash[14629]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2021-03-10T20:00:10.928 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:00:10 gibba023 bash[14629]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2021-03-10T20:00:10.928 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:00:10 gibba023 bash[14629]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-03-10T20:00:10.929 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:00:10 gibba023 bash[14629]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-03-10T20:00:10.929 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:00:10 gibba023 bash[14629]: --> ceph-volume lvm activate successful for osd ID: 0 2021-03-10T20:00:11.814 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:11 gibba023 bash[9844]: cluster 2021-03-10T20:00:10.630107+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:11.815 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:11 gibba023 bash[13032]: cluster 2021-03-10T20:00:10.630107+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:12.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:11 gibba044 bash[9859]: cluster 2021-03-10T20:00:10.630107+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:14.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:13 gibba044 bash[9859]: cluster 2021-03-10T20:00:12.630714+0000 mgr.y (mgr.14140) 57 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:14.043 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:13 gibba023 bash[9844]: cluster 2021-03-10T20:00:12.630714+0000 mgr.y (mgr.14140) 57 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:14.043 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:13 gibba023 bash[13032]: cluster 2021-03-10T20:00:12.630714+0000 mgr.y (mgr.14140) 57 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:14.547 INFO:teuthology.orchestra.run.gibba023.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-03-10T20:00:14.547 INFO:teuthology.orchestra.run.gibba023.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-03-10T20:00:14.548 INFO:teuthology.orchestra.run.gibba023.stderr: stderr: 10+0 records in 2021-03-10T20:00:14.548 INFO:teuthology.orchestra.run.gibba023.stderr:10+0 records out 2021-03-10T20:00:14.548 INFO:teuthology.orchestra.run.gibba023.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00741236 s, 1.4 GB/s 2021-03-10T20:00:14.548 INFO:teuthology.orchestra.run.gibba023.stderr:--> Zapping successful for: 2021-03-10T20:00:14.927 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:00:14 gibba023 bash[15000]: debug 2021-03-10T20:00:14.521+0000 7f8e6a2c2ec0 -1 Falling back to public interface 2021-03-10T20:00:15.295 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba023:vg_nvme/lv_3 2021-03-10T20:00:15.390 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:00:15 gibba023 bash[15000]: debug 2021-03-10T20:00:15.161+0000 7f8e6a2c2ec0 -1 osd.0 0 log_to_monitors {default=true} 2021-03-10T20:00:15.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:15 gibba023 bash[9844]: cluster 2021-03-10T20:00:14.631032+0000 mgr.y (mgr.14140) 58 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:15.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:15 gibba023 bash[9844]: audit 2021-03-10T20:00:15.166951+0000 mon.c (mon.1) 5 : audit [INF] from='osd.0 [v2:172.21.2.123:6802/1929369864,v1:172.21.2.123:6803/1929369864]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T20:00:15.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:15 gibba023 bash[9844]: audit 2021-03-10T20:00:15.167145+0000 mon.a (mon.0) 219 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T20:00:15.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:15 gibba023 bash[13032]: cluster 2021-03-10T20:00:14.631032+0000 mgr.y (mgr.14140) 58 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:15.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:15 gibba023 bash[13032]: audit 2021-03-10T20:00:15.166951+0000 mon.c (mon.1) 5 : audit [INF] from='osd.0 [v2:172.21.2.123:6802/1929369864,v1:172.21.2.123:6803/1929369864]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T20:00:15.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:15 gibba023 bash[13032]: audit 2021-03-10T20:00:15.167145+0000 mon.a (mon.0) 219 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T20:00:16.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:15 gibba044 bash[9859]: cluster 2021-03-10T20:00:14.631032+0000 mgr.y (mgr.14140) 58 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:16.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:15 gibba044 bash[9859]: audit 2021-03-10T20:00:15.166951+0000 mon.c (mon.1) 5 : audit [INF] from='osd.0 [v2:172.21.2.123:6802/1929369864,v1:172.21.2.123:6803/1929369864]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T20:00:16.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:15 gibba044 bash[9859]: audit 2021-03-10T20:00:15.167145+0000 mon.a (mon.0) 219 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T20:00:16.927 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:00:16 gibba023 bash[15000]: debug 2021-03-10T20:00:16.649+0000 7f8e53077700 -1 osd.0 0 waiting for initial osdmap 2021-03-10T20:00:16.927 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:00:16 gibba023 bash[15000]: debug 2021-03-10T20:00:16.649+0000 7f8e5e293700 -1 osd.0 9 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:00:16.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:16 gibba023 bash[9844]: audit 2021-03-10T20:00:15.637821+0000 mon.a (mon.0) 220 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T20:00:16.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:16 gibba023 bash[9844]: cluster 2021-03-10T20:00:15.637856+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-03-10T20:00:16.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:16 gibba023 bash[9844]: audit 2021-03-10T20:00:15.638054+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:00:16.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:16 gibba023 bash[9844]: audit 2021-03-10T20:00:15.638576+0000 mon.c (mon.1) 6 : audit [INF] from='osd.0 [v2:172.21.2.123:6802/1929369864,v1:172.21.2.123:6803/1929369864]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:00:16.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:16 gibba023 bash[9844]: audit 2021-03-10T20:00:15.638864+0000 mon.a (mon.0) 223 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:00:16.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:16 gibba023 bash[9844]: audit 2021-03-10T20:00:15.938751+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:00:16.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:16 gibba023 bash[13032]: audit 2021-03-10T20:00:15.637821+0000 mon.a (mon.0) 220 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T20:00:16.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:16 gibba023 bash[13032]: cluster 2021-03-10T20:00:15.637856+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-03-10T20:00:16.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:16 gibba023 bash[13032]: audit 2021-03-10T20:00:15.638054+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:00:16.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:16 gibba023 bash[13032]: audit 2021-03-10T20:00:15.638576+0000 mon.c (mon.1) 6 : audit [INF] from='osd.0 [v2:172.21.2.123:6802/1929369864,v1:172.21.2.123:6803/1929369864]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:00:16.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:16 gibba023 bash[13032]: audit 2021-03-10T20:00:15.638864+0000 mon.a (mon.0) 223 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:00:16.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:16 gibba023 bash[13032]: audit 2021-03-10T20:00:15.938751+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:00:16.932 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:16 gibba023 bash[9844]: audit 2021-03-10T20:00:16.040910+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072087\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072145\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072174\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072201\", \"created\": \"2021-03-10T20:00:07.565145\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}}, \"last_daemon_update\": \"2021-03-10T20:00:08.072247\", \"last_device_update\": \"2021-03-10T20:00:16.040377\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:00:16.932 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:16 gibba023 bash[9844]: audit 2021-03-10T20:00:16.044791+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072087\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072145\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072174\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072201\", \"created\": \"2021-03-10T20:00:07.565145\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}}, \"last_daemon_update\": \"2021-03-10T20:00:08.072247\", \"last_device_update\": \"2021-03-10T20:00:16.040377\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:00:16.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:16 gibba023 bash[13032]: audit 2021-03-10T20:00:16.040910+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072087\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072145\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072174\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072201\", \"created\": \"2021-03-10T20:00:07.565145\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}}, \"last_daemon_update\": \"2021-03-10T20:00:08.072247\", \"last_device_update\": \"2021-03-10T20:00:16.040377\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:00:16.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:16 gibba023 bash[13032]: audit 2021-03-10T20:00:16.044791+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072087\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072145\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072174\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072201\", \"created\": \"2021-03-10T20:00:07.565145\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}}, \"last_daemon_update\": \"2021-03-10T20:00:08.072247\", \"last_device_update\": \"2021-03-10T20:00:16.040377\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:00:17.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:16 gibba044 bash[9859]: audit 2021-03-10T20:00:15.637821+0000 mon.a (mon.0) 220 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T20:00:17.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:16 gibba044 bash[9859]: cluster 2021-03-10T20:00:15.637856+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-03-10T20:00:17.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:16 gibba044 bash[9859]: audit 2021-03-10T20:00:15.638054+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:00:17.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:16 gibba044 bash[9859]: audit 2021-03-10T20:00:15.638576+0000 mon.c (mon.1) 6 : audit [INF] from='osd.0 [v2:172.21.2.123:6802/1929369864,v1:172.21.2.123:6803/1929369864]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:00:17.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:16 gibba044 bash[9859]: audit 2021-03-10T20:00:15.638864+0000 mon.a (mon.0) 223 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:00:17.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:16 gibba044 bash[9859]: audit 2021-03-10T20:00:15.938751+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:00:17.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:16 gibba044 bash[9859]: audit 2021-03-10T20:00:16.040910+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072087\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072145\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072174\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072201\", \"created\": \"2021-03-10T20:00:07.565145\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}}, \"last_daemon_update\": \"2021-03-10T20:00:08.072247\", \"last_device_update\": \"2021-03-10T20:00:16.040377\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:00:17.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:16 gibba044 bash[9859]: audit 2021-03-10T20:00:16.044791+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072087\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072145\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072174\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072201\", \"created\": \"2021-03-10T20:00:07.565145\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}}, \"last_daemon_update\": \"2021-03-10T20:00:08.072247\", \"last_device_update\": \"2021-03-10T20:00:16.040377\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:00:17.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:17 gibba023 bash[9844]: cluster 2021-03-10T20:00:16.202671+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:00:17.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:17 gibba023 bash[9844]: cluster 2021-03-10T20:00:16.202786+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:00:17.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:17 gibba023 bash[9844]: cluster 2021-03-10T20:00:16.631365+0000 mgr.y (mgr.14140) 59 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:17.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:17 gibba023 bash[9844]: audit 2021-03-10T20:00:16.641281+0000 mon.a (mon.0) 227 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]': finished 2021-03-10T20:00:17.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:17 gibba023 bash[9844]: cluster 2021-03-10T20:00:16.641335+0000 mon.a (mon.0) 228 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-03-10T20:00:17.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:17 gibba023 bash[9844]: audit 2021-03-10T20:00:16.641999+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:00:17.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:17 gibba023 bash[13032]: cluster 2021-03-10T20:00:16.202671+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:00:17.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:17 gibba023 bash[13032]: cluster 2021-03-10T20:00:16.202786+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:00:17.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:17 gibba023 bash[13032]: cluster 2021-03-10T20:00:16.631365+0000 mgr.y (mgr.14140) 59 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:17.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:17 gibba023 bash[13032]: audit 2021-03-10T20:00:16.641281+0000 mon.a (mon.0) 227 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]': finished 2021-03-10T20:00:17.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:17 gibba023 bash[13032]: cluster 2021-03-10T20:00:16.641335+0000 mon.a (mon.0) 228 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-03-10T20:00:17.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:17 gibba023 bash[13032]: audit 2021-03-10T20:00:16.641999+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:00:18.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:17 gibba044 bash[9859]: cluster 2021-03-10T20:00:16.202671+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:00:18.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:17 gibba044 bash[9859]: cluster 2021-03-10T20:00:16.202786+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:00:18.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:17 gibba044 bash[9859]: cluster 2021-03-10T20:00:16.631365+0000 mgr.y (mgr.14140) 59 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:18.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:17 gibba044 bash[9859]: audit 2021-03-10T20:00:16.641281+0000 mon.a (mon.0) 227 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]': finished 2021-03-10T20:00:18.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:17 gibba044 bash[9859]: cluster 2021-03-10T20:00:16.641335+0000 mon.a (mon.0) 228 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-03-10T20:00:18.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:17 gibba044 bash[9859]: audit 2021-03-10T20:00:16.641999+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:00:18.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:18 gibba023 bash[9844]: cluster 2021-03-10T20:00:17.658956+0000 mon.a (mon.0) 230 : cluster [INF] osd.0 [v2:172.21.2.123:6802/1929369864,v1:172.21.2.123:6803/1929369864] boot 2021-03-10T20:00:18.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:18 gibba023 bash[9844]: cluster 2021-03-10T20:00:17.659094+0000 mon.a (mon.0) 231 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-03-10T20:00:18.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:18 gibba023 bash[9844]: audit 2021-03-10T20:00:17.660287+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:00:18.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:18 gibba023 bash[9844]: audit 2021-03-10T20:00:18.215011+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:00:18.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:18 gibba023 bash[9844]: audit 2021-03-10T20:00:18.215857+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:00:18.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:18 gibba023 bash[9844]: audit 2021-03-10T20:00:18.216787+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:00:18.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:18 gibba023 bash[9844]: cluster 2021-03-10T20:00:18.663034+0000 mon.a (mon.0) 236 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-03-10T20:00:18.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:18 gibba023 bash[13032]: cluster 2021-03-10T20:00:17.658956+0000 mon.a (mon.0) 230 : cluster [INF] osd.0 [v2:172.21.2.123:6802/1929369864,v1:172.21.2.123:6803/1929369864] boot 2021-03-10T20:00:18.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:18 gibba023 bash[13032]: cluster 2021-03-10T20:00:17.659094+0000 mon.a (mon.0) 231 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-03-10T20:00:18.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:18 gibba023 bash[13032]: audit 2021-03-10T20:00:17.660287+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:00:18.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:18 gibba023 bash[13032]: audit 2021-03-10T20:00:18.215011+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:00:18.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:18 gibba023 bash[13032]: audit 2021-03-10T20:00:18.215857+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:00:18.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:18 gibba023 bash[13032]: audit 2021-03-10T20:00:18.216787+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:00:18.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:18 gibba023 bash[13032]: cluster 2021-03-10T20:00:18.663034+0000 mon.a (mon.0) 236 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-03-10T20:00:19.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:18 gibba044 bash[9859]: cluster 2021-03-10T20:00:17.658956+0000 mon.a (mon.0) 230 : cluster [INF] osd.0 [v2:172.21.2.123:6802/1929369864,v1:172.21.2.123:6803/1929369864] boot 2021-03-10T20:00:19.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:18 gibba044 bash[9859]: cluster 2021-03-10T20:00:17.659094+0000 mon.a (mon.0) 231 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-03-10T20:00:19.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:18 gibba044 bash[9859]: audit 2021-03-10T20:00:17.660287+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:00:19.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:18 gibba044 bash[9859]: audit 2021-03-10T20:00:18.215011+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:00:19.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:18 gibba044 bash[9859]: audit 2021-03-10T20:00:18.215857+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:00:19.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:18 gibba044 bash[9859]: audit 2021-03-10T20:00:18.216787+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:00:19.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:18 gibba044 bash[9859]: cluster 2021-03-10T20:00:18.663034+0000 mon.a (mon.0) 236 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-03-10T20:00:19.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:19 gibba023 bash[9844]: audit 2021-03-10T20:00:18.214324+0000 mgr.y (mgr.14140) 60 : audit [DBG] from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba023:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:00:19.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:19 gibba023 bash[9844]: cephadm 2021-03-10T20:00:18.214779+0000 mgr.y (mgr.14140) 61 : cephadm [INF] Applying osd on host gibba023... 2021-03-10T20:00:19.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:19 gibba023 bash[9844]: cluster 2021-03-10T20:00:18.632154+0000 mgr.y (mgr.14140) 62 : cluster [DBG] pgmap v49: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:19.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:19 gibba023 bash[9844]: cluster 2021-03-10T20:00:19.662210+0000 mon.a (mon.0) 237 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-03-10T20:00:19.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:19 gibba023 bash[13032]: audit 2021-03-10T20:00:18.214324+0000 mgr.y (mgr.14140) 60 : audit [DBG] from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba023:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:00:19.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:19 gibba023 bash[13032]: cephadm 2021-03-10T20:00:18.214779+0000 mgr.y (mgr.14140) 61 : cephadm [INF] Applying osd on host gibba023... 2021-03-10T20:00:19.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:19 gibba023 bash[13032]: cluster 2021-03-10T20:00:18.632154+0000 mgr.y (mgr.14140) 62 : cluster [DBG] pgmap v49: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:19.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:19 gibba023 bash[13032]: cluster 2021-03-10T20:00:19.662210+0000 mon.a (mon.0) 237 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-03-10T20:00:20.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:19 gibba044 bash[9859]: audit 2021-03-10T20:00:18.214324+0000 mgr.y (mgr.14140) 60 : audit [DBG] from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba023:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:00:20.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:19 gibba044 bash[9859]: cephadm 2021-03-10T20:00:18.214779+0000 mgr.y (mgr.14140) 61 : cephadm [INF] Applying osd on host gibba023... 2021-03-10T20:00:20.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:19 gibba044 bash[9859]: cluster 2021-03-10T20:00:18.632154+0000 mgr.y (mgr.14140) 62 : cluster [DBG] pgmap v49: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-03-10T20:00:20.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:19 gibba044 bash[9859]: cluster 2021-03-10T20:00:19.662210+0000 mon.a (mon.0) 237 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-03-10T20:00:21.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:20 gibba044 bash[9859]: cluster 2021-03-10T20:00:20.673604+0000 mon.a (mon.0) 238 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:00:21.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:20 gibba023 bash[9844]: cluster 2021-03-10T20:00:20.673604+0000 mon.a (mon.0) 238 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:00:21.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:20 gibba023 bash[13032]: cluster 2021-03-10T20:00:20.673604+0000 mon.a (mon.0) 238 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:00:22.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:21 gibba044 bash[9859]: cluster 2021-03-10T20:00:20.632845+0000 mgr.y (mgr.14140) 63 : cluster [DBG] pgmap v52: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:22.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:21 gibba044 bash[9859]: audit 2021-03-10T20:00:21.354020+0000 mon.a (mon.0) 239 : audit [INF] from='client.? 172.21.2.123:0/379759391' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "95b1ac45-85e8-43cd-9a54-ac01a8971dd4"}]: dispatch 2021-03-10T20:00:22.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:21 gibba044 bash[9859]: audit 2021-03-10T20:00:21.359349+0000 mon.a (mon.0) 240 : audit [INF] from='client.? 172.21.2.123:0/379759391' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "95b1ac45-85e8-43cd-9a54-ac01a8971dd4"}]': finished 2021-03-10T20:00:22.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:21 gibba044 bash[9859]: cluster 2021-03-10T20:00:21.359387+0000 mon.a (mon.0) 241 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-03-10T20:00:22.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:21 gibba044 bash[9859]: audit 2021-03-10T20:00:21.359574+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:00:22.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:21 gibba023 bash[9844]: cluster 2021-03-10T20:00:20.632845+0000 mgr.y (mgr.14140) 63 : cluster [DBG] pgmap v52: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:22.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:21 gibba023 bash[9844]: audit 2021-03-10T20:00:21.354020+0000 mon.a (mon.0) 239 : audit [INF] from='client.? 172.21.2.123:0/379759391' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "95b1ac45-85e8-43cd-9a54-ac01a8971dd4"}]: dispatch 2021-03-10T20:00:22.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:21 gibba023 bash[9844]: audit 2021-03-10T20:00:21.359349+0000 mon.a (mon.0) 240 : audit [INF] from='client.? 172.21.2.123:0/379759391' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "95b1ac45-85e8-43cd-9a54-ac01a8971dd4"}]': finished 2021-03-10T20:00:22.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:21 gibba023 bash[9844]: cluster 2021-03-10T20:00:21.359387+0000 mon.a (mon.0) 241 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-03-10T20:00:22.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:21 gibba023 bash[9844]: audit 2021-03-10T20:00:21.359574+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:00:22.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:21 gibba023 bash[13032]: cluster 2021-03-10T20:00:20.632845+0000 mgr.y (mgr.14140) 63 : cluster [DBG] pgmap v52: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:22.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:21 gibba023 bash[13032]: audit 2021-03-10T20:00:21.354020+0000 mon.a (mon.0) 239 : audit [INF] from='client.? 172.21.2.123:0/379759391' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "95b1ac45-85e8-43cd-9a54-ac01a8971dd4"}]: dispatch 2021-03-10T20:00:22.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:21 gibba023 bash[13032]: audit 2021-03-10T20:00:21.359349+0000 mon.a (mon.0) 240 : audit [INF] from='client.? 172.21.2.123:0/379759391' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "95b1ac45-85e8-43cd-9a54-ac01a8971dd4"}]': finished 2021-03-10T20:00:22.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:21 gibba023 bash[13032]: cluster 2021-03-10T20:00:21.359387+0000 mon.a (mon.0) 241 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-03-10T20:00:22.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:21 gibba023 bash[13032]: audit 2021-03-10T20:00:21.359574+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:00:24.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:23 gibba023 bash[9844]: cluster 2021-03-10T20:00:22.633512+0000 mgr.y (mgr.14140) 64 : cluster [DBG] pgmap v54: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:24.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:23 gibba023 bash[9844]: audit 2021-03-10T20:00:23.380805+0000 mon.a (mon.0) 243 : audit [DBG] from='client.? 172.21.2.123:0/839770547' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:00:24.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:23 gibba023 bash[13032]: cluster 2021-03-10T20:00:22.633512+0000 mgr.y (mgr.14140) 64 : cluster [DBG] pgmap v54: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:24.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:23 gibba023 bash[13032]: audit 2021-03-10T20:00:23.380805+0000 mon.a (mon.0) 243 : audit [DBG] from='client.? 172.21.2.123:0/839770547' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:00:24.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:23 gibba044 bash[9859]: cluster 2021-03-10T20:00:22.633512+0000 mgr.y (mgr.14140) 64 : cluster [DBG] pgmap v54: 1 pgs: 1 creating+peering; 0 B data, 96 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:24.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:23 gibba044 bash[9859]: audit 2021-03-10T20:00:23.380805+0000 mon.a (mon.0) 243 : audit [DBG] from='client.? 172.21.2.123:0/839770547' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:00:25.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:25 gibba023 bash[9844]: cluster 2021-03-10T20:00:24.633959+0000 mgr.y (mgr.14140) 65 : cluster [DBG] pgmap v55: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:25.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:25 gibba023 bash[13032]: cluster 2021-03-10T20:00:24.633959+0000 mgr.y (mgr.14140) 65 : cluster [DBG] pgmap v55: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:26.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:25 gibba044 bash[9859]: cluster 2021-03-10T20:00:24.633959+0000 mgr.y (mgr.14140) 65 : cluster [DBG] pgmap v55: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:26.916 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:26 gibba023 bash[9844]: audit 2021-03-10T20:00:25.996929+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:00:26.917 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:26 gibba023 bash[13032]: audit 2021-03-10T20:00:25.996929+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:00:27.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:26 gibba044 bash[9859]: audit 2021-03-10T20:00:25.996929+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:00:27.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:27 gibba023 bash[9844]: cluster 2021-03-10T20:00:26.634584+0000 mgr.y (mgr.14140) 66 : cluster [DBG] pgmap v56: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:27.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:27 gibba023 bash[13032]: cluster 2021-03-10T20:00:26.634584+0000 mgr.y (mgr.14140) 66 : cluster [DBG] pgmap v56: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:28.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:27 gibba044 bash[9859]: cluster 2021-03-10T20:00:26.634584+0000 mgr.y (mgr.14140) 66 : cluster [DBG] pgmap v56: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:29.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:29 gibba023 bash[9844]: cluster 2021-03-10T20:00:28.635030+0000 mgr.y (mgr.14140) 67 : cluster [DBG] pgmap v57: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:29.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:29 gibba023 bash[9844]: audit 2021-03-10T20:00:29.301528+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-03-10T20:00:29.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:29 gibba023 bash[9844]: audit 2021-03-10T20:00:29.302499+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:00:29.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:29 gibba023 bash[9844]: audit 2021-03-10T20:00:29.303320+0000 mon.a (mon.0) 247 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-03-10T20:00:29.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:29 gibba023 bash[9844]: cluster 2021-03-10T20:00:29.625847+0000 mon.a (mon.0) 248 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T20:00:29.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:29 gibba023 bash[13032]: cluster 2021-03-10T20:00:28.635030+0000 mgr.y (mgr.14140) 67 : cluster [DBG] pgmap v57: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:29.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:29 gibba023 bash[13032]: audit 2021-03-10T20:00:29.301528+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-03-10T20:00:29.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:29 gibba023 bash[13032]: audit 2021-03-10T20:00:29.302499+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:00:29.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:29 gibba023 bash[13032]: audit 2021-03-10T20:00:29.303320+0000 mon.a (mon.0) 247 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-03-10T20:00:29.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:29 gibba023 bash[13032]: cluster 2021-03-10T20:00:29.625847+0000 mon.a (mon.0) 248 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T20:00:30.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:29 gibba044 bash[9859]: cluster 2021-03-10T20:00:28.635030+0000 mgr.y (mgr.14140) 67 : cluster [DBG] pgmap v57: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:30.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:29 gibba044 bash[9859]: audit 2021-03-10T20:00:29.301528+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-03-10T20:00:30.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:29 gibba044 bash[9859]: audit 2021-03-10T20:00:29.302499+0000 mon.a (mon.0) 246 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:00:30.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:29 gibba044 bash[9859]: audit 2021-03-10T20:00:29.303320+0000 mon.a (mon.0) 247 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-03-10T20:00:30.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:29 gibba044 bash[9859]: cluster 2021-03-10T20:00:29.625847+0000 mon.a (mon.0) 248 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-03-10T20:00:30.860 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:30 gibba023 bash[9844]: cephadm 2021-03-10T20:00:29.303120+0000 mgr.y (mgr.14140) 68 : cephadm [INF] Deploying daemon osd.1 on gibba023 2021-03-10T20:00:30.860 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:30 gibba023 bash[13032]: cephadm 2021-03-10T20:00:29.303120+0000 mgr.y (mgr.14140) 68 : cephadm [INF] Deploying daemon osd.1 on gibba023 2021-03-10T20:00:31.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:30 gibba044 bash[9859]: cephadm 2021-03-10T20:00:29.303120+0000 mgr.y (mgr.14140) 68 : cephadm [INF] Deploying daemon osd.1 on gibba023 2021-03-10T20:00:31.165 INFO:teuthology.orchestra.run.gibba023.stdout:Created osd(s) 1 on host 'gibba023' 2021-03-10T20:00:31.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:31 gibba023 bash[9844]: cluster 2021-03-10T20:00:30.635641+0000 mgr.y (mgr.14140) 69 : cluster [DBG] pgmap v58: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:31.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:31 gibba023 bash[13032]: cluster 2021-03-10T20:00:30.635641+0000 mgr.y (mgr.14140) 69 : cluster [DBG] pgmap v58: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:31.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:31 gibba023 bash[9844]: audit 2021-03-10T20:00:31.158832+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072087\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072145\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072174\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072201\", \"created\": \"2021-03-10T20:00:07.565145\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}}, \"last_device_update\": \"2021-03-10T20:00:16.040377\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:00:31.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:31 gibba023 bash[9844]: audit 2021-03-10T20:00:31.159409+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:00:31.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:31 gibba023 bash[9844]: audit 2021-03-10T20:00:31.163061+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072087\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072145\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072174\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072201\", \"created\": \"2021-03-10T20:00:07.565145\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}}, \"last_device_update\": \"2021-03-10T20:00:16.040377\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:00:31.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:31 gibba023 bash[13032]: audit 2021-03-10T20:00:31.158832+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072087\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072145\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072174\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072201\", \"created\": \"2021-03-10T20:00:07.565145\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}}, \"last_device_update\": \"2021-03-10T20:00:16.040377\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:00:31.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:31 gibba023 bash[13032]: audit 2021-03-10T20:00:31.159409+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:00:31.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:31 gibba023 bash[13032]: audit 2021-03-10T20:00:31.163061+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072087\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072145\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072174\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072201\", \"created\": \"2021-03-10T20:00:07.565145\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}}, \"last_device_update\": \"2021-03-10T20:00:16.040377\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:00:32.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:31 gibba044 bash[9859]: cluster 2021-03-10T20:00:30.635641+0000 mgr.y (mgr.14140) 69 : cluster [DBG] pgmap v58: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:32.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:31 gibba044 bash[9859]: audit 2021-03-10T20:00:31.158832+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072087\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072145\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072174\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072201\", \"created\": \"2021-03-10T20:00:07.565145\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}}, \"last_device_update\": \"2021-03-10T20:00:16.040377\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:00:32.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:31 gibba044 bash[9859]: audit 2021-03-10T20:00:31.159409+0000 mon.a (mon.0) 250 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:00:32.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:31 gibba044 bash[9859]: audit 2021-03-10T20:00:31.163061+0000 mon.a (mon.0) 251 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072087\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072145\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072174\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:08.072201\", \"created\": \"2021-03-10T20:00:07.565145\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}}, \"last_device_update\": \"2021-03-10T20:00:16.040377\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:00:32.397 DEBUG:teuthology.orchestra.run.gibba023:osd.1> sudo journalctl -f -n 0 -u ceph-dd719b26-81da-11eb-9080-001a4aab830c@osd.1.service 2021-03-10T20:00:32.400 INFO:tasks.cephadm:Deploying osd.2 on gibba023 with /dev/vg_nvme/lv_2... 2021-03-10T20:00:32.400 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-03-10T20:00:32.464 INFO:journalctl@ceph.osd.1.gibba023.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:00:32.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:32 gibba023 bash[13032]: audit 2021-03-10T20:00:31.870932+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867534\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867795\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867959\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868108\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868259\", \"created\": \"2021-03-10T20:00:31.149145\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}}, \"last_daemon_update\": \"2021-03-10T20:00:31.868512\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:00:32.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:32 gibba023 bash[9844]: audit 2021-03-10T20:00:31.870932+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867534\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867795\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867959\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868108\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868259\", \"created\": \"2021-03-10T20:00:31.149145\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}}, \"last_daemon_update\": \"2021-03-10T20:00:31.868512\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:00:32.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:32 gibba023 bash[13032]: audit 2021-03-10T20:00:31.880147+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867534\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867795\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867959\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868108\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868259\", \"created\": \"2021-03-10T20:00:31.149145\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}}, \"last_daemon_update\": \"2021-03-10T20:00:31.868512\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:00:32.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:32 gibba023 bash[13032]: audit 2021-03-10T20:00:31.880751+0000 mon.a (mon.0) 254 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:00:32.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:32 gibba023 bash[9844]: audit 2021-03-10T20:00:31.880147+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867534\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867795\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867959\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868108\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868259\", \"created\": \"2021-03-10T20:00:31.149145\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}}, \"last_daemon_update\": \"2021-03-10T20:00:31.868512\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:00:32.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:32 gibba023 bash[9844]: audit 2021-03-10T20:00:31.880751+0000 mon.a (mon.0) 254 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:00:33.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:32 gibba044 bash[9859]: audit 2021-03-10T20:00:31.870932+0000 mon.a (mon.0) 252 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867534\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867795\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867959\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868108\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868259\", \"created\": \"2021-03-10T20:00:31.149145\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}}, \"last_daemon_update\": \"2021-03-10T20:00:31.868512\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:00:33.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:32 gibba044 bash[9859]: audit 2021-03-10T20:00:31.880147+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867534\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867795\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867959\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868108\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868259\", \"created\": \"2021-03-10T20:00:31.149145\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}}, \"last_daemon_update\": \"2021-03-10T20:00:31.868512\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:00:33.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:32 gibba044 bash[9859]: audit 2021-03-10T20:00:31.880751+0000 mon.a (mon.0) 254 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:00:33.677 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:00:33 gibba023 bash[16061]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-03-10T20:00:33.678 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:00:33 gibba023 bash[16061]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2021-03-10T20:00:33.678 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:00:33 gibba023 bash[16061]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2021-03-10T20:00:33.678 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:00:33 gibba023 bash[16061]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2021-03-10T20:00:33.678 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:00:33 gibba023 bash[16061]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-03-10T20:00:33.679 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:00:33 gibba023 bash[16061]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-03-10T20:00:33.679 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:00:33 gibba023 bash[16061]: --> ceph-volume lvm activate successful for osd ID: 1 2021-03-10T20:00:34.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:33 gibba023 bash[9844]: cluster 2021-03-10T20:00:32.636201+0000 mgr.y (mgr.14140) 70 : cluster [DBG] pgmap v59: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:34.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:33 gibba023 bash[13032]: cluster 2021-03-10T20:00:32.636201+0000 mgr.y (mgr.14140) 70 : cluster [DBG] pgmap v59: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:34.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:33 gibba044 bash[9859]: cluster 2021-03-10T20:00:32.636201+0000 mgr.y (mgr.14140) 70 : cluster [DBG] pgmap v59: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:35.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:35 gibba023 bash[9844]: cluster 2021-03-10T20:00:34.636425+0000 mgr.y (mgr.14140) 71 : cluster [DBG] pgmap v60: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:35.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:35 gibba023 bash[13032]: cluster 2021-03-10T20:00:34.636425+0000 mgr.y (mgr.14140) 71 : cluster [DBG] pgmap v60: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:36.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:35 gibba044 bash[9859]: cluster 2021-03-10T20:00:34.636425+0000 mgr.y (mgr.14140) 71 : cluster [DBG] pgmap v60: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:37.904 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:37 gibba023 bash[9844]: cluster 2021-03-10T20:00:36.637099+0000 mgr.y (mgr.14140) 72 : cluster [DBG] pgmap v61: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:37.904 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:37 gibba023 bash[13032]: cluster 2021-03-10T20:00:36.637099+0000 mgr.y (mgr.14140) 72 : cluster [DBG] pgmap v61: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:37.905 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:00:37 gibba023 bash[16412]: debug 2021-03-10T20:00:37.493+0000 7f89b3e3dec0 -1 Falling back to public interface 2021-03-10T20:00:38.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:37 gibba044 bash[9859]: cluster 2021-03-10T20:00:36.637099+0000 mgr.y (mgr.14140) 72 : cluster [DBG] pgmap v61: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:38.426 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:00:38 gibba023 bash[16412]: debug 2021-03-10T20:00:38.157+0000 7f89b3e3dec0 -1 osd.1 0 log_to_monitors {default=true} 2021-03-10T20:00:38.429 INFO:teuthology.orchestra.run.gibba023.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-03-10T20:00:38.429 INFO:teuthology.orchestra.run.gibba023.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-03-10T20:00:38.429 INFO:teuthology.orchestra.run.gibba023.stderr: stderr: 10+0 records in 2021-03-10T20:00:38.430 INFO:teuthology.orchestra.run.gibba023.stderr:10+0 records out 2021-03-10T20:00:38.430 INFO:teuthology.orchestra.run.gibba023.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.009419 s, 1.1 GB/s 2021-03-10T20:00:38.430 INFO:teuthology.orchestra.run.gibba023.stderr:--> Zapping successful for: 2021-03-10T20:00:38.772 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:38 gibba023 bash[9844]: audit 2021-03-10T20:00:38.163162+0000 mon.c (mon.1) 7 : audit [INF] from='osd.1 [v2:172.21.2.123:6810/1309940659,v1:172.21.2.123:6811/1309940659]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T20:00:38.772 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:38 gibba023 bash[9844]: audit 2021-03-10T20:00:38.163350+0000 mon.a (mon.0) 255 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T20:00:38.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:38 gibba023 bash[13032]: audit 2021-03-10T20:00:38.163162+0000 mon.c (mon.1) 7 : audit [INF] from='osd.1 [v2:172.21.2.123:6810/1309940659,v1:172.21.2.123:6811/1309940659]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T20:00:38.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:38 gibba023 bash[13032]: audit 2021-03-10T20:00:38.163350+0000 mon.a (mon.0) 255 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T20:00:39.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:38 gibba044 bash[9859]: audit 2021-03-10T20:00:38.163162+0000 mon.c (mon.1) 7 : audit [INF] from='osd.1 [v2:172.21.2.123:6810/1309940659,v1:172.21.2.123:6811/1309940659]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T20:00:39.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:38 gibba044 bash[9859]: audit 2021-03-10T20:00:38.163350+0000 mon.a (mon.0) 255 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T20:00:39.178 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba023:vg_nvme/lv_2 2021-03-10T20:00:40.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:39 gibba044 bash[9859]: cluster 2021-03-10T20:00:38.637719+0000 mgr.y (mgr.14140) 73 : cluster [DBG] pgmap v62: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:40.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:39 gibba044 bash[9859]: audit 2021-03-10T20:00:38.672802+0000 mon.a (mon.0) 256 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T20:00:40.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:39 gibba044 bash[9859]: cluster 2021-03-10T20:00:38.672922+0000 mon.a (mon.0) 257 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-03-10T20:00:40.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:39 gibba044 bash[9859]: audit 2021-03-10T20:00:38.673284+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:00:40.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:39 gibba044 bash[9859]: audit 2021-03-10T20:00:38.674455+0000 mon.c (mon.1) 8 : audit [INF] from='osd.1 [v2:172.21.2.123:6810/1309940659,v1:172.21.2.123:6811/1309940659]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:00:40.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:39 gibba044 bash[9859]: audit 2021-03-10T20:00:38.675398+0000 mon.a (mon.0) 259 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:00:40.177 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:00:39 gibba023 bash[16412]: debug 2021-03-10T20:00:39.681+0000 7f8998bea700 -1 osd.1 0 waiting for initial osdmap 2021-03-10T20:00:40.178 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:00:39 gibba023 bash[16412]: debug 2021-03-10T20:00:39.681+0000 7f89a3e06700 -1 osd.1 15 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:00:40.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:39 gibba023 bash[9844]: cluster 2021-03-10T20:00:38.637719+0000 mgr.y (mgr.14140) 73 : cluster [DBG] pgmap v62: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:40.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:39 gibba023 bash[9844]: audit 2021-03-10T20:00:38.672802+0000 mon.a (mon.0) 256 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T20:00:40.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:39 gibba023 bash[9844]: cluster 2021-03-10T20:00:38.672922+0000 mon.a (mon.0) 257 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-03-10T20:00:40.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:39 gibba023 bash[9844]: audit 2021-03-10T20:00:38.673284+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:00:40.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:39 gibba023 bash[9844]: audit 2021-03-10T20:00:38.674455+0000 mon.c (mon.1) 8 : audit [INF] from='osd.1 [v2:172.21.2.123:6810/1309940659,v1:172.21.2.123:6811/1309940659]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:00:40.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:39 gibba023 bash[9844]: audit 2021-03-10T20:00:38.675398+0000 mon.a (mon.0) 259 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:00:40.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:39 gibba023 bash[13032]: cluster 2021-03-10T20:00:38.637719+0000 mgr.y (mgr.14140) 73 : cluster [DBG] pgmap v62: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:40.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:39 gibba023 bash[13032]: audit 2021-03-10T20:00:38.672802+0000 mon.a (mon.0) 256 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T20:00:40.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:39 gibba023 bash[13032]: cluster 2021-03-10T20:00:38.672922+0000 mon.a (mon.0) 257 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-03-10T20:00:40.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:39 gibba023 bash[13032]: audit 2021-03-10T20:00:38.673284+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:00:40.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:39 gibba023 bash[13032]: audit 2021-03-10T20:00:38.674455+0000 mon.c (mon.1) 8 : audit [INF] from='osd.1 [v2:172.21.2.123:6810/1309940659,v1:172.21.2.123:6811/1309940659]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:00:40.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:39 gibba023 bash[13032]: audit 2021-03-10T20:00:38.675398+0000 mon.a (mon.0) 259 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:00:40.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:40 gibba023 bash[9844]: cluster 2021-03-10T20:00:39.162206+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:00:40.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:40 gibba023 bash[9844]: cluster 2021-03-10T20:00:39.162418+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:00:40.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:40 gibba023 bash[9844]: audit 2021-03-10T20:00:39.677693+0000 mon.a (mon.0) 260 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]': finished 2021-03-10T20:00:40.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:40 gibba023 bash[9844]: cluster 2021-03-10T20:00:39.677760+0000 mon.a (mon.0) 261 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-03-10T20:00:40.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:40 gibba023 bash[9844]: audit 2021-03-10T20:00:39.678382+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:00:40.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:40 gibba023 bash[9844]: audit 2021-03-10T20:00:39.978295+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:00:40.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:40 gibba023 bash[13032]: cluster 2021-03-10T20:00:39.162206+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:00:40.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:40 gibba023 bash[13032]: cluster 2021-03-10T20:00:39.162418+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:00:40.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:40 gibba023 bash[13032]: audit 2021-03-10T20:00:39.677693+0000 mon.a (mon.0) 260 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]': finished 2021-03-10T20:00:40.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:40 gibba023 bash[13032]: cluster 2021-03-10T20:00:39.677760+0000 mon.a (mon.0) 261 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-03-10T20:00:40.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:40 gibba023 bash[13032]: audit 2021-03-10T20:00:39.678382+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:00:40.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:40 gibba023 bash[13032]: audit 2021-03-10T20:00:39.978295+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:00:40.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:40 gibba023 bash[9844]: audit 2021-03-10T20:00:40.085093+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867534\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867795\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867959\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868108\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868259\", \"created\": \"2021-03-10T20:00:31.149145\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}}, \"last_daemon_update\": \"2021-03-10T20:00:31.868512\", \"last_device_update\": \"2021-03-10T20:00:40.084567\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:00:40.932 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:40 gibba023 bash[9844]: audit 2021-03-10T20:00:40.088734+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867534\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867795\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867959\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868108\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868259\", \"created\": \"2021-03-10T20:00:31.149145\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}}, \"last_daemon_update\": \"2021-03-10T20:00:31.868512\", \"last_device_update\": \"2021-03-10T20:00:40.084567\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:00:40.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:40 gibba023 bash[13032]: audit 2021-03-10T20:00:40.085093+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867534\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867795\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867959\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868108\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868259\", \"created\": \"2021-03-10T20:00:31.149145\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}}, \"last_daemon_update\": \"2021-03-10T20:00:31.868512\", \"last_device_update\": \"2021-03-10T20:00:40.084567\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:00:40.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:40 gibba023 bash[13032]: audit 2021-03-10T20:00:40.088734+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867534\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867795\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867959\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868108\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868259\", \"created\": \"2021-03-10T20:00:31.149145\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}}, \"last_daemon_update\": \"2021-03-10T20:00:31.868512\", \"last_device_update\": \"2021-03-10T20:00:40.084567\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:00:41.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:40 gibba044 bash[9859]: cluster 2021-03-10T20:00:39.162206+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:00:41.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:40 gibba044 bash[9859]: cluster 2021-03-10T20:00:39.162418+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:00:41.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:40 gibba044 bash[9859]: audit 2021-03-10T20:00:39.677693+0000 mon.a (mon.0) 260 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]': finished 2021-03-10T20:00:41.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:40 gibba044 bash[9859]: cluster 2021-03-10T20:00:39.677760+0000 mon.a (mon.0) 261 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-03-10T20:00:41.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:40 gibba044 bash[9859]: audit 2021-03-10T20:00:39.678382+0000 mon.a (mon.0) 262 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:00:41.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:40 gibba044 bash[9859]: audit 2021-03-10T20:00:39.978295+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:00:41.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:40 gibba044 bash[9859]: audit 2021-03-10T20:00:40.085093+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867534\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867795\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867959\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868108\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868259\", \"created\": \"2021-03-10T20:00:31.149145\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}}, \"last_daemon_update\": \"2021-03-10T20:00:31.868512\", \"last_device_update\": \"2021-03-10T20:00:40.084567\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:00:41.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:40 gibba044 bash[9859]: audit 2021-03-10T20:00:40.088734+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867534\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867795\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867959\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868108\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868259\", \"created\": \"2021-03-10T20:00:31.149145\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}}, \"last_daemon_update\": \"2021-03-10T20:00:31.868512\", \"last_device_update\": \"2021-03-10T20:00:40.084567\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:00:41.994 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:41 gibba023 bash[9844]: cluster 2021-03-10T20:00:40.638541+0000 mgr.y (mgr.14140) 74 : cluster [DBG] pgmap v65: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:41.995 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:41 gibba023 bash[9844]: cluster 2021-03-10T20:00:40.692019+0000 mon.a (mon.0) 266 : cluster [INF] osd.1 [v2:172.21.2.123:6810/1309940659,v1:172.21.2.123:6811/1309940659] boot 2021-03-10T20:00:41.995 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:41 gibba023 bash[9844]: cluster 2021-03-10T20:00:40.692137+0000 mon.a (mon.0) 267 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-03-10T20:00:41.995 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:41 gibba023 bash[9844]: audit 2021-03-10T20:00:40.693536+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:00:41.996 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:41 gibba023 bash[13032]: cluster 2021-03-10T20:00:40.638541+0000 mgr.y (mgr.14140) 74 : cluster [DBG] pgmap v65: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:41.996 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:41 gibba023 bash[13032]: cluster 2021-03-10T20:00:40.692019+0000 mon.a (mon.0) 266 : cluster [INF] osd.1 [v2:172.21.2.123:6810/1309940659,v1:172.21.2.123:6811/1309940659] boot 2021-03-10T20:00:41.996 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:41 gibba023 bash[13032]: cluster 2021-03-10T20:00:40.692137+0000 mon.a (mon.0) 267 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-03-10T20:00:41.996 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:41 gibba023 bash[13032]: audit 2021-03-10T20:00:40.693536+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:00:42.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:41 gibba044 bash[9859]: cluster 2021-03-10T20:00:40.638541+0000 mgr.y (mgr.14140) 74 : cluster [DBG] pgmap v65: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 83 GiB / 84 GiB avail 2021-03-10T20:00:42.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:41 gibba044 bash[9859]: cluster 2021-03-10T20:00:40.692019+0000 mon.a (mon.0) 266 : cluster [INF] osd.1 [v2:172.21.2.123:6810/1309940659,v1:172.21.2.123:6811/1309940659] boot 2021-03-10T20:00:42.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:41 gibba044 bash[9859]: cluster 2021-03-10T20:00:40.692137+0000 mon.a (mon.0) 267 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-03-10T20:00:42.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:41 gibba044 bash[9859]: audit 2021-03-10T20:00:40.693536+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:00:43.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:42 gibba044 bash[9859]: cluster 2021-03-10T20:00:41.706787+0000 mon.a (mon.0) 269 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-03-10T20:00:43.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:42 gibba044 bash[9859]: audit 2021-03-10T20:00:42.021926+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-195836"}]: dispatch 2021-03-10T20:00:43.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:42 gibba044 bash[9859]: audit 2021-03-10T20:00:42.025616+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-195836"}]': finished 2021-03-10T20:00:43.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:42 gibba044 bash[9859]: audit 2021-03-10T20:00:42.197764+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:00:43.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:42 gibba044 bash[9859]: audit 2021-03-10T20:00:42.198548+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:00:43.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:42 gibba044 bash[9859]: audit 2021-03-10T20:00:42.199483+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:00:43.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:42 gibba023 bash[9844]: cluster 2021-03-10T20:00:41.706787+0000 mon.a (mon.0) 269 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-03-10T20:00:43.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:42 gibba023 bash[9844]: audit 2021-03-10T20:00:42.021926+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-195836"}]: dispatch 2021-03-10T20:00:43.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:42 gibba023 bash[9844]: audit 2021-03-10T20:00:42.025616+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-195836"}]': finished 2021-03-10T20:00:43.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:42 gibba023 bash[9844]: audit 2021-03-10T20:00:42.197764+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:00:43.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:42 gibba023 bash[9844]: audit 2021-03-10T20:00:42.198548+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:00:43.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:42 gibba023 bash[9844]: audit 2021-03-10T20:00:42.199483+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:00:43.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:42 gibba023 bash[13032]: cluster 2021-03-10T20:00:41.706787+0000 mon.a (mon.0) 269 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-03-10T20:00:43.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:42 gibba023 bash[13032]: audit 2021-03-10T20:00:42.021926+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-195836"}]: dispatch 2021-03-10T20:00:43.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:42 gibba023 bash[13032]: audit 2021-03-10T20:00:42.025616+0000 mon.a (mon.0) 271 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20210310-195836"}]': finished 2021-03-10T20:00:43.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:42 gibba023 bash[13032]: audit 2021-03-10T20:00:42.197764+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:00:43.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:42 gibba023 bash[13032]: audit 2021-03-10T20:00:42.198548+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:00:43.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:42 gibba023 bash[13032]: audit 2021-03-10T20:00:42.199483+0000 mon.a (mon.0) 274 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:00:44.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:44 gibba023 bash[9844]: audit 2021-03-10T20:00:42.197066+0000 mgr.y (mgr.14140) 75 : audit [DBG] from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba023:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:00:44.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:44 gibba023 bash[9844]: cephadm 2021-03-10T20:00:42.197516+0000 mgr.y (mgr.14140) 76 : cephadm [INF] Applying osd on host gibba023... 2021-03-10T20:00:44.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:44 gibba023 bash[9844]: cluster 2021-03-10T20:00:42.639221+0000 mgr.y (mgr.14140) 77 : cluster [DBG] pgmap v68: 1 pgs: 1 undersized+peered; 0 B data, 264 KiB used, 166 GiB / 168 GiB avail 2021-03-10T20:00:44.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:44 gibba023 bash[13032]: audit 2021-03-10T20:00:42.197066+0000 mgr.y (mgr.14140) 75 : audit [DBG] from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba023:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:00:44.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:44 gibba023 bash[13032]: cephadm 2021-03-10T20:00:42.197516+0000 mgr.y (mgr.14140) 76 : cephadm [INF] Applying osd on host gibba023... 2021-03-10T20:00:44.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:44 gibba023 bash[13032]: cluster 2021-03-10T20:00:42.639221+0000 mgr.y (mgr.14140) 77 : cluster [DBG] pgmap v68: 1 pgs: 1 undersized+peered; 0 B data, 264 KiB used, 166 GiB / 168 GiB avail 2021-03-10T20:00:44.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:44 gibba044 bash[9859]: audit 2021-03-10T20:00:42.197066+0000 mgr.y (mgr.14140) 75 : audit [DBG] from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba023:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:00:44.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:44 gibba044 bash[9859]: cephadm 2021-03-10T20:00:42.197516+0000 mgr.y (mgr.14140) 76 : cephadm [INF] Applying osd on host gibba023... 2021-03-10T20:00:44.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:44 gibba044 bash[9859]: cluster 2021-03-10T20:00:42.639221+0000 mgr.y (mgr.14140) 77 : cluster [DBG] pgmap v68: 1 pgs: 1 undersized+peered; 0 B data, 264 KiB used, 166 GiB / 168 GiB avail 2021-03-10T20:00:45.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:45 gibba023 bash[9844]: cluster 2021-03-10T20:00:44.639544+0000 mgr.y (mgr.14140) 78 : cluster [DBG] pgmap v69: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 166 GiB / 168 GiB avail 2021-03-10T20:00:45.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:45 gibba023 bash[9844]: audit 2021-03-10T20:00:45.210974+0000 mon.c (mon.1) 9 : audit [INF] from='client.? 172.21.2.123:0/3335323578' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a0f4e49d-c3f2-4689-a636-aeba722b895a"}]: dispatch 2021-03-10T20:00:45.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:45 gibba023 bash[9844]: audit 2021-03-10T20:00:45.211306+0000 mon.a (mon.0) 275 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a0f4e49d-c3f2-4689-a636-aeba722b895a"}]: dispatch 2021-03-10T20:00:45.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:45 gibba023 bash[9844]: audit 2021-03-10T20:00:45.216230+0000 mon.a (mon.0) 276 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a0f4e49d-c3f2-4689-a636-aeba722b895a"}]': finished 2021-03-10T20:00:45.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:45 gibba023 bash[9844]: cluster 2021-03-10T20:00:45.216274+0000 mon.a (mon.0) 277 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-03-10T20:00:45.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:45 gibba023 bash[9844]: audit 2021-03-10T20:00:45.216394+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:00:45.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:45 gibba023 bash[13032]: cluster 2021-03-10T20:00:44.639544+0000 mgr.y (mgr.14140) 78 : cluster [DBG] pgmap v69: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 166 GiB / 168 GiB avail 2021-03-10T20:00:45.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:45 gibba023 bash[13032]: audit 2021-03-10T20:00:45.210974+0000 mon.c (mon.1) 9 : audit [INF] from='client.? 172.21.2.123:0/3335323578' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a0f4e49d-c3f2-4689-a636-aeba722b895a"}]: dispatch 2021-03-10T20:00:45.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:45 gibba023 bash[13032]: audit 2021-03-10T20:00:45.211306+0000 mon.a (mon.0) 275 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a0f4e49d-c3f2-4689-a636-aeba722b895a"}]: dispatch 2021-03-10T20:00:45.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:45 gibba023 bash[13032]: audit 2021-03-10T20:00:45.216230+0000 mon.a (mon.0) 276 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a0f4e49d-c3f2-4689-a636-aeba722b895a"}]': finished 2021-03-10T20:00:45.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:45 gibba023 bash[13032]: cluster 2021-03-10T20:00:45.216274+0000 mon.a (mon.0) 277 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-03-10T20:00:45.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:45 gibba023 bash[13032]: audit 2021-03-10T20:00:45.216394+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:00:46.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:45 gibba044 bash[9859]: cluster 2021-03-10T20:00:44.639544+0000 mgr.y (mgr.14140) 78 : cluster [DBG] pgmap v69: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 166 GiB / 168 GiB avail 2021-03-10T20:00:46.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:45 gibba044 bash[9859]: audit 2021-03-10T20:00:45.210974+0000 mon.c (mon.1) 9 : audit [INF] from='client.? 172.21.2.123:0/3335323578' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a0f4e49d-c3f2-4689-a636-aeba722b895a"}]: dispatch 2021-03-10T20:00:46.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:45 gibba044 bash[9859]: audit 2021-03-10T20:00:45.211306+0000 mon.a (mon.0) 275 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a0f4e49d-c3f2-4689-a636-aeba722b895a"}]: dispatch 2021-03-10T20:00:46.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:45 gibba044 bash[9859]: audit 2021-03-10T20:00:45.216230+0000 mon.a (mon.0) 276 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a0f4e49d-c3f2-4689-a636-aeba722b895a"}]': finished 2021-03-10T20:00:46.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:45 gibba044 bash[9859]: cluster 2021-03-10T20:00:45.216274+0000 mon.a (mon.0) 277 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-03-10T20:00:46.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:45 gibba044 bash[9859]: audit 2021-03-10T20:00:45.216394+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:00:47.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:47 gibba023 bash[9844]: cluster 2021-03-10T20:00:46.640125+0000 mgr.y (mgr.14140) 79 : cluster [DBG] pgmap v71: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 166 GiB / 168 GiB avail 2021-03-10T20:00:47.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:47 gibba023 bash[9844]: audit 2021-03-10T20:00:47.238258+0000 mon.c (mon.1) 10 : audit [DBG] from='client.? 172.21.2.123:0/2659670697' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:00:47.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:47 gibba023 bash[13032]: cluster 2021-03-10T20:00:46.640125+0000 mgr.y (mgr.14140) 79 : cluster [DBG] pgmap v71: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 166 GiB / 168 GiB avail 2021-03-10T20:00:47.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:47 gibba023 bash[13032]: audit 2021-03-10T20:00:47.238258+0000 mon.c (mon.1) 10 : audit [DBG] from='client.? 172.21.2.123:0/2659670697' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:00:48.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:47 gibba044 bash[9859]: cluster 2021-03-10T20:00:46.640125+0000 mgr.y (mgr.14140) 79 : cluster [DBG] pgmap v71: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 166 GiB / 168 GiB avail 2021-03-10T20:00:48.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:47 gibba044 bash[9859]: audit 2021-03-10T20:00:47.238258+0000 mon.c (mon.1) 10 : audit [DBG] from='client.? 172.21.2.123:0/2659670697' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:00:49.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:48 gibba044 bash[9859]: cluster 2021-03-10T20:00:48.656760+0000 mon.a (mon.0) 279 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2021-03-10T20:00:49.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:48 gibba044 bash[9859]: cluster 2021-03-10T20:00:48.656854+0000 mon.a (mon.0) 280 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-03-10T20:00:49.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:48 gibba023 bash[9844]: cluster 2021-03-10T20:00:48.656760+0000 mon.a (mon.0) 279 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2021-03-10T20:00:49.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:48 gibba023 bash[9844]: cluster 2021-03-10T20:00:48.656854+0000 mon.a (mon.0) 280 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-03-10T20:00:49.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:48 gibba023 bash[13032]: cluster 2021-03-10T20:00:48.656760+0000 mon.a (mon.0) 279 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2021-03-10T20:00:49.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:48 gibba023 bash[13032]: cluster 2021-03-10T20:00:48.656854+0000 mon.a (mon.0) 280 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-03-10T20:00:49.994 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:49 gibba023 bash[9844]: cluster 2021-03-10T20:00:48.641034+0000 mgr.y (mgr.14140) 80 : cluster [DBG] pgmap v72: 1 pgs: 1 active+undersized+degraded; 0 B data, 312 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:00:49.995 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:49 gibba023 bash[13032]: cluster 2021-03-10T20:00:48.641034+0000 mgr.y (mgr.14140) 80 : cluster [DBG] pgmap v72: 1 pgs: 1 active+undersized+degraded; 0 B data, 312 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:00:50.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:49 gibba044 bash[9859]: cluster 2021-03-10T20:00:48.641034+0000 mgr.y (mgr.14140) 80 : cluster [DBG] pgmap v72: 1 pgs: 1 active+undersized+degraded; 0 B data, 312 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:00:51.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:50 gibba044 bash[9859]: audit 2021-03-10T20:00:49.883345+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:00:51.059 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:50 gibba023 bash[9844]: audit 2021-03-10T20:00:49.883345+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:00:51.059 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:50 gibba023 bash[13032]: audit 2021-03-10T20:00:49.883345+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:00:52.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:51 gibba044 bash[9859]: cluster 2021-03-10T20:00:50.641518+0000 mgr.y (mgr.14140) 81 : cluster [DBG] pgmap v73: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:00:52.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:51 gibba023 bash[9844]: cluster 2021-03-10T20:00:50.641518+0000 mgr.y (mgr.14140) 81 : cluster [DBG] pgmap v73: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:00:52.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:51 gibba023 bash[13032]: cluster 2021-03-10T20:00:50.641518+0000 mgr.y (mgr.14140) 81 : cluster [DBG] pgmap v73: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:00:54.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:53 gibba044 bash[9859]: cluster 2021-03-10T20:00:52.642162+0000 mgr.y (mgr.14140) 82 : cluster [DBG] pgmap v74: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:00:54.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:53 gibba044 bash[9859]: audit 2021-03-10T20:00:53.347210+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-03-10T20:00:54.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:53 gibba044 bash[9859]: audit 2021-03-10T20:00:53.348072+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:00:54.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:53 gibba044 bash[9859]: audit 2021-03-10T20:00:53.348963+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-03-10T20:00:54.135 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:53 gibba023 bash[9844]: cluster 2021-03-10T20:00:52.642162+0000 mgr.y (mgr.14140) 82 : cluster [DBG] pgmap v74: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:00:54.135 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:53 gibba023 bash[9844]: audit 2021-03-10T20:00:53.347210+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-03-10T20:00:54.136 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:53 gibba023 bash[9844]: audit 2021-03-10T20:00:53.348072+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:00:54.136 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:53 gibba023 bash[9844]: audit 2021-03-10T20:00:53.348963+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-03-10T20:00:54.137 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:53 gibba023 bash[13032]: cluster 2021-03-10T20:00:52.642162+0000 mgr.y (mgr.14140) 82 : cluster [DBG] pgmap v74: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:00:54.137 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:53 gibba023 bash[13032]: audit 2021-03-10T20:00:53.347210+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-03-10T20:00:54.138 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:53 gibba023 bash[13032]: audit 2021-03-10T20:00:53.348072+0000 mon.a (mon.0) 283 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:00:54.138 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:53 gibba023 bash[13032]: audit 2021-03-10T20:00:53.348963+0000 mon.a (mon.0) 284 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-03-10T20:00:55.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:54 gibba044 bash[9859]: cephadm 2021-03-10T20:00:53.348747+0000 mgr.y (mgr.14140) 83 : cephadm [INF] Deploying daemon osd.2 on gibba023 2021-03-10T20:00:55.015 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:54 gibba023 bash[13032]: cephadm 2021-03-10T20:00:53.348747+0000 mgr.y (mgr.14140) 83 : cephadm [INF] Deploying daemon osd.2 on gibba023 2021-03-10T20:00:55.016 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:54 gibba023 bash[9844]: cephadm 2021-03-10T20:00:53.348747+0000 mgr.y (mgr.14140) 83 : cephadm [INF] Deploying daemon osd.2 on gibba023 2021-03-10T20:00:55.175 INFO:teuthology.orchestra.run.gibba023.stdout:Created osd(s) 2 on host 'gibba023' 2021-03-10T20:00:55.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:55 gibba023 bash[9844]: cluster 2021-03-10T20:00:54.642914+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v75: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:00:55.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:55 gibba023 bash[13032]: cluster 2021-03-10T20:00:54.642914+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v75: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:00:55.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:55 gibba023 bash[9844]: audit 2021-03-10T20:00:55.170386+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867534\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867795\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867959\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868108\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868259\", \"created\": \"2021-03-10T20:00:31.149145\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}}, \"last_device_update\": \"2021-03-10T20:00:40.084567\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:00:55.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:55 gibba023 bash[9844]: audit 2021-03-10T20:00:55.170968+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:00:55.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:55 gibba023 bash[13032]: audit 2021-03-10T20:00:55.170386+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867534\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867795\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867959\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868108\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868259\", \"created\": \"2021-03-10T20:00:31.149145\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}}, \"last_device_update\": \"2021-03-10T20:00:40.084567\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:00:55.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:55 gibba023 bash[13032]: audit 2021-03-10T20:00:55.170968+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:00:55.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:55 gibba023 bash[9844]: audit 2021-03-10T20:00:55.174035+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867534\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867795\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867959\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868108\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868259\", \"created\": \"2021-03-10T20:00:31.149145\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}}, \"last_device_update\": \"2021-03-10T20:00:40.084567\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:00:55.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:55 gibba023 bash[13032]: audit 2021-03-10T20:00:55.174035+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867534\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867795\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867959\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868108\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868259\", \"created\": \"2021-03-10T20:00:31.149145\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}}, \"last_device_update\": \"2021-03-10T20:00:40.084567\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:00:55.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:55 gibba023 bash[9844]: audit 2021-03-10T20:00:55.731302+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730530\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730587\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730616\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730642\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730668\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730694\", \"created\": \"2021-03-10T20:00:55.158947\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}}, \"last_daemon_update\": \"2021-03-10T20:00:55.730740\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:00:55.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:55 gibba023 bash[13032]: audit 2021-03-10T20:00:55.731302+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730530\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730587\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730616\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730642\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730668\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730694\", \"created\": \"2021-03-10T20:00:55.158947\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}}, \"last_daemon_update\": \"2021-03-10T20:00:55.730740\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:00:55.932 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:55 gibba023 bash[9844]: audit 2021-03-10T20:00:55.735379+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730530\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730587\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730616\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730642\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730668\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730694\", \"created\": \"2021-03-10T20:00:55.158947\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}}, \"last_daemon_update\": \"2021-03-10T20:00:55.730740\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:00:55.932 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:55 gibba023 bash[9844]: audit 2021-03-10T20:00:55.735896+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:00:55.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:55 gibba023 bash[13032]: audit 2021-03-10T20:00:55.735379+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730530\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730587\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730616\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730642\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730668\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730694\", \"created\": \"2021-03-10T20:00:55.158947\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}}, \"last_daemon_update\": \"2021-03-10T20:00:55.730740\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:00:55.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:55 gibba023 bash[13032]: audit 2021-03-10T20:00:55.735896+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:00:56.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:55 gibba044 bash[9859]: cluster 2021-03-10T20:00:54.642914+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v75: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:00:56.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:55 gibba044 bash[9859]: audit 2021-03-10T20:00:55.170386+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867534\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867795\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867959\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868108\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868259\", \"created\": \"2021-03-10T20:00:31.149145\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}}, \"last_device_update\": \"2021-03-10T20:00:40.084567\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:00:56.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:55 gibba044 bash[9859]: audit 2021-03-10T20:00:55.170968+0000 mon.a (mon.0) 286 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:00:56.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:55 gibba044 bash[9859]: audit 2021-03-10T20:00:55.174035+0000 mon.a (mon.0) 287 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867534\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867795\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.867959\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868108\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:31.868259\", \"created\": \"2021-03-10T20:00:31.149145\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}}, \"last_device_update\": \"2021-03-10T20:00:40.084567\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:00:56.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:55 gibba044 bash[9859]: audit 2021-03-10T20:00:55.731302+0000 mon.a (mon.0) 288 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730530\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730587\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730616\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730642\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730668\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730694\", \"created\": \"2021-03-10T20:00:55.158947\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}}, \"last_daemon_update\": \"2021-03-10T20:00:55.730740\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:00:56.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:55 gibba044 bash[9859]: audit 2021-03-10T20:00:55.735379+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730530\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730587\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730616\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730642\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730668\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730694\", \"created\": \"2021-03-10T20:00:55.158947\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}}, \"last_daemon_update\": \"2021-03-10T20:00:55.730740\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:00:56.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:55 gibba044 bash[9859]: audit 2021-03-10T20:00:55.735896+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:00:56.652 DEBUG:teuthology.orchestra.run.gibba023:osd.2> sudo journalctl -f -n 0 -u ceph-dd719b26-81da-11eb-9080-001a4aab830c@osd.2.service 2021-03-10T20:00:56.656 INFO:tasks.cephadm:Deploying osd.3 on gibba023 with /dev/vg_nvme/lv_1... 2021-03-10T20:00:56.656 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2021-03-10T20:00:56.671 INFO:journalctl@ceph.osd.2.gibba023.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:00:58.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:57 gibba023 bash[9844]: cluster 2021-03-10T20:00:56.643741+0000 mgr.y (mgr.14140) 85 : cluster [DBG] pgmap v76: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:00:58.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:57 gibba023 bash[13032]: cluster 2021-03-10T20:00:56.643741+0000 mgr.y (mgr.14140) 85 : cluster [DBG] pgmap v76: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:00:58.176 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:00:57 gibba023 bash[17527]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-03-10T20:00:58.177 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:00:57 gibba023 bash[17527]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2021-03-10T20:00:58.177 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:00:57 gibba023 bash[17527]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2021-03-10T20:00:58.177 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:00:57 gibba023 bash[17527]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2021-03-10T20:00:58.177 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:00:57 gibba023 bash[17527]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-03-10T20:00:58.178 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:00:57 gibba023 bash[17527]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-03-10T20:00:58.178 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:00:57 gibba023 bash[17527]: --> ceph-volume lvm activate successful for osd ID: 2 2021-03-10T20:00:58.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:57 gibba044 bash[9859]: cluster 2021-03-10T20:00:56.643741+0000 mgr.y (mgr.14140) 85 : cluster [DBG] pgmap v76: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:00:59.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:00:59 gibba023 bash[9844]: cluster 2021-03-10T20:00:58.644452+0000 mgr.y (mgr.14140) 86 : cluster [DBG] pgmap v77: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:00:59.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:00:59 gibba023 bash[13032]: cluster 2021-03-10T20:00:58.644452+0000 mgr.y (mgr.14140) 86 : cluster [DBG] pgmap v77: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:01:00.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:00:59 gibba044 bash[9859]: cluster 2021-03-10T20:00:58.644452+0000 mgr.y (mgr.14140) 86 : cluster [DBG] pgmap v77: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:01:01.425 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:01:01 gibba023 bash[17868]: debug 2021-03-10T20:01:01.218+0000 7f1e7e76cec0 1 -- 172.21.2.123:0/516858466 >> [v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0] conn(0x55767a1f7400 msgr2=0x55767a1f3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-10T20:01:01.426 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:01:01 gibba023 bash[17868]: debug 2021-03-10T20:01:01.218+0000 7f1e78fba700 1 --2- 172.21.2.123:0/516858466 >> [v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0] conn(0x55767a1f7400 0x55767a1f3f80 secure :-1 s=THROTTLE_DONE pgs=95 cs=0 l=1 rx=0x55767a18dd10 tx=0x55767ae62aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2021-03-10T20:01:01.426 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:01:01 gibba023 bash[17868]: debug 2021-03-10T20:01:01.218+0000 7f1e7e76cec0 1 --2- 172.21.2.123:0/516858466 >> [v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0] conn(0x55767a1f7400 0x55767a1f3f80 secure :-1 s=READY pgs=95 cs=0 l=1 rx=0x55767a18dd10 tx=0x55767ae62aa0).stop 2021-03-10T20:01:01.426 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:01:01 gibba023 bash[17868]: debug 2021-03-10T20:01:01.218+0000 7f1e777b7700 1 -- 172.21.2.123:0/516858466 <== mon.0 v2:172.21.2.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (unknown 0 0 0) 0x55767a1904e0 con 0x55767a1f7400 2021-03-10T20:01:02.054 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:01 gibba023 bash[9844]: cluster 2021-03-10T20:01:00.645348+0000 mgr.y (mgr.14140) 87 : cluster [DBG] pgmap v78: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:01:02.055 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:01:01 gibba023 bash[17868]: debug 2021-03-10T20:01:01.790+0000 7f1e7e76cec0 -1 Falling back to public interface 2021-03-10T20:01:02.055 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:01 gibba023 bash[13032]: cluster 2021-03-10T20:01:00.645348+0000 mgr.y (mgr.14140) 87 : cluster [DBG] pgmap v78: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:01:02.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:01 gibba044 bash[9859]: cluster 2021-03-10T20:01:00.645348+0000 mgr.y (mgr.14140) 87 : cluster [DBG] pgmap v78: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:01:02.552 INFO:teuthology.orchestra.run.gibba023.stderr:--> Zapping: /dev/vg_nvme/lv_1 2021-03-10T20:01:02.553 INFO:teuthology.orchestra.run.gibba023.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2021-03-10T20:01:02.553 INFO:teuthology.orchestra.run.gibba023.stderr: stderr: 10+0 records in 2021-03-10T20:01:02.553 INFO:teuthology.orchestra.run.gibba023.stderr:10+0 records out 2021-03-10T20:01:02.554 INFO:teuthology.orchestra.run.gibba023.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00936543 s, 1.1 GB/s 2021-03-10T20:01:02.554 INFO:teuthology.orchestra.run.gibba023.stderr:--> Zapping successful for: 2021-03-10T20:01:02.749 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:01:02 gibba023 bash[17868]: debug 2021-03-10T20:01:02.458+0000 7f1e7e76cec0 -1 osd.2 0 log_to_monitors {default=true} 2021-03-10T20:01:03.050 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:02 gibba023 bash[9844]: audit 2021-03-10T20:01:02.467361+0000 mon.c (mon.1) 11 : audit [INF] from='osd.2 [v2:172.21.2.123:6818/949023223,v1:172.21.2.123:6819/949023223]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T20:01:03.050 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:02 gibba023 bash[9844]: audit 2021-03-10T20:01:02.467580+0000 mon.a (mon.0) 291 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T20:01:03.050 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:02 gibba023 bash[13032]: audit 2021-03-10T20:01:02.467361+0000 mon.c (mon.1) 11 : audit [INF] from='osd.2 [v2:172.21.2.123:6818/949023223,v1:172.21.2.123:6819/949023223]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T20:01:03.051 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:02 gibba023 bash[13032]: audit 2021-03-10T20:01:02.467580+0000 mon.a (mon.0) 291 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T20:01:03.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:02 gibba044 bash[9859]: audit 2021-03-10T20:01:02.467361+0000 mon.c (mon.1) 11 : audit [INF] from='osd.2 [v2:172.21.2.123:6818/949023223,v1:172.21.2.123:6819/949023223]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T20:01:03.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:02 gibba044 bash[9859]: audit 2021-03-10T20:01:02.467580+0000 mon.a (mon.0) 291 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T20:01:03.379 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba023:vg_nvme/lv_1 2021-03-10T20:01:04.175 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:01:03 gibba023 bash[17868]: debug 2021-03-10T20:01:03.798+0000 7f1e63519700 -1 osd.2 0 waiting for initial osdmap 2021-03-10T20:01:04.175 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:01:03 gibba023 bash[17868]: debug 2021-03-10T20:01:03.802+0000 7f1e6e735700 -1 osd.2 20 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:01:04.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:03 gibba023 bash[9844]: cluster 2021-03-10T20:01:02.645727+0000 mgr.y (mgr.14140) 88 : cluster [DBG] pgmap v79: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:01:04.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:03 gibba023 bash[9844]: audit 2021-03-10T20:01:02.790675+0000 mon.a (mon.0) 292 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T20:01:04.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:03 gibba023 bash[9844]: cluster 2021-03-10T20:01:02.790704+0000 mon.a (mon.0) 293 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2021-03-10T20:01:04.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:03 gibba023 bash[9844]: audit 2021-03-10T20:01:02.790780+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:01:04.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:03 gibba023 bash[9844]: audit 2021-03-10T20:01:02.791306+0000 mon.c (mon.1) 12 : audit [INF] from='osd.2 [v2:172.21.2.123:6818/949023223,v1:172.21.2.123:6819/949023223]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:01:04.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:03 gibba023 bash[9844]: audit 2021-03-10T20:01:02.791491+0000 mon.a (mon.0) 295 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:01:04.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:03 gibba023 bash[9844]: cluster 2021-03-10T20:01:03.430090+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:01:04.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:03 gibba023 bash[9844]: cluster 2021-03-10T20:01:03.430120+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:01:04.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:03 gibba023 bash[13032]: cluster 2021-03-10T20:01:02.645727+0000 mgr.y (mgr.14140) 88 : cluster [DBG] pgmap v79: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:01:04.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:03 gibba023 bash[13032]: audit 2021-03-10T20:01:02.790675+0000 mon.a (mon.0) 292 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T20:01:04.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:03 gibba023 bash[13032]: cluster 2021-03-10T20:01:02.790704+0000 mon.a (mon.0) 293 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2021-03-10T20:01:04.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:03 gibba023 bash[13032]: audit 2021-03-10T20:01:02.790780+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:01:04.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:03 gibba023 bash[13032]: audit 2021-03-10T20:01:02.791306+0000 mon.c (mon.1) 12 : audit [INF] from='osd.2 [v2:172.21.2.123:6818/949023223,v1:172.21.2.123:6819/949023223]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:01:04.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:03 gibba023 bash[13032]: audit 2021-03-10T20:01:02.791491+0000 mon.a (mon.0) 295 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:01:04.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:03 gibba023 bash[13032]: cluster 2021-03-10T20:01:03.430090+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:01:04.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:03 gibba023 bash[13032]: cluster 2021-03-10T20:01:03.430120+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:01:04.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:03 gibba044 bash[9859]: cluster 2021-03-10T20:01:02.645727+0000 mgr.y (mgr.14140) 88 : cluster [DBG] pgmap v79: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:01:04.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:03 gibba044 bash[9859]: audit 2021-03-10T20:01:02.790675+0000 mon.a (mon.0) 292 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T20:01:04.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:03 gibba044 bash[9859]: cluster 2021-03-10T20:01:02.790704+0000 mon.a (mon.0) 293 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2021-03-10T20:01:04.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:03 gibba044 bash[9859]: audit 2021-03-10T20:01:02.790780+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:01:04.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:03 gibba044 bash[9859]: audit 2021-03-10T20:01:02.791306+0000 mon.c (mon.1) 12 : audit [INF] from='osd.2 [v2:172.21.2.123:6818/949023223,v1:172.21.2.123:6819/949023223]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:01:04.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:03 gibba044 bash[9859]: audit 2021-03-10T20:01:02.791491+0000 mon.a (mon.0) 295 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:01:04.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:03 gibba044 bash[9859]: cluster 2021-03-10T20:01:03.430090+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:01:04.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:03 gibba044 bash[9859]: cluster 2021-03-10T20:01:03.430120+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:01:04.876 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:04 gibba023 bash[9844]: audit 2021-03-10T20:01:03.800522+0000 mon.a (mon.0) 296 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]': finished 2021-03-10T20:01:04.877 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:04 gibba023 bash[9844]: cluster 2021-03-10T20:01:03.800666+0000 mon.a (mon.0) 297 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2021-03-10T20:01:04.877 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:04 gibba023 bash[9844]: audit 2021-03-10T20:01:03.801396+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:01:04.877 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:04 gibba023 bash[9844]: audit 2021-03-10T20:01:04.131052+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:01:04.878 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:04 gibba023 bash[13032]: audit 2021-03-10T20:01:03.800522+0000 mon.a (mon.0) 296 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]': finished 2021-03-10T20:01:04.878 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:04 gibba023 bash[13032]: cluster 2021-03-10T20:01:03.800666+0000 mon.a (mon.0) 297 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2021-03-10T20:01:04.878 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:04 gibba023 bash[13032]: audit 2021-03-10T20:01:03.801396+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:01:04.878 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:04 gibba023 bash[13032]: audit 2021-03-10T20:01:04.131052+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:01:04.879 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:04 gibba023 bash[9844]: audit 2021-03-10T20:01:04.230700+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730530\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730587\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730616\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730642\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730668\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730694\", \"created\": \"2021-03-10T20:00:55.158947\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}}, \"last_daemon_update\": \"2021-03-10T20:00:55.730740\", \"last_device_update\": \"2021-03-10T20:01:04.230100\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:01:04.879 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:04 gibba023 bash[9844]: audit 2021-03-10T20:01:04.234558+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730530\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730587\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730616\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730642\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730668\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730694\", \"created\": \"2021-03-10T20:00:55.158947\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}}, \"last_daemon_update\": \"2021-03-10T20:00:55.730740\", \"last_device_update\": \"2021-03-10T20:01:04.230100\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:01:04.880 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:04 gibba023 bash[13032]: audit 2021-03-10T20:01:04.230700+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730530\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730587\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730616\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730642\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730668\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730694\", \"created\": \"2021-03-10T20:00:55.158947\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}}, \"last_daemon_update\": \"2021-03-10T20:00:55.730740\", \"last_device_update\": \"2021-03-10T20:01:04.230100\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:01:04.880 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:04 gibba023 bash[13032]: audit 2021-03-10T20:01:04.234558+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730530\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730587\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730616\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730642\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730668\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730694\", \"created\": \"2021-03-10T20:00:55.158947\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}}, \"last_daemon_update\": \"2021-03-10T20:00:55.730740\", \"last_device_update\": \"2021-03-10T20:01:04.230100\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:01:05.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:04 gibba044 bash[9859]: audit 2021-03-10T20:01:03.800522+0000 mon.a (mon.0) 296 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]': finished 2021-03-10T20:01:05.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:04 gibba044 bash[9859]: cluster 2021-03-10T20:01:03.800666+0000 mon.a (mon.0) 297 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2021-03-10T20:01:05.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:04 gibba044 bash[9859]: audit 2021-03-10T20:01:03.801396+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:01:05.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:04 gibba044 bash[9859]: audit 2021-03-10T20:01:04.131052+0000 mon.a (mon.0) 299 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:01:05.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:04 gibba044 bash[9859]: audit 2021-03-10T20:01:04.230700+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730530\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730587\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730616\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730642\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730668\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730694\", \"created\": \"2021-03-10T20:00:55.158947\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}}, \"last_daemon_update\": \"2021-03-10T20:00:55.730740\", \"last_device_update\": \"2021-03-10T20:01:04.230100\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:01:05.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:04 gibba044 bash[9859]: audit 2021-03-10T20:01:04.234558+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730530\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730587\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730616\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730642\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730668\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730694\", \"created\": \"2021-03-10T20:00:55.158947\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}}, \"last_daemon_update\": \"2021-03-10T20:00:55.730740\", \"last_device_update\": \"2021-03-10T20:01:04.230100\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:01:06.160 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:05 gibba023 bash[9844]: cluster 2021-03-10T20:01:04.645976+0000 mgr.y (mgr.14140) 89 : cluster [DBG] pgmap v82: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:01:06.161 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:05 gibba023 bash[9844]: cluster 2021-03-10T20:01:04.810346+0000 mon.a (mon.0) 302 : cluster [INF] osd.2 [v2:172.21.2.123:6818/949023223,v1:172.21.2.123:6819/949023223] boot 2021-03-10T20:01:06.161 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:05 gibba023 bash[9844]: cluster 2021-03-10T20:01:04.810475+0000 mon.a (mon.0) 303 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-03-10T20:01:06.161 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:05 gibba023 bash[9844]: audit 2021-03-10T20:01:04.811510+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:01:06.162 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:05 gibba023 bash[13032]: cluster 2021-03-10T20:01:04.645976+0000 mgr.y (mgr.14140) 89 : cluster [DBG] pgmap v82: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:01:06.162 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:05 gibba023 bash[13032]: cluster 2021-03-10T20:01:04.810346+0000 mon.a (mon.0) 302 : cluster [INF] osd.2 [v2:172.21.2.123:6818/949023223,v1:172.21.2.123:6819/949023223] boot 2021-03-10T20:01:06.162 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:05 gibba023 bash[13032]: cluster 2021-03-10T20:01:04.810475+0000 mon.a (mon.0) 303 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-03-10T20:01:06.162 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:05 gibba023 bash[13032]: audit 2021-03-10T20:01:04.811510+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:01:06.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:05 gibba044 bash[9859]: cluster 2021-03-10T20:01:04.645976+0000 mgr.y (mgr.14140) 89 : cluster [DBG] pgmap v82: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 166 GiB / 168 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:01:06.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:05 gibba044 bash[9859]: cluster 2021-03-10T20:01:04.810346+0000 mon.a (mon.0) 302 : cluster [INF] osd.2 [v2:172.21.2.123:6818/949023223,v1:172.21.2.123:6819/949023223] boot 2021-03-10T20:01:06.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:05 gibba044 bash[9859]: cluster 2021-03-10T20:01:04.810475+0000 mon.a (mon.0) 303 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-03-10T20:01:06.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:05 gibba044 bash[9859]: audit 2021-03-10T20:01:04.811510+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:01:07.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:06 gibba023 bash[9844]: cluster 2021-03-10T20:01:05.833101+0000 mon.a (mon.0) 305 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2021-03-10T20:01:07.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:06 gibba023 bash[9844]: audit 2021-03-10T20:01:06.455598+0000 mon.a (mon.0) 306 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:01:07.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:06 gibba023 bash[9844]: audit 2021-03-10T20:01:06.456584+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:01:07.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:06 gibba023 bash[9844]: audit 2021-03-10T20:01:06.457608+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:01:07.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:06 gibba023 bash[13032]: cluster 2021-03-10T20:01:05.833101+0000 mon.a (mon.0) 305 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2021-03-10T20:01:07.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:06 gibba023 bash[13032]: audit 2021-03-10T20:01:06.455598+0000 mon.a (mon.0) 306 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:01:07.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:06 gibba023 bash[13032]: audit 2021-03-10T20:01:06.456584+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:01:07.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:06 gibba023 bash[13032]: audit 2021-03-10T20:01:06.457608+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:01:07.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:06 gibba044 bash[9859]: cluster 2021-03-10T20:01:05.833101+0000 mon.a (mon.0) 305 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2021-03-10T20:01:07.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:06 gibba044 bash[9859]: audit 2021-03-10T20:01:06.455598+0000 mon.a (mon.0) 306 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:01:07.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:06 gibba044 bash[9859]: audit 2021-03-10T20:01:06.456584+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:01:07.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:06 gibba044 bash[9859]: audit 2021-03-10T20:01:06.457608+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:01:08.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:07 gibba023 bash[9844]: audit 2021-03-10T20:01:06.454589+0000 mgr.y (mgr.14140) 90 : audit [DBG] from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba023:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:01:08.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:07 gibba023 bash[9844]: cephadm 2021-03-10T20:01:06.455284+0000 mgr.y (mgr.14140) 91 : cephadm [INF] Applying osd on host gibba023... 2021-03-10T20:01:08.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:07 gibba023 bash[9844]: cluster 2021-03-10T20:01:06.646755+0000 mgr.y (mgr.14140) 92 : cluster [DBG] pgmap v85: 1 pgs: 1 active+undersized+degraded; 0 B data, 504 KiB used, 249 GiB / 252 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:01:08.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:07 gibba023 bash[9844]: cluster 2021-03-10T20:01:06.848728+0000 mon.a (mon.0) 309 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2021-03-10T20:01:08.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:07 gibba023 bash[13032]: audit 2021-03-10T20:01:06.454589+0000 mgr.y (mgr.14140) 90 : audit [DBG] from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba023:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:01:08.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:07 gibba023 bash[13032]: cephadm 2021-03-10T20:01:06.455284+0000 mgr.y (mgr.14140) 91 : cephadm [INF] Applying osd on host gibba023... 2021-03-10T20:01:08.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:07 gibba023 bash[13032]: cluster 2021-03-10T20:01:06.646755+0000 mgr.y (mgr.14140) 92 : cluster [DBG] pgmap v85: 1 pgs: 1 active+undersized+degraded; 0 B data, 504 KiB used, 249 GiB / 252 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:01:08.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:07 gibba023 bash[13032]: cluster 2021-03-10T20:01:06.848728+0000 mon.a (mon.0) 309 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2021-03-10T20:01:08.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:07 gibba044 bash[9859]: audit 2021-03-10T20:01:06.454589+0000 mgr.y (mgr.14140) 90 : audit [DBG] from='client.14271 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba023:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:01:08.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:07 gibba044 bash[9859]: cephadm 2021-03-10T20:01:06.455284+0000 mgr.y (mgr.14140) 91 : cephadm [INF] Applying osd on host gibba023... 2021-03-10T20:01:08.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:07 gibba044 bash[9859]: cluster 2021-03-10T20:01:06.646755+0000 mgr.y (mgr.14140) 92 : cluster [DBG] pgmap v85: 1 pgs: 1 active+undersized+degraded; 0 B data, 504 KiB used, 249 GiB / 252 GiB avail; 1/3 objects degraded (33.333%) 2021-03-10T20:01:08.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:07 gibba044 bash[9859]: cluster 2021-03-10T20:01:06.848728+0000 mon.a (mon.0) 309 : cluster [DBG] osdmap e23: 3 total, 3 up, 3 in 2021-03-10T20:01:09.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:08 gibba023 bash[9844]: cluster 2021-03-10T20:01:08.853277+0000 mon.a (mon.0) 310 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2021-03-10T20:01:09.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:08 gibba023 bash[9844]: cluster 2021-03-10T20:01:08.853369+0000 mon.a (mon.0) 311 : cluster [INF] Cluster is now healthy 2021-03-10T20:01:09.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:08 gibba023 bash[13032]: cluster 2021-03-10T20:01:08.853277+0000 mon.a (mon.0) 310 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2021-03-10T20:01:09.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:08 gibba023 bash[13032]: cluster 2021-03-10T20:01:08.853369+0000 mon.a (mon.0) 311 : cluster [INF] Cluster is now healthy 2021-03-10T20:01:09.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:08 gibba044 bash[9859]: cluster 2021-03-10T20:01:08.853277+0000 mon.a (mon.0) 310 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2021-03-10T20:01:09.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:08 gibba044 bash[9859]: cluster 2021-03-10T20:01:08.853369+0000 mon.a (mon.0) 311 : cluster [INF] Cluster is now healthy 2021-03-10T20:01:10.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:09 gibba023 bash[9844]: cluster 2021-03-10T20:01:08.647567+0000 mgr.y (mgr.14140) 93 : cluster [DBG] pgmap v87: 1 pgs: 1 peering; 0 B data, 536 KiB used, 249 GiB / 252 GiB avail 2021-03-10T20:01:10.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:09 gibba023 bash[9844]: audit 2021-03-10T20:01:09.712170+0000 mon.c (mon.1) 13 : audit [INF] from='client.? 172.21.2.123:0/846140265' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6613b193-a360-4fc9-a240-11ac052531a2"}]: dispatch 2021-03-10T20:01:10.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:09 gibba023 bash[9844]: audit 2021-03-10T20:01:09.712460+0000 mon.a (mon.0) 312 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6613b193-a360-4fc9-a240-11ac052531a2"}]: dispatch 2021-03-10T20:01:10.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:09 gibba023 bash[9844]: audit 2021-03-10T20:01:09.717220+0000 mon.a (mon.0) 313 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6613b193-a360-4fc9-a240-11ac052531a2"}]': finished 2021-03-10T20:01:10.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:09 gibba023 bash[9844]: cluster 2021-03-10T20:01:09.717252+0000 mon.a (mon.0) 314 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2021-03-10T20:01:10.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:09 gibba023 bash[9844]: audit 2021-03-10T20:01:09.717344+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:01:10.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:09 gibba023 bash[13032]: cluster 2021-03-10T20:01:08.647567+0000 mgr.y (mgr.14140) 93 : cluster [DBG] pgmap v87: 1 pgs: 1 peering; 0 B data, 536 KiB used, 249 GiB / 252 GiB avail 2021-03-10T20:01:10.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:09 gibba023 bash[13032]: audit 2021-03-10T20:01:09.712170+0000 mon.c (mon.1) 13 : audit [INF] from='client.? 172.21.2.123:0/846140265' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6613b193-a360-4fc9-a240-11ac052531a2"}]: dispatch 2021-03-10T20:01:10.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:09 gibba023 bash[13032]: audit 2021-03-10T20:01:09.712460+0000 mon.a (mon.0) 312 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6613b193-a360-4fc9-a240-11ac052531a2"}]: dispatch 2021-03-10T20:01:10.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:09 gibba023 bash[13032]: audit 2021-03-10T20:01:09.717220+0000 mon.a (mon.0) 313 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6613b193-a360-4fc9-a240-11ac052531a2"}]': finished 2021-03-10T20:01:10.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:09 gibba023 bash[13032]: cluster 2021-03-10T20:01:09.717252+0000 mon.a (mon.0) 314 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2021-03-10T20:01:10.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:09 gibba023 bash[13032]: audit 2021-03-10T20:01:09.717344+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:01:10.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:09 gibba044 bash[9859]: cluster 2021-03-10T20:01:08.647567+0000 mgr.y (mgr.14140) 93 : cluster [DBG] pgmap v87: 1 pgs: 1 peering; 0 B data, 536 KiB used, 249 GiB / 252 GiB avail 2021-03-10T20:01:10.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:09 gibba044 bash[9859]: audit 2021-03-10T20:01:09.712170+0000 mon.c (mon.1) 13 : audit [INF] from='client.? 172.21.2.123:0/846140265' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6613b193-a360-4fc9-a240-11ac052531a2"}]: dispatch 2021-03-10T20:01:10.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:09 gibba044 bash[9859]: audit 2021-03-10T20:01:09.712460+0000 mon.a (mon.0) 312 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6613b193-a360-4fc9-a240-11ac052531a2"}]: dispatch 2021-03-10T20:01:10.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:09 gibba044 bash[9859]: audit 2021-03-10T20:01:09.717220+0000 mon.a (mon.0) 313 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6613b193-a360-4fc9-a240-11ac052531a2"}]': finished 2021-03-10T20:01:10.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:09 gibba044 bash[9859]: cluster 2021-03-10T20:01:09.717252+0000 mon.a (mon.0) 314 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2021-03-10T20:01:10.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:09 gibba044 bash[9859]: audit 2021-03-10T20:01:09.717344+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:01:12.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:11 gibba023 bash[9844]: cluster 2021-03-10T20:01:10.648316+0000 mgr.y (mgr.14140) 94 : cluster [DBG] pgmap v89: 1 pgs: 1 peering; 0 B data, 576 KiB used, 249 GiB / 252 GiB avail 2021-03-10T20:01:12.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:11 gibba023 bash[9844]: audit 2021-03-10T20:01:11.846535+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.2.123:0/2081866918' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:01:12.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:11 gibba023 bash[13032]: cluster 2021-03-10T20:01:10.648316+0000 mgr.y (mgr.14140) 94 : cluster [DBG] pgmap v89: 1 pgs: 1 peering; 0 B data, 576 KiB used, 249 GiB / 252 GiB avail 2021-03-10T20:01:12.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:11 gibba023 bash[13032]: audit 2021-03-10T20:01:11.846535+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.2.123:0/2081866918' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:01:12.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:11 gibba044 bash[9859]: cluster 2021-03-10T20:01:10.648316+0000 mgr.y (mgr.14140) 94 : cluster [DBG] pgmap v89: 1 pgs: 1 peering; 0 B data, 576 KiB used, 249 GiB / 252 GiB avail 2021-03-10T20:01:12.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:11 gibba044 bash[9859]: audit 2021-03-10T20:01:11.846535+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.2.123:0/2081866918' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:01:14.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:13 gibba044 bash[9859]: cluster 2021-03-10T20:01:12.649132+0000 mgr.y (mgr.14140) 95 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 608 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:01:14.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:13 gibba023 bash[9844]: cluster 2021-03-10T20:01:12.649132+0000 mgr.y (mgr.14140) 95 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 608 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:01:14.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:13 gibba023 bash[13032]: cluster 2021-03-10T20:01:12.649132+0000 mgr.y (mgr.14140) 95 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 608 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:01:15.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:14 gibba044 bash[9859]: audit 2021-03-10T20:01:14.512056+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:01:15.351 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:14 gibba023 bash[9844]: audit 2021-03-10T20:01:14.512056+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:01:15.352 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:14 gibba023 bash[13032]: audit 2021-03-10T20:01:14.512056+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:01:16.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:15 gibba044 bash[9859]: cluster 2021-03-10T20:01:14.649438+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 616 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:01:16.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:15 gibba023 bash[9844]: cluster 2021-03-10T20:01:14.649438+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 616 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:01:16.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:15 gibba023 bash[13032]: cluster 2021-03-10T20:01:14.649438+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 616 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:01:18.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:17 gibba044 bash[9859]: cluster 2021-03-10T20:01:16.650178+0000 mgr.y (mgr.14140) 97 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:01:18.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:17 gibba023 bash[9844]: cluster 2021-03-10T20:01:16.650178+0000 mgr.y (mgr.14140) 97 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:01:18.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:17 gibba023 bash[13032]: cluster 2021-03-10T20:01:16.650178+0000 mgr.y (mgr.14140) 97 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:01:19.234 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:18 gibba023 bash[9844]: audit 2021-03-10T20:01:18.030755+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-03-10T20:01:19.234 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:18 gibba023 bash[9844]: audit 2021-03-10T20:01:18.031559+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:01:19.235 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:18 gibba023 bash[9844]: cephadm 2021-03-10T20:01:18.032247+0000 mgr.y (mgr.14140) 98 : cephadm [INF] Deploying daemon osd.3 on gibba023 2021-03-10T20:01:19.235 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:18 gibba023 bash[9844]: audit 2021-03-10T20:01:18.032442+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-03-10T20:01:19.235 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:18 gibba023 bash[13032]: audit 2021-03-10T20:01:18.030755+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-03-10T20:01:19.235 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:18 gibba023 bash[13032]: audit 2021-03-10T20:01:18.031559+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:01:19.236 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:18 gibba023 bash[13032]: cephadm 2021-03-10T20:01:18.032247+0000 mgr.y (mgr.14140) 98 : cephadm [INF] Deploying daemon osd.3 on gibba023 2021-03-10T20:01:19.236 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:18 gibba023 bash[13032]: audit 2021-03-10T20:01:18.032442+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-03-10T20:01:19.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:18 gibba044 bash[9859]: audit 2021-03-10T20:01:18.030755+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-03-10T20:01:19.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:18 gibba044 bash[9859]: audit 2021-03-10T20:01:18.031559+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:01:19.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:18 gibba044 bash[9859]: cephadm 2021-03-10T20:01:18.032247+0000 mgr.y (mgr.14140) 98 : cephadm [INF] Deploying daemon osd.3 on gibba023 2021-03-10T20:01:19.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:18 gibba044 bash[9859]: audit 2021-03-10T20:01:18.032442+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-03-10T20:01:19.940 INFO:teuthology.orchestra.run.gibba023.stdout:Created osd(s) 3 on host 'gibba023' 2021-03-10T20:01:20.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:19 gibba023 bash[9844]: cluster 2021-03-10T20:01:18.651119+0000 mgr.y (mgr.14140) 99 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:01:20.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:19 gibba023 bash[13032]: cluster 2021-03-10T20:01:18.651119+0000 mgr.y (mgr.14140) 99 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:01:20.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:19 gibba023 bash[9844]: audit 2021-03-10T20:01:19.935592+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730530\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730587\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730616\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730642\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730668\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730694\", \"created\": \"2021-03-10T20:00:55.158947\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}}, \"last_device_update\": \"2021-03-10T20:01:04.230100\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:01:20.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:19 gibba023 bash[9844]: audit 2021-03-10T20:01:19.936150+0000 mon.a (mon.0) 321 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:01:20.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:19 gibba023 bash[9844]: audit 2021-03-10T20:01:19.939323+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730530\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730587\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730616\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730642\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730668\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730694\", \"created\": \"2021-03-10T20:00:55.158947\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}}, \"last_device_update\": \"2021-03-10T20:01:04.230100\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:01:20.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:19 gibba023 bash[13032]: audit 2021-03-10T20:01:19.935592+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730530\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730587\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730616\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730642\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730668\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730694\", \"created\": \"2021-03-10T20:00:55.158947\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}}, \"last_device_update\": \"2021-03-10T20:01:04.230100\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:01:20.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:19 gibba023 bash[13032]: audit 2021-03-10T20:01:19.936150+0000 mon.a (mon.0) 321 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:01:20.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:19 gibba023 bash[13032]: audit 2021-03-10T20:01:19.939323+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730530\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730587\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730616\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730642\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730668\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730694\", \"created\": \"2021-03-10T20:00:55.158947\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}}, \"last_device_update\": \"2021-03-10T20:01:04.230100\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:01:20.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:19 gibba044 bash[9859]: cluster 2021-03-10T20:01:18.651119+0000 mgr.y (mgr.14140) 99 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:01:20.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:19 gibba044 bash[9859]: audit 2021-03-10T20:01:19.935592+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730530\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730587\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730616\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730642\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730668\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730694\", \"created\": \"2021-03-10T20:00:55.158947\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}}, \"last_device_update\": \"2021-03-10T20:01:04.230100\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:01:20.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:19 gibba044 bash[9859]: audit 2021-03-10T20:01:19.936150+0000 mon.a (mon.0) 321 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:01:20.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:19 gibba044 bash[9859]: audit 2021-03-10T20:01:19.939323+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730530\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730587\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730616\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730642\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730668\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:00:55.730694\", \"created\": \"2021-03-10T20:00:55.158947\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}}, \"last_device_update\": \"2021-03-10T20:01:04.230100\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:01:21.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:20 gibba044 bash[9859]: audit 2021-03-10T20:01:20.487954+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487092\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487151\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487181\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487208\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487235\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487260\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487287\", \"created\": \"2021-03-10T20:01:19.922947\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}}, \"last_daemon_update\": \"2021-03-10T20:01:20.487336\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:01:21.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:20 gibba044 bash[9859]: audit 2021-03-10T20:01:20.492206+0000 mon.a (mon.0) 324 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487092\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487151\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487181\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487208\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487235\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487260\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487287\", \"created\": \"2021-03-10T20:01:19.922947\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}}, \"last_daemon_update\": \"2021-03-10T20:01:20.487336\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:01:21.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:20 gibba044 bash[9859]: audit 2021-03-10T20:01:20.492695+0000 mon.a (mon.0) 325 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:01:21.320 DEBUG:teuthology.orchestra.run.gibba023:osd.3> sudo journalctl -f -n 0 -u ceph-dd719b26-81da-11eb-9080-001a4aab830c@osd.3.service 2021-03-10T20:01:21.321 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:20 gibba023 bash[9844]: audit 2021-03-10T20:01:20.487954+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487092\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487151\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487181\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487208\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487235\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487260\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487287\", \"created\": \"2021-03-10T20:01:19.922947\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}}, \"last_daemon_update\": \"2021-03-10T20:01:20.487336\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:01:21.321 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:20 gibba023 bash[9844]: audit 2021-03-10T20:01:20.492206+0000 mon.a (mon.0) 324 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487092\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487151\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487181\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487208\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487235\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487260\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487287\", \"created\": \"2021-03-10T20:01:19.922947\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}}, \"last_daemon_update\": \"2021-03-10T20:01:20.487336\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:01:21.322 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:20 gibba023 bash[9844]: audit 2021-03-10T20:01:20.492695+0000 mon.a (mon.0) 325 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:01:21.322 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:20 gibba023 bash[13032]: audit 2021-03-10T20:01:20.487954+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487092\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487151\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487181\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487208\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487235\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487260\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487287\", \"created\": \"2021-03-10T20:01:19.922947\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}}, \"last_daemon_update\": \"2021-03-10T20:01:20.487336\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:01:21.323 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:20 gibba023 bash[13032]: audit 2021-03-10T20:01:20.492206+0000 mon.a (mon.0) 324 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487092\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487151\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487181\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487208\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487235\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487260\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487287\", \"created\": \"2021-03-10T20:01:19.922947\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}}, \"last_daemon_update\": \"2021-03-10T20:01:20.487336\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:01:21.323 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:20 gibba023 bash[13032]: audit 2021-03-10T20:01:20.492695+0000 mon.a (mon.0) 325 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:01:21.325 INFO:tasks.cephadm:Deploying osd.4 on gibba044 with /dev/vg_nvme/lv_4... 2021-03-10T20:01:21.326 DEBUG:teuthology.orchestra.run.gibba044:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-03-10T20:01:21.402 INFO:journalctl@ceph.osd.3.gibba023.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:01:22.148 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:21 gibba023 bash[9844]: cluster 2021-03-10T20:01:20.651817+0000 mgr.y (mgr.14140) 100 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:01:22.149 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:21 gibba023 bash[13032]: cluster 2021-03-10T20:01:20.651817+0000 mgr.y (mgr.14140) 100 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:01:22.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:21 gibba044 bash[9859]: cluster 2021-03-10T20:01:20.651817+0000 mgr.y (mgr.14140) 100 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:01:22.697 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:01:22 gibba023 bash[19009]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-03-10T20:01:22.698 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:01:22 gibba023 bash[19009]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2021-03-10T20:01:22.698 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:01:22 gibba023 bash[19009]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2021-03-10T20:01:22.698 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:01:22 gibba023 bash[19009]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2021-03-10T20:01:22.698 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:01:22 gibba023 bash[19009]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-03-10T20:01:22.699 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:01:22 gibba023 bash[19009]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-03-10T20:01:22.699 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:01:22 gibba023 bash[19009]: --> ceph-volume lvm activate successful for osd ID: 3 2021-03-10T20:01:24.107 INFO:teuthology.orchestra.run.gibba044.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-03-10T20:01:24.107 INFO:teuthology.orchestra.run.gibba044.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-03-10T20:01:24.108 INFO:teuthology.orchestra.run.gibba044.stderr: stderr: 10+0 records in 2021-03-10T20:01:24.108 INFO:teuthology.orchestra.run.gibba044.stderr:10+0 records out 2021-03-10T20:01:24.108 INFO:teuthology.orchestra.run.gibba044.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0104981 s, 999 MB/s 2021-03-10T20:01:24.108 INFO:teuthology.orchestra.run.gibba044.stderr:--> Zapping successful for: 2021-03-10T20:01:24.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:23 gibba044 bash[9859]: cluster 2021-03-10T20:01:22.652626+0000 mgr.y (mgr.14140) 101 : cluster [DBG] pgmap v95: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:01:24.385 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:23 gibba023 bash[9844]: cluster 2021-03-10T20:01:22.652626+0000 mgr.y (mgr.14140) 101 : cluster [DBG] pgmap v95: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:01:24.386 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:23 gibba023 bash[13032]: cluster 2021-03-10T20:01:22.652626+0000 mgr.y (mgr.14140) 101 : cluster [DBG] pgmap v95: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:01:24.675 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:01:24 gibba023 bash[19342]: debug 2021-03-10T20:01:24.538+0000 7f2629763ec0 1 -- 172.21.2.123:0/311450671 >> [v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0] conn(0x560bc6c12c00 msgr2=0x560bc6c0f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2021-03-10T20:01:24.676 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:01:24 gibba023 bash[19342]: debug 2021-03-10T20:01:24.538+0000 7f2629763ec0 1 --2- 172.21.2.123:0/311450671 >> [v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0] conn(0x560bc6c12c00 0x560bc6c0f680 secure :-1 s=READY pgs=99 cs=0 l=1 rx=0x560bc6ba9e90 tx=0x560bc7888aa0).stop 2021-03-10T20:01:24.738 DEBUG:teuthology.orchestra.run.gibba044:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba044:vg_nvme/lv_4 2021-03-10T20:01:25.425 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:01:25 gibba023 bash[19342]: debug 2021-03-10T20:01:25.102+0000 7f2629763ec0 -1 Falling back to public interface 2021-03-10T20:01:25.911 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:25 gibba044 bash[9859]: cluster 2021-03-10T20:01:24.652938+0000 mgr.y (mgr.14140) 102 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T20:01:25.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:25 gibba023 bash[9844]: cluster 2021-03-10T20:01:24.652938+0000 mgr.y (mgr.14140) 102 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T20:01:25.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:25 gibba023 bash[13032]: cluster 2021-03-10T20:01:24.652938+0000 mgr.y (mgr.14140) 102 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T20:01:25.926 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:01:25 gibba023 bash[19342]: debug 2021-03-10T20:01:25.742+0000 7f2629763ec0 -1 osd.3 0 log_to_monitors {default=true} 2021-03-10T20:01:26.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:26 gibba023 bash[9844]: audit 2021-03-10T20:01:25.750094+0000 mon.c (mon.1) 15 : audit [INF] from='osd.3 [v2:172.21.2.123:6826/161452900,v1:172.21.2.123:6827/161452900]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T20:01:26.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:26 gibba023 bash[9844]: audit 2021-03-10T20:01:25.750394+0000 mon.a (mon.0) 326 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T20:01:26.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:26 gibba023 bash[9844]: audit 2021-03-10T20:01:26.331034+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:01:26.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:26 gibba023 bash[13032]: audit 2021-03-10T20:01:25.750094+0000 mon.c (mon.1) 15 : audit [INF] from='osd.3 [v2:172.21.2.123:6826/161452900,v1:172.21.2.123:6827/161452900]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T20:01:26.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:26 gibba023 bash[13032]: audit 2021-03-10T20:01:25.750394+0000 mon.a (mon.0) 326 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T20:01:26.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:26 gibba023 bash[13032]: audit 2021-03-10T20:01:26.331034+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:01:26.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:26 gibba023 bash[9844]: audit 2021-03-10T20:01:26.426848+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487092\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487151\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487181\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487208\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487235\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487260\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487287\", \"created\": \"2021-03-10T20:01:19.922947\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}}, \"last_daemon_update\": \"2021-03-10T20:01:20.487336\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:01:26.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:26 gibba023 bash[9844]: audit 2021-03-10T20:01:26.431289+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487092\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487151\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487181\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487208\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487235\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487260\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487287\", \"created\": \"2021-03-10T20:01:19.922947\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}}, \"last_daemon_update\": \"2021-03-10T20:01:20.487336\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:01:26.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:26 gibba023 bash[13032]: audit 2021-03-10T20:01:26.426848+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487092\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487151\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487181\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487208\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487235\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487260\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487287\", \"created\": \"2021-03-10T20:01:19.922947\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}}, \"last_daemon_update\": \"2021-03-10T20:01:20.487336\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:01:26.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:26 gibba023 bash[13032]: audit 2021-03-10T20:01:26.431289+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487092\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487151\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487181\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487208\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487235\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487260\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487287\", \"created\": \"2021-03-10T20:01:19.922947\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}}, \"last_daemon_update\": \"2021-03-10T20:01:20.487336\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:01:27.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:26 gibba044 bash[9859]: audit 2021-03-10T20:01:25.750094+0000 mon.c (mon.1) 15 : audit [INF] from='osd.3 [v2:172.21.2.123:6826/161452900,v1:172.21.2.123:6827/161452900]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T20:01:27.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:26 gibba044 bash[9859]: audit 2021-03-10T20:01:25.750394+0000 mon.a (mon.0) 326 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T20:01:27.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:26 gibba044 bash[9859]: audit 2021-03-10T20:01:26.331034+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:01:27.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:26 gibba044 bash[9859]: audit 2021-03-10T20:01:26.426848+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487092\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487151\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487181\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487208\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487235\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487260\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487287\", \"created\": \"2021-03-10T20:01:19.922947\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}}, \"last_daemon_update\": \"2021-03-10T20:01:20.487336\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:01:27.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:26 gibba044 bash[9859]: audit 2021-03-10T20:01:26.431289+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487092\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487151\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487181\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487208\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487235\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487260\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487287\", \"created\": \"2021-03-10T20:01:19.922947\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}}, \"last_daemon_update\": \"2021-03-10T20:01:20.487336\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:01:27.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:27 gibba044 bash[9859]: cluster 2021-03-10T20:01:26.653463+0000 mgr.y (mgr.14140) 103 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T20:01:27.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:27 gibba044 bash[9859]: audit 2021-03-10T20:01:26.664026+0000 mon.a (mon.0) 330 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T20:01:27.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:27 gibba044 bash[9859]: cluster 2021-03-10T20:01:26.664071+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2021-03-10T20:01:27.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:27 gibba044 bash[9859]: audit 2021-03-10T20:01:26.664623+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:01:27.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:27 gibba044 bash[9859]: audit 2021-03-10T20:01:26.664651+0000 mon.c (mon.1) 16 : audit [INF] from='osd.3 [v2:172.21.2.123:6826/161452900,v1:172.21.2.123:6827/161452900]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:01:27.758 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:27 gibba044 bash[9859]: audit 2021-03-10T20:01:26.664931+0000 mon.a (mon.0) 333 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:01:27.758 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:27 gibba044 bash[9859]: audit 2021-03-10T20:01:27.302875+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:01:27.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:27 gibba044 bash[9859]: audit 2021-03-10T20:01:27.305645+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:01:27.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:27 gibba044 bash[9859]: audit 2021-03-10T20:01:27.309591+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:01:27.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:27 gibba044 bash[9859]: audit 2021-03-10T20:01:27.668462+0000 mon.a (mon.0) 337 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]': finished 2021-03-10T20:01:27.760 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:27 gibba044 bash[9859]: cluster 2021-03-10T20:01:27.668603+0000 mon.a (mon.0) 338 : cluster [DBG] osdmap e26: 4 total, 3 up, 3 in 2021-03-10T20:01:27.760 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:27 gibba044 bash[9859]: audit 2021-03-10T20:01:27.668954+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:01:27.926 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:01:27 gibba023 bash[19342]: debug 2021-03-10T20:01:27.666+0000 7f260e510700 -1 osd.3 0 waiting for initial osdmap 2021-03-10T20:01:27.927 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:01:27 gibba023 bash[19342]: debug 2021-03-10T20:01:27.670+0000 7f261972c700 -1 osd.3 26 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:01:27.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:27 gibba023 bash[9844]: cluster 2021-03-10T20:01:26.653463+0000 mgr.y (mgr.14140) 103 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T20:01:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:27 gibba023 bash[9844]: audit 2021-03-10T20:01:26.664026+0000 mon.a (mon.0) 330 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T20:01:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:27 gibba023 bash[9844]: cluster 2021-03-10T20:01:26.664071+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2021-03-10T20:01:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:27 gibba023 bash[9844]: audit 2021-03-10T20:01:26.664623+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:01:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:27 gibba023 bash[9844]: audit 2021-03-10T20:01:26.664651+0000 mon.c (mon.1) 16 : audit [INF] from='osd.3 [v2:172.21.2.123:6826/161452900,v1:172.21.2.123:6827/161452900]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:01:27.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:27 gibba023 bash[9844]: audit 2021-03-10T20:01:26.664931+0000 mon.a (mon.0) 333 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:01:27.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:27 gibba023 bash[9844]: audit 2021-03-10T20:01:27.302875+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:01:27.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:27 gibba023 bash[9844]: audit 2021-03-10T20:01:27.305645+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:01:27.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:27 gibba023 bash[9844]: audit 2021-03-10T20:01:27.309591+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:01:27.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:27 gibba023 bash[9844]: audit 2021-03-10T20:01:27.668462+0000 mon.a (mon.0) 337 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]': finished 2021-03-10T20:01:27.932 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:27 gibba023 bash[9844]: cluster 2021-03-10T20:01:27.668603+0000 mon.a (mon.0) 338 : cluster [DBG] osdmap e26: 4 total, 3 up, 3 in 2021-03-10T20:01:27.932 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:27 gibba023 bash[9844]: audit 2021-03-10T20:01:27.668954+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:01:27.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:27 gibba023 bash[13032]: cluster 2021-03-10T20:01:26.653463+0000 mgr.y (mgr.14140) 103 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T20:01:27.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:27 gibba023 bash[13032]: audit 2021-03-10T20:01:26.664026+0000 mon.a (mon.0) 330 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T20:01:27.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:27 gibba023 bash[13032]: cluster 2021-03-10T20:01:26.664071+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2021-03-10T20:01:27.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:27 gibba023 bash[13032]: audit 2021-03-10T20:01:26.664623+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:01:27.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:27 gibba023 bash[13032]: audit 2021-03-10T20:01:26.664651+0000 mon.c (mon.1) 16 : audit [INF] from='osd.3 [v2:172.21.2.123:6826/161452900,v1:172.21.2.123:6827/161452900]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:01:27.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:27 gibba023 bash[13032]: audit 2021-03-10T20:01:26.664931+0000 mon.a (mon.0) 333 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:01:27.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:27 gibba023 bash[13032]: audit 2021-03-10T20:01:27.302875+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:01:27.936 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:27 gibba023 bash[13032]: audit 2021-03-10T20:01:27.305645+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:01:27.936 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:27 gibba023 bash[13032]: audit 2021-03-10T20:01:27.309591+0000 mon.a (mon.0) 336 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:01:27.937 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:27 gibba023 bash[13032]: audit 2021-03-10T20:01:27.668462+0000 mon.a (mon.0) 337 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]': finished 2021-03-10T20:01:27.937 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:27 gibba023 bash[13032]: cluster 2021-03-10T20:01:27.668603+0000 mon.a (mon.0) 338 : cluster [DBG] osdmap e26: 4 total, 3 up, 3 in 2021-03-10T20:01:27.937 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:27 gibba023 bash[13032]: audit 2021-03-10T20:01:27.668954+0000 mon.a (mon.0) 339 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:01:28.973 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:28 gibba044 bash[9859]: cluster 2021-03-10T20:01:26.776503+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:01:28.974 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:28 gibba044 bash[9859]: cluster 2021-03-10T20:01:26.776640+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:01:28.974 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:28 gibba044 bash[9859]: audit 2021-03-10T20:01:27.299531+0000 mgr.y (mgr.14140) 104 : audit [DBG] from='client.34121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:01:28.974 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:28 gibba044 bash[9859]: cephadm 2021-03-10T20:01:27.302020+0000 mgr.y (mgr.14140) 105 : cephadm [INF] Applying osd on host gibba044... 2021-03-10T20:01:29.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:28 gibba023 bash[9844]: cluster 2021-03-10T20:01:26.776503+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:01:29.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:28 gibba023 bash[9844]: cluster 2021-03-10T20:01:26.776640+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:01:29.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:28 gibba023 bash[9844]: audit 2021-03-10T20:01:27.299531+0000 mgr.y (mgr.14140) 104 : audit [DBG] from='client.34121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:01:29.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:28 gibba023 bash[9844]: cephadm 2021-03-10T20:01:27.302020+0000 mgr.y (mgr.14140) 105 : cephadm [INF] Applying osd on host gibba044... 2021-03-10T20:01:29.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:28 gibba023 bash[13032]: cluster 2021-03-10T20:01:26.776503+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:01:29.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:28 gibba023 bash[13032]: cluster 2021-03-10T20:01:26.776640+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:01:29.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:28 gibba023 bash[13032]: audit 2021-03-10T20:01:27.299531+0000 mgr.y (mgr.14140) 104 : audit [DBG] from='client.34121 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba044:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:01:29.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:28 gibba023 bash[13032]: cephadm 2021-03-10T20:01:27.302020+0000 mgr.y (mgr.14140) 105 : cephadm [INF] Applying osd on host gibba044... 2021-03-10T20:01:30.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:29 gibba044 bash[9859]: cluster 2021-03-10T20:01:28.654458+0000 mgr.y (mgr.14140) 106 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T20:01:30.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:29 gibba044 bash[9859]: cluster 2021-03-10T20:01:28.682041+0000 mon.a (mon.0) 340 : cluster [INF] osd.3 [v2:172.21.2.123:6826/161452900,v1:172.21.2.123:6827/161452900] boot 2021-03-10T20:01:30.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:29 gibba044 bash[9859]: cluster 2021-03-10T20:01:28.682111+0000 mon.a (mon.0) 341 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2021-03-10T20:01:30.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:29 gibba044 bash[9859]: audit 2021-03-10T20:01:28.682621+0000 mon.a (mon.0) 342 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:01:30.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:29 gibba023 bash[9844]: cluster 2021-03-10T20:01:28.654458+0000 mgr.y (mgr.14140) 106 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T20:01:30.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:29 gibba023 bash[9844]: cluster 2021-03-10T20:01:28.682041+0000 mon.a (mon.0) 340 : cluster [INF] osd.3 [v2:172.21.2.123:6826/161452900,v1:172.21.2.123:6827/161452900] boot 2021-03-10T20:01:30.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:29 gibba023 bash[9844]: cluster 2021-03-10T20:01:28.682111+0000 mon.a (mon.0) 341 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2021-03-10T20:01:30.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:29 gibba023 bash[9844]: audit 2021-03-10T20:01:28.682621+0000 mon.a (mon.0) 342 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:01:30.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:29 gibba023 bash[13032]: cluster 2021-03-10T20:01:28.654458+0000 mgr.y (mgr.14140) 106 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 624 KiB used, 249 GiB / 252 GiB avail 2021-03-10T20:01:30.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:29 gibba023 bash[13032]: cluster 2021-03-10T20:01:28.682041+0000 mon.a (mon.0) 340 : cluster [INF] osd.3 [v2:172.21.2.123:6826/161452900,v1:172.21.2.123:6827/161452900] boot 2021-03-10T20:01:30.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:29 gibba023 bash[13032]: cluster 2021-03-10T20:01:28.682111+0000 mon.a (mon.0) 341 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2021-03-10T20:01:30.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:29 gibba023 bash[13032]: audit 2021-03-10T20:01:28.682621+0000 mon.a (mon.0) 342 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:01:31.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:30 gibba044 bash[9859]: cluster 2021-03-10T20:01:29.693943+0000 mon.a (mon.0) 343 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2021-03-10T20:01:31.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:30 gibba044 bash[9859]: audit 2021-03-10T20:01:30.363935+0000 mon.b (mon.2) 7 : audit [INF] from='client.? 172.21.2.144:0/4112576957' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f824eb9a-50e5-46f0-a070-ab633188e079"}]: dispatch 2021-03-10T20:01:31.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:30 gibba044 bash[9859]: audit 2021-03-10T20:01:30.367182+0000 mon.a (mon.0) 344 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f824eb9a-50e5-46f0-a070-ab633188e079"}]: dispatch 2021-03-10T20:01:31.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:30 gibba044 bash[9859]: audit 2021-03-10T20:01:30.378622+0000 mon.a (mon.0) 345 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f824eb9a-50e5-46f0-a070-ab633188e079"}]': finished 2021-03-10T20:01:31.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:30 gibba044 bash[9859]: cluster 2021-03-10T20:01:30.378729+0000 mon.a (mon.0) 346 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2021-03-10T20:01:31.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:30 gibba044 bash[9859]: audit 2021-03-10T20:01:30.378884+0000 mon.a (mon.0) 347 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:01:31.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:30 gibba023 bash[9844]: cluster 2021-03-10T20:01:29.693943+0000 mon.a (mon.0) 343 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2021-03-10T20:01:31.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:30 gibba023 bash[9844]: audit 2021-03-10T20:01:30.363935+0000 mon.b (mon.2) 7 : audit [INF] from='client.? 172.21.2.144:0/4112576957' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f824eb9a-50e5-46f0-a070-ab633188e079"}]: dispatch 2021-03-10T20:01:31.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:30 gibba023 bash[9844]: audit 2021-03-10T20:01:30.367182+0000 mon.a (mon.0) 344 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f824eb9a-50e5-46f0-a070-ab633188e079"}]: dispatch 2021-03-10T20:01:31.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:30 gibba023 bash[9844]: audit 2021-03-10T20:01:30.378622+0000 mon.a (mon.0) 345 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f824eb9a-50e5-46f0-a070-ab633188e079"}]': finished 2021-03-10T20:01:31.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:30 gibba023 bash[9844]: cluster 2021-03-10T20:01:30.378729+0000 mon.a (mon.0) 346 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2021-03-10T20:01:31.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:30 gibba023 bash[9844]: audit 2021-03-10T20:01:30.378884+0000 mon.a (mon.0) 347 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:01:31.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:30 gibba023 bash[13032]: cluster 2021-03-10T20:01:29.693943+0000 mon.a (mon.0) 343 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2021-03-10T20:01:31.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:30 gibba023 bash[13032]: audit 2021-03-10T20:01:30.363935+0000 mon.b (mon.2) 7 : audit [INF] from='client.? 172.21.2.144:0/4112576957' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f824eb9a-50e5-46f0-a070-ab633188e079"}]: dispatch 2021-03-10T20:01:31.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:30 gibba023 bash[13032]: audit 2021-03-10T20:01:30.367182+0000 mon.a (mon.0) 344 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f824eb9a-50e5-46f0-a070-ab633188e079"}]: dispatch 2021-03-10T20:01:31.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:30 gibba023 bash[13032]: audit 2021-03-10T20:01:30.378622+0000 mon.a (mon.0) 345 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f824eb9a-50e5-46f0-a070-ab633188e079"}]': finished 2021-03-10T20:01:31.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:30 gibba023 bash[13032]: cluster 2021-03-10T20:01:30.378729+0000 mon.a (mon.0) 346 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2021-03-10T20:01:31.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:30 gibba023 bash[13032]: audit 2021-03-10T20:01:30.378884+0000 mon.a (mon.0) 347 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:01:32.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:31 gibba044 bash[9859]: cluster 2021-03-10T20:01:30.655346+0000 mgr.y (mgr.14140) 107 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 864 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:32.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:31 gibba023 bash[9844]: cluster 2021-03-10T20:01:30.655346+0000 mgr.y (mgr.14140) 107 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 864 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:32.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:31 gibba023 bash[13032]: cluster 2021-03-10T20:01:30.655346+0000 mgr.y (mgr.14140) 107 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 864 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:33.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:32 gibba044 bash[9859]: audit 2021-03-10T20:01:32.393417+0000 mon.b (mon.2) 8 : audit [DBG] from='client.? 172.21.2.144:0/2709330002' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:01:33.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:32 gibba023 bash[9844]: audit 2021-03-10T20:01:32.393417+0000 mon.b (mon.2) 8 : audit [DBG] from='client.? 172.21.2.144:0/2709330002' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:01:33.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:32 gibba023 bash[13032]: audit 2021-03-10T20:01:32.393417+0000 mon.b (mon.2) 8 : audit [DBG] from='client.? 172.21.2.144:0/2709330002' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:01:34.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:33 gibba044 bash[9859]: cluster 2021-03-10T20:01:32.656243+0000 mgr.y (mgr.14140) 108 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 912 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:34.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:33 gibba023 bash[9844]: cluster 2021-03-10T20:01:32.656243+0000 mgr.y (mgr.14140) 108 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 912 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:34.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:33 gibba023 bash[13032]: cluster 2021-03-10T20:01:32.656243+0000 mgr.y (mgr.14140) 108 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 912 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:35.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:35 gibba023 bash[9844]: cluster 2021-03-10T20:01:34.656771+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 944 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:35.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:35 gibba023 bash[9844]: audit 2021-03-10T20:01:34.995436+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:01:35.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:35 gibba023 bash[13032]: cluster 2021-03-10T20:01:34.656771+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 944 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:35.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:35 gibba023 bash[13032]: audit 2021-03-10T20:01:34.995436+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:01:35.963 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:35 gibba044 bash[9859]: cluster 2021-03-10T20:01:34.656771+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 944 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:35.964 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:35 gibba044 bash[9859]: audit 2021-03-10T20:01:34.995436+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:01:37.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:37 gibba023 bash[9844]: cluster 2021-03-10T20:01:36.657585+0000 mgr.y (mgr.14140) 110 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 976 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:37.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:37 gibba023 bash[13032]: cluster 2021-03-10T20:01:36.657585+0000 mgr.y (mgr.14140) 110 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 976 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:38.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:37 gibba044 bash[9859]: cluster 2021-03-10T20:01:36.657585+0000 mgr.y (mgr.14140) 110 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 976 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:39.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:38 gibba044 bash[9859]: audit 2021-03-10T20:01:38.064893+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-03-10T20:01:39.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:38 gibba044 bash[9859]: audit 2021-03-10T20:01:38.067821+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:01:39.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:38 gibba044 bash[9859]: cephadm 2021-03-10T20:01:38.070206+0000 mgr.y (mgr.14140) 111 : cephadm [INF] Deploying daemon osd.4 on gibba044 2021-03-10T20:01:39.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:38 gibba044 bash[9859]: audit 2021-03-10T20:01:38.071174+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-03-10T20:01:39.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:38 gibba023 bash[9844]: audit 2021-03-10T20:01:38.064893+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-03-10T20:01:39.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:38 gibba023 bash[9844]: audit 2021-03-10T20:01:38.067821+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:01:39.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:38 gibba023 bash[9844]: cephadm 2021-03-10T20:01:38.070206+0000 mgr.y (mgr.14140) 111 : cephadm [INF] Deploying daemon osd.4 on gibba044 2021-03-10T20:01:39.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:38 gibba023 bash[9844]: audit 2021-03-10T20:01:38.071174+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-03-10T20:01:39.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:38 gibba023 bash[13032]: audit 2021-03-10T20:01:38.064893+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-03-10T20:01:39.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:38 gibba023 bash[13032]: audit 2021-03-10T20:01:38.067821+0000 mon.a (mon.0) 350 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:01:39.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:38 gibba023 bash[13032]: cephadm 2021-03-10T20:01:38.070206+0000 mgr.y (mgr.14140) 111 : cephadm [INF] Deploying daemon osd.4 on gibba044 2021-03-10T20:01:39.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:38 gibba023 bash[13032]: audit 2021-03-10T20:01:38.071174+0000 mon.a (mon.0) 351 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-03-10T20:01:39.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:39 gibba044 bash[9859]: cluster 2021-03-10T20:01:38.658509+0000 mgr.y (mgr.14140) 112 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:39.785 INFO:teuthology.orchestra.run.gibba044.stdout:Created osd(s) 4 on host 'gibba044' 2021-03-10T20:01:40.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:39 gibba023 bash[9844]: cluster 2021-03-10T20:01:38.658509+0000 mgr.y (mgr.14140) 112 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:40.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:39 gibba023 bash[13032]: cluster 2021-03-10T20:01:38.658509+0000 mgr.y (mgr.14140) 112 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:40.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:40 gibba044 bash[9859]: audit 2021-03-10T20:01:39.773318+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073317\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073577\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073746\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}}, \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:01:40.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:40 gibba044 bash[9859]: audit 2021-03-10T20:01:39.774809+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:01:40.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:40 gibba044 bash[9859]: audit 2021-03-10T20:01:39.782256+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073317\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073577\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073746\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}}, \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:01:40.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:40 gibba044 bash[9859]: audit 2021-03-10T20:01:40.323982+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321025\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321295\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321464\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321622\", \"created\": \"2021-03-10T20:01:39.757721\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}}, \"last_daemon_update\": \"2021-03-10T20:01:40.321884\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:01:40.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:40 gibba044 bash[9859]: audit 2021-03-10T20:01:40.332777+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321025\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321295\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321464\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321622\", \"created\": \"2021-03-10T20:01:39.757721\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}}, \"last_daemon_update\": \"2021-03-10T20:01:40.321884\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:01:40.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:40 gibba044 bash[9859]: audit 2021-03-10T20:01:40.333410+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:01:40.895 DEBUG:teuthology.orchestra.run.gibba044:osd.4> sudo journalctl -f -n 0 -u ceph-dd719b26-81da-11eb-9080-001a4aab830c@osd.4.service 2021-03-10T20:01:40.898 INFO:tasks.cephadm:Deploying osd.5 on gibba044 with /dev/vg_nvme/lv_3... 2021-03-10T20:01:40.898 DEBUG:teuthology.orchestra.run.gibba044:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-03-10T20:01:41.147 INFO:journalctl@ceph.osd.4.gibba044.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:01:41.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:40 gibba023 bash[9844]: audit 2021-03-10T20:01:39.773318+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073317\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073577\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073746\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}}, \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:01:41.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:40 gibba023 bash[9844]: audit 2021-03-10T20:01:39.774809+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:01:41.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:40 gibba023 bash[13032]: audit 2021-03-10T20:01:39.773318+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073317\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073577\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073746\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}}, \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:01:41.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:40 gibba023 bash[13032]: audit 2021-03-10T20:01:39.774809+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:01:41.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:40 gibba023 bash[9844]: audit 2021-03-10T20:01:39.782256+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073317\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073577\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073746\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}}, \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:01:41.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:40 gibba023 bash[13032]: audit 2021-03-10T20:01:39.782256+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073317\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073577\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T19:59:54.073746\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}}, \"last_device_update\": \"2021-03-10T19:59:08.896693\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:01:41.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:40 gibba023 bash[9844]: audit 2021-03-10T20:01:40.323982+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321025\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321295\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321464\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321622\", \"created\": \"2021-03-10T20:01:39.757721\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}}, \"last_daemon_update\": \"2021-03-10T20:01:40.321884\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:01:41.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:40 gibba023 bash[13032]: audit 2021-03-10T20:01:40.323982+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321025\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321295\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321464\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321622\", \"created\": \"2021-03-10T20:01:39.757721\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}}, \"last_daemon_update\": \"2021-03-10T20:01:40.321884\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:01:41.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:40 gibba023 bash[9844]: audit 2021-03-10T20:01:40.332777+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321025\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321295\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321464\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321622\", \"created\": \"2021-03-10T20:01:39.757721\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}}, \"last_daemon_update\": \"2021-03-10T20:01:40.321884\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:01:41.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:40 gibba023 bash[9844]: audit 2021-03-10T20:01:40.333410+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:01:41.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:40 gibba023 bash[13032]: audit 2021-03-10T20:01:40.332777+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321025\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321295\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321464\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321622\", \"created\": \"2021-03-10T20:01:39.757721\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}}, \"last_daemon_update\": \"2021-03-10T20:01:40.321884\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:01:41.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:40 gibba023 bash[13032]: audit 2021-03-10T20:01:40.333410+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:01:41.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:41 gibba023 bash[9844]: cluster 2021-03-10T20:01:40.659315+0000 mgr.y (mgr.14140) 113 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:41.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:41 gibba023 bash[13032]: cluster 2021-03-10T20:01:40.659315+0000 mgr.y (mgr.14140) 113 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:41.966 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:41 gibba044 bash[9859]: cluster 2021-03-10T20:01:40.659315+0000 mgr.y (mgr.14140) 113 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:42.239 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:01:41 gibba044 bash[11923]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-03-10T20:01:42.239 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:01:41 gibba044 bash[11923]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2021-03-10T20:01:42.240 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:01:41 gibba044 bash[11923]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2021-03-10T20:01:42.240 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:01:41 gibba044 bash[11923]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2021-03-10T20:01:42.240 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:01:41 gibba044 bash[11923]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-03-10T20:01:42.240 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:01:41 gibba044 bash[11923]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-03-10T20:01:42.240 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:01:41 gibba044 bash[11923]: --> ceph-volume lvm activate successful for osd ID: 4 2021-03-10T20:01:44.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:43 gibba044 bash[9859]: cluster 2021-03-10T20:01:42.660292+0000 mgr.y (mgr.14140) 114 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:44.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:43 gibba023 bash[9844]: cluster 2021-03-10T20:01:42.660292+0000 mgr.y (mgr.14140) 114 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:44.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:43 gibba023 bash[13032]: cluster 2021-03-10T20:01:42.660292+0000 mgr.y (mgr.14140) 114 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:45.668 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:01:45 gibba044 bash[12230]: debug 2021-03-10T20:01:45.261+0000 7f80fdf1cec0 -1 Falling back to public interface 2021-03-10T20:01:45.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:45 gibba023 bash[9844]: cluster 2021-03-10T20:01:44.660726+0000 mgr.y (mgr.14140) 115 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:45.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:45 gibba023 bash[13032]: cluster 2021-03-10T20:01:44.660726+0000 mgr.y (mgr.14140) 115 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:45.973 INFO:teuthology.orchestra.run.gibba044.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-03-10T20:01:45.973 INFO:teuthology.orchestra.run.gibba044.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-03-10T20:01:45.974 INFO:teuthology.orchestra.run.gibba044.stderr: stderr: 10+0 records in 2021-03-10T20:01:45.974 INFO:teuthology.orchestra.run.gibba044.stderr:10+0 records out 2021-03-10T20:01:45.974 INFO:teuthology.orchestra.run.gibba044.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00908349 s, 1.2 GB/s 2021-03-10T20:01:45.974 INFO:teuthology.orchestra.run.gibba044.stderr:--> Zapping successful for: 2021-03-10T20:01:46.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:45 gibba044 bash[9859]: cluster 2021-03-10T20:01:44.660726+0000 mgr.y (mgr.14140) 115 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:46.005 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:01:45 gibba044 bash[12230]: debug 2021-03-10T20:01:45.909+0000 7f80fdf1cec0 -1 osd.4 0 log_to_monitors {default=true} 2021-03-10T20:01:46.834 DEBUG:teuthology.orchestra.run.gibba044:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba044:vg_nvme/lv_3 2021-03-10T20:01:46.922 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:46 gibba044 bash[9859]: audit 2021-03-10T20:01:45.916861+0000 mon.b (mon.2) 9 : audit [INF] from='osd.4 [v2:172.21.2.144:6800/165091654,v1:172.21.2.144:6801/165091654]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T20:01:46.922 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:46 gibba044 bash[9859]: audit 2021-03-10T20:01:45.919844+0000 mon.a (mon.0) 358 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T20:01:46.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:46 gibba023 bash[9844]: audit 2021-03-10T20:01:45.916861+0000 mon.b (mon.2) 9 : audit [INF] from='osd.4 [v2:172.21.2.144:6800/165091654,v1:172.21.2.144:6801/165091654]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T20:01:46.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:46 gibba023 bash[9844]: audit 2021-03-10T20:01:45.919844+0000 mon.a (mon.0) 358 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T20:01:46.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:46 gibba023 bash[13032]: audit 2021-03-10T20:01:45.916861+0000 mon.b (mon.2) 9 : audit [INF] from='osd.4 [v2:172.21.2.144:6800/165091654,v1:172.21.2.144:6801/165091654]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T20:01:46.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:46 gibba023 bash[13032]: audit 2021-03-10T20:01:45.919844+0000 mon.a (mon.0) 358 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T20:01:48.005 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:01:47 gibba044 bash[12230]: debug 2021-03-10T20:01:47.697+0000 7f80e2cc9700 -1 osd.4 0 waiting for initial osdmap 2021-03-10T20:01:48.005 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:01:47 gibba044 bash[12230]: debug 2021-03-10T20:01:47.701+0000 7f80edee5700 -1 osd.4 31 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:01:48.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:47 gibba044 bash[9859]: cluster 2021-03-10T20:01:46.661446+0000 mgr.y (mgr.14140) 116 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:48.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:47 gibba044 bash[9859]: audit 2021-03-10T20:01:46.682239+0000 mon.b (mon.2) 10 : audit [INF] from='osd.4 [v2:172.21.2.144:6800/165091654,v1:172.21.2.144:6801/165091654]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:01:48.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:47 gibba044 bash[9859]: audit 2021-03-10T20:01:46.682556+0000 mon.a (mon.0) 359 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T20:01:48.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:47 gibba044 bash[9859]: cluster 2021-03-10T20:01:46.682593+0000 mon.a (mon.0) 360 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2021-03-10T20:01:48.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:47 gibba044 bash[9859]: audit 2021-03-10T20:01:46.682667+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:01:48.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:47 gibba044 bash[9859]: audit 2021-03-10T20:01:46.684623+0000 mon.a (mon.0) 362 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:01:48.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:47 gibba044 bash[9859]: cluster 2021-03-10T20:01:46.909778+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:01:48.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:47 gibba044 bash[9859]: cluster 2021-03-10T20:01:46.909812+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:01:48.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:47 gibba044 bash[9859]: audit 2021-03-10T20:01:47.228039+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:01:48.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:47 gibba044 bash[9859]: audit 2021-03-10T20:01:47.337346+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321025\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321295\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321464\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321622\", \"created\": \"2021-03-10T20:01:39.757721\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}}, \"last_daemon_update\": \"2021-03-10T20:01:40.321884\", \"last_device_update\": \"2021-03-10T20:01:47.335879\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:01:48.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:47 gibba044 bash[9859]: audit 2021-03-10T20:01:47.345397+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321025\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321295\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321464\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321622\", \"created\": \"2021-03-10T20:01:39.757721\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}}, \"last_daemon_update\": \"2021-03-10T20:01:40.321884\", \"last_device_update\": \"2021-03-10T20:01:47.335879\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:01:48.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:47 gibba023 bash[9844]: cluster 2021-03-10T20:01:46.661446+0000 mgr.y (mgr.14140) 116 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:48.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:47 gibba023 bash[9844]: audit 2021-03-10T20:01:46.682239+0000 mon.b (mon.2) 10 : audit [INF] from='osd.4 [v2:172.21.2.144:6800/165091654,v1:172.21.2.144:6801/165091654]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:01:48.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:47 gibba023 bash[9844]: audit 2021-03-10T20:01:46.682556+0000 mon.a (mon.0) 359 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T20:01:48.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:47 gibba023 bash[9844]: cluster 2021-03-10T20:01:46.682593+0000 mon.a (mon.0) 360 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2021-03-10T20:01:48.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:47 gibba023 bash[9844]: audit 2021-03-10T20:01:46.682667+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:01:48.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:47 gibba023 bash[9844]: audit 2021-03-10T20:01:46.684623+0000 mon.a (mon.0) 362 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:01:48.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:47 gibba023 bash[9844]: cluster 2021-03-10T20:01:46.909778+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:01:48.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:47 gibba023 bash[9844]: cluster 2021-03-10T20:01:46.909812+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:01:48.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:47 gibba023 bash[9844]: audit 2021-03-10T20:01:47.228039+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:01:48.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:47 gibba023 bash[13032]: cluster 2021-03-10T20:01:46.661446+0000 mgr.y (mgr.14140) 116 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 992 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:48.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:47 gibba023 bash[13032]: audit 2021-03-10T20:01:46.682239+0000 mon.b (mon.2) 10 : audit [INF] from='osd.4 [v2:172.21.2.144:6800/165091654,v1:172.21.2.144:6801/165091654]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:01:48.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:47 gibba023 bash[13032]: audit 2021-03-10T20:01:46.682556+0000 mon.a (mon.0) 359 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T20:01:48.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:47 gibba023 bash[13032]: cluster 2021-03-10T20:01:46.682593+0000 mon.a (mon.0) 360 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2021-03-10T20:01:48.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:47 gibba023 bash[13032]: audit 2021-03-10T20:01:46.682667+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:01:48.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:47 gibba023 bash[13032]: audit 2021-03-10T20:01:46.684623+0000 mon.a (mon.0) 362 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:01:48.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:47 gibba023 bash[13032]: cluster 2021-03-10T20:01:46.909778+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:01:48.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:47 gibba023 bash[13032]: cluster 2021-03-10T20:01:46.909812+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:01:48.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:47 gibba023 bash[13032]: audit 2021-03-10T20:01:47.228039+0000 mon.a (mon.0) 363 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:01:48.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:47 gibba023 bash[9844]: audit 2021-03-10T20:01:47.337346+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321025\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321295\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321464\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321622\", \"created\": \"2021-03-10T20:01:39.757721\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}}, \"last_daemon_update\": \"2021-03-10T20:01:40.321884\", \"last_device_update\": \"2021-03-10T20:01:47.335879\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:01:48.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:47 gibba023 bash[9844]: audit 2021-03-10T20:01:47.345397+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321025\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321295\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321464\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321622\", \"created\": \"2021-03-10T20:01:39.757721\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}}, \"last_daemon_update\": \"2021-03-10T20:01:40.321884\", \"last_device_update\": \"2021-03-10T20:01:47.335879\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:01:48.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:47 gibba023 bash[13032]: audit 2021-03-10T20:01:47.337346+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321025\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321295\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321464\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321622\", \"created\": \"2021-03-10T20:01:39.757721\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}}, \"last_daemon_update\": \"2021-03-10T20:01:40.321884\", \"last_device_update\": \"2021-03-10T20:01:47.335879\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:01:48.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:47 gibba023 bash[13032]: audit 2021-03-10T20:01:47.345397+0000 mon.a (mon.0) 365 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321025\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321295\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321464\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321622\", \"created\": \"2021-03-10T20:01:39.757721\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}}, \"last_daemon_update\": \"2021-03-10T20:01:40.321884\", \"last_device_update\": \"2021-03-10T20:01:47.335879\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:01:49.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:48 gibba044 bash[9859]: audit 2021-03-10T20:01:47.691275+0000 mon.a (mon.0) 366 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]': finished 2021-03-10T20:01:49.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:48 gibba044 bash[9859]: cluster 2021-03-10T20:01:47.691342+0000 mon.a (mon.0) 367 : cluster [DBG] osdmap e31: 5 total, 4 up, 4 in 2021-03-10T20:01:49.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:48 gibba044 bash[9859]: audit 2021-03-10T20:01:47.691944+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:01:49.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:48 gibba023 bash[9844]: audit 2021-03-10T20:01:47.691275+0000 mon.a (mon.0) 366 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]': finished 2021-03-10T20:01:49.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:48 gibba023 bash[9844]: cluster 2021-03-10T20:01:47.691342+0000 mon.a (mon.0) 367 : cluster [DBG] osdmap e31: 5 total, 4 up, 4 in 2021-03-10T20:01:49.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:48 gibba023 bash[9844]: audit 2021-03-10T20:01:47.691944+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:01:49.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:48 gibba023 bash[13032]: audit 2021-03-10T20:01:47.691275+0000 mon.a (mon.0) 366 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]': finished 2021-03-10T20:01:49.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:48 gibba023 bash[13032]: cluster 2021-03-10T20:01:47.691342+0000 mon.a (mon.0) 367 : cluster [DBG] osdmap e31: 5 total, 4 up, 4 in 2021-03-10T20:01:49.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:48 gibba023 bash[13032]: audit 2021-03-10T20:01:47.691944+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:01:50.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:49 gibba044 bash[9859]: cluster 2021-03-10T20:01:48.662196+0000 mgr.y (mgr.14140) 117 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 1008 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:50.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:49 gibba044 bash[9859]: cluster 2021-03-10T20:01:48.706867+0000 mon.a (mon.0) 369 : cluster [INF] osd.4 [v2:172.21.2.144:6800/165091654,v1:172.21.2.144:6801/165091654] boot 2021-03-10T20:01:50.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:49 gibba044 bash[9859]: cluster 2021-03-10T20:01:48.706901+0000 mon.a (mon.0) 370 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-03-10T20:01:50.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:49 gibba044 bash[9859]: audit 2021-03-10T20:01:48.707448+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:01:50.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:49 gibba044 bash[9859]: audit 2021-03-10T20:01:49.332251+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:01:50.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:49 gibba044 bash[9859]: audit 2021-03-10T20:01:49.335146+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:01:50.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:49 gibba044 bash[9859]: audit 2021-03-10T20:01:49.339313+0000 mon.a (mon.0) 374 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:01:50.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:49 gibba044 bash[9859]: cluster 2021-03-10T20:01:49.704649+0000 mon.a (mon.0) 375 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2021-03-10T20:01:50.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:49 gibba023 bash[9844]: cluster 2021-03-10T20:01:48.662196+0000 mgr.y (mgr.14140) 117 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 1008 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:50.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:49 gibba023 bash[9844]: cluster 2021-03-10T20:01:48.706867+0000 mon.a (mon.0) 369 : cluster [INF] osd.4 [v2:172.21.2.144:6800/165091654,v1:172.21.2.144:6801/165091654] boot 2021-03-10T20:01:50.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:49 gibba023 bash[9844]: cluster 2021-03-10T20:01:48.706901+0000 mon.a (mon.0) 370 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-03-10T20:01:50.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:49 gibba023 bash[9844]: audit 2021-03-10T20:01:48.707448+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:01:50.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:49 gibba023 bash[9844]: audit 2021-03-10T20:01:49.332251+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:01:50.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:49 gibba023 bash[9844]: audit 2021-03-10T20:01:49.335146+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:01:50.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:49 gibba023 bash[9844]: audit 2021-03-10T20:01:49.339313+0000 mon.a (mon.0) 374 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:01:50.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:49 gibba023 bash[9844]: cluster 2021-03-10T20:01:49.704649+0000 mon.a (mon.0) 375 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2021-03-10T20:01:50.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:49 gibba023 bash[13032]: cluster 2021-03-10T20:01:48.662196+0000 mgr.y (mgr.14140) 117 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 1008 KiB used, 332 GiB / 336 GiB avail 2021-03-10T20:01:50.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:49 gibba023 bash[13032]: cluster 2021-03-10T20:01:48.706867+0000 mon.a (mon.0) 369 : cluster [INF] osd.4 [v2:172.21.2.144:6800/165091654,v1:172.21.2.144:6801/165091654] boot 2021-03-10T20:01:50.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:49 gibba023 bash[13032]: cluster 2021-03-10T20:01:48.706901+0000 mon.a (mon.0) 370 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-03-10T20:01:50.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:49 gibba023 bash[13032]: audit 2021-03-10T20:01:48.707448+0000 mon.a (mon.0) 371 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:01:50.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:49 gibba023 bash[13032]: audit 2021-03-10T20:01:49.332251+0000 mon.a (mon.0) 372 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:01:50.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:49 gibba023 bash[13032]: audit 2021-03-10T20:01:49.335146+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:01:50.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:49 gibba023 bash[13032]: audit 2021-03-10T20:01:49.339313+0000 mon.a (mon.0) 374 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:01:50.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:49 gibba023 bash[13032]: cluster 2021-03-10T20:01:49.704649+0000 mon.a (mon.0) 375 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2021-03-10T20:01:50.885 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:50 gibba044 bash[9859]: audit 2021-03-10T20:01:49.329376+0000 mgr.y (mgr.14140) 118 : audit [DBG] from='client.34148 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:01:50.886 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:50 gibba044 bash[9859]: cephadm 2021-03-10T20:01:49.331431+0000 mgr.y (mgr.14140) 119 : cephadm [INF] Applying osd on host gibba044... 2021-03-10T20:01:51.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:50 gibba023 bash[9844]: audit 2021-03-10T20:01:49.329376+0000 mgr.y (mgr.14140) 118 : audit [DBG] from='client.34148 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:01:51.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:50 gibba023 bash[9844]: cephadm 2021-03-10T20:01:49.331431+0000 mgr.y (mgr.14140) 119 : cephadm [INF] Applying osd on host gibba044... 2021-03-10T20:01:51.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:50 gibba023 bash[13032]: audit 2021-03-10T20:01:49.329376+0000 mgr.y (mgr.14140) 118 : audit [DBG] from='client.34148 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba044:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:01:51.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:50 gibba023 bash[13032]: cephadm 2021-03-10T20:01:49.331431+0000 mgr.y (mgr.14140) 119 : cephadm [INF] Applying osd on host gibba044... 2021-03-10T20:01:52.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:51 gibba044 bash[9859]: cluster 2021-03-10T20:01:50.663318+0000 mgr.y (mgr.14140) 120 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:01:52.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:51 gibba023 bash[9844]: cluster 2021-03-10T20:01:50.663318+0000 mgr.y (mgr.14140) 120 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:01:52.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:51 gibba023 bash[13032]: cluster 2021-03-10T20:01:50.663318+0000 mgr.y (mgr.14140) 120 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:01:53.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:52 gibba044 bash[9859]: audit 2021-03-10T20:01:52.208329+0000 mon.b (mon.2) 11 : audit [INF] from='client.? 172.21.2.144:0/3189729243' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5087ad12-b460-4867-b004-2f5082257775"}]: dispatch 2021-03-10T20:01:53.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:52 gibba044 bash[9859]: audit 2021-03-10T20:01:52.211508+0000 mon.a (mon.0) 376 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5087ad12-b460-4867-b004-2f5082257775"}]: dispatch 2021-03-10T20:01:53.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:52 gibba044 bash[9859]: audit 2021-03-10T20:01:52.223404+0000 mon.a (mon.0) 377 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5087ad12-b460-4867-b004-2f5082257775"}]': finished 2021-03-10T20:01:53.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:52 gibba044 bash[9859]: cluster 2021-03-10T20:01:52.223435+0000 mon.a (mon.0) 378 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2021-03-10T20:01:53.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:52 gibba044 bash[9859]: audit 2021-03-10T20:01:52.223588+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:01:53.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:52 gibba023 bash[9844]: audit 2021-03-10T20:01:52.208329+0000 mon.b (mon.2) 11 : audit [INF] from='client.? 172.21.2.144:0/3189729243' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5087ad12-b460-4867-b004-2f5082257775"}]: dispatch 2021-03-10T20:01:53.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:52 gibba023 bash[9844]: audit 2021-03-10T20:01:52.211508+0000 mon.a (mon.0) 376 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5087ad12-b460-4867-b004-2f5082257775"}]: dispatch 2021-03-10T20:01:53.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:52 gibba023 bash[9844]: audit 2021-03-10T20:01:52.223404+0000 mon.a (mon.0) 377 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5087ad12-b460-4867-b004-2f5082257775"}]': finished 2021-03-10T20:01:53.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:52 gibba023 bash[9844]: cluster 2021-03-10T20:01:52.223435+0000 mon.a (mon.0) 378 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2021-03-10T20:01:53.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:52 gibba023 bash[9844]: audit 2021-03-10T20:01:52.223588+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:01:53.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:52 gibba023 bash[13032]: audit 2021-03-10T20:01:52.208329+0000 mon.b (mon.2) 11 : audit [INF] from='client.? 172.21.2.144:0/3189729243' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5087ad12-b460-4867-b004-2f5082257775"}]: dispatch 2021-03-10T20:01:53.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:52 gibba023 bash[13032]: audit 2021-03-10T20:01:52.211508+0000 mon.a (mon.0) 376 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5087ad12-b460-4867-b004-2f5082257775"}]: dispatch 2021-03-10T20:01:53.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:52 gibba023 bash[13032]: audit 2021-03-10T20:01:52.223404+0000 mon.a (mon.0) 377 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5087ad12-b460-4867-b004-2f5082257775"}]': finished 2021-03-10T20:01:53.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:52 gibba023 bash[13032]: cluster 2021-03-10T20:01:52.223435+0000 mon.a (mon.0) 378 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2021-03-10T20:01:53.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:52 gibba023 bash[13032]: audit 2021-03-10T20:01:52.223588+0000 mon.a (mon.0) 379 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:01:54.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:53 gibba044 bash[9859]: cluster 2021-03-10T20:01:52.664268+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:01:54.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:53 gibba023 bash[9844]: cluster 2021-03-10T20:01:52.664268+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:01:54.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:53 gibba023 bash[13032]: cluster 2021-03-10T20:01:52.664268+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:01:55.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:54 gibba044 bash[9859]: audit 2021-03-10T20:01:54.257865+0000 mon.b (mon.2) 12 : audit [DBG] from='client.? 172.21.2.144:0/778260521' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:01:55.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:54 gibba023 bash[9844]: audit 2021-03-10T20:01:54.257865+0000 mon.b (mon.2) 12 : audit [DBG] from='client.? 172.21.2.144:0/778260521' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:01:55.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:54 gibba023 bash[13032]: audit 2021-03-10T20:01:54.257865+0000 mon.b (mon.2) 12 : audit [DBG] from='client.? 172.21.2.144:0/778260521' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:01:56.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:55 gibba044 bash[9859]: cluster 2021-03-10T20:01:54.664970+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:01:56.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:55 gibba023 bash[9844]: cluster 2021-03-10T20:01:54.664970+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:01:56.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:55 gibba023 bash[13032]: cluster 2021-03-10T20:01:54.664970+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:01:57.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:56 gibba023 bash[9844]: audit 2021-03-10T20:01:56.746760+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:01:57.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:56 gibba023 bash[13032]: audit 2021-03-10T20:01:56.746760+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:01:57.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:56 gibba044 bash[9859]: audit 2021-03-10T20:01:56.746760+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:01:57.861 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:57 gibba044 bash[9859]: cluster 2021-03-10T20:01:56.665942+0000 mgr.y (mgr.14140) 123 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:01:58.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:57 gibba023 bash[9844]: cluster 2021-03-10T20:01:56.665942+0000 mgr.y (mgr.14140) 123 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:01:58.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:57 gibba023 bash[13032]: cluster 2021-03-10T20:01:56.665942+0000 mgr.y (mgr.14140) 123 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:02:00.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:01:59 gibba023 bash[9844]: cluster 2021-03-10T20:01:58.666978+0000 mgr.y (mgr.14140) 124 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:02:00.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:01:59 gibba023 bash[13032]: cluster 2021-03-10T20:01:58.666978+0000 mgr.y (mgr.14140) 124 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:02:00.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:01:59 gibba044 bash[9859]: cluster 2021-03-10T20:01:58.666978+0000 mgr.y (mgr.14140) 124 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:02:01.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:00 gibba044 bash[9859]: audit 2021-03-10T20:01:59.830839+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-03-10T20:02:01.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:00 gibba044 bash[9859]: audit 2021-03-10T20:01:59.831969+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:01.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:00 gibba044 bash[9859]: cephadm 2021-03-10T20:01:59.832804+0000 mgr.y (mgr.14140) 125 : cephadm [INF] Deploying daemon osd.5 on gibba044 2021-03-10T20:02:01.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:00 gibba044 bash[9859]: audit 2021-03-10T20:01:59.833129+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-03-10T20:02:01.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:00 gibba023 bash[9844]: audit 2021-03-10T20:01:59.830839+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-03-10T20:02:01.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:00 gibba023 bash[9844]: audit 2021-03-10T20:01:59.831969+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:01.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:00 gibba023 bash[9844]: cephadm 2021-03-10T20:01:59.832804+0000 mgr.y (mgr.14140) 125 : cephadm [INF] Deploying daemon osd.5 on gibba044 2021-03-10T20:02:01.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:00 gibba023 bash[9844]: audit 2021-03-10T20:01:59.833129+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-03-10T20:02:01.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:00 gibba023 bash[13032]: audit 2021-03-10T20:01:59.830839+0000 mon.a (mon.0) 381 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-03-10T20:02:01.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:00 gibba023 bash[13032]: audit 2021-03-10T20:01:59.831969+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:01.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:00 gibba023 bash[13032]: cephadm 2021-03-10T20:01:59.832804+0000 mgr.y (mgr.14140) 125 : cephadm [INF] Deploying daemon osd.5 on gibba044 2021-03-10T20:02:01.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:00 gibba023 bash[13032]: audit 2021-03-10T20:01:59.833129+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-03-10T20:02:01.673 INFO:teuthology.orchestra.run.gibba044.stdout:Created osd(s) 5 on host 'gibba044' 2021-03-10T20:02:01.888 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:01 gibba044 bash[9859]: cluster 2021-03-10T20:02:00.667785+0000 mgr.y (mgr.14140) 126 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:02:01.889 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:01 gibba044 bash[9859]: audit 2021-03-10T20:02:01.661414+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321025\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321295\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321464\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321622\", \"created\": \"2021-03-10T20:01:39.757721\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}}, \"last_device_update\": \"2021-03-10T20:01:47.335879\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:02:01.889 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:01 gibba044 bash[9859]: audit 2021-03-10T20:02:01.663009+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:01.889 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:01 gibba044 bash[9859]: audit 2021-03-10T20:02:01.670210+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321025\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321295\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321464\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321622\", \"created\": \"2021-03-10T20:01:39.757721\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}}, \"last_device_update\": \"2021-03-10T20:01:47.335879\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:02:01.889 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:01 gibba044 bash[9859]: audit 2021-03-10T20:02:01.710093+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"0c99881f-7dc7-4eaa-91e6-f68f44036d07\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406508.7066813, \"finished_at\": 1615406521.6757762}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T20:02:01.890 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:01 gibba044 bash[9859]: audit 2021-03-10T20:02:01.714062+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"0c99881f-7dc7-4eaa-91e6-f68f44036d07\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406508.7066813, \"finished_at\": 1615406521.6757762}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T20:02:02.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:01 gibba023 bash[9844]: cluster 2021-03-10T20:02:00.667785+0000 mgr.y (mgr.14140) 126 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:02:02.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:01 gibba023 bash[13032]: cluster 2021-03-10T20:02:00.667785+0000 mgr.y (mgr.14140) 126 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2021-03-10T20:02:02.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:01 gibba023 bash[9844]: audit 2021-03-10T20:02:01.661414+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321025\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321295\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321464\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321622\", \"created\": \"2021-03-10T20:01:39.757721\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}}, \"last_device_update\": \"2021-03-10T20:01:47.335879\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:02:02.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:01 gibba023 bash[9844]: audit 2021-03-10T20:02:01.663009+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:02.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:01 gibba023 bash[9844]: audit 2021-03-10T20:02:01.670210+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321025\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321295\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321464\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321622\", \"created\": \"2021-03-10T20:01:39.757721\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}}, \"last_device_update\": \"2021-03-10T20:01:47.335879\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:02:02.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:01 gibba023 bash[9844]: audit 2021-03-10T20:02:01.710093+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"0c99881f-7dc7-4eaa-91e6-f68f44036d07\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406508.7066813, \"finished_at\": 1615406521.6757762}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T20:02:02.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:01 gibba023 bash[9844]: audit 2021-03-10T20:02:01.714062+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"0c99881f-7dc7-4eaa-91e6-f68f44036d07\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406508.7066813, \"finished_at\": 1615406521.6757762}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T20:02:02.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:01 gibba023 bash[13032]: audit 2021-03-10T20:02:01.661414+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321025\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321295\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321464\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321622\", \"created\": \"2021-03-10T20:01:39.757721\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}}, \"last_device_update\": \"2021-03-10T20:01:47.335879\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:02:02.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:01 gibba023 bash[13032]: audit 2021-03-10T20:02:01.663009+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:02.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:01 gibba023 bash[13032]: audit 2021-03-10T20:02:01.670210+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321025\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321295\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321464\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:40.321622\", \"created\": \"2021-03-10T20:01:39.757721\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}}, \"last_device_update\": \"2021-03-10T20:01:47.335879\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:02:02.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:01 gibba023 bash[13032]: audit 2021-03-10T20:02:01.710093+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"0c99881f-7dc7-4eaa-91e6-f68f44036d07\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406508.7066813, \"finished_at\": 1615406521.6757762}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T20:02:02.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:01 gibba023 bash[13032]: audit 2021-03-10T20:02:01.714062+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"0c99881f-7dc7-4eaa-91e6-f68f44036d07\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406508.7066813, \"finished_at\": 1615406521.6757762}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T20:02:02.840 DEBUG:teuthology.orchestra.run.gibba044:osd.5> sudo journalctl -f -n 0 -u ceph-dd719b26-81da-11eb-9080-001a4aab830c@osd.5.service 2021-03-10T20:02:02.843 INFO:tasks.cephadm:Deploying osd.6 on gibba044 with /dev/vg_nvme/lv_2... 2021-03-10T20:02:02.843 DEBUG:teuthology.orchestra.run.gibba044:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-03-10T20:02:02.942 INFO:journalctl@ceph.osd.5.gibba044.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:02:03.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:02 gibba023 bash[9844]: audit 2021-03-10T20:02:02.150050+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.146776\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147046\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147215\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147372\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147524\", \"created\": \"2021-03-10T20:02:01.645721\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}}, \"last_daemon_update\": \"2021-03-10T20:02:02.147791\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:02:03.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:02 gibba023 bash[9844]: audit 2021-03-10T20:02:02.159054+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.146776\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147046\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147215\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147372\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147524\", \"created\": \"2021-03-10T20:02:01.645721\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}}, \"last_daemon_update\": \"2021-03-10T20:02:02.147791\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:02:03.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:02 gibba023 bash[9844]: audit 2021-03-10T20:02:02.159954+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:03.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:02 gibba023 bash[13032]: audit 2021-03-10T20:02:02.150050+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.146776\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147046\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147215\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147372\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147524\", \"created\": \"2021-03-10T20:02:01.645721\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}}, \"last_daemon_update\": \"2021-03-10T20:02:02.147791\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:02:03.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:02 gibba023 bash[13032]: audit 2021-03-10T20:02:02.159054+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.146776\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147046\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147215\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147372\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147524\", \"created\": \"2021-03-10T20:02:01.645721\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}}, \"last_daemon_update\": \"2021-03-10T20:02:02.147791\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:02:03.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:02 gibba023 bash[13032]: audit 2021-03-10T20:02:02.159954+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:03.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:02 gibba044 bash[9859]: audit 2021-03-10T20:02:02.150050+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.146776\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147046\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147215\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147372\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147524\", \"created\": \"2021-03-10T20:02:01.645721\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}}, \"last_daemon_update\": \"2021-03-10T20:02:02.147791\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:02:03.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:02 gibba044 bash[9859]: audit 2021-03-10T20:02:02.159054+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.146776\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147046\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147215\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147372\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147524\", \"created\": \"2021-03-10T20:02:01.645721\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}}, \"last_daemon_update\": \"2021-03-10T20:02:02.147791\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:02:03.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:02 gibba044 bash[9859]: audit 2021-03-10T20:02:02.159954+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:04.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:03 gibba023 bash[9844]: cluster 2021-03-10T20:02:02.668733+0000 mgr.y (mgr.14140) 127 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:02:04.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:03 gibba023 bash[13032]: cluster 2021-03-10T20:02:02.668733+0000 mgr.y (mgr.14140) 127 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:02:04.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:03 gibba044 bash[9859]: cluster 2021-03-10T20:02:02.668733+0000 mgr.y (mgr.14140) 127 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:02:04.255 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:02:03 gibba044 bash[13372]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-03-10T20:02:04.255 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:02:03 gibba044 bash[13372]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2021-03-10T20:02:04.256 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:02:03 gibba044 bash[13372]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2021-03-10T20:02:04.256 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:02:03 gibba044 bash[13372]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2021-03-10T20:02:04.256 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:02:03 gibba044 bash[13372]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-03-10T20:02:04.256 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:02:03 gibba044 bash[13372]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-03-10T20:02:04.257 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:02:03 gibba044 bash[13372]: --> ceph-volume lvm activate successful for osd ID: 5 2021-03-10T20:02:05.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:05 gibba044 bash[9859]: cluster 2021-03-10T20:02:04.669414+0000 mgr.y (mgr.14140) 128 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:02:06.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:05 gibba023 bash[9844]: cluster 2021-03-10T20:02:04.669414+0000 mgr.y (mgr.14140) 128 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:02:06.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:05 gibba023 bash[13032]: cluster 2021-03-10T20:02:04.669414+0000 mgr.y (mgr.14140) 128 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:02:07.573 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:02:07 gibba044 bash[13682]: debug 2021-03-10T20:02:07.313+0000 7fc8e8daeec0 -1 Falling back to public interface 2021-03-10T20:02:08.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:07 gibba044 bash[9859]: cluster 2021-03-10T20:02:06.670430+0000 mgr.y (mgr.14140) 129 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:02:08.068 INFO:teuthology.orchestra.run.gibba044.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-03-10T20:02:08.068 INFO:teuthology.orchestra.run.gibba044.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-03-10T20:02:08.068 INFO:teuthology.orchestra.run.gibba044.stderr: stderr: 10+0 records in 2021-03-10T20:02:08.069 INFO:teuthology.orchestra.run.gibba044.stderr:10+0 records out 2021-03-10T20:02:08.069 INFO:teuthology.orchestra.run.gibba044.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00828979 s, 1.3 GB/s 2021-03-10T20:02:08.069 INFO:teuthology.orchestra.run.gibba044.stderr:--> Zapping successful for: 2021-03-10T20:02:08.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:07 gibba023 bash[9844]: cluster 2021-03-10T20:02:06.670430+0000 mgr.y (mgr.14140) 129 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:02:08.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:07 gibba023 bash[13032]: cluster 2021-03-10T20:02:06.670430+0000 mgr.y (mgr.14140) 129 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:02:08.505 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:02:08 gibba044 bash[13682]: debug 2021-03-10T20:02:08.029+0000 7fc8e8daeec0 -1 osd.5 0 log_to_monitors {default=true} 2021-03-10T20:02:09.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:08 gibba044 bash[9859]: audit 2021-03-10T20:02:08.036604+0000 mon.b (mon.2) 13 : audit [INF] from='osd.5 [v2:172.21.2.144:6808/2575964695,v1:172.21.2.144:6809/2575964695]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T20:02:09.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:08 gibba044 bash[9859]: audit 2021-03-10T20:02:08.039663+0000 mon.a (mon.0) 392 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T20:02:09.029 DEBUG:teuthology.orchestra.run.gibba044:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba044:vg_nvme/lv_2 2021-03-10T20:02:09.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:08 gibba023 bash[9844]: audit 2021-03-10T20:02:08.036604+0000 mon.b (mon.2) 13 : audit [INF] from='osd.5 [v2:172.21.2.144:6808/2575964695,v1:172.21.2.144:6809/2575964695]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T20:02:09.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:08 gibba023 bash[9844]: audit 2021-03-10T20:02:08.039663+0000 mon.a (mon.0) 392 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T20:02:09.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:08 gibba023 bash[13032]: audit 2021-03-10T20:02:08.036604+0000 mon.b (mon.2) 13 : audit [INF] from='osd.5 [v2:172.21.2.144:6808/2575964695,v1:172.21.2.144:6809/2575964695]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T20:02:09.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:08 gibba023 bash[13032]: audit 2021-03-10T20:02:08.039663+0000 mon.a (mon.0) 392 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T20:02:10.004 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:02:09 gibba044 bash[13682]: debug 2021-03-10T20:02:09.701+0000 7fc8cdb5b700 -1 osd.5 0 waiting for initial osdmap 2021-03-10T20:02:10.005 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:02:09 gibba044 bash[13682]: debug 2021-03-10T20:02:09.709+0000 7fc8d8d77700 -1 osd.5 36 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:02:10.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:09 gibba044 bash[9859]: cluster 2021-03-10T20:02:08.671412+0000 mgr.y (mgr.14140) 130 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:02:10.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:09 gibba044 bash[9859]: audit 2021-03-10T20:02:08.700470+0000 mon.b (mon.2) 14 : audit [INF] from='osd.5 [v2:172.21.2.144:6808/2575964695,v1:172.21.2.144:6809/2575964695]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:02:10.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:09 gibba044 bash[9859]: audit 2021-03-10T20:02:08.700948+0000 mon.a (mon.0) 393 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T20:02:10.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:09 gibba044 bash[9859]: cluster 2021-03-10T20:02:08.700990+0000 mon.a (mon.0) 394 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2021-03-10T20:02:10.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:09 gibba044 bash[9859]: audit 2021-03-10T20:02:08.701092+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:02:10.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:09 gibba044 bash[9859]: audit 2021-03-10T20:02:08.702622+0000 mon.a (mon.0) 396 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:02:10.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:09 gibba044 bash[9859]: cluster 2021-03-10T20:02:09.000418+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:02:10.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:09 gibba044 bash[9859]: cluster 2021-03-10T20:02:09.000525+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:02:10.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:09 gibba044 bash[9859]: audit 2021-03-10T20:02:09.072815+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:10.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:09 gibba044 bash[9859]: audit 2021-03-10T20:02:09.181221+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.146776\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147046\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147215\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147372\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147524\", \"created\": \"2021-03-10T20:02:01.645721\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}}, \"last_daemon_update\": \"2021-03-10T20:02:02.147791\", \"last_device_update\": \"2021-03-10T20:02:09.179518\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:02:10.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:09 gibba044 bash[9859]: audit 2021-03-10T20:02:09.189212+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.146776\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147046\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147215\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147372\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147524\", \"created\": \"2021-03-10T20:02:01.645721\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}}, \"last_daemon_update\": \"2021-03-10T20:02:02.147791\", \"last_device_update\": \"2021-03-10T20:02:09.179518\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:02:10.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:09 gibba023 bash[9844]: cluster 2021-03-10T20:02:08.671412+0000 mgr.y (mgr.14140) 130 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:02:10.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:09 gibba023 bash[9844]: audit 2021-03-10T20:02:08.700470+0000 mon.b (mon.2) 14 : audit [INF] from='osd.5 [v2:172.21.2.144:6808/2575964695,v1:172.21.2.144:6809/2575964695]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:02:10.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:09 gibba023 bash[9844]: audit 2021-03-10T20:02:08.700948+0000 mon.a (mon.0) 393 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T20:02:10.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:09 gibba023 bash[9844]: cluster 2021-03-10T20:02:08.700990+0000 mon.a (mon.0) 394 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2021-03-10T20:02:10.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:09 gibba023 bash[9844]: audit 2021-03-10T20:02:08.701092+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:02:10.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:09 gibba023 bash[9844]: audit 2021-03-10T20:02:08.702622+0000 mon.a (mon.0) 396 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:02:10.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:09 gibba023 bash[9844]: cluster 2021-03-10T20:02:09.000418+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:02:10.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:09 gibba023 bash[9844]: cluster 2021-03-10T20:02:09.000525+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:02:10.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:09 gibba023 bash[9844]: audit 2021-03-10T20:02:09.072815+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:10.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:09 gibba023 bash[13032]: cluster 2021-03-10T20:02:08.671412+0000 mgr.y (mgr.14140) 130 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:02:10.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:09 gibba023 bash[13032]: audit 2021-03-10T20:02:08.700470+0000 mon.b (mon.2) 14 : audit [INF] from='osd.5 [v2:172.21.2.144:6808/2575964695,v1:172.21.2.144:6809/2575964695]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:02:10.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:09 gibba023 bash[13032]: audit 2021-03-10T20:02:08.700948+0000 mon.a (mon.0) 393 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T20:02:10.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:09 gibba023 bash[13032]: cluster 2021-03-10T20:02:08.700990+0000 mon.a (mon.0) 394 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2021-03-10T20:02:10.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:09 gibba023 bash[13032]: audit 2021-03-10T20:02:08.701092+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:02:10.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:09 gibba023 bash[13032]: audit 2021-03-10T20:02:08.702622+0000 mon.a (mon.0) 396 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:02:10.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:09 gibba023 bash[13032]: cluster 2021-03-10T20:02:09.000418+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:02:10.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:09 gibba023 bash[13032]: cluster 2021-03-10T20:02:09.000525+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:02:10.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:09 gibba023 bash[13032]: audit 2021-03-10T20:02:09.072815+0000 mon.a (mon.0) 397 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:10.184 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:09 gibba023 bash[9844]: audit 2021-03-10T20:02:09.181221+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.146776\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147046\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147215\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147372\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147524\", \"created\": \"2021-03-10T20:02:01.645721\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}}, \"last_daemon_update\": \"2021-03-10T20:02:02.147791\", \"last_device_update\": \"2021-03-10T20:02:09.179518\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:02:10.184 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:09 gibba023 bash[9844]: audit 2021-03-10T20:02:09.189212+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.146776\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147046\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147215\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147372\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147524\", \"created\": \"2021-03-10T20:02:01.645721\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}}, \"last_daemon_update\": \"2021-03-10T20:02:02.147791\", \"last_device_update\": \"2021-03-10T20:02:09.179518\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:02:10.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:09 gibba023 bash[13032]: audit 2021-03-10T20:02:09.181221+0000 mon.a (mon.0) 398 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.146776\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147046\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147215\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147372\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147524\", \"created\": \"2021-03-10T20:02:01.645721\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}}, \"last_daemon_update\": \"2021-03-10T20:02:02.147791\", \"last_device_update\": \"2021-03-10T20:02:09.179518\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:02:10.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:09 gibba023 bash[13032]: audit 2021-03-10T20:02:09.189212+0000 mon.a (mon.0) 399 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.146776\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147046\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147215\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147372\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147524\", \"created\": \"2021-03-10T20:02:01.645721\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}}, \"last_daemon_update\": \"2021-03-10T20:02:02.147791\", \"last_device_update\": \"2021-03-10T20:02:09.179518\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:02:11.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:10 gibba044 bash[9859]: audit 2021-03-10T20:02:09.703520+0000 mon.a (mon.0) 400 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]': finished 2021-03-10T20:02:11.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:10 gibba044 bash[9859]: cluster 2021-03-10T20:02:09.703567+0000 mon.a (mon.0) 401 : cluster [DBG] osdmap e36: 6 total, 5 up, 5 in 2021-03-10T20:02:11.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:10 gibba044 bash[9859]: audit 2021-03-10T20:02:09.704105+0000 mon.a (mon.0) 402 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:02:11.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:10 gibba023 bash[9844]: audit 2021-03-10T20:02:09.703520+0000 mon.a (mon.0) 400 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]': finished 2021-03-10T20:02:11.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:10 gibba023 bash[9844]: cluster 2021-03-10T20:02:09.703567+0000 mon.a (mon.0) 401 : cluster [DBG] osdmap e36: 6 total, 5 up, 5 in 2021-03-10T20:02:11.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:10 gibba023 bash[9844]: audit 2021-03-10T20:02:09.704105+0000 mon.a (mon.0) 402 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:02:11.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:10 gibba023 bash[13032]: audit 2021-03-10T20:02:09.703520+0000 mon.a (mon.0) 400 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]': finished 2021-03-10T20:02:11.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:10 gibba023 bash[13032]: cluster 2021-03-10T20:02:09.703567+0000 mon.a (mon.0) 401 : cluster [DBG] osdmap e36: 6 total, 5 up, 5 in 2021-03-10T20:02:11.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:10 gibba023 bash[13032]: audit 2021-03-10T20:02:09.704105+0000 mon.a (mon.0) 402 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:02:12.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:11 gibba044 bash[9859]: cluster 2021-03-10T20:02:10.672284+0000 mgr.y (mgr.14140) 131 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:02:12.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:11 gibba044 bash[9859]: cluster 2021-03-10T20:02:10.716468+0000 mon.a (mon.0) 403 : cluster [INF] osd.5 [v2:172.21.2.144:6808/2575964695,v1:172.21.2.144:6809/2575964695] boot 2021-03-10T20:02:12.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:11 gibba044 bash[9859]: cluster 2021-03-10T20:02:10.716511+0000 mon.a (mon.0) 404 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-03-10T20:02:12.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:11 gibba044 bash[9859]: audit 2021-03-10T20:02:10.717261+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:02:12.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:11 gibba044 bash[9859]: audit 2021-03-10T20:02:11.575896+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:02:12.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:11 gibba044 bash[9859]: audit 2021-03-10T20:02:11.578774+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:12.009 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:11 gibba044 bash[9859]: audit 2021-03-10T20:02:11.583024+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:12.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:11 gibba023 bash[9844]: cluster 2021-03-10T20:02:10.672284+0000 mgr.y (mgr.14140) 131 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:02:12.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:11 gibba023 bash[9844]: cluster 2021-03-10T20:02:10.716468+0000 mon.a (mon.0) 403 : cluster [INF] osd.5 [v2:172.21.2.144:6808/2575964695,v1:172.21.2.144:6809/2575964695] boot 2021-03-10T20:02:12.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:11 gibba023 bash[9844]: cluster 2021-03-10T20:02:10.716511+0000 mon.a (mon.0) 404 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-03-10T20:02:12.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:11 gibba023 bash[9844]: audit 2021-03-10T20:02:10.717261+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:02:12.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:11 gibba023 bash[9844]: audit 2021-03-10T20:02:11.575896+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:02:12.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:11 gibba023 bash[9844]: audit 2021-03-10T20:02:11.578774+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:12.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:11 gibba023 bash[9844]: audit 2021-03-10T20:02:11.583024+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:12.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:11 gibba023 bash[13032]: cluster 2021-03-10T20:02:10.672284+0000 mgr.y (mgr.14140) 131 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 415 GiB / 420 GiB avail 2021-03-10T20:02:12.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:11 gibba023 bash[13032]: cluster 2021-03-10T20:02:10.716468+0000 mon.a (mon.0) 403 : cluster [INF] osd.5 [v2:172.21.2.144:6808/2575964695,v1:172.21.2.144:6809/2575964695] boot 2021-03-10T20:02:12.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:11 gibba023 bash[13032]: cluster 2021-03-10T20:02:10.716511+0000 mon.a (mon.0) 404 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-03-10T20:02:12.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:11 gibba023 bash[13032]: audit 2021-03-10T20:02:10.717261+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:02:12.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:11 gibba023 bash[13032]: audit 2021-03-10T20:02:11.575896+0000 mon.a (mon.0) 406 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:02:12.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:11 gibba023 bash[13032]: audit 2021-03-10T20:02:11.578774+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:12.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:11 gibba023 bash[13032]: audit 2021-03-10T20:02:11.583024+0000 mon.a (mon.0) 408 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:12.803 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:12 gibba044 bash[9859]: audit 2021-03-10T20:02:11.573056+0000 mgr.y (mgr.14140) 132 : audit [DBG] from='client.34175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba044:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:02:12.803 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:12 gibba044 bash[9859]: cephadm 2021-03-10T20:02:11.575070+0000 mgr.y (mgr.14140) 133 : cephadm [INF] Applying osd on host gibba044... 2021-03-10T20:02:12.804 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:12 gibba044 bash[9859]: cluster 2021-03-10T20:02:11.732564+0000 mon.a (mon.0) 409 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2021-03-10T20:02:13.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:12 gibba023 bash[9844]: audit 2021-03-10T20:02:11.573056+0000 mgr.y (mgr.14140) 132 : audit [DBG] from='client.34175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba044:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:02:13.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:12 gibba023 bash[9844]: cephadm 2021-03-10T20:02:11.575070+0000 mgr.y (mgr.14140) 133 : cephadm [INF] Applying osd on host gibba044... 2021-03-10T20:02:13.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:12 gibba023 bash[9844]: cluster 2021-03-10T20:02:11.732564+0000 mon.a (mon.0) 409 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2021-03-10T20:02:13.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:12 gibba023 bash[13032]: audit 2021-03-10T20:02:11.573056+0000 mgr.y (mgr.14140) 132 : audit [DBG] from='client.34175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba044:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:02:13.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:12 gibba023 bash[13032]: cephadm 2021-03-10T20:02:11.575070+0000 mgr.y (mgr.14140) 133 : cephadm [INF] Applying osd on host gibba044... 2021-03-10T20:02:13.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:12 gibba023 bash[13032]: cluster 2021-03-10T20:02:11.732564+0000 mon.a (mon.0) 409 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2021-03-10T20:02:14.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:13 gibba044 bash[9859]: cluster 2021-03-10T20:02:12.673255+0000 mgr.y (mgr.14140) 134 : cluster [DBG] pgmap v134: 1 pgs: 1 peering; 0 B data, 1.8 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:14.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:13 gibba044 bash[9859]: cluster 2021-03-10T20:02:12.732411+0000 mon.a (mon.0) 410 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:02:14.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:13 gibba023 bash[9844]: cluster 2021-03-10T20:02:12.673255+0000 mgr.y (mgr.14140) 134 : cluster [DBG] pgmap v134: 1 pgs: 1 peering; 0 B data, 1.8 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:14.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:13 gibba023 bash[9844]: cluster 2021-03-10T20:02:12.732411+0000 mon.a (mon.0) 410 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:02:14.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:13 gibba023 bash[13032]: cluster 2021-03-10T20:02:12.673255+0000 mgr.y (mgr.14140) 134 : cluster [DBG] pgmap v134: 1 pgs: 1 peering; 0 B data, 1.8 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:14.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:13 gibba023 bash[13032]: cluster 2021-03-10T20:02:12.732411+0000 mon.a (mon.0) 410 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:02:15.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:14 gibba023 bash[9844]: audit 2021-03-10T20:02:14.516151+0000 mon.b (mon.2) 15 : audit [INF] from='client.? 172.21.2.144:0/1243161164' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "457d92b3-5bf6-4787-9c6d-a62b863cd4a8"}]: dispatch 2021-03-10T20:02:15.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:14 gibba023 bash[9844]: audit 2021-03-10T20:02:14.519493+0000 mon.a (mon.0) 411 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "457d92b3-5bf6-4787-9c6d-a62b863cd4a8"}]: dispatch 2021-03-10T20:02:15.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:14 gibba023 bash[9844]: audit 2021-03-10T20:02:14.530809+0000 mon.a (mon.0) 412 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "457d92b3-5bf6-4787-9c6d-a62b863cd4a8"}]': finished 2021-03-10T20:02:15.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:14 gibba023 bash[9844]: cluster 2021-03-10T20:02:14.530870+0000 mon.a (mon.0) 413 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2021-03-10T20:02:15.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:14 gibba023 bash[9844]: audit 2021-03-10T20:02:14.531041+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:02:15.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:14 gibba023 bash[13032]: audit 2021-03-10T20:02:14.516151+0000 mon.b (mon.2) 15 : audit [INF] from='client.? 172.21.2.144:0/1243161164' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "457d92b3-5bf6-4787-9c6d-a62b863cd4a8"}]: dispatch 2021-03-10T20:02:15.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:14 gibba023 bash[13032]: audit 2021-03-10T20:02:14.519493+0000 mon.a (mon.0) 411 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "457d92b3-5bf6-4787-9c6d-a62b863cd4a8"}]: dispatch 2021-03-10T20:02:15.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:14 gibba023 bash[13032]: audit 2021-03-10T20:02:14.530809+0000 mon.a (mon.0) 412 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "457d92b3-5bf6-4787-9c6d-a62b863cd4a8"}]': finished 2021-03-10T20:02:15.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:14 gibba023 bash[13032]: cluster 2021-03-10T20:02:14.530870+0000 mon.a (mon.0) 413 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2021-03-10T20:02:15.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:14 gibba023 bash[13032]: audit 2021-03-10T20:02:14.531041+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:02:15.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:14 gibba044 bash[9859]: audit 2021-03-10T20:02:14.516151+0000 mon.b (mon.2) 15 : audit [INF] from='client.? 172.21.2.144:0/1243161164' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "457d92b3-5bf6-4787-9c6d-a62b863cd4a8"}]: dispatch 2021-03-10T20:02:15.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:14 gibba044 bash[9859]: audit 2021-03-10T20:02:14.519493+0000 mon.a (mon.0) 411 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "457d92b3-5bf6-4787-9c6d-a62b863cd4a8"}]: dispatch 2021-03-10T20:02:15.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:14 gibba044 bash[9859]: audit 2021-03-10T20:02:14.530809+0000 mon.a (mon.0) 412 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "457d92b3-5bf6-4787-9c6d-a62b863cd4a8"}]': finished 2021-03-10T20:02:15.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:14 gibba044 bash[9859]: cluster 2021-03-10T20:02:14.530870+0000 mon.a (mon.0) 413 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2021-03-10T20:02:15.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:14 gibba044 bash[9859]: audit 2021-03-10T20:02:14.531041+0000 mon.a (mon.0) 414 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:02:16.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:15 gibba023 bash[9844]: cluster 2021-03-10T20:02:14.674004+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v136: 1 pgs: 1 peering; 0 B data, 1.9 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:16.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:15 gibba023 bash[13032]: cluster 2021-03-10T20:02:14.674004+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v136: 1 pgs: 1 peering; 0 B data, 1.9 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:16.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:15 gibba044 bash[9859]: cluster 2021-03-10T20:02:14.674004+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v136: 1 pgs: 1 peering; 0 B data, 1.9 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:17.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:16 gibba023 bash[9844]: audit 2021-03-10T20:02:16.625613+0000 mon.b (mon.2) 16 : audit [DBG] from='client.? 172.21.2.144:0/2766908050' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:02:17.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:16 gibba023 bash[13032]: audit 2021-03-10T20:02:16.625613+0000 mon.b (mon.2) 16 : audit [DBG] from='client.? 172.21.2.144:0/2766908050' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:02:17.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:16 gibba044 bash[9859]: audit 2021-03-10T20:02:16.625613+0000 mon.b (mon.2) 16 : audit [DBG] from='client.? 172.21.2.144:0/2766908050' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:02:18.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:17 gibba023 bash[9844]: cluster 2021-03-10T20:02:16.674959+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v137: 1 pgs: 1 peering; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:18.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:17 gibba023 bash[13032]: cluster 2021-03-10T20:02:16.674959+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v137: 1 pgs: 1 peering; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:18.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:17 gibba044 bash[9859]: cluster 2021-03-10T20:02:16.674959+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v137: 1 pgs: 1 peering; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:19.009 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:18 gibba044 bash[9859]: cluster 2021-03-10T20:02:18.787386+0000 mon.a (mon.0) 415 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T20:02:19.010 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:18 gibba044 bash[9859]: cluster 2021-03-10T20:02:18.787523+0000 mon.a (mon.0) 416 : cluster [INF] Cluster is now healthy 2021-03-10T20:02:19.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:18 gibba023 bash[9844]: cluster 2021-03-10T20:02:18.787386+0000 mon.a (mon.0) 415 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T20:02:19.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:18 gibba023 bash[9844]: cluster 2021-03-10T20:02:18.787523+0000 mon.a (mon.0) 416 : cluster [INF] Cluster is now healthy 2021-03-10T20:02:19.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:18 gibba023 bash[13032]: cluster 2021-03-10T20:02:18.787386+0000 mon.a (mon.0) 415 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T20:02:19.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:18 gibba023 bash[13032]: cluster 2021-03-10T20:02:18.787523+0000 mon.a (mon.0) 416 : cluster [INF] Cluster is now healthy 2021-03-10T20:02:20.177 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:19 gibba044 bash[9859]: cluster 2021-03-10T20:02:18.675855+0000 mgr.y (mgr.14140) 137 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:20.177 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:19 gibba044 bash[9859]: audit 2021-03-10T20:02:19.245021+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:20.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:19 gibba023 bash[9844]: cluster 2021-03-10T20:02:18.675855+0000 mgr.y (mgr.14140) 137 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:20.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:19 gibba023 bash[9844]: audit 2021-03-10T20:02:19.245021+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:20.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:19 gibba023 bash[13032]: cluster 2021-03-10T20:02:18.675855+0000 mgr.y (mgr.14140) 137 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:20.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:19 gibba023 bash[13032]: audit 2021-03-10T20:02:19.245021+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:22.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:21 gibba023 bash[9844]: cluster 2021-03-10T20:02:20.676674+0000 mgr.y (mgr.14140) 138 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:22.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:21 gibba023 bash[13032]: cluster 2021-03-10T20:02:20.676674+0000 mgr.y (mgr.14140) 138 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:22.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:21 gibba044 bash[9859]: cluster 2021-03-10T20:02:20.676674+0000 mgr.y (mgr.14140) 138 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:23.173 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:22 gibba044 bash[9859]: audit 2021-03-10T20:02:22.401510+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-03-10T20:02:23.173 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:22 gibba044 bash[9859]: audit 2021-03-10T20:02:22.404285+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:23.173 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:22 gibba044 bash[9859]: audit 2021-03-10T20:02:22.407595+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-03-10T20:02:23.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:22 gibba023 bash[9844]: audit 2021-03-10T20:02:22.401510+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-03-10T20:02:23.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:22 gibba023 bash[9844]: audit 2021-03-10T20:02:22.404285+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:23.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:22 gibba023 bash[9844]: audit 2021-03-10T20:02:22.407595+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-03-10T20:02:23.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:22 gibba023 bash[13032]: audit 2021-03-10T20:02:22.401510+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-03-10T20:02:23.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:22 gibba023 bash[13032]: audit 2021-03-10T20:02:22.404285+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:23.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:22 gibba023 bash[13032]: audit 2021-03-10T20:02:22.407595+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-03-10T20:02:24.089 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:23 gibba044 bash[9859]: cephadm 2021-03-10T20:02:22.406634+0000 mgr.y (mgr.14140) 139 : cephadm [INF] Deploying daemon osd.6 on gibba044 2021-03-10T20:02:24.089 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:23 gibba044 bash[9859]: cluster 2021-03-10T20:02:22.677512+0000 mgr.y (mgr.14140) 140 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:24.133 INFO:teuthology.orchestra.run.gibba044.stdout:Created osd(s) 6 on host 'gibba044' 2021-03-10T20:02:24.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:23 gibba023 bash[9844]: cephadm 2021-03-10T20:02:22.406634+0000 mgr.y (mgr.14140) 139 : cephadm [INF] Deploying daemon osd.6 on gibba044 2021-03-10T20:02:24.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:23 gibba023 bash[9844]: cluster 2021-03-10T20:02:22.677512+0000 mgr.y (mgr.14140) 140 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:24.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:23 gibba023 bash[13032]: cephadm 2021-03-10T20:02:22.406634+0000 mgr.y (mgr.14140) 139 : cephadm [INF] Deploying daemon osd.6 on gibba044 2021-03-10T20:02:24.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:23 gibba023 bash[13032]: cluster 2021-03-10T20:02:22.677512+0000 mgr.y (mgr.14140) 140 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:25.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:24 gibba023 bash[9844]: audit 2021-03-10T20:02:24.119295+0000 mon.a (mon.0) 421 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.146776\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147046\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147215\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147372\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147524\", \"created\": \"2021-03-10T20:02:01.645721\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}}, \"last_device_update\": \"2021-03-10T20:02:09.179518\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:02:25.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:24 gibba023 bash[9844]: audit 2021-03-10T20:02:24.120977+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:25.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:24 gibba023 bash[13032]: audit 2021-03-10T20:02:24.119295+0000 mon.a (mon.0) 421 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.146776\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147046\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147215\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147372\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147524\", \"created\": \"2021-03-10T20:02:01.645721\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}}, \"last_device_update\": \"2021-03-10T20:02:09.179518\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:02:25.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:24 gibba023 bash[13032]: audit 2021-03-10T20:02:24.120977+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:25.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:24 gibba023 bash[9844]: audit 2021-03-10T20:02:24.128733+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.146776\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147046\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147215\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147372\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147524\", \"created\": \"2021-03-10T20:02:01.645721\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}}, \"last_device_update\": \"2021-03-10T20:02:09.179518\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:02:25.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:24 gibba023 bash[13032]: audit 2021-03-10T20:02:24.128733+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.146776\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147046\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147215\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147372\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147524\", \"created\": \"2021-03-10T20:02:01.645721\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}}, \"last_device_update\": \"2021-03-10T20:02:09.179518\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:02:25.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:24 gibba023 bash[9844]: audit 2021-03-10T20:02:24.597344+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.593777\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594048\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594218\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594418\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594571\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594719\", \"created\": \"2021-03-10T20:02:24.101721\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}}, \"last_daemon_update\": \"2021-03-10T20:02:24.594983\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:02:25.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:24 gibba023 bash[9844]: audit 2021-03-10T20:02:24.605972+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.593777\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594048\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594218\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594418\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594571\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594719\", \"created\": \"2021-03-10T20:02:24.101721\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}}, \"last_daemon_update\": \"2021-03-10T20:02:24.594983\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:02:25.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:24 gibba023 bash[9844]: audit 2021-03-10T20:02:24.606726+0000 mon.a (mon.0) 426 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:25.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:24 gibba023 bash[13032]: audit 2021-03-10T20:02:24.597344+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.593777\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594048\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594218\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594418\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594571\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594719\", \"created\": \"2021-03-10T20:02:24.101721\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}}, \"last_daemon_update\": \"2021-03-10T20:02:24.594983\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:02:25.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:24 gibba023 bash[13032]: audit 2021-03-10T20:02:24.605972+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.593777\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594048\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594218\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594418\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594571\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594719\", \"created\": \"2021-03-10T20:02:24.101721\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}}, \"last_daemon_update\": \"2021-03-10T20:02:24.594983\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:02:25.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:24 gibba023 bash[13032]: audit 2021-03-10T20:02:24.606726+0000 mon.a (mon.0) 426 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:25.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:24 gibba044 bash[9859]: audit 2021-03-10T20:02:24.119295+0000 mon.a (mon.0) 421 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.146776\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147046\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147215\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147372\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147524\", \"created\": \"2021-03-10T20:02:01.645721\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}}, \"last_device_update\": \"2021-03-10T20:02:09.179518\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:02:25.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:24 gibba044 bash[9859]: audit 2021-03-10T20:02:24.120977+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:25.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:24 gibba044 bash[9859]: audit 2021-03-10T20:02:24.128733+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.146776\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147046\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147215\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147372\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:02.147524\", \"created\": \"2021-03-10T20:02:01.645721\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}}, \"last_device_update\": \"2021-03-10T20:02:09.179518\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:02:25.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:24 gibba044 bash[9859]: audit 2021-03-10T20:02:24.597344+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.593777\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594048\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594218\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594418\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594571\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594719\", \"created\": \"2021-03-10T20:02:24.101721\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}}, \"last_daemon_update\": \"2021-03-10T20:02:24.594983\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:02:25.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:24 gibba044 bash[9859]: audit 2021-03-10T20:02:24.605972+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.593777\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594048\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594218\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594418\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594571\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594719\", \"created\": \"2021-03-10T20:02:24.101721\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}}, \"last_daemon_update\": \"2021-03-10T20:02:24.594983\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:02:25.258 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:24 gibba044 bash[9859]: audit 2021-03-10T20:02:24.606726+0000 mon.a (mon.0) 426 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:25.373 DEBUG:teuthology.orchestra.run.gibba044:osd.6> sudo journalctl -f -n 0 -u ceph-dd719b26-81da-11eb-9080-001a4aab830c@osd.6.service 2021-03-10T20:02:25.376 INFO:tasks.cephadm:Deploying osd.7 on gibba044 with /dev/vg_nvme/lv_1... 2021-03-10T20:02:25.376 DEBUG:teuthology.orchestra.run.gibba044:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2021-03-10T20:02:25.461 INFO:journalctl@ceph.osd.6.gibba044.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:02:26.167 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:25 gibba044 bash[9859]: cluster 2021-03-10T20:02:24.677906+0000 mgr.y (mgr.14140) 141 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:26.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:25 gibba023 bash[9844]: cluster 2021-03-10T20:02:24.677906+0000 mgr.y (mgr.14140) 141 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:26.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:25 gibba023 bash[13032]: cluster 2021-03-10T20:02:24.677906+0000 mgr.y (mgr.14140) 141 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:26.469 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:02:26 gibba044 bash[14829]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-03-10T20:02:26.470 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:02:26 gibba044 bash[14829]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2021-03-10T20:02:26.470 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:02:26 gibba044 bash[14829]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2021-03-10T20:02:26.471 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:02:26 gibba044 bash[14829]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2021-03-10T20:02:26.471 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:02:26 gibba044 bash[14829]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-03-10T20:02:26.472 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:02:26 gibba044 bash[14829]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-03-10T20:02:26.473 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:02:26 gibba044 bash[14829]: --> ceph-volume lvm activate successful for osd ID: 6 2021-03-10T20:02:27.009 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:26 gibba044 bash[9859]: audit 2021-03-10T20:02:26.717434+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"0c99881f-7dc7-4eaa-91e6-f68f44036d07\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406508.7066813, \"finished_at\": 1615406521.6757762}, {\"id\": \"c2f74deb-072c-4705-af9c-ad4ec57fb938\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406530.7164228, \"finished_at\": 1615406544.1326172}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T20:02:27.009 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:26 gibba044 bash[9859]: audit 2021-03-10T20:02:26.727190+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"0c99881f-7dc7-4eaa-91e6-f68f44036d07\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406508.7066813, \"finished_at\": 1615406521.6757762}, {\"id\": \"c2f74deb-072c-4705-af9c-ad4ec57fb938\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406530.7164228, \"finished_at\": 1615406544.1326172}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T20:02:27.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:26 gibba023 bash[9844]: audit 2021-03-10T20:02:26.717434+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"0c99881f-7dc7-4eaa-91e6-f68f44036d07\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406508.7066813, \"finished_at\": 1615406521.6757762}, {\"id\": \"c2f74deb-072c-4705-af9c-ad4ec57fb938\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406530.7164228, \"finished_at\": 1615406544.1326172}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T20:02:27.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:26 gibba023 bash[9844]: audit 2021-03-10T20:02:26.727190+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"0c99881f-7dc7-4eaa-91e6-f68f44036d07\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406508.7066813, \"finished_at\": 1615406521.6757762}, {\"id\": \"c2f74deb-072c-4705-af9c-ad4ec57fb938\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406530.7164228, \"finished_at\": 1615406544.1326172}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T20:02:27.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:26 gibba023 bash[13032]: audit 2021-03-10T20:02:26.717434+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"0c99881f-7dc7-4eaa-91e6-f68f44036d07\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406508.7066813, \"finished_at\": 1615406521.6757762}, {\"id\": \"c2f74deb-072c-4705-af9c-ad4ec57fb938\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406530.7164228, \"finished_at\": 1615406544.1326172}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T20:02:27.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:26 gibba023 bash[13032]: audit 2021-03-10T20:02:26.727190+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"0c99881f-7dc7-4eaa-91e6-f68f44036d07\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406508.7066813, \"finished_at\": 1615406521.6757762}, {\"id\": \"c2f74deb-072c-4705-af9c-ad4ec57fb938\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406530.7164228, \"finished_at\": 1615406544.1326172}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T20:02:28.166 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:27 gibba044 bash[9859]: cluster 2021-03-10T20:02:26.678807+0000 mgr.y (mgr.14140) 142 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:28.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:27 gibba023 bash[9844]: cluster 2021-03-10T20:02:26.678807+0000 mgr.y (mgr.14140) 142 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:28.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:27 gibba023 bash[13032]: cluster 2021-03-10T20:02:26.678807+0000 mgr.y (mgr.14140) 142 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:30.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:29 gibba023 bash[9844]: cluster 2021-03-10T20:02:28.679834+0000 mgr.y (mgr.14140) 143 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:30.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:29 gibba023 bash[13032]: cluster 2021-03-10T20:02:28.679834+0000 mgr.y (mgr.14140) 143 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:30.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:29 gibba044 bash[9859]: cluster 2021-03-10T20:02:28.679834+0000 mgr.y (mgr.14140) 143 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:30.255 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:02:29 gibba044 bash[15158]: debug 2021-03-10T20:02:29.953+0000 7f87a8c4dec0 -1 Falling back to public interface 2021-03-10T20:02:30.558 INFO:teuthology.orchestra.run.gibba044.stderr:--> Zapping: /dev/vg_nvme/lv_1 2021-03-10T20:02:30.558 INFO:teuthology.orchestra.run.gibba044.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2021-03-10T20:02:30.558 INFO:teuthology.orchestra.run.gibba044.stderr: stderr: 10+0 records in 2021-03-10T20:02:30.559 INFO:teuthology.orchestra.run.gibba044.stderr:10+0 records out 2021-03-10T20:02:30.559 INFO:teuthology.orchestra.run.gibba044.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00864838 s, 1.2 GB/s 2021-03-10T20:02:30.559 INFO:teuthology.orchestra.run.gibba044.stderr:--> Zapping successful for: 2021-03-10T20:02:30.923 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:02:30 gibba044 bash[15158]: debug 2021-03-10T20:02:30.661+0000 7f87a8c4dec0 -1 osd.6 0 log_to_monitors {default=true} 2021-03-10T20:02:30.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:30 gibba044 bash[9859]: audit 2021-03-10T20:02:30.670363+0000 mon.b (mon.2) 17 : audit [INF] from='osd.6 [v2:172.21.2.144:6816/1059379749,v1:172.21.2.144:6817/1059379749]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:02:30.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:30 gibba044 bash[9859]: audit 2021-03-10T20:02:30.673216+0000 mon.a (mon.0) 429 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:02:31.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:30 gibba023 bash[9844]: audit 2021-03-10T20:02:30.670363+0000 mon.b (mon.2) 17 : audit [INF] from='osd.6 [v2:172.21.2.144:6816/1059379749,v1:172.21.2.144:6817/1059379749]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:02:31.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:30 gibba023 bash[9844]: audit 2021-03-10T20:02:30.673216+0000 mon.a (mon.0) 429 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:02:31.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:30 gibba023 bash[13032]: audit 2021-03-10T20:02:30.670363+0000 mon.b (mon.2) 17 : audit [INF] from='osd.6 [v2:172.21.2.144:6816/1059379749,v1:172.21.2.144:6817/1059379749]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:02:31.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:30 gibba023 bash[13032]: audit 2021-03-10T20:02:30.673216+0000 mon.a (mon.0) 429 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:02:31.301 DEBUG:teuthology.orchestra.run.gibba044:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph orch daemon add osd gibba044:vg_nvme/lv_1 2021-03-10T20:02:32.255 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:02:31 gibba044 bash[15158]: debug 2021-03-10T20:02:31.929+0000 7f8791a02700 -1 osd.6 0 waiting for initial osdmap 2021-03-10T20:02:32.255 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:02:31 gibba044 bash[15158]: debug 2021-03-10T20:02:31.937+0000 7f879cc1e700 -1 osd.6 41 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:02:32.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:31 gibba044 bash[9859]: cluster 2021-03-10T20:02:30.680469+0000 mgr.y (mgr.14140) 144 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:32.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:31 gibba044 bash[9859]: audit 2021-03-10T20:02:30.921778+0000 mon.b (mon.2) 18 : audit [INF] from='osd.6 [v2:172.21.2.144:6816/1059379749,v1:172.21.2.144:6817/1059379749]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:02:32.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:31 gibba044 bash[9859]: audit 2021-03-10T20:02:30.922439+0000 mon.a (mon.0) 430 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T20:02:32.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:31 gibba044 bash[9859]: cluster 2021-03-10T20:02:30.922459+0000 mon.a (mon.0) 431 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2021-03-10T20:02:32.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:31 gibba044 bash[9859]: audit 2021-03-10T20:02:30.922558+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:02:32.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:31 gibba044 bash[9859]: audit 2021-03-10T20:02:30.923756+0000 mon.a (mon.0) 433 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:02:32.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:31 gibba023 bash[9844]: cluster 2021-03-10T20:02:30.680469+0000 mgr.y (mgr.14140) 144 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:32.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:31 gibba023 bash[9844]: audit 2021-03-10T20:02:30.921778+0000 mon.b (mon.2) 18 : audit [INF] from='osd.6 [v2:172.21.2.144:6816/1059379749,v1:172.21.2.144:6817/1059379749]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:02:32.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:31 gibba023 bash[9844]: audit 2021-03-10T20:02:30.922439+0000 mon.a (mon.0) 430 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T20:02:32.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:31 gibba023 bash[9844]: cluster 2021-03-10T20:02:30.922459+0000 mon.a (mon.0) 431 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2021-03-10T20:02:32.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:31 gibba023 bash[9844]: audit 2021-03-10T20:02:30.922558+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:02:32.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:31 gibba023 bash[9844]: audit 2021-03-10T20:02:30.923756+0000 mon.a (mon.0) 433 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:02:32.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:31 gibba023 bash[13032]: cluster 2021-03-10T20:02:30.680469+0000 mgr.y (mgr.14140) 144 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:32.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:31 gibba023 bash[13032]: audit 2021-03-10T20:02:30.921778+0000 mon.b (mon.2) 18 : audit [INF] from='osd.6 [v2:172.21.2.144:6816/1059379749,v1:172.21.2.144:6817/1059379749]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:02:32.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:31 gibba023 bash[13032]: audit 2021-03-10T20:02:30.922439+0000 mon.a (mon.0) 430 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T20:02:32.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:31 gibba023 bash[13032]: cluster 2021-03-10T20:02:30.922459+0000 mon.a (mon.0) 431 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2021-03-10T20:02:32.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:31 gibba023 bash[13032]: audit 2021-03-10T20:02:30.922558+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:02:32.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:31 gibba023 bash[13032]: audit 2021-03-10T20:02:30.923756+0000 mon.a (mon.0) 433 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:02:33.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:32 gibba044 bash[9859]: cluster 2021-03-10T20:02:31.672475+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:02:33.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:32 gibba044 bash[9859]: cluster 2021-03-10T20:02:31.672642+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:02:33.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:32 gibba044 bash[9859]: audit 2021-03-10T20:02:31.932195+0000 mon.a (mon.0) 434 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]': finished 2021-03-10T20:02:33.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:32 gibba044 bash[9859]: cluster 2021-03-10T20:02:31.932252+0000 mon.a (mon.0) 435 : cluster [DBG] osdmap e41: 7 total, 6 up, 6 in 2021-03-10T20:02:33.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:32 gibba044 bash[9859]: audit 2021-03-10T20:02:31.932893+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:02:33.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:32 gibba044 bash[9859]: audit 2021-03-10T20:02:32.017561+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:33.258 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:32 gibba044 bash[9859]: audit 2021-03-10T20:02:32.126595+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.593777\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594048\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594218\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594418\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594571\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594719\", \"created\": \"2021-03-10T20:02:24.101721\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}}, \"last_daemon_update\": \"2021-03-10T20:02:24.594983\", \"last_device_update\": \"2021-03-10T20:02:32.124133\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:02:33.258 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:32 gibba044 bash[9859]: audit 2021-03-10T20:02:32.135510+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.593777\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594048\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594218\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594418\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594571\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594719\", \"created\": \"2021-03-10T20:02:24.101721\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}}, \"last_daemon_update\": \"2021-03-10T20:02:24.594983\", \"last_device_update\": \"2021-03-10T20:02:32.124133\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:02:33.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:32 gibba023 bash[9844]: cluster 2021-03-10T20:02:31.672475+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:02:33.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:32 gibba023 bash[9844]: cluster 2021-03-10T20:02:31.672642+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:02:33.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:32 gibba023 bash[9844]: audit 2021-03-10T20:02:31.932195+0000 mon.a (mon.0) 434 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]': finished 2021-03-10T20:02:33.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:32 gibba023 bash[9844]: cluster 2021-03-10T20:02:31.932252+0000 mon.a (mon.0) 435 : cluster [DBG] osdmap e41: 7 total, 6 up, 6 in 2021-03-10T20:02:33.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:32 gibba023 bash[9844]: audit 2021-03-10T20:02:31.932893+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:02:33.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:32 gibba023 bash[9844]: audit 2021-03-10T20:02:32.017561+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:33.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:32 gibba023 bash[13032]: cluster 2021-03-10T20:02:31.672475+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:02:33.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:32 gibba023 bash[13032]: cluster 2021-03-10T20:02:31.672642+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:02:33.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:32 gibba023 bash[13032]: audit 2021-03-10T20:02:31.932195+0000 mon.a (mon.0) 434 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]': finished 2021-03-10T20:02:33.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:32 gibba023 bash[13032]: cluster 2021-03-10T20:02:31.932252+0000 mon.a (mon.0) 435 : cluster [DBG] osdmap e41: 7 total, 6 up, 6 in 2021-03-10T20:02:33.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:32 gibba023 bash[13032]: audit 2021-03-10T20:02:31.932893+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:02:33.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:32 gibba023 bash[13032]: audit 2021-03-10T20:02:32.017561+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:33.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:32 gibba023 bash[9844]: audit 2021-03-10T20:02:32.126595+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.593777\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594048\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594218\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594418\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594571\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594719\", \"created\": \"2021-03-10T20:02:24.101721\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}}, \"last_daemon_update\": \"2021-03-10T20:02:24.594983\", \"last_device_update\": \"2021-03-10T20:02:32.124133\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:02:33.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:32 gibba023 bash[9844]: audit 2021-03-10T20:02:32.135510+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.593777\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594048\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594218\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594418\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594571\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594719\", \"created\": \"2021-03-10T20:02:24.101721\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}}, \"last_daemon_update\": \"2021-03-10T20:02:24.594983\", \"last_device_update\": \"2021-03-10T20:02:32.124133\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:02:33.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:32 gibba023 bash[13032]: audit 2021-03-10T20:02:32.126595+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.593777\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594048\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594218\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594418\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594571\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594719\", \"created\": \"2021-03-10T20:02:24.101721\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}}, \"last_daemon_update\": \"2021-03-10T20:02:24.594983\", \"last_device_update\": \"2021-03-10T20:02:32.124133\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:02:33.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:32 gibba023 bash[13032]: audit 2021-03-10T20:02:32.135510+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.593777\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594048\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594218\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594418\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594571\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594719\", \"created\": \"2021-03-10T20:02:24.101721\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}}, \"last_daemon_update\": \"2021-03-10T20:02:24.594983\", \"last_device_update\": \"2021-03-10T20:02:32.124133\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:02:34.218 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:33 gibba044 bash[9859]: cluster 2021-03-10T20:02:32.681261+0000 mgr.y (mgr.14140) 145 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:34.219 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:33 gibba044 bash[9859]: cluster 2021-03-10T20:02:32.945317+0000 mon.a (mon.0) 440 : cluster [INF] osd.6 [v2:172.21.2.144:6816/1059379749,v1:172.21.2.144:6817/1059379749] boot 2021-03-10T20:02:34.219 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:33 gibba044 bash[9859]: cluster 2021-03-10T20:02:32.945370+0000 mon.a (mon.0) 441 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-03-10T20:02:34.219 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:33 gibba044 bash[9859]: audit 2021-03-10T20:02:32.946016+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:02:34.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:33 gibba023 bash[9844]: cluster 2021-03-10T20:02:32.681261+0000 mgr.y (mgr.14140) 145 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:34.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:33 gibba023 bash[9844]: cluster 2021-03-10T20:02:32.945317+0000 mon.a (mon.0) 440 : cluster [INF] osd.6 [v2:172.21.2.144:6816/1059379749,v1:172.21.2.144:6817/1059379749] boot 2021-03-10T20:02:34.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:33 gibba023 bash[9844]: cluster 2021-03-10T20:02:32.945370+0000 mon.a (mon.0) 441 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-03-10T20:02:34.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:33 gibba023 bash[9844]: audit 2021-03-10T20:02:32.946016+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:02:34.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:33 gibba023 bash[13032]: cluster 2021-03-10T20:02:32.681261+0000 mgr.y (mgr.14140) 145 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 2.1 MiB used, 498 GiB / 504 GiB avail 2021-03-10T20:02:34.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:33 gibba023 bash[13032]: cluster 2021-03-10T20:02:32.945317+0000 mon.a (mon.0) 440 : cluster [INF] osd.6 [v2:172.21.2.144:6816/1059379749,v1:172.21.2.144:6817/1059379749] boot 2021-03-10T20:02:34.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:33 gibba023 bash[13032]: cluster 2021-03-10T20:02:32.945370+0000 mon.a (mon.0) 441 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-03-10T20:02:34.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:33 gibba023 bash[13032]: audit 2021-03-10T20:02:32.946016+0000 mon.a (mon.0) 442 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:02:35.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:34 gibba044 bash[9859]: cluster 2021-03-10T20:02:33.958847+0000 mon.a (mon.0) 443 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2021-03-10T20:02:35.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:34 gibba044 bash[9859]: audit 2021-03-10T20:02:34.050748+0000 mgr.y (mgr.14140) 146 : audit [DBG] from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba044:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:02:35.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:34 gibba044 bash[9859]: cephadm 2021-03-10T20:02:34.052742+0000 mgr.y (mgr.14140) 147 : cephadm [INF] Applying osd on host gibba044... 2021-03-10T20:02:35.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:34 gibba044 bash[9859]: audit 2021-03-10T20:02:34.053585+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:02:35.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:34 gibba044 bash[9859]: audit 2021-03-10T20:02:34.056359+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:35.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:34 gibba044 bash[9859]: audit 2021-03-10T20:02:34.060671+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:35.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:34 gibba023 bash[9844]: cluster 2021-03-10T20:02:33.958847+0000 mon.a (mon.0) 443 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2021-03-10T20:02:35.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:34 gibba023 bash[9844]: audit 2021-03-10T20:02:34.050748+0000 mgr.y (mgr.14140) 146 : audit [DBG] from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba044:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:02:35.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:34 gibba023 bash[9844]: cephadm 2021-03-10T20:02:34.052742+0000 mgr.y (mgr.14140) 147 : cephadm [INF] Applying osd on host gibba044... 2021-03-10T20:02:35.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:34 gibba023 bash[9844]: audit 2021-03-10T20:02:34.053585+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:02:35.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:34 gibba023 bash[9844]: audit 2021-03-10T20:02:34.056359+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:35.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:34 gibba023 bash[9844]: audit 2021-03-10T20:02:34.060671+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:35.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:34 gibba023 bash[13032]: cluster 2021-03-10T20:02:33.958847+0000 mon.a (mon.0) 443 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2021-03-10T20:02:35.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:34 gibba023 bash[13032]: audit 2021-03-10T20:02:34.050748+0000 mgr.y (mgr.14140) 146 : audit [DBG] from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba044:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:02:35.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:34 gibba023 bash[13032]: cephadm 2021-03-10T20:02:34.052742+0000 mgr.y (mgr.14140) 147 : cephadm [INF] Applying osd on host gibba044... 2021-03-10T20:02:35.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:34 gibba023 bash[13032]: audit 2021-03-10T20:02:34.053585+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-03-10T20:02:35.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:34 gibba023 bash[13032]: audit 2021-03-10T20:02:34.056359+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:35.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:34 gibba023 bash[13032]: audit 2021-03-10T20:02:34.060671+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:36.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:35 gibba044 bash[9859]: cluster 2021-03-10T20:02:34.682086+0000 mgr.y (mgr.14140) 148 : cluster [DBG] pgmap v150: 1 pgs: 1 peering; 0 B data, 2.5 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:36.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:35 gibba044 bash[9859]: cluster 2021-03-10T20:02:35.679471+0000 mon.a (mon.0) 447 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:02:36.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:35 gibba023 bash[9844]: cluster 2021-03-10T20:02:34.682086+0000 mgr.y (mgr.14140) 148 : cluster [DBG] pgmap v150: 1 pgs: 1 peering; 0 B data, 2.5 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:36.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:35 gibba023 bash[9844]: cluster 2021-03-10T20:02:35.679471+0000 mon.a (mon.0) 447 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:02:36.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:35 gibba023 bash[13032]: cluster 2021-03-10T20:02:34.682086+0000 mgr.y (mgr.14140) 148 : cluster [DBG] pgmap v150: 1 pgs: 1 peering; 0 B data, 2.5 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:36.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:35 gibba023 bash[13032]: cluster 2021-03-10T20:02:35.679471+0000 mon.a (mon.0) 447 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:02:38.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:37 gibba044 bash[9859]: cluster 2021-03-10T20:02:36.684428+0000 mgr.y (mgr.14140) 149 : cluster [DBG] pgmap v151: 1 pgs: 1 peering; 0 B data, 2.6 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:38.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:37 gibba044 bash[9859]: audit 2021-03-10T20:02:37.140291+0000 mon.b (mon.2) 19 : audit [INF] from='client.? 172.21.2.144:0/80323568' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b833ae5d-df2b-4716-9b7c-1daad27d8d5a"}]: dispatch 2021-03-10T20:02:38.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:37 gibba044 bash[9859]: audit 2021-03-10T20:02:37.143092+0000 mon.a (mon.0) 448 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b833ae5d-df2b-4716-9b7c-1daad27d8d5a"}]: dispatch 2021-03-10T20:02:38.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:37 gibba044 bash[9859]: audit 2021-03-10T20:02:37.154757+0000 mon.a (mon.0) 449 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b833ae5d-df2b-4716-9b7c-1daad27d8d5a"}]': finished 2021-03-10T20:02:38.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:37 gibba044 bash[9859]: cluster 2021-03-10T20:02:37.154881+0000 mon.a (mon.0) 450 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2021-03-10T20:02:38.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:37 gibba044 bash[9859]: audit 2021-03-10T20:02:37.155010+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:02:38.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:37 gibba023 bash[9844]: cluster 2021-03-10T20:02:36.684428+0000 mgr.y (mgr.14140) 149 : cluster [DBG] pgmap v151: 1 pgs: 1 peering; 0 B data, 2.6 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:38.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:37 gibba023 bash[9844]: audit 2021-03-10T20:02:37.140291+0000 mon.b (mon.2) 19 : audit [INF] from='client.? 172.21.2.144:0/80323568' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b833ae5d-df2b-4716-9b7c-1daad27d8d5a"}]: dispatch 2021-03-10T20:02:38.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:37 gibba023 bash[9844]: audit 2021-03-10T20:02:37.143092+0000 mon.a (mon.0) 448 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b833ae5d-df2b-4716-9b7c-1daad27d8d5a"}]: dispatch 2021-03-10T20:02:38.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:37 gibba023 bash[9844]: audit 2021-03-10T20:02:37.154757+0000 mon.a (mon.0) 449 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b833ae5d-df2b-4716-9b7c-1daad27d8d5a"}]': finished 2021-03-10T20:02:38.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:37 gibba023 bash[9844]: cluster 2021-03-10T20:02:37.154881+0000 mon.a (mon.0) 450 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2021-03-10T20:02:38.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:37 gibba023 bash[9844]: audit 2021-03-10T20:02:37.155010+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:02:38.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:37 gibba023 bash[13032]: cluster 2021-03-10T20:02:36.684428+0000 mgr.y (mgr.14140) 149 : cluster [DBG] pgmap v151: 1 pgs: 1 peering; 0 B data, 2.6 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:38.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:37 gibba023 bash[13032]: audit 2021-03-10T20:02:37.140291+0000 mon.b (mon.2) 19 : audit [INF] from='client.? 172.21.2.144:0/80323568' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b833ae5d-df2b-4716-9b7c-1daad27d8d5a"}]: dispatch 2021-03-10T20:02:38.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:37 gibba023 bash[13032]: audit 2021-03-10T20:02:37.143092+0000 mon.a (mon.0) 448 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b833ae5d-df2b-4716-9b7c-1daad27d8d5a"}]: dispatch 2021-03-10T20:02:38.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:37 gibba023 bash[13032]: audit 2021-03-10T20:02:37.154757+0000 mon.a (mon.0) 449 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b833ae5d-df2b-4716-9b7c-1daad27d8d5a"}]': finished 2021-03-10T20:02:38.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:37 gibba023 bash[13032]: cluster 2021-03-10T20:02:37.154881+0000 mon.a (mon.0) 450 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2021-03-10T20:02:38.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:37 gibba023 bash[13032]: audit 2021-03-10T20:02:37.155010+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:02:40.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:39 gibba044 bash[9859]: cluster 2021-03-10T20:02:38.685201+0000 mgr.y (mgr.14140) 150 : cluster [DBG] pgmap v153: 1 pgs: 1 peering; 0 B data, 2.7 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:40.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:39 gibba044 bash[9859]: audit 2021-03-10T20:02:39.448387+0000 mon.b (mon.2) 20 : audit [DBG] from='client.? 172.21.2.144:0/3511751809' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:02:40.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:39 gibba023 bash[9844]: cluster 2021-03-10T20:02:38.685201+0000 mgr.y (mgr.14140) 150 : cluster [DBG] pgmap v153: 1 pgs: 1 peering; 0 B data, 2.7 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:40.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:39 gibba023 bash[9844]: audit 2021-03-10T20:02:39.448387+0000 mon.b (mon.2) 20 : audit [DBG] from='client.? 172.21.2.144:0/3511751809' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:02:40.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:39 gibba023 bash[13032]: cluster 2021-03-10T20:02:38.685201+0000 mgr.y (mgr.14140) 150 : cluster [DBG] pgmap v153: 1 pgs: 1 peering; 0 B data, 2.7 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:40.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:39 gibba023 bash[13032]: audit 2021-03-10T20:02:39.448387+0000 mon.b (mon.2) 20 : audit [DBG] from='client.? 172.21.2.144:0/3511751809' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-03-10T20:02:41.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:41 gibba023 bash[9844]: cluster 2021-03-10T20:02:40.990940+0000 mon.a (mon.0) 452 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T20:02:41.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:41 gibba023 bash[9844]: cluster 2021-03-10T20:02:40.991036+0000 mon.a (mon.0) 453 : cluster [INF] Cluster is now healthy 2021-03-10T20:02:41.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:41 gibba023 bash[13032]: cluster 2021-03-10T20:02:40.990940+0000 mon.a (mon.0) 452 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T20:02:41.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:41 gibba023 bash[13032]: cluster 2021-03-10T20:02:40.991036+0000 mon.a (mon.0) 453 : cluster [INF] Cluster is now healthy 2021-03-10T20:02:41.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:41 gibba044 bash[9859]: cluster 2021-03-10T20:02:40.990940+0000 mon.a (mon.0) 452 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T20:02:41.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:41 gibba044 bash[9859]: cluster 2021-03-10T20:02:40.991036+0000 mon.a (mon.0) 453 : cluster [INF] Cluster is now healthy 2021-03-10T20:02:42.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:42 gibba023 bash[9844]: cluster 2021-03-10T20:02:40.686044+0000 mgr.y (mgr.14140) 151 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:42.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:42 gibba023 bash[9844]: audit 2021-03-10T20:02:41.986640+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:42.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:42 gibba023 bash[13032]: cluster 2021-03-10T20:02:40.686044+0000 mgr.y (mgr.14140) 151 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:42.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:42 gibba023 bash[13032]: audit 2021-03-10T20:02:41.986640+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:42.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:42 gibba044 bash[9859]: cluster 2021-03-10T20:02:40.686044+0000 mgr.y (mgr.14140) 151 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:42.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:42 gibba044 bash[9859]: audit 2021-03-10T20:02:41.986640+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:44.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:44 gibba023 bash[9844]: cluster 2021-03-10T20:02:42.686905+0000 mgr.y (mgr.14140) 152 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:44.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:44 gibba023 bash[13032]: cluster 2021-03-10T20:02:42.686905+0000 mgr.y (mgr.14140) 152 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:44.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:44 gibba044 bash[9859]: cluster 2021-03-10T20:02:42.686905+0000 mgr.y (mgr.14140) 152 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:45.956 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:45 gibba044 bash[9859]: cluster 2021-03-10T20:02:44.687582+0000 mgr.y (mgr.14140) 153 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:45.956 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:45 gibba044 bash[9859]: audit 2021-03-10T20:02:45.162019+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-03-10T20:02:45.957 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:45 gibba044 bash[9859]: audit 2021-03-10T20:02:45.164772+0000 mon.a (mon.0) 456 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:45.957 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:45 gibba044 bash[9859]: audit 2021-03-10T20:02:45.168084+0000 mon.a (mon.0) 457 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-03-10T20:02:46.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:45 gibba023 bash[9844]: cluster 2021-03-10T20:02:44.687582+0000 mgr.y (mgr.14140) 153 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:46.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:45 gibba023 bash[9844]: audit 2021-03-10T20:02:45.162019+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-03-10T20:02:46.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:45 gibba023 bash[9844]: audit 2021-03-10T20:02:45.164772+0000 mon.a (mon.0) 456 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:46.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:45 gibba023 bash[9844]: audit 2021-03-10T20:02:45.168084+0000 mon.a (mon.0) 457 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-03-10T20:02:46.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:45 gibba023 bash[13032]: cluster 2021-03-10T20:02:44.687582+0000 mgr.y (mgr.14140) 153 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:46.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:45 gibba023 bash[13032]: audit 2021-03-10T20:02:45.162019+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-03-10T20:02:46.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:45 gibba023 bash[13032]: audit 2021-03-10T20:02:45.164772+0000 mon.a (mon.0) 456 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:02:46.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:45 gibba023 bash[13032]: audit 2021-03-10T20:02:45.168084+0000 mon.a (mon.0) 457 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-03-10T20:02:46.925 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:46 gibba044 bash[9859]: cephadm 2021-03-10T20:02:45.167137+0000 mgr.y (mgr.14140) 154 : cephadm [INF] Deploying daemon osd.7 on gibba044 2021-03-10T20:02:47.075 INFO:teuthology.orchestra.run.gibba044.stdout:Created osd(s) 7 on host 'gibba044' 2021-03-10T20:02:47.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:46 gibba023 bash[9844]: cephadm 2021-03-10T20:02:45.167137+0000 mgr.y (mgr.14140) 154 : cephadm [INF] Deploying daemon osd.7 on gibba044 2021-03-10T20:02:47.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:46 gibba023 bash[13032]: cephadm 2021-03-10T20:02:45.167137+0000 mgr.y (mgr.14140) 154 : cephadm [INF] Deploying daemon osd.7 on gibba044 2021-03-10T20:02:48.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:47 gibba044 bash[9859]: cluster 2021-03-10T20:02:46.688440+0000 mgr.y (mgr.14140) 155 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:48.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:47 gibba044 bash[9859]: audit 2021-03-10T20:02:46.958475+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.593777\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594048\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594218\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594418\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594571\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594719\", \"created\": \"2021-03-10T20:02:24.101721\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}}, \"last_device_update\": \"2021-03-10T20:02:32.124133\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:02:48.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:47 gibba044 bash[9859]: audit 2021-03-10T20:02:46.959982+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:48.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:47 gibba044 bash[9859]: audit 2021-03-10T20:02:46.966827+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.593777\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594048\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594218\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594418\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594571\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594719\", \"created\": \"2021-03-10T20:02:24.101721\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}}, \"last_device_update\": \"2021-03-10T20:02:32.124133\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:02:48.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:47 gibba044 bash[9859]: audit 2021-03-10T20:02:47.533998+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530059\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530367\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530540\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530697\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530847\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530999\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.531148\", \"created\": \"2021-03-10T20:02:46.941722\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}}, \"last_daemon_update\": \"2021-03-10T20:02:47.531417\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:02:48.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:47 gibba044 bash[9859]: audit 2021-03-10T20:02:47.542712+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530059\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530367\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530540\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530697\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530847\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530999\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.531148\", \"created\": \"2021-03-10T20:02:46.941722\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}}, \"last_daemon_update\": \"2021-03-10T20:02:47.531417\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:02:48.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:47 gibba044 bash[9859]: audit 2021-03-10T20:02:47.543491+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:48.058 DEBUG:teuthology.orchestra.run.gibba044:osd.7> sudo journalctl -f -n 0 -u ceph-dd719b26-81da-11eb-9080-001a4aab830c@osd.7.service 2021-03-10T20:02:48.061 INFO:tasks.cephadm:Adding prometheus.a on gibba044 2021-03-10T20:02:48.062 DEBUG:teuthology.orchestra.run.gibba044:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph orch apply prometheus '1;gibba044=a' 2021-03-10T20:02:48.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:47 gibba023 bash[9844]: cluster 2021-03-10T20:02:46.688440+0000 mgr.y (mgr.14140) 155 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:48.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:47 gibba023 bash[13032]: cluster 2021-03-10T20:02:46.688440+0000 mgr.y (mgr.14140) 155 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:48.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:47 gibba023 bash[9844]: audit 2021-03-10T20:02:46.958475+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.593777\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594048\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594218\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594418\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594571\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594719\", \"created\": \"2021-03-10T20:02:24.101721\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}}, \"last_device_update\": \"2021-03-10T20:02:32.124133\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:02:48.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:47 gibba023 bash[9844]: audit 2021-03-10T20:02:46.959982+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:48.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:47 gibba023 bash[13032]: audit 2021-03-10T20:02:46.958475+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.593777\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594048\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594218\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594418\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594571\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594719\", \"created\": \"2021-03-10T20:02:24.101721\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}}, \"last_device_update\": \"2021-03-10T20:02:32.124133\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:02:48.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:47 gibba023 bash[13032]: audit 2021-03-10T20:02:46.959982+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:48.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:47 gibba023 bash[9844]: audit 2021-03-10T20:02:46.966827+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.593777\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594048\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594218\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594418\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594571\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594719\", \"created\": \"2021-03-10T20:02:24.101721\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}}, \"last_device_update\": \"2021-03-10T20:02:32.124133\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:02:48.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:47 gibba023 bash[13032]: audit 2021-03-10T20:02:46.966827+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.593777\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594048\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594218\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594418\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594571\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:24.594719\", \"created\": \"2021-03-10T20:02:24.101721\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}}, \"last_device_update\": \"2021-03-10T20:02:32.124133\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:02:48.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:47 gibba023 bash[9844]: audit 2021-03-10T20:02:47.533998+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530059\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530367\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530540\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530697\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530847\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530999\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.531148\", \"created\": \"2021-03-10T20:02:46.941722\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}}, \"last_daemon_update\": \"2021-03-10T20:02:47.531417\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:02:48.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:47 gibba023 bash[13032]: audit 2021-03-10T20:02:47.533998+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530059\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530367\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530540\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530697\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530847\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530999\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.531148\", \"created\": \"2021-03-10T20:02:46.941722\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}}, \"last_daemon_update\": \"2021-03-10T20:02:47.531417\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:02:48.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:47 gibba023 bash[9844]: audit 2021-03-10T20:02:47.542712+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530059\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530367\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530540\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530697\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530847\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530999\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.531148\", \"created\": \"2021-03-10T20:02:46.941722\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}}, \"last_daemon_update\": \"2021-03-10T20:02:47.531417\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:02:48.183 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:47 gibba023 bash[9844]: audit 2021-03-10T20:02:47.543491+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:48.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:47 gibba023 bash[13032]: audit 2021-03-10T20:02:47.542712+0000 mon.a (mon.0) 462 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530059\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530367\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530540\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530697\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530847\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530999\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.531148\", \"created\": \"2021-03-10T20:02:46.941722\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}}, \"last_daemon_update\": \"2021-03-10T20:02:47.531417\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:02:48.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:47 gibba023 bash[13032]: audit 2021-03-10T20:02:47.543491+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-03-10T20:02:48.239 INFO:journalctl@ceph.osd.7.gibba044.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:02:49.478 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:02:49 gibba044 bash[16275]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-03-10T20:02:49.478 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:02:49 gibba044 bash[16275]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2021-03-10T20:02:49.479 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:02:49 gibba044 bash[16275]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2021-03-10T20:02:49.479 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:02:49 gibba044 bash[16275]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2021-03-10T20:02:49.479 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:02:49 gibba044 bash[16275]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-03-10T20:02:49.479 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:02:49 gibba044 bash[16275]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-03-10T20:02:49.479 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:02:49 gibba044 bash[16275]: --> ceph-volume lvm activate successful for osd ID: 7 2021-03-10T20:02:49.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:49 gibba044 bash[9859]: cluster 2021-03-10T20:02:48.689265+0000 mgr.y (mgr.14140) 156 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:50.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:49 gibba023 bash[9844]: cluster 2021-03-10T20:02:48.689265+0000 mgr.y (mgr.14140) 156 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:50.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:49 gibba023 bash[13032]: cluster 2021-03-10T20:02:48.689265+0000 mgr.y (mgr.14140) 156 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:52.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:51 gibba044 bash[9859]: cluster 2021-03-10T20:02:50.690308+0000 mgr.y (mgr.14140) 157 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:52.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:51 gibba023 bash[9844]: cluster 2021-03-10T20:02:50.690308+0000 mgr.y (mgr.14140) 157 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:52.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:51 gibba023 bash[13032]: cluster 2021-03-10T20:02:50.690308+0000 mgr.y (mgr.14140) 157 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:52.676 INFO:teuthology.orchestra.run.gibba044.stdout:Scheduled prometheus update... 2021-03-10T20:02:53.005 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:02:52 gibba044 bash[16667]: debug 2021-03-10T20:02:52.841+0000 7f10caea5ec0 -1 Falling back to public interface 2021-03-10T20:02:53.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:52 gibba044 bash[9859]: audit 2021-03-10T20:02:51.732615+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"0c99881f-7dc7-4eaa-91e6-f68f44036d07\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406508.7066813, \"finished_at\": 1615406521.6757762}, {\"id\": \"c2f74deb-072c-4705-af9c-ad4ec57fb938\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406530.7164228, \"finished_at\": 1615406544.1326172}, {\"id\": \"bd62fc8d-8ca2-4129-988e-8f1bc9256b70\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615406552.9449513, \"finished_at\": 1615406566.9700556}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T20:02:53.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:52 gibba044 bash[9859]: audit 2021-03-10T20:02:51.736559+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"0c99881f-7dc7-4eaa-91e6-f68f44036d07\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406508.7066813, \"finished_at\": 1615406521.6757762}, {\"id\": \"c2f74deb-072c-4705-af9c-ad4ec57fb938\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406530.7164228, \"finished_at\": 1615406544.1326172}, {\"id\": \"bd62fc8d-8ca2-4129-988e-8f1bc9256b70\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615406552.9449513, \"finished_at\": 1615406566.9700556}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T20:02:53.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:52 gibba044 bash[9859]: audit 2021-03-10T20:02:52.664872+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T20:02:52.663930\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba044\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2021-03-10T20:02:53.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:52 gibba044 bash[9859]: audit 2021-03-10T20:02:52.673369+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T20:02:52.663930\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba044\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2021-03-10T20:02:53.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:52 gibba023 bash[9844]: audit 2021-03-10T20:02:51.732615+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"0c99881f-7dc7-4eaa-91e6-f68f44036d07\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406508.7066813, \"finished_at\": 1615406521.6757762}, {\"id\": \"c2f74deb-072c-4705-af9c-ad4ec57fb938\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406530.7164228, \"finished_at\": 1615406544.1326172}, {\"id\": \"bd62fc8d-8ca2-4129-988e-8f1bc9256b70\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615406552.9449513, \"finished_at\": 1615406566.9700556}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T20:02:53.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:52 gibba023 bash[9844]: audit 2021-03-10T20:02:51.736559+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"0c99881f-7dc7-4eaa-91e6-f68f44036d07\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406508.7066813, \"finished_at\": 1615406521.6757762}, {\"id\": \"c2f74deb-072c-4705-af9c-ad4ec57fb938\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406530.7164228, \"finished_at\": 1615406544.1326172}, {\"id\": \"bd62fc8d-8ca2-4129-988e-8f1bc9256b70\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615406552.9449513, \"finished_at\": 1615406566.9700556}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T20:02:53.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:52 gibba023 bash[9844]: audit 2021-03-10T20:02:52.664872+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T20:02:52.663930\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba044\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2021-03-10T20:02:53.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:52 gibba023 bash[9844]: audit 2021-03-10T20:02:52.673369+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T20:02:52.663930\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba044\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2021-03-10T20:02:53.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:52 gibba023 bash[13032]: audit 2021-03-10T20:02:51.732615+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"0c99881f-7dc7-4eaa-91e6-f68f44036d07\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406508.7066813, \"finished_at\": 1615406521.6757762}, {\"id\": \"c2f74deb-072c-4705-af9c-ad4ec57fb938\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406530.7164228, \"finished_at\": 1615406544.1326172}, {\"id\": \"bd62fc8d-8ca2-4129-988e-8f1bc9256b70\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615406552.9449513, \"finished_at\": 1615406566.9700556}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T20:02:53.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:52 gibba023 bash[13032]: audit 2021-03-10T20:02:51.736559+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"0c99881f-7dc7-4eaa-91e6-f68f44036d07\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406508.7066813, \"finished_at\": 1615406521.6757762}, {\"id\": \"c2f74deb-072c-4705-af9c-ad4ec57fb938\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406530.7164228, \"finished_at\": 1615406544.1326172}, {\"id\": \"bd62fc8d-8ca2-4129-988e-8f1bc9256b70\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615406552.9449513, \"finished_at\": 1615406566.9700556}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T20:02:53.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:52 gibba023 bash[13032]: audit 2021-03-10T20:02:52.664872+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T20:02:52.663930\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba044\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2021-03-10T20:02:53.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:52 gibba023 bash[13032]: audit 2021-03-10T20:02:52.673369+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2021-03-10T20:02:52.663930\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba044\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2021-03-10T20:02:53.292 DEBUG:teuthology.orchestra.run.gibba044:prometheus.a> sudo journalctl -f -n 0 -u ceph-dd719b26-81da-11eb-9080-001a4aab830c@prometheus.a.service 2021-03-10T20:02:53.305 INFO:tasks.cephadm:Adding node-exporter.a on gibba023 2021-03-10T20:02:53.305 INFO:tasks.cephadm:Adding node-exporter.b on gibba044 2021-03-10T20:02:53.306 DEBUG:teuthology.orchestra.run.gibba044:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph orch apply node-exporter '2;gibba023=a;gibba044=b' 2021-03-10T20:02:53.342 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:02:53.744 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:02:53 gibba044 bash[16667]: debug 2021-03-10T20:02:53.513+0000 7f10caea5ec0 -1 osd.7 0 log_to_monitors {default=true} 2021-03-10T20:02:54.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:53 gibba044 bash[9859]: audit 2021-03-10T20:02:52.662588+0000 mgr.y (mgr.14140) 158 : audit [DBG] from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;gibba044=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:02:54.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:53 gibba044 bash[9859]: cephadm 2021-03-10T20:02:52.663895+0000 mgr.y (mgr.14140) 159 : cephadm [INF] Saving service prometheus spec with placement count:1 gibba044=a 2021-03-10T20:02:54.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:53 gibba044 bash[9859]: cluster 2021-03-10T20:02:52.690995+0000 mgr.y (mgr.14140) 160 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:54.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:53 gibba044 bash[9859]: audit 2021-03-10T20:02:53.519968+0000 mon.b (mon.2) 21 : audit [INF] from='osd.7 [v2:172.21.2.144:6824/3721100466,v1:172.21.2.144:6825/3721100466]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T20:02:54.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:53 gibba044 bash[9859]: audit 2021-03-10T20:02:53.522606+0000 mon.a (mon.0) 468 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T20:02:54.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:53 gibba023 bash[9844]: audit 2021-03-10T20:02:52.662588+0000 mgr.y (mgr.14140) 158 : audit [DBG] from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;gibba044=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:02:54.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:53 gibba023 bash[9844]: cephadm 2021-03-10T20:02:52.663895+0000 mgr.y (mgr.14140) 159 : cephadm [INF] Saving service prometheus spec with placement count:1 gibba044=a 2021-03-10T20:02:54.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:53 gibba023 bash[9844]: cluster 2021-03-10T20:02:52.690995+0000 mgr.y (mgr.14140) 160 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:54.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:53 gibba023 bash[9844]: audit 2021-03-10T20:02:53.519968+0000 mon.b (mon.2) 21 : audit [INF] from='osd.7 [v2:172.21.2.144:6824/3721100466,v1:172.21.2.144:6825/3721100466]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T20:02:54.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:53 gibba023 bash[9844]: audit 2021-03-10T20:02:53.522606+0000 mon.a (mon.0) 468 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T20:02:54.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:53 gibba023 bash[13032]: audit 2021-03-10T20:02:52.662588+0000 mgr.y (mgr.14140) 158 : audit [DBG] from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;gibba044=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:02:54.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:53 gibba023 bash[13032]: cephadm 2021-03-10T20:02:52.663895+0000 mgr.y (mgr.14140) 159 : cephadm [INF] Saving service prometheus spec with placement count:1 gibba044=a 2021-03-10T20:02:54.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:53 gibba023 bash[13032]: cluster 2021-03-10T20:02:52.690995+0000 mgr.y (mgr.14140) 160 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:54.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:53 gibba023 bash[13032]: audit 2021-03-10T20:02:53.519968+0000 mon.b (mon.2) 21 : audit [INF] from='osd.7 [v2:172.21.2.144:6824/3721100466,v1:172.21.2.144:6825/3721100466]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T20:02:54.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:53 gibba023 bash[13032]: audit 2021-03-10T20:02:53.522606+0000 mon.a (mon.0) 468 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T20:02:54.854 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:02:54 gibba044 bash[16667]: debug 2021-03-10T20:02:54.749+0000 7f10b3c5a700 -1 osd.7 0 waiting for initial osdmap 2021-03-10T20:02:54.854 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:02:54 gibba044 bash[16667]: debug 2021-03-10T20:02:54.753+0000 7f10bee76700 -1 osd.7 46 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:02:54.855 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:54 gibba044 bash[9859]: audit 2021-03-10T20:02:53.737874+0000 mon.a (mon.0) 469 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T20:02:54.855 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:54 gibba044 bash[9859]: cluster 2021-03-10T20:02:53.737935+0000 mon.a (mon.0) 470 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2021-03-10T20:02:54.856 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:54 gibba044 bash[9859]: audit 2021-03-10T20:02:53.738221+0000 mon.b (mon.2) 22 : audit [INF] from='osd.7 [v2:172.21.2.144:6824/3721100466,v1:172.21.2.144:6825/3721100466]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:02:54.856 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:54 gibba044 bash[9859]: audit 2021-03-10T20:02:53.738525+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:02:54.856 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:54 gibba044 bash[9859]: audit 2021-03-10T20:02:53.745574+0000 mon.a (mon.0) 472 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:02:54.856 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:54 gibba044 bash[9859]: audit 2021-03-10T20:02:54.447867+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:54.856 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:54 gibba044 bash[9859]: cluster 2021-03-10T20:02:54.488195+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:02:54.857 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:54 gibba044 bash[9859]: cluster 2021-03-10T20:02:54.488225+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:02:54.857 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:54 gibba044 bash[9859]: audit 2021-03-10T20:02:54.559014+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530059\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530367\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530540\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530697\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530847\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530999\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.531148\", \"created\": \"2021-03-10T20:02:46.941722\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}}, \"last_daemon_update\": \"2021-03-10T20:02:47.531417\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:02:54.858 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:54 gibba044 bash[9859]: audit 2021-03-10T20:02:54.568184+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530059\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530367\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530540\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530697\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530847\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530999\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.531148\", \"created\": \"2021-03-10T20:02:46.941722\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}}, \"last_daemon_update\": \"2021-03-10T20:02:47.531417\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:02:55.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:54 gibba023 bash[9844]: audit 2021-03-10T20:02:53.737874+0000 mon.a (mon.0) 469 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T20:02:55.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:54 gibba023 bash[9844]: cluster 2021-03-10T20:02:53.737935+0000 mon.a (mon.0) 470 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2021-03-10T20:02:55.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:54 gibba023 bash[9844]: audit 2021-03-10T20:02:53.738221+0000 mon.b (mon.2) 22 : audit [INF] from='osd.7 [v2:172.21.2.144:6824/3721100466,v1:172.21.2.144:6825/3721100466]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:02:55.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:54 gibba023 bash[9844]: audit 2021-03-10T20:02:53.738525+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:02:55.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:54 gibba023 bash[9844]: audit 2021-03-10T20:02:53.745574+0000 mon.a (mon.0) 472 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:02:55.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:54 gibba023 bash[9844]: audit 2021-03-10T20:02:54.447867+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:55.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:54 gibba023 bash[9844]: cluster 2021-03-10T20:02:54.488195+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:02:55.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:54 gibba023 bash[9844]: cluster 2021-03-10T20:02:54.488225+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:02:55.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:54 gibba023 bash[13032]: audit 2021-03-10T20:02:53.737874+0000 mon.a (mon.0) 469 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T20:02:55.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:54 gibba023 bash[13032]: cluster 2021-03-10T20:02:53.737935+0000 mon.a (mon.0) 470 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2021-03-10T20:02:55.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:54 gibba023 bash[13032]: audit 2021-03-10T20:02:53.738221+0000 mon.b (mon.2) 22 : audit [INF] from='osd.7 [v2:172.21.2.144:6824/3721100466,v1:172.21.2.144:6825/3721100466]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:02:55.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:54 gibba023 bash[13032]: audit 2021-03-10T20:02:53.738525+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:02:55.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:54 gibba023 bash[13032]: audit 2021-03-10T20:02:53.745574+0000 mon.a (mon.0) 472 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:02:55.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:54 gibba023 bash[13032]: audit 2021-03-10T20:02:54.447867+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:02:55.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:54 gibba023 bash[13032]: cluster 2021-03-10T20:02:54.488195+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-03-10T20:02:55.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:54 gibba023 bash[13032]: cluster 2021-03-10T20:02:54.488225+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-03-10T20:02:55.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:54 gibba023 bash[9844]: audit 2021-03-10T20:02:54.559014+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530059\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530367\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530540\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530697\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530847\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530999\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.531148\", \"created\": \"2021-03-10T20:02:46.941722\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}}, \"last_daemon_update\": \"2021-03-10T20:02:47.531417\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:02:55.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:54 gibba023 bash[9844]: audit 2021-03-10T20:02:54.568184+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530059\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530367\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530540\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530697\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530847\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530999\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.531148\", \"created\": \"2021-03-10T20:02:46.941722\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}}, \"last_daemon_update\": \"2021-03-10T20:02:47.531417\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:02:55.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:54 gibba023 bash[13032]: audit 2021-03-10T20:02:54.559014+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530059\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530367\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530540\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530697\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530847\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530999\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.531148\", \"created\": \"2021-03-10T20:02:46.941722\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}}, \"last_daemon_update\": \"2021-03-10T20:02:47.531417\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:02:55.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:54 gibba023 bash[13032]: audit 2021-03-10T20:02:54.568184+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530059\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530367\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530540\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530697\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530847\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530999\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.531148\", \"created\": \"2021-03-10T20:02:46.941722\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}}, \"last_daemon_update\": \"2021-03-10T20:02:47.531417\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:02:56.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:55 gibba023 bash[9844]: cephadm 2021-03-10T20:02:54.571162+0000 mgr.y (mgr.14140) 161 : cephadm [INF] Deploying daemon prometheus.a on gibba044 2021-03-10T20:02:56.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:55 gibba023 bash[9844]: cluster 2021-03-10T20:02:54.691613+0000 mgr.y (mgr.14140) 162 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:56.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:55 gibba023 bash[9844]: audit 2021-03-10T20:02:54.751435+0000 mon.a (mon.0) 476 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]': finished 2021-03-10T20:02:56.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:55 gibba023 bash[9844]: cluster 2021-03-10T20:02:54.751616+0000 mon.a (mon.0) 477 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2021-03-10T20:02:56.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:55 gibba023 bash[9844]: audit 2021-03-10T20:02:54.753082+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:02:56.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:55 gibba023 bash[9844]: cluster 2021-03-10T20:02:55.751188+0000 mon.a (mon.0) 479 : cluster [INF] osd.7 [v2:172.21.2.144:6824/3721100466,v1:172.21.2.144:6825/3721100466] boot 2021-03-10T20:02:56.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:55 gibba023 bash[9844]: cluster 2021-03-10T20:02:55.751246+0000 mon.a (mon.0) 480 : cluster [DBG] osdmap e47: 8 total, 8 up, 8 in 2021-03-10T20:02:56.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:55 gibba023 bash[9844]: audit 2021-03-10T20:02:55.751439+0000 mon.a (mon.0) 481 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:02:56.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:55 gibba023 bash[13032]: cephadm 2021-03-10T20:02:54.571162+0000 mgr.y (mgr.14140) 161 : cephadm [INF] Deploying daemon prometheus.a on gibba044 2021-03-10T20:02:56.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:55 gibba023 bash[13032]: cluster 2021-03-10T20:02:54.691613+0000 mgr.y (mgr.14140) 162 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:56.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:55 gibba023 bash[13032]: audit 2021-03-10T20:02:54.751435+0000 mon.a (mon.0) 476 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]': finished 2021-03-10T20:02:56.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:55 gibba023 bash[13032]: cluster 2021-03-10T20:02:54.751616+0000 mon.a (mon.0) 477 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2021-03-10T20:02:56.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:55 gibba023 bash[13032]: audit 2021-03-10T20:02:54.753082+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:02:56.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:55 gibba023 bash[13032]: cluster 2021-03-10T20:02:55.751188+0000 mon.a (mon.0) 479 : cluster [INF] osd.7 [v2:172.21.2.144:6824/3721100466,v1:172.21.2.144:6825/3721100466] boot 2021-03-10T20:02:56.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:55 gibba023 bash[13032]: cluster 2021-03-10T20:02:55.751246+0000 mon.a (mon.0) 480 : cluster [DBG] osdmap e47: 8 total, 8 up, 8 in 2021-03-10T20:02:56.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:55 gibba023 bash[13032]: audit 2021-03-10T20:02:55.751439+0000 mon.a (mon.0) 481 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:02:56.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:55 gibba044 bash[9859]: cephadm 2021-03-10T20:02:54.571162+0000 mgr.y (mgr.14140) 161 : cephadm [INF] Deploying daemon prometheus.a on gibba044 2021-03-10T20:02:56.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:55 gibba044 bash[9859]: cluster 2021-03-10T20:02:54.691613+0000 mgr.y (mgr.14140) 162 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 2.8 MiB used, 581 GiB / 588 GiB avail 2021-03-10T20:02:56.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:55 gibba044 bash[9859]: audit 2021-03-10T20:02:54.751435+0000 mon.a (mon.0) 476 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]': finished 2021-03-10T20:02:56.258 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:55 gibba044 bash[9859]: cluster 2021-03-10T20:02:54.751616+0000 mon.a (mon.0) 477 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2021-03-10T20:02:56.258 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:55 gibba044 bash[9859]: audit 2021-03-10T20:02:54.753082+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:02:56.258 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:55 gibba044 bash[9859]: cluster 2021-03-10T20:02:55.751188+0000 mon.a (mon.0) 479 : cluster [INF] osd.7 [v2:172.21.2.144:6824/3721100466,v1:172.21.2.144:6825/3721100466] boot 2021-03-10T20:02:56.258 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:55 gibba044 bash[9859]: cluster 2021-03-10T20:02:55.751246+0000 mon.a (mon.0) 480 : cluster [DBG] osdmap e47: 8 total, 8 up, 8 in 2021-03-10T20:02:56.259 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:55 gibba044 bash[9859]: audit 2021-03-10T20:02:55.751439+0000 mon.a (mon.0) 481 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:02:57.254 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:02:56 gibba044 bash[15158]: debug 2021-03-10T20:02:56.769+0000 7f8786bf2700 -1 osd.6 48 build_incremental_map_msg missing incremental map 48 2021-03-10T20:02:57.560 INFO:teuthology.orchestra.run.gibba044.stdout:Scheduled node-exporter update... 2021-03-10T20:02:57.637 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:02:57 gibba044 bash[15158]: debug 2021-03-10T20:02:57.265+0000 7f87a2499700 -1 osd.6 48 build_incremental_map_msg missing incremental map 48 2021-03-10T20:02:58.028 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:57 gibba044 bash[9859]: cluster 2021-03-10T20:02:56.692547+0000 mgr.y (mgr.14140) 163 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 3.3 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:02:58.028 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:57 gibba044 bash[9859]: cluster 2021-03-10T20:02:56.772846+0000 mon.a (mon.0) 482 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2021-03-10T20:02:58.028 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:57 gibba044 bash[9859]: audit 2021-03-10T20:02:57.549490+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T20:02:57.548509\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba023\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba044\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2021-03-10T20:02:58.029 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:57 gibba044 bash[9859]: audit 2021-03-10T20:02:57.557792+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T20:02:57.548509\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba023\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba044\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2021-03-10T20:02:58.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:57 gibba023 bash[9844]: cluster 2021-03-10T20:02:56.692547+0000 mgr.y (mgr.14140) 163 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 3.3 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:02:58.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:57 gibba023 bash[9844]: cluster 2021-03-10T20:02:56.772846+0000 mon.a (mon.0) 482 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2021-03-10T20:02:58.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:57 gibba023 bash[9844]: audit 2021-03-10T20:02:57.549490+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T20:02:57.548509\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba023\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba044\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2021-03-10T20:02:58.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:57 gibba023 bash[9844]: audit 2021-03-10T20:02:57.557792+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T20:02:57.548509\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba023\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba044\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2021-03-10T20:02:58.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:57 gibba023 bash[13032]: cluster 2021-03-10T20:02:56.692547+0000 mgr.y (mgr.14140) 163 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 3.3 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:02:58.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:57 gibba023 bash[13032]: cluster 2021-03-10T20:02:56.772846+0000 mon.a (mon.0) 482 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2021-03-10T20:02:58.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:57 gibba023 bash[13032]: audit 2021-03-10T20:02:57.549490+0000 mon.a (mon.0) 483 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T20:02:57.548509\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba023\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba044\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2021-03-10T20:02:58.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:57 gibba023 bash[13032]: audit 2021-03-10T20:02:57.557792+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2021-03-10T20:02:57.548509\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"gibba023\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"gibba044\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2021-03-10T20:02:59.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:58 gibba023 bash[9844]: audit 2021-03-10T20:02:57.547066+0000 mgr.y (mgr.14140) 164 : audit [DBG] from='client.34235 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;gibba023=a;gibba044=b", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:02:59.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:58 gibba023 bash[9844]: cephadm 2021-03-10T20:02:57.548475+0000 mgr.y (mgr.14140) 165 : cephadm [INF] Saving service node-exporter spec with placement count:2 gibba023=a,gibba044=b 2021-03-10T20:02:59.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:58 gibba023 bash[13032]: audit 2021-03-10T20:02:57.547066+0000 mgr.y (mgr.14140) 164 : audit [DBG] from='client.34235 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;gibba023=a;gibba044=b", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:02:59.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:58 gibba023 bash[13032]: cephadm 2021-03-10T20:02:57.548475+0000 mgr.y (mgr.14140) 165 : cephadm [INF] Saving service node-exporter spec with placement count:2 gibba023=a,gibba044=b 2021-03-10T20:02:59.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:58 gibba044 bash[9859]: audit 2021-03-10T20:02:57.547066+0000 mgr.y (mgr.14140) 164 : audit [DBG] from='client.34235 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;gibba023=a;gibba044=b", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:02:59.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:58 gibba044 bash[9859]: cephadm 2021-03-10T20:02:57.548475+0000 mgr.y (mgr.14140) 165 : cephadm [INF] Saving service node-exporter spec with placement count:2 gibba023=a,gibba044=b 2021-03-10T20:02:59.519 DEBUG:teuthology.orchestra.run.gibba023:node-exporter.a> sudo journalctl -f -n 0 -u ceph-dd719b26-81da-11eb-9080-001a4aab830c@node-exporter.a.service 2021-03-10T20:02:59.523 DEBUG:teuthology.orchestra.run.gibba044:node-exporter.b> sudo journalctl -f -n 0 -u ceph-dd719b26-81da-11eb-9080-001a4aab830c@node-exporter.b.service 2021-03-10T20:02:59.525 INFO:tasks.cephadm:Adding alertmanager.a on gibba023 2021-03-10T20:02:59.526 DEBUG:teuthology.orchestra.run.gibba044:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph orch apply alertmanager '1;gibba023=a' 2021-03-10T20:02:59.530 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:02:59.531 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:03:00.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:02:59 gibba044 bash[9859]: cluster 2021-03-10T20:02:58.693393+0000 mgr.y (mgr.14140) 166 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 3.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:00.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:02:59 gibba023 bash[9844]: cluster 2021-03-10T20:02:58.693393+0000 mgr.y (mgr.14140) 166 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 3.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:00.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:02:59 gibba023 bash[13032]: cluster 2021-03-10T20:02:58.693393+0000 mgr.y (mgr.14140) 166 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 3.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:02.125 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:01 gibba044 bash[9859]: cluster 2021-03-10T20:03:00.694323+0000 mgr.y (mgr.14140) 167 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:02.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:01 gibba023 bash[9844]: cluster 2021-03-10T20:03:00.694323+0000 mgr.y (mgr.14140) 167 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:02.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:01 gibba023 bash[13032]: cluster 2021-03-10T20:03:00.694323+0000 mgr.y (mgr.14140) 167 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 3.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:03.765 INFO:teuthology.orchestra.run.gibba044.stdout:Scheduled alertmanager update... 2021-03-10T20:03:04.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:03 gibba044 bash[9859]: cluster 2021-03-10T20:03:02.695385+0000 mgr.y (mgr.14140) 168 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:04.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:03 gibba044 bash[9859]: audit 2021-03-10T20:03:03.753354+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T20:03:03.752414\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba023\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2021-03-10T20:03:04.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:03 gibba044 bash[9859]: audit 2021-03-10T20:03:03.762533+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T20:03:03.752414\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba023\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2021-03-10T20:03:04.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:03 gibba023 bash[9844]: cluster 2021-03-10T20:03:02.695385+0000 mgr.y (mgr.14140) 168 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:04.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:03 gibba023 bash[9844]: audit 2021-03-10T20:03:03.753354+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T20:03:03.752414\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba023\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2021-03-10T20:03:04.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:03 gibba023 bash[9844]: audit 2021-03-10T20:03:03.762533+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T20:03:03.752414\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba023\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2021-03-10T20:03:04.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:03 gibba023 bash[13032]: cluster 2021-03-10T20:03:02.695385+0000 mgr.y (mgr.14140) 168 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:04.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:03 gibba023 bash[13032]: audit 2021-03-10T20:03:03.753354+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T20:03:03.752414\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba023\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2021-03-10T20:03:04.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:03 gibba023 bash[13032]: audit 2021-03-10T20:03:03.762533+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2021-03-10T20:03:03.752414\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba023\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2021-03-10T20:03:04.836 DEBUG:teuthology.orchestra.run.gibba023:alertmanager.a> sudo journalctl -f -n 0 -u ceph-dd719b26-81da-11eb-9080-001a4aab830c@alertmanager.a.service 2021-03-10T20:03:04.839 INFO:tasks.cephadm:Adding grafana.a on gibba044 2021-03-10T20:03:04.840 DEBUG:teuthology.orchestra.run.gibba044:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph orch apply grafana '1;gibba044=a' 2021-03-10T20:03:04.853 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:03:05.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:04 gibba023 bash[9844]: audit 2021-03-10T20:03:03.751053+0000 mgr.y (mgr.14140) 169 : audit [DBG] from='client.34241 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;gibba023=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:03:05.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:04 gibba023 bash[9844]: cephadm 2021-03-10T20:03:03.752378+0000 mgr.y (mgr.14140) 170 : cephadm [INF] Saving service alertmanager spec with placement count:1 gibba023=a 2021-03-10T20:03:05.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:04 gibba023 bash[13032]: audit 2021-03-10T20:03:03.751053+0000 mgr.y (mgr.14140) 169 : audit [DBG] from='client.34241 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;gibba023=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:03:05.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:04 gibba023 bash[13032]: cephadm 2021-03-10T20:03:03.752378+0000 mgr.y (mgr.14140) 170 : cephadm [INF] Saving service alertmanager spec with placement count:1 gibba023=a 2021-03-10T20:03:05.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:04 gibba044 bash[9859]: audit 2021-03-10T20:03:03.751053+0000 mgr.y (mgr.14140) 169 : audit [DBG] from='client.34241 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;gibba023=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:03:05.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:04 gibba044 bash[9859]: cephadm 2021-03-10T20:03:03.752378+0000 mgr.y (mgr.14140) 170 : cephadm [INF] Saving service alertmanager spec with placement count:1 gibba023=a 2021-03-10T20:03:06.105 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:05 gibba044 bash[9859]: cluster 2021-03-10T20:03:04.696084+0000 mgr.y (mgr.14140) 171 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:06.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:05 gibba023 bash[9844]: cluster 2021-03-10T20:03:04.696084+0000 mgr.y (mgr.14140) 171 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:06.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:05 gibba023 bash[13032]: cluster 2021-03-10T20:03:04.696084+0000 mgr.y (mgr.14140) 171 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:06.990 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:06 gibba044 bash[9859]: audit 2021-03-10T20:03:06.739359+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"0c99881f-7dc7-4eaa-91e6-f68f44036d07\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406508.7066813, \"finished_at\": 1615406521.6757762}, {\"id\": \"c2f74deb-072c-4705-af9c-ad4ec57fb938\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406530.7164228, \"finished_at\": 1615406544.1326172}, {\"id\": \"bd62fc8d-8ca2-4129-988e-8f1bc9256b70\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615406552.9449513, \"finished_at\": 1615406566.9700556}, {\"id\": \"ccb51b5d-44fd-4670-9bf9-659563a46d01\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615406575.7507927, \"finished_at\": 1615406586.007307}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T20:03:06.990 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:06 gibba044 bash[9859]: audit 2021-03-10T20:03:06.748454+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"0c99881f-7dc7-4eaa-91e6-f68f44036d07\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406508.7066813, \"finished_at\": 1615406521.6757762}, {\"id\": \"c2f74deb-072c-4705-af9c-ad4ec57fb938\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406530.7164228, \"finished_at\": 1615406544.1326172}, {\"id\": \"bd62fc8d-8ca2-4129-988e-8f1bc9256b70\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615406552.9449513, \"finished_at\": 1615406566.9700556}, {\"id\": \"ccb51b5d-44fd-4670-9bf9-659563a46d01\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615406575.7507927, \"finished_at\": 1615406586.007307}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T20:03:07.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:06 gibba023 bash[9844]: audit 2021-03-10T20:03:06.739359+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"0c99881f-7dc7-4eaa-91e6-f68f44036d07\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406508.7066813, \"finished_at\": 1615406521.6757762}, {\"id\": \"c2f74deb-072c-4705-af9c-ad4ec57fb938\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406530.7164228, \"finished_at\": 1615406544.1326172}, {\"id\": \"bd62fc8d-8ca2-4129-988e-8f1bc9256b70\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615406552.9449513, \"finished_at\": 1615406566.9700556}, {\"id\": \"ccb51b5d-44fd-4670-9bf9-659563a46d01\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615406575.7507927, \"finished_at\": 1615406586.007307}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T20:03:07.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:06 gibba023 bash[9844]: audit 2021-03-10T20:03:06.748454+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"0c99881f-7dc7-4eaa-91e6-f68f44036d07\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406508.7066813, \"finished_at\": 1615406521.6757762}, {\"id\": \"c2f74deb-072c-4705-af9c-ad4ec57fb938\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406530.7164228, \"finished_at\": 1615406544.1326172}, {\"id\": \"bd62fc8d-8ca2-4129-988e-8f1bc9256b70\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615406552.9449513, \"finished_at\": 1615406566.9700556}, {\"id\": \"ccb51b5d-44fd-4670-9bf9-659563a46d01\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615406575.7507927, \"finished_at\": 1615406586.007307}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T20:03:07.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:06 gibba023 bash[13032]: audit 2021-03-10T20:03:06.739359+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"0c99881f-7dc7-4eaa-91e6-f68f44036d07\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406508.7066813, \"finished_at\": 1615406521.6757762}, {\"id\": \"c2f74deb-072c-4705-af9c-ad4ec57fb938\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406530.7164228, \"finished_at\": 1615406544.1326172}, {\"id\": \"bd62fc8d-8ca2-4129-988e-8f1bc9256b70\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615406552.9449513, \"finished_at\": 1615406566.9700556}, {\"id\": \"ccb51b5d-44fd-4670-9bf9-659563a46d01\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615406575.7507927, \"finished_at\": 1615406586.007307}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2021-03-10T20:03:07.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:06 gibba023 bash[13032]: audit 2021-03-10T20:03:06.748454+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"0c99881f-7dc7-4eaa-91e6-f68f44036d07\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1615406508.7066813, \"finished_at\": 1615406521.6757762}, {\"id\": \"c2f74deb-072c-4705-af9c-ad4ec57fb938\", \"message\": \"Rebalancing after osd.5 marked in\", \"refs\": [[\"osd\", 5]], \"started_at\": 1615406530.7164228, \"finished_at\": 1615406544.1326172}, {\"id\": \"bd62fc8d-8ca2-4129-988e-8f1bc9256b70\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1615406552.9449513, \"finished_at\": 1615406566.9700556}, {\"id\": \"ccb51b5d-44fd-4670-9bf9-659563a46d01\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1615406575.7507927, \"finished_at\": 1615406586.007307}], \"version\": 2, \"compat_version\": 2}"}]': finished 2021-03-10T20:03:07.505 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:07 gibba044 docker[17843]: Error: No such container: ceph-dd719b26-81da-11eb-9080-001a4aab830c-prometheus.a 2021-03-10T20:03:07.506 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:07 gibba044 systemd[1]: Started Ceph prometheus.a for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:03:08.106 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:07 gibba044 bash[9859]: cluster 2021-03-10T20:03:06.697105+0000 mgr.y (mgr.14140) 172 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:08.107 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:07 gibba044 bash[9859]: audit 2021-03-10T20:03:07.157544+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530059\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530367\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530540\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530697\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530847\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530999\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.531148\", \"created\": \"2021-03-10T20:02:46.941722\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:03:08.107 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:07 gibba044 bash[9859]: audit 2021-03-10T20:03:07.166461+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530059\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530367\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530540\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530697\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530847\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530999\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.531148\", \"created\": \"2021-03-10T20:02:46.941722\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:03:08.107 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:07 gibba044 bash[9859]: audit 2021-03-10T20:03:07.167178+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:08.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:07 gibba023 bash[9844]: cluster 2021-03-10T20:03:06.697105+0000 mgr.y (mgr.14140) 172 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:08.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:07 gibba023 bash[13032]: cluster 2021-03-10T20:03:06.697105+0000 mgr.y (mgr.14140) 172 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:08.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:07 gibba023 bash[9844]: audit 2021-03-10T20:03:07.157544+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530059\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530367\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530540\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530697\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530847\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530999\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.531148\", \"created\": \"2021-03-10T20:02:46.941722\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:03:08.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:07 gibba023 bash[9844]: audit 2021-03-10T20:03:07.166461+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530059\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530367\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530540\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530697\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530847\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530999\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.531148\", \"created\": \"2021-03-10T20:02:46.941722\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:03:08.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:07 gibba023 bash[9844]: audit 2021-03-10T20:03:07.167178+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:08.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:07 gibba023 bash[13032]: audit 2021-03-10T20:03:07.157544+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530059\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530367\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530540\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530697\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530847\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530999\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.531148\", \"created\": \"2021-03-10T20:02:46.941722\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:03:08.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:07 gibba023 bash[13032]: audit 2021-03-10T20:03:07.166461+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530059\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530367\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530540\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530697\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530847\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.530999\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:02:47.531148\", \"created\": \"2021-03-10T20:02:46.941722\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:03:08.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:07 gibba023 bash[13032]: audit 2021-03-10T20:03:07.167178+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:08.362 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:08 gibba044 docker[18120]: Error: No such container: ceph-dd719b26-81da-11eb-9080-001a4aab830c-node-exporter.b 2021-03-10T20:03:08.362 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:08 gibba044 systemd[1]: Started Ceph node-exporter.b for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:03:08.614 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[18139]: Unable to find image 'prom/node-exporter:latest' locally 2021-03-10T20:03:08.916 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[18139]: latest: Pulling from prom/node-exporter 2021-03-10T20:03:08.916 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[18139]: dc6dd4561653: Pulling fs layer 2021-03-10T20:03:08.917 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[18139]: 613f88646930: Pulling fs layer 2021-03-10T20:03:08.917 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[18139]: edad907fb257: Pulling fs layer 2021-03-10T20:03:08.917 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[18139]: 613f88646930: Download complete 2021-03-10T20:03:08.917 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[18139]: dc6dd4561653: Verifying Checksum 2021-03-10T20:03:08.918 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[18139]: dc6dd4561653: Download complete 2021-03-10T20:03:08.918 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[18139]: edad907fb257: Verifying Checksum 2021-03-10T20:03:08.918 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[18139]: edad907fb257: Download complete 2021-03-10T20:03:08.918 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[18139]: dc6dd4561653: Pull complete 2021-03-10T20:03:08.919 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:08.755Z caller=main.go:366 msg="No time or size retention was set so using the default time retention" duration=15d 2021-03-10T20:03:08.919 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:08.755Z caller=main.go:404 msg="Starting Prometheus" version="(version=2.25.0, branch=HEAD, revision=a6be548dbc17780d562a39c0e4bd0bd4c00ad6e2)" 2021-03-10T20:03:08.919 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:08.755Z caller=main.go:409 build_context="(go=go1.15.8, user=root@615f028225c9, date=20210217-14:17:24)" 2021-03-10T20:03:08.921 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:08.755Z caller=main.go:410 host_details="(Linux 5.4.0-66-generic #74-Ubuntu SMP Wed Jan 27 22:54:38 UTC 2021 x86_64 gibba044 (none))" 2021-03-10T20:03:08.921 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:08.755Z caller=main.go:411 fd_limits="(soft=1048576, hard=1048576)" 2021-03-10T20:03:08.921 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:08.755Z caller=main.go:412 vm_limits="(soft=unlimited, hard=unlimited)" 2021-03-10T20:03:08.921 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:08.756Z caller=web.go:532 component=web msg="Start listening for connections" address=:9095 2021-03-10T20:03:08.922 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:08.756Z caller=main.go:779 msg="Starting TSDB ..." 2021-03-10T20:03:08.922 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:08.757Z caller=tls_config.go:191 component=web msg="TLS is disabled." http2=false 2021-03-10T20:03:08.922 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:08.758Z caller=head.go:668 component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2021-03-10T20:03:08.922 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:08.758Z caller=head.go:682 component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.533µs 2021-03-10T20:03:08.923 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:08.758Z caller=head.go:688 component=tsdb msg="Replaying WAL, this may take a while" 2021-03-10T20:03:08.923 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:08.758Z caller=head.go:740 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2021-03-10T20:03:08.923 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:08.758Z caller=head.go:745 component=tsdb msg="WAL replay completed" checkpoint_replay_duration=13.034µs wal_replay_duration=209.041µs total_replay_duration=237.103µs 2021-03-10T20:03:08.923 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:08.759Z caller=main.go:799 fs_type=XFS_SUPER_MAGIC 2021-03-10T20:03:08.924 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:08.759Z caller=main.go:802 msg="TSDB started" 2021-03-10T20:03:08.924 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:08.759Z caller=main.go:928 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2021-03-10T20:03:08.924 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:08.760Z caller=main.go:959 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=931.255µs remote_storage=1.8µs web_handler=266ns query_engine=588ns scrape=372.898µs scrape_sd=55.895µs notify=1.583µs notify_sd=8.312µs rules=24.371µs 2021-03-10T20:03:08.924 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:08.760Z caller=main.go:751 msg="Server is ready to receive web requests." 2021-03-10T20:03:08.926 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[9859]: audit 2021-03-10T20:03:07.934580+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930255\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930557\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930726\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930882\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931032\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931179\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931326\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931472\", \"created\": \"2021-03-10T20:03:07.141722\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}}, \"last_daemon_update\": \"2021-03-10T20:03:07.931735\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:03:08.926 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[9859]: audit 2021-03-10T20:03:07.943285+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930255\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930557\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930726\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930882\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931032\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931179\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931326\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931472\", \"created\": \"2021-03-10T20:03:07.141722\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}}, \"last_daemon_update\": \"2021-03-10T20:03:07.931735\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:03:08.926 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[9859]: audit 2021-03-10T20:03:07.944486+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T20:03:08.927 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[9859]: audit 2021-03-10T20:03:07.945150+0000 mon.a (mon.0) 495 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:03:08.927 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[9859]: cephadm 2021-03-10T20:03:07.945834+0000 mgr.y (mgr.14140) 173 : cephadm [INF] Deploying daemon node-exporter.b on gibba044 2021-03-10T20:03:08.927 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[9859]: audit 2021-03-10T20:03:08.350815+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930255\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930557\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930726\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930882\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931032\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931179\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931326\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931472\", \"created\": \"2021-03-10T20:03:07.141722\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:03:08.927 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[9859]: audit 2021-03-10T20:03:08.359688+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930255\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930557\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930726\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930882\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931032\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931179\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931326\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931472\", \"created\": \"2021-03-10T20:03:07.141722\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:03:08.928 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[9859]: audit 2021-03-10T20:03:08.360768+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T20:03:08.928 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[9859]: audit 2021-03-10T20:03:08.361789+0000 mon.a (mon.0) 499 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:03:08.928 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[9859]: audit 2021-03-10T20:03:08.759445+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487092\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487151\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487181\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487208\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487235\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487260\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487287\", \"created\": \"2021-03-10T20:01:19.922947\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:03:08.929 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:08 gibba044 bash[9859]: audit 2021-03-10T20:03:08.762676+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487092\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487151\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487181\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487208\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487235\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487260\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487287\", \"created\": \"2021-03-10T20:01:19.922947\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:03:08.950 INFO:teuthology.orchestra.run.gibba044.stdout:Scheduled grafana update... 2021-03-10T20:03:09.004 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:08 gibba023 systemd[1]: Started Ceph node-exporter.a for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:03:09.004 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:08 gibba023 bash[19731]: Unable to find image 'prom/node-exporter:latest' locally 2021-03-10T20:03:09.004 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:08 gibba023 bash[19731]: latest: Pulling from prom/node-exporter 2021-03-10T20:03:09.004 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:09 gibba023 bash[19731]: dc6dd4561653: Pulling fs layer 2021-03-10T20:03:09.005 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:08 gibba023 bash[9844]: audit 2021-03-10T20:03:07.934580+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930255\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930557\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930726\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930882\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931032\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931179\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931326\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931472\", \"created\": \"2021-03-10T20:03:07.141722\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}}, \"last_daemon_update\": \"2021-03-10T20:03:07.931735\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:03:09.006 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:08 gibba023 bash[13032]: audit 2021-03-10T20:03:07.934580+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930255\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930557\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930726\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930882\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931032\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931179\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931326\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931472\", \"created\": \"2021-03-10T20:03:07.141722\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}}, \"last_daemon_update\": \"2021-03-10T20:03:07.931735\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:03:09.007 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:08 gibba023 bash[9844]: audit 2021-03-10T20:03:07.943285+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930255\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930557\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930726\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930882\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931032\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931179\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931326\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931472\", \"created\": \"2021-03-10T20:03:07.141722\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}}, \"last_daemon_update\": \"2021-03-10T20:03:07.931735\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:03:09.007 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:08 gibba023 bash[9844]: audit 2021-03-10T20:03:07.944486+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T20:03:09.007 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:08 gibba023 bash[9844]: audit 2021-03-10T20:03:07.945150+0000 mon.a (mon.0) 495 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:03:09.007 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:08 gibba023 bash[9844]: cephadm 2021-03-10T20:03:07.945834+0000 mgr.y (mgr.14140) 173 : cephadm [INF] Deploying daemon node-exporter.b on gibba044 2021-03-10T20:03:09.008 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:08 gibba023 bash[13032]: audit 2021-03-10T20:03:07.943285+0000 mon.a (mon.0) 493 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930255\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930557\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930726\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930882\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931032\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931179\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931326\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931472\", \"created\": \"2021-03-10T20:03:07.141722\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}}, \"last_daemon_update\": \"2021-03-10T20:03:07.931735\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:03:09.008 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:08 gibba023 bash[13032]: audit 2021-03-10T20:03:07.944486+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T20:03:09.008 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:08 gibba023 bash[13032]: audit 2021-03-10T20:03:07.945150+0000 mon.a (mon.0) 495 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:03:09.009 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:08 gibba023 bash[13032]: cephadm 2021-03-10T20:03:07.945834+0000 mgr.y (mgr.14140) 173 : cephadm [INF] Deploying daemon node-exporter.b on gibba044 2021-03-10T20:03:09.009 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:08 gibba023 bash[9844]: audit 2021-03-10T20:03:08.350815+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930255\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930557\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930726\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930882\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931032\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931179\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931326\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931472\", \"created\": \"2021-03-10T20:03:07.141722\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:03:09.010 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:08 gibba023 bash[9844]: audit 2021-03-10T20:03:08.359688+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930255\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930557\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930726\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930882\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931032\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931179\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931326\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931472\", \"created\": \"2021-03-10T20:03:07.141722\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:03:09.010 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:08 gibba023 bash[9844]: audit 2021-03-10T20:03:08.360768+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T20:03:09.010 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:08 gibba023 bash[9844]: audit 2021-03-10T20:03:08.361789+0000 mon.a (mon.0) 499 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:03:09.020 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:08 gibba023 bash[13032]: audit 2021-03-10T20:03:08.350815+0000 mon.a (mon.0) 496 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930255\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930557\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930726\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930882\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931032\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931179\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931326\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931472\", \"created\": \"2021-03-10T20:03:07.141722\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:03:09.021 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:08 gibba023 bash[9844]: audit 2021-03-10T20:03:08.759445+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487092\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487151\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487181\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487208\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487235\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487260\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487287\", \"created\": \"2021-03-10T20:01:19.922947\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:03:09.021 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:08 gibba023 bash[9844]: audit 2021-03-10T20:03:08.762676+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487092\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487151\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487181\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487208\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487235\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487260\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487287\", \"created\": \"2021-03-10T20:01:19.922947\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:03:09.021 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:08 gibba023 bash[13032]: audit 2021-03-10T20:03:08.359688+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930255\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930557\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930726\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.930882\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931032\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931179\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931326\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:07.931472\", \"created\": \"2021-03-10T20:03:07.141722\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:03:09.022 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:08 gibba023 bash[13032]: audit 2021-03-10T20:03:08.360768+0000 mon.a (mon.0) 498 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2021-03-10T20:03:09.022 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:08 gibba023 bash[13032]: audit 2021-03-10T20:03:08.361789+0000 mon.a (mon.0) 499 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:03:09.022 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:08 gibba023 bash[13032]: audit 2021-03-10T20:03:08.759445+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487092\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487151\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487181\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487208\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487235\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487260\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487287\", \"created\": \"2021-03-10T20:01:19.922947\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:03:09.023 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:08 gibba023 bash[13032]: audit 2021-03-10T20:03:08.762676+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487092\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487151\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487181\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487208\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487235\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487260\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487287\", \"created\": \"2021-03-10T20:01:19.922947\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:03:09.378 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:09 gibba023 bash[19731]: 613f88646930: Pulling fs layer 2021-03-10T20:03:09.379 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:09 gibba023 bash[19731]: edad907fb257: Pulling fs layer 2021-03-10T20:03:09.379 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:09 gibba023 bash[19731]: 613f88646930: Verifying Checksum 2021-03-10T20:03:09.379 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:09 gibba023 bash[19731]: 613f88646930: Download complete 2021-03-10T20:03:09.380 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:09 gibba023 bash[19731]: dc6dd4561653: Download complete 2021-03-10T20:03:09.380 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:09 gibba023 bash[19731]: edad907fb257: Verifying Checksum 2021-03-10T20:03:09.380 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:09 gibba023 bash[19731]: edad907fb257: Download complete 2021-03-10T20:03:09.380 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:09 gibba023 bash[19731]: dc6dd4561653: Pull complete 2021-03-10T20:03:10.004 DEBUG:teuthology.orchestra.run.gibba044:grafana.a> sudo journalctl -f -n 0 -u ceph-dd719b26-81da-11eb-9080-001a4aab830c@grafana.a.service 2021-03-10T20:03:10.006 INFO:tasks.cephadm:Setting up client nodes... 2021-03-10T20:03:10.007 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-03-10T20:03:10.015 INFO:journalctl@ceph.grafana.a.gibba044.stdout:-- Logs begin at Wed 2021-03-03 23:49:35 UTC. -- 2021-03-10T20:03:10.099 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:09 gibba023 bash[19731]: 613f88646930: Pull complete 2021-03-10T20:03:10.100 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:09 gibba023 bash[9844]: cephadm 2021-03-10T20:03:08.362417+0000 mgr.y (mgr.14140) 174 : cephadm [INF] Deploying daemon node-exporter.a on gibba023 2021-03-10T20:03:10.100 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:09 gibba023 bash[9844]: cluster 2021-03-10T20:03:08.697459+0000 mgr.y (mgr.14140) 175 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:10.100 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:09 gibba023 bash[9844]: cephadm 2021-03-10T20:03:08.765156+0000 mgr.y (mgr.14140) 176 : cephadm [INF] Deploying daemon alertmanager.a on gibba023 2021-03-10T20:03:10.101 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:09 gibba023 bash[9844]: audit 2021-03-10T20:03:08.937371+0000 mgr.y (mgr.14140) 177 : audit [DBG] from='client.34247 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;gibba044=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:03:10.101 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:09 gibba023 bash[9844]: cephadm 2021-03-10T20:03:08.938689+0000 mgr.y (mgr.14140) 178 : cephadm [INF] Saving service grafana spec with placement count:1 gibba044=a 2021-03-10T20:03:10.101 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:09 gibba023 bash[9844]: audit 2021-03-10T20:03:08.939654+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T20:03:08.938723\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba044\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2021-03-10T20:03:10.101 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:09 gibba023 bash[9844]: audit 2021-03-10T20:03:08.947786+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T20:03:08.938723\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba044\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2021-03-10T20:03:10.102 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:09 gibba023 bash[13032]: cephadm 2021-03-10T20:03:08.362417+0000 mgr.y (mgr.14140) 174 : cephadm [INF] Deploying daemon node-exporter.a on gibba023 2021-03-10T20:03:10.102 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:09 gibba023 bash[13032]: cluster 2021-03-10T20:03:08.697459+0000 mgr.y (mgr.14140) 175 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:10.102 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:09 gibba023 bash[13032]: cephadm 2021-03-10T20:03:08.765156+0000 mgr.y (mgr.14140) 176 : cephadm [INF] Deploying daemon alertmanager.a on gibba023 2021-03-10T20:03:10.103 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:09 gibba023 bash[13032]: audit 2021-03-10T20:03:08.937371+0000 mgr.y (mgr.14140) 177 : audit [DBG] from='client.34247 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;gibba044=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:03:10.103 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:09 gibba023 bash[13032]: cephadm 2021-03-10T20:03:08.938689+0000 mgr.y (mgr.14140) 178 : cephadm [INF] Saving service grafana spec with placement count:1 gibba044=a 2021-03-10T20:03:10.103 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:09 gibba023 bash[13032]: audit 2021-03-10T20:03:08.939654+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T20:03:08.938723\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba044\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2021-03-10T20:03:10.103 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:09 gibba023 bash[13032]: audit 2021-03-10T20:03:08.947786+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T20:03:08.938723\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba044\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2021-03-10T20:03:10.197 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:09 gibba044 bash[18139]: 613f88646930: Pull complete 2021-03-10T20:03:10.198 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:09 gibba044 bash[9859]: cephadm 2021-03-10T20:03:08.362417+0000 mgr.y (mgr.14140) 174 : cephadm [INF] Deploying daemon node-exporter.a on gibba023 2021-03-10T20:03:10.198 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:09 gibba044 bash[9859]: cluster 2021-03-10T20:03:08.697459+0000 mgr.y (mgr.14140) 175 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:10.198 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:09 gibba044 bash[9859]: cephadm 2021-03-10T20:03:08.765156+0000 mgr.y (mgr.14140) 176 : cephadm [INF] Deploying daemon alertmanager.a on gibba023 2021-03-10T20:03:10.198 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:09 gibba044 bash[9859]: audit 2021-03-10T20:03:08.937371+0000 mgr.y (mgr.14140) 177 : audit [DBG] from='client.34247 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;gibba044=a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:03:10.199 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:09 gibba044 bash[9859]: cephadm 2021-03-10T20:03:08.938689+0000 mgr.y (mgr.14140) 178 : cephadm [INF] Saving service grafana spec with placement count:1 gibba044=a 2021-03-10T20:03:10.199 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:09 gibba044 bash[9859]: audit 2021-03-10T20:03:08.939654+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T20:03:08.938723\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba044\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2021-03-10T20:03:10.199 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:09 gibba044 bash[9859]: audit 2021-03-10T20:03:08.947786+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2021-03-10T20:03:08.938723\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"gibba044\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2021-03-10T20:03:10.427 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:10 gibba023 bash[19731]: edad907fb257: Pull complete 2021-03-10T20:03:10.508 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:10 gibba044 bash[18139]: edad907fb257: Pull complete 2021-03-10T20:03:10.509 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:10 gibba044 bash[18139]: Digest: sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810 2021-03-10T20:03:10.509 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:10 gibba044 bash[18139]: Status: Downloaded newer image for prom/node-exporter:latest 2021-03-10T20:03:10.929 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:10 gibba023 bash[19731]: Digest: sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810 2021-03-10T20:03:11.427 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:11 gibba023 bash[19731]: Status: Downloaded newer image for prom/node-exporter:latest 2021-03-10T20:03:11.756 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.455Z caller=node_exporter.go:178 msg="Starting node_exporter" version="(version=1.1.2, branch=HEAD, revision=b597c1244d7bef49e6f3359c87a56dd7707f6719)" 2021-03-10T20:03:11.981 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.455Z caller=node_exporter.go:179 msg="Build context" build_context="(go=go1.15.8, user=root@f07de8ca602a, date=20210305-09:29:10)" 2021-03-10T20:03:11.982 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.455Z caller=filesystem_common.go:74 collector=filesystem msg="Parsed flag --collector.filesystem.ignored-mount-points" flag=^/(dev|proc|sys|var/lib/docker/.+)($|/) 2021-03-10T20:03:11.982 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.455Z caller=filesystem_common.go:76 collector=filesystem msg="Parsed flag --collector.filesystem.ignored-fs-types" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2021-03-10T20:03:11.982 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.455Z caller=node_exporter.go:106 msg="Enabled collectors" 2021-03-10T20:03:11.982 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.455Z caller=node_exporter.go:113 collector=arp 2021-03-10T20:03:11.983 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.455Z caller=node_exporter.go:113 collector=bcache 2021-03-10T20:03:11.983 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.455Z caller=node_exporter.go:113 collector=bonding 2021-03-10T20:03:11.983 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.455Z caller=node_exporter.go:113 collector=btrfs 2021-03-10T20:03:11.983 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.455Z caller=node_exporter.go:113 collector=conntrack 2021-03-10T20:03:11.984 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.455Z caller=node_exporter.go:113 collector=cpu 2021-03-10T20:03:11.984 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.455Z caller=node_exporter.go:113 collector=cpufreq 2021-03-10T20:03:11.984 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.455Z caller=node_exporter.go:113 collector=diskstats 2021-03-10T20:03:11.984 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.455Z caller=node_exporter.go:113 collector=edac 2021-03-10T20:03:11.985 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.455Z caller=node_exporter.go:113 collector=entropy 2021-03-10T20:03:11.985 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.455Z caller=node_exporter.go:113 collector=fibrechannel 2021-03-10T20:03:11.985 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.455Z caller=node_exporter.go:113 collector=filefd 2021-03-10T20:03:11.985 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.455Z caller=node_exporter.go:113 collector=filesystem 2021-03-10T20:03:11.985 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.455Z caller=node_exporter.go:113 collector=hwmon 2021-03-10T20:03:11.986 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.455Z caller=node_exporter.go:113 collector=infiniband 2021-03-10T20:03:11.986 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.455Z caller=node_exporter.go:113 collector=ipvs 2021-03-10T20:03:11.987 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.455Z caller=node_exporter.go:113 collector=loadavg 2021-03-10T20:03:11.987 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.455Z caller=node_exporter.go:113 collector=mdadm 2021-03-10T20:03:11.987 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.456Z caller=node_exporter.go:113 collector=meminfo 2021-03-10T20:03:11.987 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.456Z caller=node_exporter.go:113 collector=netclass 2021-03-10T20:03:11.988 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.456Z caller=node_exporter.go:113 collector=netdev 2021-03-10T20:03:11.988 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.456Z caller=node_exporter.go:113 collector=netstat 2021-03-10T20:03:11.988 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.456Z caller=node_exporter.go:113 collector=nfs 2021-03-10T20:03:11.988 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.456Z caller=node_exporter.go:113 collector=nfsd 2021-03-10T20:03:11.989 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.456Z caller=node_exporter.go:113 collector=powersupplyclass 2021-03-10T20:03:11.989 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.456Z caller=node_exporter.go:113 collector=pressure 2021-03-10T20:03:11.989 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.456Z caller=node_exporter.go:113 collector=rapl 2021-03-10T20:03:11.989 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.456Z caller=node_exporter.go:113 collector=schedstat 2021-03-10T20:03:11.990 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.456Z caller=node_exporter.go:113 collector=sockstat 2021-03-10T20:03:11.990 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.456Z caller=node_exporter.go:113 collector=softnet 2021-03-10T20:03:11.990 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.456Z caller=node_exporter.go:113 collector=stat 2021-03-10T20:03:11.990 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.456Z caller=node_exporter.go:113 collector=textfile 2021-03-10T20:03:11.991 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.456Z caller=node_exporter.go:113 collector=thermal_zone 2021-03-10T20:03:11.991 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.456Z caller=node_exporter.go:113 collector=time 2021-03-10T20:03:11.991 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.456Z caller=node_exporter.go:113 collector=udp_queues 2021-03-10T20:03:11.991 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.456Z caller=node_exporter.go:113 collector=uname 2021-03-10T20:03:11.992 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.456Z caller=node_exporter.go:113 collector=vmstat 2021-03-10T20:03:11.992 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.456Z caller=node_exporter.go:113 collector=xfs 2021-03-10T20:03:11.992 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.456Z caller=node_exporter.go:113 collector=zfs 2021-03-10T20:03:11.992 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.456Z caller=node_exporter.go:195 msg="Listening on" address=:9100 2021-03-10T20:03:11.993 INFO:journalctl@ceph.node-exporter.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[18139]: level=info ts=2021-03-10T20:03:11.456Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2021-03-10T20:03:12.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:11 gibba023 bash[9844]: cluster 2021-03-10T20:03:10.698162+0000 mgr.y (mgr.14140) 179 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:12.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:11 gibba023 bash[13032]: cluster 2021-03-10T20:03:10.698162+0000 mgr.y (mgr.14140) 179 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:12.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:11 gibba044 bash[9859]: cluster 2021-03-10T20:03:10.698162+0000 mgr.y (mgr.14140) 179 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:13.836 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.606Z caller=node_exporter.go:178 msg="Starting node_exporter" version="(version=1.1.2, branch=HEAD, revision=b597c1244d7bef49e6f3359c87a56dd7707f6719)" 2021-03-10T20:03:13.837 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.606Z caller=node_exporter.go:179 msg="Build context" build_context="(go=go1.15.8, user=root@f07de8ca602a, date=20210305-09:29:10)" 2021-03-10T20:03:13.837 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.606Z caller=filesystem_common.go:74 collector=filesystem msg="Parsed flag --collector.filesystem.ignored-mount-points" flag=^/(dev|proc|sys|var/lib/docker/.+)($|/) 2021-03-10T20:03:13.837 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.606Z caller=filesystem_common.go:76 collector=filesystem msg="Parsed flag --collector.filesystem.ignored-fs-types" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2021-03-10T20:03:13.837 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:106 msg="Enabled collectors" 2021-03-10T20:03:13.838 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=arp 2021-03-10T20:03:13.838 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=bcache 2021-03-10T20:03:13.838 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=bonding 2021-03-10T20:03:13.838 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=btrfs 2021-03-10T20:03:13.839 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=conntrack 2021-03-10T20:03:13.839 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=cpu 2021-03-10T20:03:13.839 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=cpufreq 2021-03-10T20:03:13.839 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=diskstats 2021-03-10T20:03:13.839 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=edac 2021-03-10T20:03:13.840 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=entropy 2021-03-10T20:03:13.840 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=fibrechannel 2021-03-10T20:03:13.840 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=filefd 2021-03-10T20:03:13.840 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=filesystem 2021-03-10T20:03:13.840 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=hwmon 2021-03-10T20:03:13.841 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=infiniband 2021-03-10T20:03:13.841 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=ipvs 2021-03-10T20:03:13.841 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=loadavg 2021-03-10T20:03:13.841 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=mdadm 2021-03-10T20:03:13.841 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=meminfo 2021-03-10T20:03:13.842 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=netclass 2021-03-10T20:03:13.842 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=netdev 2021-03-10T20:03:13.842 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=netstat 2021-03-10T20:03:13.843 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=nfs 2021-03-10T20:03:13.843 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=nfsd 2021-03-10T20:03:13.843 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=powersupplyclass 2021-03-10T20:03:13.844 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=pressure 2021-03-10T20:03:13.844 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=rapl 2021-03-10T20:03:13.844 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=schedstat 2021-03-10T20:03:13.844 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=sockstat 2021-03-10T20:03:13.844 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=softnet 2021-03-10T20:03:13.845 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=stat 2021-03-10T20:03:13.845 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=textfile 2021-03-10T20:03:13.845 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=thermal_zone 2021-03-10T20:03:13.845 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=time 2021-03-10T20:03:13.845 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=udp_queues 2021-03-10T20:03:13.846 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=uname 2021-03-10T20:03:13.846 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=vmstat 2021-03-10T20:03:13.846 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=xfs 2021-03-10T20:03:13.846 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:113 collector=zfs 2021-03-10T20:03:13.847 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=node_exporter.go:195 msg="Listening on" address=:9100 2021-03-10T20:03:13.847 INFO:journalctl@ceph.node-exporter.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[19731]: level=info ts=2021-03-10T20:03:13.607Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2021-03-10T20:03:14.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[9844]: cluster 2021-03-10T20:03:12.698992+0000 mgr.y (mgr.14140) 180 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:14.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:13 gibba023 bash[13032]: cluster 2021-03-10T20:03:12.698992+0000 mgr.y (mgr.14140) 180 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:14.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:13 gibba044 bash[9859]: cluster 2021-03-10T20:03:12.698992+0000 mgr.y (mgr.14140) 180 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:16.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:15 gibba044 bash[9859]: cluster 2021-03-10T20:03:14.699372+0000 mgr.y (mgr.14140) 181 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:16.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:15 gibba023 bash[9844]: cluster 2021-03-10T20:03:14.699372+0000 mgr.y (mgr.14140) 181 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:16.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:15 gibba023 bash[13032]: cluster 2021-03-10T20:03:14.699372+0000 mgr.y (mgr.14140) 181 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:16.184 INFO:teuthology.orchestra.run.gibba023.stdout:[client.0] 2021-03-10T20:03:16.184 INFO:teuthology.orchestra.run.gibba023.stdout: key = AQAEJklgkOyTChAAhABKKSvF3a0XjjxSCSbcXw== 2021-03-10T20:03:16.810 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:16 gibba023 bash[9844]: audit 2021-03-10T20:03:16.177011+0000 mon.c (mon.1) 17 : audit [INF] from='client.? 172.21.2.123:0/1763573784' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T20:03:16.810 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:16 gibba023 bash[9844]: audit 2021-03-10T20:03:16.177394+0000 mon.a (mon.0) 504 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T20:03:16.810 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:16 gibba023 bash[9844]: audit 2021-03-10T20:03:16.181494+0000 mon.a (mon.0) 505 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T20:03:16.811 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:16 gibba023 bash[13032]: audit 2021-03-10T20:03:16.177011+0000 mon.c (mon.1) 17 : audit [INF] from='client.? 172.21.2.123:0/1763573784' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T20:03:17.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:16 gibba044 bash[9859]: audit 2021-03-10T20:03:16.177011+0000 mon.c (mon.1) 17 : audit [INF] from='client.? 172.21.2.123:0/1763573784' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T20:03:17.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:16 gibba044 bash[9859]: audit 2021-03-10T20:03:16.177394+0000 mon.a (mon.0) 504 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T20:03:17.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:16 gibba044 bash[9859]: audit 2021-03-10T20:03:16.181494+0000 mon.a (mon.0) 505 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T20:03:17.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:16 gibba023 bash[13032]: audit 2021-03-10T20:03:16.177394+0000 mon.a (mon.0) 504 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T20:03:17.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:16 gibba023 bash[13032]: audit 2021-03-10T20:03:16.181494+0000 mon.a (mon.0) 505 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T20:03:17.314 DEBUG:teuthology.orchestra.run.gibba023:> set -ex 2021-03-10T20:03:17.315 DEBUG:teuthology.orchestra.run.gibba023:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2021-03-10T20:03:17.316 DEBUG:teuthology.orchestra.run.gibba023:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-03-10T20:03:17.337 DEBUG:teuthology.orchestra.run.gibba044:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-03-10T20:03:17.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:17 gibba023 bash[9844]: cluster 2021-03-10T20:03:16.700115+0000 mgr.y (mgr.14140) 182 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:17.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:17 gibba023 bash[13032]: cluster 2021-03-10T20:03:16.700115+0000 mgr.y (mgr.14140) 182 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:18.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:17 gibba044 bash[9859]: cluster 2021-03-10T20:03:16.700115+0000 mgr.y (mgr.14140) 182 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:18.860 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:03:18 gibba023 docker[20342]: Error: No such container: ceph-dd719b26-81da-11eb-9080-001a4aab830c-alertmanager.a 2021-03-10T20:03:18.860 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:03:18 gibba023 systemd[1]: Started Ceph alertmanager.a for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:03:18.861 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:18 gibba023 bash[9844]: audit 2021-03-10T20:03:18.587749+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487092\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487151\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487181\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487208\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487235\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487260\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487287\", \"created\": \"2021-03-10T20:01:19.922947\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.763299\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:03:18.862 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:18 gibba023 bash[9844]: audit 2021-03-10T20:03:18.591361+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487092\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487151\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487181\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487208\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487235\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487260\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487287\", \"created\": \"2021-03-10T20:01:19.922947\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.763299\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:03:18.862 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:18 gibba023 bash[9844]: audit 2021-03-10T20:03:18.591972+0000 mon.a (mon.0) 508 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:18.863 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:18 gibba023 bash[13032]: audit 2021-03-10T20:03:18.587749+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487092\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487151\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487181\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487208\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487235\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487260\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487287\", \"created\": \"2021-03-10T20:01:19.922947\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.763299\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:03:18.863 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:18 gibba023 bash[13032]: audit 2021-03-10T20:03:18.591361+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487092\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487151\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487181\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487208\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487235\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487260\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487287\", \"created\": \"2021-03-10T20:01:19.922947\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.763299\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:03:18.863 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:18 gibba023 bash[13032]: audit 2021-03-10T20:03:18.591972+0000 mon.a (mon.0) 508 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:18.978 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:18 gibba044 bash[9859]: audit 2021-03-10T20:03:18.587749+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487092\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487151\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487181\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487208\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487235\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487260\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487287\", \"created\": \"2021-03-10T20:01:19.922947\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.763299\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:03:18.978 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:18 gibba044 bash[9859]: audit 2021-03-10T20:03:18.591361+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487092\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487151\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487181\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487208\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487235\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487260\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:01:20.487287\", \"created\": \"2021-03-10T20:01:19.922947\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.763299\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:03:18.978 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:18 gibba044 bash[9859]: audit 2021-03-10T20:03:18.591972+0000 mon.a (mon.0) 508 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:19.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:19 gibba023 bash[9844]: cluster 2021-03-10T20:03:18.700448+0000 mgr.y (mgr.14140) 183 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:19.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:19 gibba023 bash[13032]: cluster 2021-03-10T20:03:18.700448+0000 mgr.y (mgr.14140) 183 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:19.928 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:03:19 gibba023 bash[20360]: level=info ts=2021-03-10T20:03:19.735Z caller=main.go:216 msg="Starting Alertmanager" version="(version=0.21.0, branch=HEAD, revision=4c6c03ebfe21009c546e4d1e9b92c371d67c021d)" 2021-03-10T20:03:19.929 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:03:19 gibba023 bash[20360]: level=info ts=2021-03-10T20:03:19.735Z caller=main.go:217 build_context="(go=go1.14.4, user=root@dee35927357f, date=20200617-08:54:02)" 2021-03-10T20:03:19.929 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:03:19 gibba023 bash[20360]: level=info ts=2021-03-10T20:03:19.736Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.2.123 port=9094 2021-03-10T20:03:19.930 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:03:19 gibba023 bash[20360]: level=info ts=2021-03-10T20:03:19.736Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-03-10T20:03:19.931 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:03:19 gibba023 bash[20360]: level=info ts=2021-03-10T20:03:19.750Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T20:03:19.932 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:03:19 gibba023 bash[20360]: level=info ts=2021-03-10T20:03:19.750Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T20:03:19.932 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:03:19 gibba023 bash[20360]: level=info ts=2021-03-10T20:03:19.752Z caller=main.go:485 msg=Listening address=:9093 2021-03-10T20:03:20.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:19 gibba044 bash[9859]: cluster 2021-03-10T20:03:18.700448+0000 mgr.y (mgr.14140) 183 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:20.140 INFO:teuthology.orchestra.run.gibba044.stdout:[client.1] 2021-03-10T20:03:20.140 INFO:teuthology.orchestra.run.gibba044.stdout: key = AQAIJklgStuVBxAAXjJzUXRyz9vwSveEWreCFg== 2021-03-10T20:03:20.739 DEBUG:teuthology.orchestra.run.gibba044:> set -ex 2021-03-10T20:03:20.740 DEBUG:teuthology.orchestra.run.gibba044:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2021-03-10T20:03:20.740 DEBUG:teuthology.orchestra.run.gibba044:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-03-10T20:03:20.749 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph osd dump --format=json 2021-03-10T20:03:21.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:20 gibba044 bash[9859]: audit 2021-03-10T20:03:19.918852+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917514\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917593\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917635\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917675\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917714\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917752\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917790\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917828\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e8edea0d5c6a\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917866\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:18.600962\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.763299\"}}, \"last_daemon_update\": \"2021-03-10T20:03:19.917956\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:03:21.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:20 gibba044 bash[9859]: audit 2021-03-10T20:03:19.921909+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917514\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917593\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917635\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917675\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917714\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917752\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917790\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917828\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e8edea0d5c6a\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917866\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:18.600962\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.763299\"}}, \"last_daemon_update\": \"2021-03-10T20:03:19.917956\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:03:21.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:20 gibba044 bash[9859]: audit 2021-03-10T20:03:19.922526+0000 mon.a (mon.0) 511 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:21.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:20 gibba044 bash[9859]: audit 2021-03-10T20:03:20.124292+0000 mon.b (mon.2) 23 : audit [INF] from='client.? 172.21.2.144:0/1738647036' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T20:03:21.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:20 gibba044 bash[9859]: audit 2021-03-10T20:03:20.126876+0000 mon.a (mon.0) 512 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T20:03:21.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:20 gibba044 bash[9859]: audit 2021-03-10T20:03:20.137434+0000 mon.a (mon.0) 513 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T20:03:21.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:20 gibba023 bash[9844]: audit 2021-03-10T20:03:19.918852+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917514\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917593\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917635\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917675\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917714\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917752\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917790\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917828\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e8edea0d5c6a\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917866\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:18.600962\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.763299\"}}, \"last_daemon_update\": \"2021-03-10T20:03:19.917956\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:03:21.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:20 gibba023 bash[9844]: audit 2021-03-10T20:03:19.921909+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917514\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917593\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917635\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917675\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917714\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917752\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917790\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917828\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e8edea0d5c6a\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917866\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:18.600962\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.763299\"}}, \"last_daemon_update\": \"2021-03-10T20:03:19.917956\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:03:21.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:20 gibba023 bash[9844]: audit 2021-03-10T20:03:19.922526+0000 mon.a (mon.0) 511 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:21.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:20 gibba023 bash[9844]: audit 2021-03-10T20:03:20.124292+0000 mon.b (mon.2) 23 : audit [INF] from='client.? 172.21.2.144:0/1738647036' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T20:03:21.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:20 gibba023 bash[9844]: audit 2021-03-10T20:03:20.126876+0000 mon.a (mon.0) 512 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T20:03:21.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:20 gibba023 bash[9844]: audit 2021-03-10T20:03:20.137434+0000 mon.a (mon.0) 513 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T20:03:21.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:20 gibba023 bash[13032]: audit 2021-03-10T20:03:19.918852+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917514\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917593\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917635\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917675\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917714\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917752\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917790\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917828\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e8edea0d5c6a\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917866\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:18.600962\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.763299\"}}, \"last_daemon_update\": \"2021-03-10T20:03:19.917956\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:03:21.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:20 gibba023 bash[13032]: audit 2021-03-10T20:03:19.921909+0000 mon.a (mon.0) 510 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917514\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917593\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917635\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917675\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917714\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917752\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917790\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917828\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e8edea0d5c6a\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:19.917866\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:18.600962\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.763299\"}}, \"last_daemon_update\": \"2021-03-10T20:03:19.917956\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:03:21.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:20 gibba023 bash[13032]: audit 2021-03-10T20:03:19.922526+0000 mon.a (mon.0) 511 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:21.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:20 gibba023 bash[13032]: audit 2021-03-10T20:03:20.124292+0000 mon.b (mon.2) 23 : audit [INF] from='client.? 172.21.2.144:0/1738647036' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T20:03:21.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:20 gibba023 bash[13032]: audit 2021-03-10T20:03:20.126876+0000 mon.a (mon.0) 512 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-03-10T20:03:21.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:20 gibba023 bash[13032]: audit 2021-03-10T20:03:20.137434+0000 mon.a (mon.0) 513 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-03-10T20:03:22.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:21 gibba044 bash[9859]: cluster 2021-03-10T20:03:20.701280+0000 mgr.y (mgr.14140) 184 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:22.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:21 gibba044 bash[9859]: audit 2021-03-10T20:03:20.769048+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768075\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768132\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768160\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768186\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768212\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768236\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768261\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"282b9567456b\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768285\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:07.165491\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768310\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}}, \"last_daemon_update\": \"2021-03-10T20:03:20.768368\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:03:22.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:21 gibba044 bash[9859]: audit 2021-03-10T20:03:20.772327+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768075\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768132\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768160\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768186\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768212\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768236\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768261\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"282b9567456b\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768285\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:07.165491\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768310\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}}, \"last_daemon_update\": \"2021-03-10T20:03:20.768368\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:03:22.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:21 gibba044 bash[9859]: audit 2021-03-10T20:03:20.862319+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQDSAI+gFopKBrAUNBSGhcYtMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjEwMzEwMjAwMzIwWhcN\nMzEwMzA4MjAwMzIwWjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA34xtZzQAHH8YxHFbNd0k\nJsWVAX/JpklG89ZxeTSNMt4HoUXBqSNCQGwPhi4/9nLNGVaW6YdtVevNu1xxTXaD\nwsWJr8mmfJtsYKEDg/PCJx0FagpsAhdGZ0VHFyAkEn7ffuDIlwcBJkH8+J9lHTYT\nARHJw8XMFKeJQi0LAxtd6YSUllAqXX1KjtTH0KrA7rFihg2JINElg6iTfKzDvwlv\n0K2f7lxrYR6o+6viYt7RacACbvlt7Tg+/6RntN2PcxzT62MEWJgsYkHMY0V7Z1DE\nobKQGm7NuFwS9ZiYQyEtDxeHoCkk1DX/gmM4nwHotevpPP44VsGzfVSjjlR3RZdC\nKQIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQDPbERW1O2L79Mns/0b6Zx0377RR35O\n+5JaqVaVOhwCAxYZxUEQkJ90HTR2HsAte63gbMB/T5SuFNa4XSNHTRT708FaCkfs\nhktpcBrfM0419o8qr2rfZgdBMqfM4DHD7nNndpPxLXFQVVadg5hk6l58R1IILeZY\nlMswDXIpF7zXU8L9VGCnIGXyDlUzsIoZgjag9OPrW3u7zrzoUVUWF3yrXIx6b1Ke\ntfHt4cGkCBeny2365XLaKrmZuD5vdFEDZWu29/in5RrnUcCceFydgDIO6lltniUl\ndRXAbudKto4D/Zg0H79XeKegtlw43WBHP39KHAqRgt3rZwKRfPVzj0CO\n-----END CERTIFICATE-----\n"}]: dispatch 2021-03-10T20:03:22.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:21 gibba044 bash[9859]: audit 2021-03-10T20:03:20.865912+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQDSAI+gFopKBrAUNBSGhcYtMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjEwMzEwMjAwMzIwWhcN\nMzEwMzA4MjAwMzIwWjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA34xtZzQAHH8YxHFbNd0k\nJsWVAX/JpklG89ZxeTSNMt4HoUXBqSNCQGwPhi4/9nLNGVaW6YdtVevNu1xxTXaD\nwsWJr8mmfJtsYKEDg/PCJx0FagpsAhdGZ0VHFyAkEn7ffuDIlwcBJkH8+J9lHTYT\nARHJw8XMFKeJQi0LAxtd6YSUllAqXX1KjtTH0KrA7rFihg2JINElg6iTfKzDvwlv\n0K2f7lxrYR6o+6viYt7RacACbvlt7Tg+/6RntN2PcxzT62MEWJgsYkHMY0V7Z1DE\nobKQGm7NuFwS9ZiYQyEtDxeHoCkk1DX/gmM4nwHotevpPP44VsGzfVSjjlR3RZdC\nKQIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQDPbERW1O2L79Mns/0b6Zx0377RR35O\n+5JaqVaVOhwCAxYZxUEQkJ90HTR2HsAte63gbMB/T5SuFNa4XSNHTRT708FaCkfs\nhktpcBrfM0419o8qr2rfZgdBMqfM4DHD7nNndpPxLXFQVVadg5hk6l58R1IILeZY\nlMswDXIpF7zXU8L9VGCnIGXyDlUzsIoZgjag9OPrW3u7zrzoUVUWF3yrXIx6b1Ke\ntfHt4cGkCBeny2365XLaKrmZuD5vdFEDZWu29/in5RrnUcCceFydgDIO6lltniUl\ndRXAbudKto4D/Zg0H79XeKegtlw43WBHP39KHAqRgt3rZwKRfPVzj0CO\n-----END CERTIFICATE-----\n"}]': finished 2021-03-10T20:03:22.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:21 gibba044 bash[9859]: audit 2021-03-10T20:03:20.866269+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvAIBADANBgkqhkiG9w0BAQEFAASCBKYwggSiAgEAAoIBAQDfjG1nNAAcfxjE\ncVs13SQmxZUBf8mmSUbz1nF5NI0y3gehRcGpI0JAbA+GLj/2cs0ZVpbph21V6827\nXHFNdoPCxYmvyaZ8m2xgoQOD88InHQVqCmwCF0ZnRUcXICQSft9+4MiXBwEmQfz4\nn2UdNhMBEcnDxcwUp4lCLQsDG13phJSWUCpdfUqO1MfQqsDusWKGDYkg0SWDqJN8\nrMO/CW/QrZ/uXGthHqj7q+Ji3tFpwAJu+W3tOD7/pGe03Y9zHNPrYwRYmCxiQcxj\nRXtnUMShspAabs24XBL1mJhDIS0PF4egKSTUNf+CYzifAei16+k8/jhWwbN9VKOO\nVHdFl0IpAgMBAAECggEAabbuxa9Bnjg8biltCLvbLLqjDGJx6cEdXJI8dyTy4Os+\nkHV8b4/M9MolTT7x4InJlAHuu+DfQ5KPZ9r/ebJh/OmNgyPJJ4QYbFm4X94WIokG\n1m63RQXctVl9lOIOLPDyn/2M3l7hnEX4a1p1Zqr7sbXHxFz1dY8EydajLoTylErL\n7KEPC5UfpA7k4RsNQgQfP+Bdf36S5rLMZuDQSlh5Q9Jkao8mmtN0cJZwePR+z80d\nXlmzq+UbSi+v9BJ2509DWXWLgj70ZxyywnBP4Rn5WoSedXJ+ZTwlQes+ekwnZ2Zz\nbtzsLSFgbRcp2c4aVB+3l2ytERGogG60PcV6jerpQQKBgQDz2sNJtVK29DaCO+V5\nTrFFgdkfEMq97BSqIQPdR9lYGAlHnNo4RSP6koWX6ORy+QXMBgRlLeLzQmvUrepp\nn02GzjddMDzGhEsWBkm2bT52Vh4FePto2hPTLRZanfApCAx4bwVjM8Wl9GRtlhpU\nBCuIhMrlAphd5M8l/TKlt4s93wKBgQDqrsFhztsNx28EBzl29rAk6cZ57F+YURZ2\nj32fqobk3nn8F/z4Ntt/MfKbO7ApRngFreNOv2SRQ0ahzGGtemqjFIGmbraq8DFx\ng2rmRTDhnrpEGsTGV0GvvcylNyTXuTeCQxxlbQwwupqOXSiz/6UOMNSHBe5xVTDe\nEzuFiHNw9wKBgFAeI+Nnq5FokzAetboxXJTVoJxQTAwyMGflCPv+yy3iV8orgpbS\nQIvm7/WFEumjX4A0yeTkOphpzjvGGCozqKkNv6riWlVuyaymzDkfk1IV4S8zHIbK\nf5D2U03abjlM56v57e81504rCYPnuSa5aAQmfPLY826F6nk0wxsnPpxJAoGAKoB9\nu1X4LBWrUGJykM36dqTz8g7R/UbqN4yjJrB+f6KfGv3JLbbZp76G/oAf1knR4M1u\nNkvJTdmOSC04n29lMqW7GUZBxNF9Ut6HFK8BPEs/1qe2bWlOFyLblixXes4rdGbt\nFJ1cMNMKvK+4eGjbHqfPRajYVyQjloSLKhLdPV8CgYByCAZ46IC+WV3NxdzEyYX1\nDwA/W1zTDmBwAvIuZ4V3oROyzTu7mRLkWBn7xkrVyxa2x9qcpQ24xMQtVHU+Gj5o\nGFG4d4AH6J2t5NuxTxB6nCd+RbEdDYDYgJ3k/ye2XIR2tFT4d2Cw+BGpiVkApQj2\nTfUHhqoY5OH21g6rxrz9BA==\n-----END PRIVATE KEY-----\n"}]: dispatch 2021-03-10T20:03:22.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:21 gibba044 bash[9859]: audit 2021-03-10T20:03:20.873385+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvAIBADANBgkqhkiG9w0BAQEFAASCBKYwggSiAgEAAoIBAQDfjG1nNAAcfxjE\ncVs13SQmxZUBf8mmSUbz1nF5NI0y3gehRcGpI0JAbA+GLj/2cs0ZVpbph21V6827\nXHFNdoPCxYmvyaZ8m2xgoQOD88InHQVqCmwCF0ZnRUcXICQSft9+4MiXBwEmQfz4\nn2UdNhMBEcnDxcwUp4lCLQsDG13phJSWUCpdfUqO1MfQqsDusWKGDYkg0SWDqJN8\nrMO/CW/QrZ/uXGthHqj7q+Ji3tFpwAJu+W3tOD7/pGe03Y9zHNPrYwRYmCxiQcxj\nRXtnUMShspAabs24XBL1mJhDIS0PF4egKSTUNf+CYzifAei16+k8/jhWwbN9VKOO\nVHdFl0IpAgMBAAECggEAabbuxa9Bnjg8biltCLvbLLqjDGJx6cEdXJI8dyTy4Os+\nkHV8b4/M9MolTT7x4InJlAHuu+DfQ5KPZ9r/ebJh/OmNgyPJJ4QYbFm4X94WIokG\n1m63RQXctVl9lOIOLPDyn/2M3l7hnEX4a1p1Zqr7sbXHxFz1dY8EydajLoTylErL\n7KEPC5UfpA7k4RsNQgQfP+Bdf36S5rLMZuDQSlh5Q9Jkao8mmtN0cJZwePR+z80d\nXlmzq+UbSi+v9BJ2509DWXWLgj70ZxyywnBP4Rn5WoSedXJ+ZTwlQes+ekwnZ2Zz\nbtzsLSFgbRcp2c4aVB+3l2ytERGogG60PcV6jerpQQKBgQDz2sNJtVK29DaCO+V5\nTrFFgdkfEMq97BSqIQPdR9lYGAlHnNo4RSP6koWX6ORy+QXMBgRlLeLzQmvUrepp\nn02GzjddMDzGhEsWBkm2bT52Vh4FePto2hPTLRZanfApCAx4bwVjM8Wl9GRtlhpU\nBCuIhMrlAphd5M8l/TKlt4s93wKBgQDqrsFhztsNx28EBzl29rAk6cZ57F+YURZ2\nj32fqobk3nn8F/z4Ntt/MfKbO7ApRngFreNOv2SRQ0ahzGGtemqjFIGmbraq8DFx\ng2rmRTDhnrpEGsTGV0GvvcylNyTXuTeCQxxlbQwwupqOXSiz/6UOMNSHBe5xVTDe\nEzuFiHNw9wKBgFAeI+Nnq5FokzAetboxXJTVoJxQTAwyMGflCPv+yy3iV8orgpbS\nQIvm7/WFEumjX4A0yeTkOphpzjvGGCozqKkNv6riWlVuyaymzDkfk1IV4S8zHIbK\nf5D2U03abjlM56v57e81504rCYPnuSa5aAQmfPLY826F6nk0wxsnPpxJAoGAKoB9\nu1X4LBWrUGJykM36dqTz8g7R/UbqN4yjJrB+f6KfGv3JLbbZp76G/oAf1knR4M1u\nNkvJTdmOSC04n29lMqW7GUZBxNF9Ut6HFK8BPEs/1qe2bWlOFyLblixXes4rdGbt\nFJ1cMNMKvK+4eGjbHqfPRajYVyQjloSLKhLdPV8CgYByCAZ46IC+WV3NxdzEyYX1\nDwA/W1zTDmBwAvIuZ4V3oROyzTu7mRLkWBn7xkrVyxa2x9qcpQ24xMQtVHU+Gj5o\nGFG4d4AH6J2t5NuxTxB6nCd+RbEdDYDYgJ3k/ye2XIR2tFT4d2Cw+BGpiVkApQj2\nTfUHhqoY5OH21g6rxrz9BA==\n-----END PRIVATE KEY-----\n"}]': finished 2021-03-10T20:03:22.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:21 gibba044 bash[9859]: cephadm 2021-03-10T20:03:20.873782+0000 mgr.y (mgr.14140) 185 : cephadm [INF] Deploying daemon grafana.a on gibba044 2021-03-10T20:03:22.050 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:03:21 gibba023 bash[20360]: level=info ts=2021-03-10T20:03:21.737Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000042298s 2021-03-10T20:03:22.051 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:21 gibba023 bash[9844]: cluster 2021-03-10T20:03:20.701280+0000 mgr.y (mgr.14140) 184 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:22.051 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:21 gibba023 bash[9844]: audit 2021-03-10T20:03:20.769048+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768075\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768132\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768160\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768186\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768212\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768236\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768261\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"282b9567456b\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768285\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:07.165491\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768310\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}}, \"last_daemon_update\": \"2021-03-10T20:03:20.768368\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:03:22.052 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:21 gibba023 bash[13032]: cluster 2021-03-10T20:03:20.701280+0000 mgr.y (mgr.14140) 184 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:22.052 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:21 gibba023 bash[9844]: audit 2021-03-10T20:03:20.772327+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768075\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768132\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768160\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768186\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768212\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768236\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768261\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"282b9567456b\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768285\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:07.165491\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768310\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}}, \"last_daemon_update\": \"2021-03-10T20:03:20.768368\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:03:22.053 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:21 gibba023 bash[9844]: audit 2021-03-10T20:03:20.862319+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQDSAI+gFopKBrAUNBSGhcYtMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjEwMzEwMjAwMzIwWhcN\nMzEwMzA4MjAwMzIwWjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA34xtZzQAHH8YxHFbNd0k\nJsWVAX/JpklG89ZxeTSNMt4HoUXBqSNCQGwPhi4/9nLNGVaW6YdtVevNu1xxTXaD\nwsWJr8mmfJtsYKEDg/PCJx0FagpsAhdGZ0VHFyAkEn7ffuDIlwcBJkH8+J9lHTYT\nARHJw8XMFKeJQi0LAxtd6YSUllAqXX1KjtTH0KrA7rFihg2JINElg6iTfKzDvwlv\n0K2f7lxrYR6o+6viYt7RacACbvlt7Tg+/6RntN2PcxzT62MEWJgsYkHMY0V7Z1DE\nobKQGm7NuFwS9ZiYQyEtDxeHoCkk1DX/gmM4nwHotevpPP44VsGzfVSjjlR3RZdC\nKQIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQDPbERW1O2L79Mns/0b6Zx0377RR35O\n+5JaqVaVOhwCAxYZxUEQkJ90HTR2HsAte63gbMB/T5SuFNa4XSNHTRT708FaCkfs\nhktpcBrfM0419o8qr2rfZgdBMqfM4DHD7nNndpPxLXFQVVadg5hk6l58R1IILeZY\nlMswDXIpF7zXU8L9VGCnIGXyDlUzsIoZgjag9OPrW3u7zrzoUVUWF3yrXIx6b1Ke\ntfHt4cGkCBeny2365XLaKrmZuD5vdFEDZWu29/in5RrnUcCceFydgDIO6lltniUl\ndRXAbudKto4D/Zg0H79XeKegtlw43WBHP39KHAqRgt3rZwKRfPVzj0CO\n-----END CERTIFICATE-----\n"}]: dispatch 2021-03-10T20:03:22.053 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:21 gibba023 bash[9844]: audit 2021-03-10T20:03:20.865912+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQDSAI+gFopKBrAUNBSGhcYtMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjEwMzEwMjAwMzIwWhcN\nMzEwMzA4MjAwMzIwWjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA34xtZzQAHH8YxHFbNd0k\nJsWVAX/JpklG89ZxeTSNMt4HoUXBqSNCQGwPhi4/9nLNGVaW6YdtVevNu1xxTXaD\nwsWJr8mmfJtsYKEDg/PCJx0FagpsAhdGZ0VHFyAkEn7ffuDIlwcBJkH8+J9lHTYT\nARHJw8XMFKeJQi0LAxtd6YSUllAqXX1KjtTH0KrA7rFihg2JINElg6iTfKzDvwlv\n0K2f7lxrYR6o+6viYt7RacACbvlt7Tg+/6RntN2PcxzT62MEWJgsYkHMY0V7Z1DE\nobKQGm7NuFwS9ZiYQyEtDxeHoCkk1DX/gmM4nwHotevpPP44VsGzfVSjjlR3RZdC\nKQIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQDPbERW1O2L79Mns/0b6Zx0377RR35O\n+5JaqVaVOhwCAxYZxUEQkJ90HTR2HsAte63gbMB/T5SuFNa4XSNHTRT708FaCkfs\nhktpcBrfM0419o8qr2rfZgdBMqfM4DHD7nNndpPxLXFQVVadg5hk6l58R1IILeZY\nlMswDXIpF7zXU8L9VGCnIGXyDlUzsIoZgjag9OPrW3u7zrzoUVUWF3yrXIx6b1Ke\ntfHt4cGkCBeny2365XLaKrmZuD5vdFEDZWu29/in5RrnUcCceFydgDIO6lltniUl\ndRXAbudKto4D/Zg0H79XeKegtlw43WBHP39KHAqRgt3rZwKRfPVzj0CO\n-----END CERTIFICATE-----\n"}]': finished 2021-03-10T20:03:22.053 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:21 gibba023 bash[9844]: audit 2021-03-10T20:03:20.866269+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvAIBADANBgkqhkiG9w0BAQEFAASCBKYwggSiAgEAAoIBAQDfjG1nNAAcfxjE\ncVs13SQmxZUBf8mmSUbz1nF5NI0y3gehRcGpI0JAbA+GLj/2cs0ZVpbph21V6827\nXHFNdoPCxYmvyaZ8m2xgoQOD88InHQVqCmwCF0ZnRUcXICQSft9+4MiXBwEmQfz4\nn2UdNhMBEcnDxcwUp4lCLQsDG13phJSWUCpdfUqO1MfQqsDusWKGDYkg0SWDqJN8\nrMO/CW/QrZ/uXGthHqj7q+Ji3tFpwAJu+W3tOD7/pGe03Y9zHNPrYwRYmCxiQcxj\nRXtnUMShspAabs24XBL1mJhDIS0PF4egKSTUNf+CYzifAei16+k8/jhWwbN9VKOO\nVHdFl0IpAgMBAAECggEAabbuxa9Bnjg8biltCLvbLLqjDGJx6cEdXJI8dyTy4Os+\nkHV8b4/M9MolTT7x4InJlAHuu+DfQ5KPZ9r/ebJh/OmNgyPJJ4QYbFm4X94WIokG\n1m63RQXctVl9lOIOLPDyn/2M3l7hnEX4a1p1Zqr7sbXHxFz1dY8EydajLoTylErL\n7KEPC5UfpA7k4RsNQgQfP+Bdf36S5rLMZuDQSlh5Q9Jkao8mmtN0cJZwePR+z80d\nXlmzq+UbSi+v9BJ2509DWXWLgj70ZxyywnBP4Rn5WoSedXJ+ZTwlQes+ekwnZ2Zz\nbtzsLSFgbRcp2c4aVB+3l2ytERGogG60PcV6jerpQQKBgQDz2sNJtVK29DaCO+V5\nTrFFgdkfEMq97BSqIQPdR9lYGAlHnNo4RSP6koWX6ORy+QXMBgRlLeLzQmvUrepp\nn02GzjddMDzGhEsWBkm2bT52Vh4FePto2hPTLRZanfApCAx4bwVjM8Wl9GRtlhpU\nBCuIhMrlAphd5M8l/TKlt4s93wKBgQDqrsFhztsNx28EBzl29rAk6cZ57F+YURZ2\nj32fqobk3nn8F/z4Ntt/MfKbO7ApRngFreNOv2SRQ0ahzGGtemqjFIGmbraq8DFx\ng2rmRTDhnrpEGsTGV0GvvcylNyTXuTeCQxxlbQwwupqOXSiz/6UOMNSHBe5xVTDe\nEzuFiHNw9wKBgFAeI+Nnq5FokzAetboxXJTVoJxQTAwyMGflCPv+yy3iV8orgpbS\nQIvm7/WFEumjX4A0yeTkOphpzjvGGCozqKkNv6riWlVuyaymzDkfk1IV4S8zHIbK\nf5D2U03abjlM56v57e81504rCYPnuSa5aAQmfPLY826F6nk0wxsnPpxJAoGAKoB9\nu1X4LBWrUGJykM36dqTz8g7R/UbqN4yjJrB+f6KfGv3JLbbZp76G/oAf1knR4M1u\nNkvJTdmOSC04n29lMqW7GUZBxNF9Ut6HFK8BPEs/1qe2bWlOFyLblixXes4rdGbt\nFJ1cMNMKvK+4eGjbHqfPRajYVyQjloSLKhLdPV8CgYByCAZ46IC+WV3NxdzEyYX1\nDwA/W1zTDmBwAvIuZ4V3oROyzTu7mRLkWBn7xkrVyxa2x9qcpQ24xMQtVHU+Gj5o\nGFG4d4AH6J2t5NuxTxB6nCd+RbEdDYDYgJ3k/ye2XIR2tFT4d2Cw+BGpiVkApQj2\nTfUHhqoY5OH21g6rxrz9BA==\n-----END PRIVATE KEY-----\n"}]: dispatch 2021-03-10T20:03:22.053 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:21 gibba023 bash[9844]: audit 2021-03-10T20:03:20.873385+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvAIBADANBgkqhkiG9w0BAQEFAASCBKYwggSiAgEAAoIBAQDfjG1nNAAcfxjE\ncVs13SQmxZUBf8mmSUbz1nF5NI0y3gehRcGpI0JAbA+GLj/2cs0ZVpbph21V6827\nXHFNdoPCxYmvyaZ8m2xgoQOD88InHQVqCmwCF0ZnRUcXICQSft9+4MiXBwEmQfz4\nn2UdNhMBEcnDxcwUp4lCLQsDG13phJSWUCpdfUqO1MfQqsDusWKGDYkg0SWDqJN8\nrMO/CW/QrZ/uXGthHqj7q+Ji3tFpwAJu+W3tOD7/pGe03Y9zHNPrYwRYmCxiQcxj\nRXtnUMShspAabs24XBL1mJhDIS0PF4egKSTUNf+CYzifAei16+k8/jhWwbN9VKOO\nVHdFl0IpAgMBAAECggEAabbuxa9Bnjg8biltCLvbLLqjDGJx6cEdXJI8dyTy4Os+\nkHV8b4/M9MolTT7x4InJlAHuu+DfQ5KPZ9r/ebJh/OmNgyPJJ4QYbFm4X94WIokG\n1m63RQXctVl9lOIOLPDyn/2M3l7hnEX4a1p1Zqr7sbXHxFz1dY8EydajLoTylErL\n7KEPC5UfpA7k4RsNQgQfP+Bdf36S5rLMZuDQSlh5Q9Jkao8mmtN0cJZwePR+z80d\nXlmzq+UbSi+v9BJ2509DWXWLgj70ZxyywnBP4Rn5WoSedXJ+ZTwlQes+ekwnZ2Zz\nbtzsLSFgbRcp2c4aVB+3l2ytERGogG60PcV6jerpQQKBgQDz2sNJtVK29DaCO+V5\nTrFFgdkfEMq97BSqIQPdR9lYGAlHnNo4RSP6koWX6ORy+QXMBgRlLeLzQmvUrepp\nn02GzjddMDzGhEsWBkm2bT52Vh4FePto2hPTLRZanfApCAx4bwVjM8Wl9GRtlhpU\nBCuIhMrlAphd5M8l/TKlt4s93wKBgQDqrsFhztsNx28EBzl29rAk6cZ57F+YURZ2\nj32fqobk3nn8F/z4Ntt/MfKbO7ApRngFreNOv2SRQ0ahzGGtemqjFIGmbraq8DFx\ng2rmRTDhnrpEGsTGV0GvvcylNyTXuTeCQxxlbQwwupqOXSiz/6UOMNSHBe5xVTDe\nEzuFiHNw9wKBgFAeI+Nnq5FokzAetboxXJTVoJxQTAwyMGflCPv+yy3iV8orgpbS\nQIvm7/WFEumjX4A0yeTkOphpzjvGGCozqKkNv6riWlVuyaymzDkfk1IV4S8zHIbK\nf5D2U03abjlM56v57e81504rCYPnuSa5aAQmfPLY826F6nk0wxsnPpxJAoGAKoB9\nu1X4LBWrUGJykM36dqTz8g7R/UbqN4yjJrB+f6KfGv3JLbbZp76G/oAf1knR4M1u\nNkvJTdmOSC04n29lMqW7GUZBxNF9Ut6HFK8BPEs/1qe2bWlOFyLblixXes4rdGbt\nFJ1cMNMKvK+4eGjbHqfPRajYVyQjloSLKhLdPV8CgYByCAZ46IC+WV3NxdzEyYX1\nDwA/W1zTDmBwAvIuZ4V3oROyzTu7mRLkWBn7xkrVyxa2x9qcpQ24xMQtVHU+Gj5o\nGFG4d4AH6J2t5NuxTxB6nCd+RbEdDYDYgJ3k/ye2XIR2tFT4d2Cw+BGpiVkApQj2\nTfUHhqoY5OH21g6rxrz9BA==\n-----END PRIVATE KEY-----\n"}]': finished 2021-03-10T20:03:22.054 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:21 gibba023 bash[9844]: cephadm 2021-03-10T20:03:20.873782+0000 mgr.y (mgr.14140) 185 : cephadm [INF] Deploying daemon grafana.a on gibba044 2021-03-10T20:03:22.054 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:21 gibba023 bash[13032]: audit 2021-03-10T20:03:20.769048+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768075\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768132\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768160\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768186\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768212\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768236\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768261\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"282b9567456b\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768285\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:07.165491\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768310\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}}, \"last_daemon_update\": \"2021-03-10T20:03:20.768368\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:03:22.055 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:21 gibba023 bash[13032]: audit 2021-03-10T20:03:20.772327+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768075\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768132\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768160\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768186\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768212\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768236\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768261\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"282b9567456b\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768285\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:07.165491\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768310\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}}, \"last_daemon_update\": \"2021-03-10T20:03:20.768368\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:03:22.055 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:21 gibba023 bash[13032]: audit 2021-03-10T20:03:20.862319+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQDSAI+gFopKBrAUNBSGhcYtMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjEwMzEwMjAwMzIwWhcN\nMzEwMzA4MjAwMzIwWjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA34xtZzQAHH8YxHFbNd0k\nJsWVAX/JpklG89ZxeTSNMt4HoUXBqSNCQGwPhi4/9nLNGVaW6YdtVevNu1xxTXaD\nwsWJr8mmfJtsYKEDg/PCJx0FagpsAhdGZ0VHFyAkEn7ffuDIlwcBJkH8+J9lHTYT\nARHJw8XMFKeJQi0LAxtd6YSUllAqXX1KjtTH0KrA7rFihg2JINElg6iTfKzDvwlv\n0K2f7lxrYR6o+6viYt7RacACbvlt7Tg+/6RntN2PcxzT62MEWJgsYkHMY0V7Z1DE\nobKQGm7NuFwS9ZiYQyEtDxeHoCkk1DX/gmM4nwHotevpPP44VsGzfVSjjlR3RZdC\nKQIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQDPbERW1O2L79Mns/0b6Zx0377RR35O\n+5JaqVaVOhwCAxYZxUEQkJ90HTR2HsAte63gbMB/T5SuFNa4XSNHTRT708FaCkfs\nhktpcBrfM0419o8qr2rfZgdBMqfM4DHD7nNndpPxLXFQVVadg5hk6l58R1IILeZY\nlMswDXIpF7zXU8L9VGCnIGXyDlUzsIoZgjag9OPrW3u7zrzoUVUWF3yrXIx6b1Ke\ntfHt4cGkCBeny2365XLaKrmZuD5vdFEDZWu29/in5RrnUcCceFydgDIO6lltniUl\ndRXAbudKto4D/Zg0H79XeKegtlw43WBHP39KHAqRgt3rZwKRfPVzj0CO\n-----END CERTIFICATE-----\n"}]: dispatch 2021-03-10T20:03:22.055 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:21 gibba023 bash[13032]: audit 2021-03-10T20:03:20.865912+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQDSAI+gFopKBrAUNBSGhcYtMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjEwMzEwMjAwMzIwWhcN\nMzEwMzA4MjAwMzIwWjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA34xtZzQAHH8YxHFbNd0k\nJsWVAX/JpklG89ZxeTSNMt4HoUXBqSNCQGwPhi4/9nLNGVaW6YdtVevNu1xxTXaD\nwsWJr8mmfJtsYKEDg/PCJx0FagpsAhdGZ0VHFyAkEn7ffuDIlwcBJkH8+J9lHTYT\nARHJw8XMFKeJQi0LAxtd6YSUllAqXX1KjtTH0KrA7rFihg2JINElg6iTfKzDvwlv\n0K2f7lxrYR6o+6viYt7RacACbvlt7Tg+/6RntN2PcxzT62MEWJgsYkHMY0V7Z1DE\nobKQGm7NuFwS9ZiYQyEtDxeHoCkk1DX/gmM4nwHotevpPP44VsGzfVSjjlR3RZdC\nKQIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQDPbERW1O2L79Mns/0b6Zx0377RR35O\n+5JaqVaVOhwCAxYZxUEQkJ90HTR2HsAte63gbMB/T5SuFNa4XSNHTRT708FaCkfs\nhktpcBrfM0419o8qr2rfZgdBMqfM4DHD7nNndpPxLXFQVVadg5hk6l58R1IILeZY\nlMswDXIpF7zXU8L9VGCnIGXyDlUzsIoZgjag9OPrW3u7zrzoUVUWF3yrXIx6b1Ke\ntfHt4cGkCBeny2365XLaKrmZuD5vdFEDZWu29/in5RrnUcCceFydgDIO6lltniUl\ndRXAbudKto4D/Zg0H79XeKegtlw43WBHP39KHAqRgt3rZwKRfPVzj0CO\n-----END CERTIFICATE-----\n"}]': finished 2021-03-10T20:03:22.056 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:21 gibba023 bash[13032]: audit 2021-03-10T20:03:20.866269+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvAIBADANBgkqhkiG9w0BAQEFAASCBKYwggSiAgEAAoIBAQDfjG1nNAAcfxjE\ncVs13SQmxZUBf8mmSUbz1nF5NI0y3gehRcGpI0JAbA+GLj/2cs0ZVpbph21V6827\nXHFNdoPCxYmvyaZ8m2xgoQOD88InHQVqCmwCF0ZnRUcXICQSft9+4MiXBwEmQfz4\nn2UdNhMBEcnDxcwUp4lCLQsDG13phJSWUCpdfUqO1MfQqsDusWKGDYkg0SWDqJN8\nrMO/CW/QrZ/uXGthHqj7q+Ji3tFpwAJu+W3tOD7/pGe03Y9zHNPrYwRYmCxiQcxj\nRXtnUMShspAabs24XBL1mJhDIS0PF4egKSTUNf+CYzifAei16+k8/jhWwbN9VKOO\nVHdFl0IpAgMBAAECggEAabbuxa9Bnjg8biltCLvbLLqjDGJx6cEdXJI8dyTy4Os+\nkHV8b4/M9MolTT7x4InJlAHuu+DfQ5KPZ9r/ebJh/OmNgyPJJ4QYbFm4X94WIokG\n1m63RQXctVl9lOIOLPDyn/2M3l7hnEX4a1p1Zqr7sbXHxFz1dY8EydajLoTylErL\n7KEPC5UfpA7k4RsNQgQfP+Bdf36S5rLMZuDQSlh5Q9Jkao8mmtN0cJZwePR+z80d\nXlmzq+UbSi+v9BJ2509DWXWLgj70ZxyywnBP4Rn5WoSedXJ+ZTwlQes+ekwnZ2Zz\nbtzsLSFgbRcp2c4aVB+3l2ytERGogG60PcV6jerpQQKBgQDz2sNJtVK29DaCO+V5\nTrFFgdkfEMq97BSqIQPdR9lYGAlHnNo4RSP6koWX6ORy+QXMBgRlLeLzQmvUrepp\nn02GzjddMDzGhEsWBkm2bT52Vh4FePto2hPTLRZanfApCAx4bwVjM8Wl9GRtlhpU\nBCuIhMrlAphd5M8l/TKlt4s93wKBgQDqrsFhztsNx28EBzl29rAk6cZ57F+YURZ2\nj32fqobk3nn8F/z4Ntt/MfKbO7ApRngFreNOv2SRQ0ahzGGtemqjFIGmbraq8DFx\ng2rmRTDhnrpEGsTGV0GvvcylNyTXuTeCQxxlbQwwupqOXSiz/6UOMNSHBe5xVTDe\nEzuFiHNw9wKBgFAeI+Nnq5FokzAetboxXJTVoJxQTAwyMGflCPv+yy3iV8orgpbS\nQIvm7/WFEumjX4A0yeTkOphpzjvGGCozqKkNv6riWlVuyaymzDkfk1IV4S8zHIbK\nf5D2U03abjlM56v57e81504rCYPnuSa5aAQmfPLY826F6nk0wxsnPpxJAoGAKoB9\nu1X4LBWrUGJykM36dqTz8g7R/UbqN4yjJrB+f6KfGv3JLbbZp76G/oAf1knR4M1u\nNkvJTdmOSC04n29lMqW7GUZBxNF9Ut6HFK8BPEs/1qe2bWlOFyLblixXes4rdGbt\nFJ1cMNMKvK+4eGjbHqfPRajYVyQjloSLKhLdPV8CgYByCAZ46IC+WV3NxdzEyYX1\nDwA/W1zTDmBwAvIuZ4V3oROyzTu7mRLkWBn7xkrVyxa2x9qcpQ24xMQtVHU+Gj5o\nGFG4d4AH6J2t5NuxTxB6nCd+RbEdDYDYgJ3k/ye2XIR2tFT4d2Cw+BGpiVkApQj2\nTfUHhqoY5OH21g6rxrz9BA==\n-----END PRIVATE KEY-----\n"}]: dispatch 2021-03-10T20:03:22.056 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:21 gibba023 bash[13032]: audit 2021-03-10T20:03:20.873385+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvAIBADANBgkqhkiG9w0BAQEFAASCBKYwggSiAgEAAoIBAQDfjG1nNAAcfxjE\ncVs13SQmxZUBf8mmSUbz1nF5NI0y3gehRcGpI0JAbA+GLj/2cs0ZVpbph21V6827\nXHFNdoPCxYmvyaZ8m2xgoQOD88InHQVqCmwCF0ZnRUcXICQSft9+4MiXBwEmQfz4\nn2UdNhMBEcnDxcwUp4lCLQsDG13phJSWUCpdfUqO1MfQqsDusWKGDYkg0SWDqJN8\nrMO/CW/QrZ/uXGthHqj7q+Ji3tFpwAJu+W3tOD7/pGe03Y9zHNPrYwRYmCxiQcxj\nRXtnUMShspAabs24XBL1mJhDIS0PF4egKSTUNf+CYzifAei16+k8/jhWwbN9VKOO\nVHdFl0IpAgMBAAECggEAabbuxa9Bnjg8biltCLvbLLqjDGJx6cEdXJI8dyTy4Os+\nkHV8b4/M9MolTT7x4InJlAHuu+DfQ5KPZ9r/ebJh/OmNgyPJJ4QYbFm4X94WIokG\n1m63RQXctVl9lOIOLPDyn/2M3l7hnEX4a1p1Zqr7sbXHxFz1dY8EydajLoTylErL\n7KEPC5UfpA7k4RsNQgQfP+Bdf36S5rLMZuDQSlh5Q9Jkao8mmtN0cJZwePR+z80d\nXlmzq+UbSi+v9BJ2509DWXWLgj70ZxyywnBP4Rn5WoSedXJ+ZTwlQes+ekwnZ2Zz\nbtzsLSFgbRcp2c4aVB+3l2ytERGogG60PcV6jerpQQKBgQDz2sNJtVK29DaCO+V5\nTrFFgdkfEMq97BSqIQPdR9lYGAlHnNo4RSP6koWX6ORy+QXMBgRlLeLzQmvUrepp\nn02GzjddMDzGhEsWBkm2bT52Vh4FePto2hPTLRZanfApCAx4bwVjM8Wl9GRtlhpU\nBCuIhMrlAphd5M8l/TKlt4s93wKBgQDqrsFhztsNx28EBzl29rAk6cZ57F+YURZ2\nj32fqobk3nn8F/z4Ntt/MfKbO7ApRngFreNOv2SRQ0ahzGGtemqjFIGmbraq8DFx\ng2rmRTDhnrpEGsTGV0GvvcylNyTXuTeCQxxlbQwwupqOXSiz/6UOMNSHBe5xVTDe\nEzuFiHNw9wKBgFAeI+Nnq5FokzAetboxXJTVoJxQTAwyMGflCPv+yy3iV8orgpbS\nQIvm7/WFEumjX4A0yeTkOphpzjvGGCozqKkNv6riWlVuyaymzDkfk1IV4S8zHIbK\nf5D2U03abjlM56v57e81504rCYPnuSa5aAQmfPLY826F6nk0wxsnPpxJAoGAKoB9\nu1X4LBWrUGJykM36dqTz8g7R/UbqN4yjJrB+f6KfGv3JLbbZp76G/oAf1knR4M1u\nNkvJTdmOSC04n29lMqW7GUZBxNF9Ut6HFK8BPEs/1qe2bWlOFyLblixXes4rdGbt\nFJ1cMNMKvK+4eGjbHqfPRajYVyQjloSLKhLdPV8CgYByCAZ46IC+WV3NxdzEyYX1\nDwA/W1zTDmBwAvIuZ4V3oROyzTu7mRLkWBn7xkrVyxa2x9qcpQ24xMQtVHU+Gj5o\nGFG4d4AH6J2t5NuxTxB6nCd+RbEdDYDYgJ3k/ye2XIR2tFT4d2Cw+BGpiVkApQj2\nTfUHhqoY5OH21g6rxrz9BA==\n-----END PRIVATE KEY-----\n"}]': finished 2021-03-10T20:03:22.056 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:21 gibba023 bash[13032]: cephadm 2021-03-10T20:03:20.873782+0000 mgr.y (mgr.14140) 185 : cephadm [INF] Deploying daemon grafana.a on gibba044 2021-03-10T20:03:23.505 INFO:teuthology.orchestra.run.gibba023.stdout: 2021-03-10T20:03:23.505 INFO:teuthology.orchestra.run.gibba023.stdout:{"epoch":48,"fsid":"dd719b26-81da-11eb-9080-001a4aab830c","created":"2021-03-10T19:58:03.970903+0000","modified":"2021-03-10T20:02:56.762243+0000","last_up_change":"2021-03-10T20:02:55.745021+0000","last_in_change":"2021-03-10T20:02:55.745021+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-10T19:58:14.436249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"44017fc6-e3eb-486e-b88f-073ab24f2838","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6802","nonce":1929369864},{"type":"v1","addr":"172.21.2.123:6803","nonce":1929369864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6804","nonce":1929369864},{"type":"v1","addr":"172.21.2.123:6805","nonce":1929369864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6808","nonce":1929369864},{"type":"v1","addr":"172.21.2.123:6809","nonce":1929369864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6806","nonce":1929369864},{"type":"v1","addr":"172.21.2.123:6807","nonce":1929369864}]},"public_addr":"172.21.2.123:6803/1929369864","cluster_addr":"172.21.2.123:6805/1929369864","heartbeat_back_addr":"172.21.2.123:6809/1929369864","heartbeat_front_addr":"172.21.2.123:6807/1929369864","state":["exists","up"]},{"osd":1,"uuid":"95b1ac45-85e8-43cd-9a54-ac01a8971dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6810","nonce":1309940659},{"type":"v1","addr":"172.21.2.123:6811","nonce":1309940659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6812","nonce":1309940659},{"type":"v1","addr":"172.21.2.123:6813","nonce":1309940659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6816","nonce":1309940659},{"type":"v1","addr":"172.21.2.123:6817","nonce":1309940659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6814","nonce":1309940659},{"type":"v1","addr":"172.21.2.123:6815","nonce":1309940659}]},"public_addr":"172.21.2.123:6811/1309940659","cluster_addr":"172.21.2.123:6813/1309940659","heartbeat_back_addr":"172.21.2.123:6817/1309940659","heartbeat_front_addr":"172.21.2.123:6815/1309940659","state":["exists","up"]},{"osd":2,"uuid":"a0f4e49d-c3f2-4689-a636-aeba722b895a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6818","nonce":949023223},{"type":"v1","addr":"172.21.2.123:6819","nonce":949023223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6820","nonce":949023223},{"type":"v1","addr":"172.21.2.123:6821","nonce":949023223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6824","nonce":949023223},{"type":"v1","addr":"172.21.2.123:6825","nonce":949023223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6822","nonce":949023223},{"type":"v1","addr":"172.21.2.123:6823","nonce":949023223}]},"public_addr":"172.21.2.123:6819/949023223","cluster_addr":"172.21.2.123:6821/949023223","heartbeat_back_addr":"172.21.2.123:6825/949023223","heartbeat_front_addr":"172.21.2.123:6823/949023223","state":["exists","up"]},{"osd":3,"uuid":"6613b193-a360-4fc9-a240-11ac052531a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6826","nonce":161452900},{"type":"v1","addr":"172.21.2.123:6827","nonce":161452900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6828","nonce":161452900},{"type":"v1","addr":"172.21.2.123:6829","nonce":161452900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6832","nonce":161452900},{"type":"v1","addr":"172.21.2.123:6833","nonce":161452900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6830","nonce":161452900},{"type":"v1","addr":"172.21.2.123:6831","nonce":161452900}]},"public_addr":"172.21.2.123:6827/161452900","cluster_addr":"172.21.2.123:6829/161452900","heartbeat_back_addr":"172.21.2.123:6833/161452900","heartbeat_front_addr":"172.21.2.123:6831/161452900","state":["exists","up"]},{"osd":4,"uuid":"f824eb9a-50e5-46f0-a070-ab633188e079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6800","nonce":165091654},{"type":"v1","addr":"172.21.2.144:6801","nonce":165091654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6802","nonce":165091654},{"type":"v1","addr":"172.21.2.144:6803","nonce":165091654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6806","nonce":165091654},{"type":"v1","addr":"172.21.2.144:6807","nonce":165091654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6804","nonce":165091654},{"type":"v1","addr":"172.21.2.144:6805","nonce":165091654}]},"public_addr":"172.21.2.144:6801/165091654","cluster_addr":"172.21.2.144:6803/165091654","heartbeat_back_addr":"172.21.2.144:6807/165091654","heartbeat_front_addr":"172.21.2.144:6805/165091654","state":["exists","up"]},{"osd":5,"uuid":"5087ad12-b460-4867-b004-2f5082257775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6808","nonce":2575964695},{"type":"v1","addr":"172.21.2.144:6809","nonce":2575964695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6810","nonce":2575964695},{"type":"v1","addr":"172.21.2.144:6811","nonce":2575964695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6814","nonce":2575964695},{"type":"v1","addr":"172.21.2.144:6815","nonce":2575964695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6812","nonce":2575964695},{"type":"v1","addr":"172.21.2.144:6813","nonce":2575964695}]},"public_addr":"172.21.2.144:6809/2575964695","cluster_addr":"172.21.2.144:6811/2575964695","heartbeat_back_addr":"172.21.2.144:6815/2575964695","heartbeat_front_addr":"172.21.2.144:6813/2575964695","state":["exists","up"]},{"osd":6,"uuid":"457d92b3-5bf6-4787-9c6d-a62b863cd4a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6816","nonce":1059379749},{"type":"v1","addr":"172.21.2.144:6817","nonce":1059379749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6818","nonce":1059379749},{"type":"v1","addr":"172.21.2.144:6819","nonce":1059379749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6822","nonce":1059379749},{"type":"v1","addr":"172.21.2.144:6823","nonce":1059379749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6820","nonce":1059379749},{"type":"v1","addr":"172.21.2.144:6821","nonce":1059379749}]},"public_addr":"172.21.2.144:6817/1059379749","cluster_addr":"172.21.2.144:6819/1059379749","heartbeat_back_addr":"172.21.2.144:6823/1059379749","heartbeat_front_addr":"172.21.2.144:6821/1059379749","state":["exists","up"]},{"osd":7,"uuid":"b833ae5d-df2b-4716-9b7c-1daad27d8d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6824","nonce":3721100466},{"type":"v1","addr":"172.21.2.144:6825","nonce":3721100466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6826","nonce":3721100466},{"type":"v1","addr":"172.21.2.144:6827","nonce":3721100466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6830","nonce":3721100466},{"type":"v1","addr":"172.21.2.144:6831","nonce":3721100466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6828","nonce":3721100466},{"type":"v1","addr":"172.21.2.144:6829","nonce":3721100466}]},"public_addr":"172.21.2.144:6825/3721100466","cluster_addr":"172.21.2.144:6827/3721100466","heartbeat_back_addr":"172.21.2.144:6831/3721100466","heartbeat_front_addr":"172.21.2.144:6829/3721100466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:00:16.202793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:00:39.162431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:01:03.430121+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:01:26.776648+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:01:46.909813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:02:09.000532+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:02:31.672650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:02:54.488226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.123:0/1355182290":"2021-03-11T19:58:35.850574+0000","172.21.2.123:0/2011847773":"2021-03-11T19:58:35.850574+0000","172.21.2.123:0/1029094703":"2021-03-11T19:58:35.850574+0000","172.21.2.123:6801/3266400770":"2021-03-11T19:58:35.850574+0000","172.21.2.123:6800/3266400770":"2021-03-11T19:58:35.850574+0000","172.21.2.123:0/1668334859":"2021-03-11T19:58:21.167435+0000","172.21.2.123:0/2479556364":"2021-03-11T19:58:21.167435+0000","172.21.2.123:6801/1515571074":"2021-03-11T19:58:21.167435+0000","172.21.2.123:6800/1515571074":"2021-03-11T19:58:21.167435+0000","172.21.2.123:0/3654852492":"2021-03-11T19:58:21.167435+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-03-10T20:03:23.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:23 gibba023 bash[9844]: cluster 2021-03-10T20:03:22.702072+0000 mgr.y (mgr.14140) 186 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:23.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:23 gibba023 bash[9844]: audit 2021-03-10T20:03:23.500595+0000 mon.b (mon.2) 24 : audit [DBG] from='client.? 172.21.2.123:0/4090558329' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T20:03:23.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:23 gibba023 bash[13032]: cluster 2021-03-10T20:03:22.702072+0000 mgr.y (mgr.14140) 186 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:23.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:23 gibba023 bash[13032]: audit 2021-03-10T20:03:23.500595+0000 mon.b (mon.2) 24 : audit [DBG] from='client.? 172.21.2.123:0/4090558329' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T20:03:24.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:23 gibba044 bash[9859]: cluster 2021-03-10T20:03:22.702072+0000 mgr.y (mgr.14140) 186 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:24.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:23 gibba044 bash[9859]: audit 2021-03-10T20:03:23.500595+0000 mon.b (mon.2) 24 : audit [DBG] from='client.? 172.21.2.123:0/4090558329' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T20:03:24.197 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-03-10T19:58:14.436249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2021-03-10T20:03:24.198 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph osd pool get device_health_metrics pg_num 2021-03-10T20:03:26.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:25 gibba044 bash[9859]: cluster 2021-03-10T20:03:24.702472+0000 mgr.y (mgr.14140) 187 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:26.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:25 gibba023 bash[9844]: cluster 2021-03-10T20:03:24.702472+0000 mgr.y (mgr.14140) 187 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:26.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:25 gibba023 bash[13032]: cluster 2021-03-10T20:03:24.702472+0000 mgr.y (mgr.14140) 187 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:26.983 INFO:teuthology.orchestra.run.gibba023.stdout:pg_num: 1 2021-03-10T20:03:27.626 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-03-10T20:03:27.627 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2021-03-10T20:03:27.627 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph mgr dump --format=json 2021-03-10T20:03:27.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:27 gibba023 bash[9844]: cluster 2021-03-10T20:03:26.703112+0000 mgr.y (mgr.14140) 188 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:27.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:27 gibba023 bash[9844]: audit 2021-03-10T20:03:26.980891+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.2.123:0/13099846' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-03-10T20:03:27.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:27 gibba023 bash[13032]: cluster 2021-03-10T20:03:26.703112+0000 mgr.y (mgr.14140) 188 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:27.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:27 gibba023 bash[13032]: audit 2021-03-10T20:03:26.980891+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.2.123:0/13099846' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-03-10T20:03:28.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:27 gibba044 bash[9859]: cluster 2021-03-10T20:03:26.703112+0000 mgr.y (mgr.14140) 188 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:28.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:27 gibba044 bash[9859]: audit 2021-03-10T20:03:26.980891+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.2.123:0/13099846' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-03-10T20:03:29.978 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:29 gibba044 bash[9859]: cluster 2021-03-10T20:03:28.703600+0000 mgr.y (mgr.14140) 189 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:30.111 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:29 gibba023 bash[9844]: cluster 2021-03-10T20:03:28.703600+0000 mgr.y (mgr.14140) 189 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:30.112 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:03:29 gibba023 bash[20360]: level=info ts=2021-03-10T20:03:29.737Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.000804725s 2021-03-10T20:03:30.112 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:29 gibba023 bash[13032]: cluster 2021-03-10T20:03:28.703600+0000 mgr.y (mgr.14140) 189 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:30.403 INFO:teuthology.orchestra.run.gibba023.stdout: 2021-03-10T20:03:30.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:30 gibba023 bash[9844]: audit 2021-03-10T20:03:30.396626+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.2.123:0/1316275007' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-03-10T20:03:30.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:30 gibba023 bash[13032]: audit 2021-03-10T20:03:30.396626+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.2.123:0/1316275007' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-03-10T20:03:31.009 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:30 gibba044 bash[9859]: audit 2021-03-10T20:03:30.396626+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.2.123:0/1316275007' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-03-10T20:03:31.133 INFO:teuthology.orchestra.run.gibba023.stdout:{"epoch":15,"active_gid":14140,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6800","nonce":617645769},{"type":"v1","addr":"172.21.2.123:6801","nonce":617645769}]},"active_addr":"172.21.2.123:6801/617645769","active_change":"2021-03-10T19:58:35.851026+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":34109,"name":"x","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":34115,"name":"gibba044.wflcwh","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://gibba023:8443/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":5,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.2.123:0","nonce":3407354389}]},{"addrvec":[{"type":"v2","addr":"172.21.2.123:0","nonce":3929112942}]},{"addrvec":[{"type":"v2","addr":"172.21.2.123:0","nonce":779403845}]}]}} 2021-03-10T20:03:31.139 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2021-03-10T20:03:31.140 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2021-03-10T20:03:31.140 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph osd dump --format=json 2021-03-10T20:03:32.027 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:31 gibba023 bash[9844]: cluster 2021-03-10T20:03:30.704338+0000 mgr.y (mgr.14140) 190 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:32.028 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:31 gibba023 bash[13032]: cluster 2021-03-10T20:03:30.704338+0000 mgr.y (mgr.14140) 190 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:32.057 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:31 gibba044 bash[9859]: cluster 2021-03-10T20:03:30.704338+0000 mgr.y (mgr.14140) 190 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:32.505 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:32 gibba044 docker[19067]: Error: No such container: ceph-dd719b26-81da-11eb-9080-001a4aab830c-grafana.a 2021-03-10T20:03:32.505 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:32 gibba044 systemd[1]: Started Ceph grafana.a for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:03:33.024 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:32 gibba044 bash[9859]: audit 2021-03-10T20:03:32.223763+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768075\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768132\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768160\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768186\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768212\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768236\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768261\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"282b9567456b\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768285\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:07.165491\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768310\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:03:33.025 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:32 gibba044 bash[9859]: audit 2021-03-10T20:03:32.229264+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768075\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768132\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768160\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768186\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768212\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768236\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768261\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"282b9567456b\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768285\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:07.165491\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768310\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:03:33.025 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:32 gibba044 bash[9859]: audit 2021-03-10T20:03:32.230666+0000 mon.a (mon.0) 522 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:33.040 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:32 gibba023 bash[13032]: audit 2021-03-10T20:03:32.223763+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768075\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768132\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768160\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768186\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768212\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768236\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768261\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"282b9567456b\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768285\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:07.165491\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768310\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:03:33.041 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:32 gibba023 bash[13032]: audit 2021-03-10T20:03:32.229264+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768075\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768132\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768160\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768186\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768212\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768236\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768261\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"282b9567456b\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768285\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:07.165491\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768310\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:03:33.041 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:32 gibba023 bash[13032]: audit 2021-03-10T20:03:32.230666+0000 mon.a (mon.0) 522 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:33.042 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:32 gibba023 bash[9844]: audit 2021-03-10T20:03:32.223763+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768075\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768132\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768160\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768186\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768212\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768236\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768261\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"282b9567456b\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768285\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:07.165491\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768310\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:03:33.042 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:32 gibba023 bash[9844]: audit 2021-03-10T20:03:32.229264+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768075\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768132\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768160\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768186\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768212\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768236\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768261\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"282b9567456b\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768285\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:07.165491\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:20.768310\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:03:33.043 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:32 gibba023 bash[9844]: audit 2021-03-10T20:03:32.230666+0000 mon.a (mon.0) 522 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:33.344 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="Starting Grafana" logger=server version=6.6.2 commit=3fa63cfc34 branch=HEAD compiled=2020-02-20T12:03:49+0000 2021-03-10T20:03:33.344 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2021-03-10T20:03:33.344 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2021-03-10T20:03:33.345 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2021-03-10T20:03:33.345 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2021-03-10T20:03:33.345 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2021-03-10T20:03:33.345 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2021-03-10T20:03:33.345 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2021-03-10T20:03:33.346 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2021-03-10T20:03:33.346 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2021-03-10T20:03:33.346 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2021-03-10T20:03:33.346 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2021-03-10T20:03:33.347 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="App mode production" logger=settings 2021-03-10T20:03:33.347 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="Initializing SqlStore" logger=server 2021-03-10T20:03:33.347 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2021-03-10T20:03:33.347 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="Starting DB migration" logger=migrator 2021-03-10T20:03:33.347 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2021-03-10T20:03:33.348 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2021-03-10T20:03:33.348 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2021-03-10T20:03:33.348 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2021-03-10T20:03:33.594 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2021-03-10T20:03:33.594 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2021-03-10T20:03:33.845 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2021-03-10T20:03:33.846 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2021-03-10T20:03:33.846 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2021-03-10T20:03:33.846 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2021-03-10T20:03:33.847 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[9859]: cluster 2021-03-10T20:03:32.704656+0000 mgr.y (mgr.14140) 191 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:33.847 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[9859]: audit 2021-03-10T20:03:33.519284+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518373\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518445\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518474\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518500\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518526\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518553\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518579\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518605\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e8edea0d5c6a\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518631\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:18.600962\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.763299\"}}, \"last_daemon_update\": \"2021-03-10T20:03:33.518692\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:03:33.848 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[9859]: audit 2021-03-10T20:03:33.522984+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518373\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518445\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518474\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518500\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518526\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518553\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518579\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518605\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e8edea0d5c6a\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518631\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:18.600962\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.763299\"}}, \"last_daemon_update\": \"2021-03-10T20:03:33.518692\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:03:33.848 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[9859]: audit 2021-03-10T20:03:33.523434+0000 mon.a (mon.0) 525 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:33.962 INFO:teuthology.orchestra.run.gibba023.stdout: 2021-03-10T20:03:33.962 INFO:teuthology.orchestra.run.gibba023.stdout:{"epoch":48,"fsid":"dd719b26-81da-11eb-9080-001a4aab830c","created":"2021-03-10T19:58:03.970903+0000","modified":"2021-03-10T20:02:56.762243+0000","last_up_change":"2021-03-10T20:02:55.745021+0000","last_in_change":"2021-03-10T20:02:55.745021+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-10T19:58:14.436249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"44017fc6-e3eb-486e-b88f-073ab24f2838","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6802","nonce":1929369864},{"type":"v1","addr":"172.21.2.123:6803","nonce":1929369864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6804","nonce":1929369864},{"type":"v1","addr":"172.21.2.123:6805","nonce":1929369864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6808","nonce":1929369864},{"type":"v1","addr":"172.21.2.123:6809","nonce":1929369864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6806","nonce":1929369864},{"type":"v1","addr":"172.21.2.123:6807","nonce":1929369864}]},"public_addr":"172.21.2.123:6803/1929369864","cluster_addr":"172.21.2.123:6805/1929369864","heartbeat_back_addr":"172.21.2.123:6809/1929369864","heartbeat_front_addr":"172.21.2.123:6807/1929369864","state":["exists","up"]},{"osd":1,"uuid":"95b1ac45-85e8-43cd-9a54-ac01a8971dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6810","nonce":1309940659},{"type":"v1","addr":"172.21.2.123:6811","nonce":1309940659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6812","nonce":1309940659},{"type":"v1","addr":"172.21.2.123:6813","nonce":1309940659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6816","nonce":1309940659},{"type":"v1","addr":"172.21.2.123:6817","nonce":1309940659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6814","nonce":1309940659},{"type":"v1","addr":"172.21.2.123:6815","nonce":1309940659}]},"public_addr":"172.21.2.123:6811/1309940659","cluster_addr":"172.21.2.123:6813/1309940659","heartbeat_back_addr":"172.21.2.123:6817/1309940659","heartbeat_front_addr":"172.21.2.123:6815/1309940659","state":["exists","up"]},{"osd":2,"uuid":"a0f4e49d-c3f2-4689-a636-aeba722b895a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6818","nonce":949023223},{"type":"v1","addr":"172.21.2.123:6819","nonce":949023223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6820","nonce":949023223},{"type":"v1","addr":"172.21.2.123:6821","nonce":949023223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6824","nonce":949023223},{"type":"v1","addr":"172.21.2.123:6825","nonce":949023223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6822","nonce":949023223},{"type":"v1","addr":"172.21.2.123:6823","nonce":949023223}]},"public_addr":"172.21.2.123:6819/949023223","cluster_addr":"172.21.2.123:6821/949023223","heartbeat_back_addr":"172.21.2.123:6825/949023223","heartbeat_front_addr":"172.21.2.123:6823/949023223","state":["exists","up"]},{"osd":3,"uuid":"6613b193-a360-4fc9-a240-11ac052531a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6826","nonce":161452900},{"type":"v1","addr":"172.21.2.123:6827","nonce":161452900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6828","nonce":161452900},{"type":"v1","addr":"172.21.2.123:6829","nonce":161452900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6832","nonce":161452900},{"type":"v1","addr":"172.21.2.123:6833","nonce":161452900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6830","nonce":161452900},{"type":"v1","addr":"172.21.2.123:6831","nonce":161452900}]},"public_addr":"172.21.2.123:6827/161452900","cluster_addr":"172.21.2.123:6829/161452900","heartbeat_back_addr":"172.21.2.123:6833/161452900","heartbeat_front_addr":"172.21.2.123:6831/161452900","state":["exists","up"]},{"osd":4,"uuid":"f824eb9a-50e5-46f0-a070-ab633188e079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6800","nonce":165091654},{"type":"v1","addr":"172.21.2.144:6801","nonce":165091654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6802","nonce":165091654},{"type":"v1","addr":"172.21.2.144:6803","nonce":165091654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6806","nonce":165091654},{"type":"v1","addr":"172.21.2.144:6807","nonce":165091654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6804","nonce":165091654},{"type":"v1","addr":"172.21.2.144:6805","nonce":165091654}]},"public_addr":"172.21.2.144:6801/165091654","cluster_addr":"172.21.2.144:6803/165091654","heartbeat_back_addr":"172.21.2.144:6807/165091654","heartbeat_front_addr":"172.21.2.144:6805/165091654","state":["exists","up"]},{"osd":5,"uuid":"5087ad12-b460-4867-b004-2f5082257775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6808","nonce":2575964695},{"type":"v1","addr":"172.21.2.144:6809","nonce":2575964695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6810","nonce":2575964695},{"type":"v1","addr":"172.21.2.144:6811","nonce":2575964695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6814","nonce":2575964695},{"type":"v1","addr":"172.21.2.144:6815","nonce":2575964695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6812","nonce":2575964695},{"type":"v1","addr":"172.21.2.144:6813","nonce":2575964695}]},"public_addr":"172.21.2.144:6809/2575964695","cluster_addr":"172.21.2.144:6811/2575964695","heartbeat_back_addr":"172.21.2.144:6815/2575964695","heartbeat_front_addr":"172.21.2.144:6813/2575964695","state":["exists","up"]},{"osd":6,"uuid":"457d92b3-5bf6-4787-9c6d-a62b863cd4a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6816","nonce":1059379749},{"type":"v1","addr":"172.21.2.144:6817","nonce":1059379749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6818","nonce":1059379749},{"type":"v1","addr":"172.21.2.144:6819","nonce":1059379749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6822","nonce":1059379749},{"type":"v1","addr":"172.21.2.144:6823","nonce":1059379749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6820","nonce":1059379749},{"type":"v1","addr":"172.21.2.144:6821","nonce":1059379749}]},"public_addr":"172.21.2.144:6817/1059379749","cluster_addr":"172.21.2.144:6819/1059379749","heartbeat_back_addr":"172.21.2.144:6823/1059379749","heartbeat_front_addr":"172.21.2.144:6821/1059379749","state":["exists","up"]},{"osd":7,"uuid":"b833ae5d-df2b-4716-9b7c-1daad27d8d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6824","nonce":3721100466},{"type":"v1","addr":"172.21.2.144:6825","nonce":3721100466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6826","nonce":3721100466},{"type":"v1","addr":"172.21.2.144:6827","nonce":3721100466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6830","nonce":3721100466},{"type":"v1","addr":"172.21.2.144:6831","nonce":3721100466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6828","nonce":3721100466},{"type":"v1","addr":"172.21.2.144:6829","nonce":3721100466}]},"public_addr":"172.21.2.144:6825/3721100466","cluster_addr":"172.21.2.144:6827/3721100466","heartbeat_back_addr":"172.21.2.144:6831/3721100466","heartbeat_front_addr":"172.21.2.144:6829/3721100466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:00:16.202793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:00:39.162431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:01:03.430121+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:01:26.776648+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:01:46.909813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:02:09.000532+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:02:31.672650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:02:54.488226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.123:0/1355182290":"2021-03-11T19:58:35.850574+0000","172.21.2.123:0/2011847773":"2021-03-11T19:58:35.850574+0000","172.21.2.123:0/1029094703":"2021-03-11T19:58:35.850574+0000","172.21.2.123:6801/3266400770":"2021-03-11T19:58:35.850574+0000","172.21.2.123:6800/3266400770":"2021-03-11T19:58:35.850574+0000","172.21.2.123:0/1668334859":"2021-03-11T19:58:21.167435+0000","172.21.2.123:0/2479556364":"2021-03-11T19:58:21.167435+0000","172.21.2.123:6801/1515571074":"2021-03-11T19:58:21.167435+0000","172.21.2.123:6800/1515571074":"2021-03-11T19:58:21.167435+0000","172.21.2.123:0/3654852492":"2021-03-11T19:58:21.167435+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-03-10T20:03:34.023 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:33 gibba023 bash[9844]: cluster 2021-03-10T20:03:32.704656+0000 mgr.y (mgr.14140) 191 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:34.024 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:33 gibba023 bash[13032]: cluster 2021-03-10T20:03:32.704656+0000 mgr.y (mgr.14140) 191 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:34.024 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:33 gibba023 bash[9844]: audit 2021-03-10T20:03:33.519284+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518373\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518445\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518474\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518500\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518526\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518553\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518579\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518605\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e8edea0d5c6a\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518631\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:18.600962\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.763299\"}}, \"last_daemon_update\": \"2021-03-10T20:03:33.518692\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:03:34.025 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:33 gibba023 bash[9844]: audit 2021-03-10T20:03:33.522984+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518373\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518445\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518474\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518500\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518526\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518553\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518579\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518605\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e8edea0d5c6a\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518631\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:18.600962\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.763299\"}}, \"last_daemon_update\": \"2021-03-10T20:03:33.518692\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:03:34.025 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:33 gibba023 bash[9844]: audit 2021-03-10T20:03:33.523434+0000 mon.a (mon.0) 525 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:34.026 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:33 gibba023 bash[13032]: audit 2021-03-10T20:03:33.519284+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518373\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518445\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518474\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518500\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518526\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518553\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518579\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518605\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e8edea0d5c6a\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518631\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:18.600962\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.763299\"}}, \"last_daemon_update\": \"2021-03-10T20:03:33.518692\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:03:34.026 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:33 gibba023 bash[13032]: audit 2021-03-10T20:03:33.522984+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518373\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518445\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518474\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518500\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518526\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518553\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518579\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518605\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e8edea0d5c6a\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518631\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:18.600962\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.763299\"}}, \"last_daemon_update\": \"2021-03-10T20:03:33.518692\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:03:34.026 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:33 gibba023 bash[13032]: audit 2021-03-10T20:03:33.523434+0000 mon.a (mon.0) 525 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:34.139 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2021-03-10T20:03:34.140 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2021-03-10T20:03:34.140 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:33 gibba044 bash[19086]: t=2021-03-10T20:03:33+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2021-03-10T20:03:34.140 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:34 gibba044 bash[19086]: t=2021-03-10T20:03:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2021-03-10T20:03:34.140 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:34 gibba044 bash[19086]: t=2021-03-10T20:03:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2021-03-10T20:03:34.141 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:34 gibba044 bash[19086]: t=2021-03-10T20:03:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2021-03-10T20:03:34.255 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:34 gibba044 bash[19086]: t=2021-03-10T20:03:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2021-03-10T20:03:34.401 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:34 gibba044 bash[19086]: t=2021-03-10T20:03:34+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2021-03-10T20:03:34.401 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:34 gibba044 bash[19086]: t=2021-03-10T20:03:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2021-03-10T20:03:34.695 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:34 gibba044 bash[19086]: t=2021-03-10T20:03:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2021-03-10T20:03:34.695 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:34 gibba044 bash[19086]: t=2021-03-10T20:03:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2021-03-10T20:03:34.696 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:34 gibba044 bash[19086]: t=2021-03-10T20:03:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2021-03-10T20:03:34.696 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:34 gibba044 bash[19086]: t=2021-03-10T20:03:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2021-03-10T20:03:34.696 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:34 gibba044 bash[19086]: t=2021-03-10T20:03:34+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2021-03-10T20:03:34.696 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:34 gibba044 bash[19086]: t=2021-03-10T20:03:34+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2021-03-10T20:03:34.719 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2021-03-10T20:03:34.720 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph osd dump --format=json 2021-03-10T20:03:35.005 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:34 gibba044 bash[19086]: t=2021-03-10T20:03:34+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2021-03-10T20:03:35.006 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:34 gibba044 bash[19086]: t=2021-03-10T20:03:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2021-03-10T20:03:35.006 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:34 gibba044 bash[19086]: t=2021-03-10T20:03:34+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2021-03-10T20:03:35.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:34 gibba044 bash[9859]: audit 2021-03-10T20:03:33.959283+0000 mon.a (mon.0) 526 : audit [DBG] from='client.? 172.21.2.123:0/4281940689' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T20:03:35.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:34 gibba044 bash[9859]: audit 2021-03-10T20:03:34.379668+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.374763\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375026\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375195\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375350\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375498\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375647\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375797\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"282b9567456b\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375945\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:07.165491\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.376092\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.376241\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}}, \"last_daemon_update\": \"2021-03-10T20:03:34.376570\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:03:35.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:34 gibba044 bash[9859]: audit 2021-03-10T20:03:34.388757+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.374763\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375026\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375195\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375350\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375498\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375647\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375797\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"282b9567456b\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375945\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:07.165491\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.376092\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.376241\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}}, \"last_daemon_update\": \"2021-03-10T20:03:34.376570\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:03:35.187 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:34 gibba023 bash[9844]: audit 2021-03-10T20:03:33.959283+0000 mon.a (mon.0) 526 : audit [DBG] from='client.? 172.21.2.123:0/4281940689' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T20:03:35.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:34 gibba023 bash[13032]: audit 2021-03-10T20:03:33.959283+0000 mon.a (mon.0) 526 : audit [DBG] from='client.? 172.21.2.123:0/4281940689' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T20:03:35.188 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:34 gibba023 bash[9844]: audit 2021-03-10T20:03:34.379668+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.374763\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375026\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375195\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375350\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375498\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375647\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375797\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"282b9567456b\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375945\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:07.165491\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.376092\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.376241\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}}, \"last_daemon_update\": \"2021-03-10T20:03:34.376570\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:03:35.189 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:34 gibba023 bash[9844]: audit 2021-03-10T20:03:34.388757+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.374763\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375026\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375195\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375350\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375498\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375647\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375797\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"282b9567456b\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375945\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:07.165491\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.376092\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.376241\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}}, \"last_daemon_update\": \"2021-03-10T20:03:34.376570\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:03:35.189 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:34 gibba023 bash[13032]: audit 2021-03-10T20:03:34.379668+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.374763\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375026\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375195\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375350\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375498\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375647\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375797\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"282b9567456b\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375945\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:07.165491\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.376092\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.376241\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}}, \"last_daemon_update\": \"2021-03-10T20:03:34.376570\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:03:35.189 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:34 gibba023 bash[13032]: audit 2021-03-10T20:03:34.388757+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.374763\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375026\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375195\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375350\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375498\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375647\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375797\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"282b9567456b\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375945\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:07.165491\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.376092\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.376241\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:02:54.569108\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}}, \"last_daemon_update\": \"2021-03-10T20:03:34.376570\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:03:35.288 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:35 gibba044 bash[19086]: t=2021-03-10T20:03:35+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2021-03-10T20:03:35.289 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:35 gibba044 bash[19086]: t=2021-03-10T20:03:35+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2021-03-10T20:03:35.289 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:35 gibba044 bash[19086]: t=2021-03-10T20:03:35+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2021-03-10T20:03:35.619 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:35 gibba044 bash[19086]: t=2021-03-10T20:03:35+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2021-03-10T20:03:35.620 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:35 gibba044 bash[19086]: t=2021-03-10T20:03:35+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2021-03-10T20:03:35.620 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:35 gibba044 bash[19086]: t=2021-03-10T20:03:35+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2021-03-10T20:03:35.620 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:35 gibba044 bash[19086]: t=2021-03-10T20:03:35+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2021-03-10T20:03:35.620 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:35 gibba044 bash[19086]: t=2021-03-10T20:03:35+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2021-03-10T20:03:35.928 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:35 gibba044 bash[9859]: cephadm 2021-03-10T20:03:34.390230+0000 mgr.y (mgr.14140) 192 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T20:03:35.929 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:35 gibba044 bash[9859]: cephadm 2021-03-10T20:03:34.392199+0000 mgr.y (mgr.14140) 193 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba023 2021-03-10T20:03:35.929 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:35 gibba044 bash[9859]: cluster 2021-03-10T20:03:34.705232+0000 mgr.y (mgr.14140) 194 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:35.929 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:35 gibba044 bash[19086]: t=2021-03-10T20:03:35+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2021-03-10T20:03:35.930 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:35 gibba044 bash[19086]: t=2021-03-10T20:03:35+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2021-03-10T20:03:35.930 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:35 gibba044 bash[19086]: t=2021-03-10T20:03:35+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2021-03-10T20:03:35.930 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:35 gibba044 bash[19086]: t=2021-03-10T20:03:35+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2021-03-10T20:03:36.037 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:35 gibba023 bash[9844]: cephadm 2021-03-10T20:03:34.390230+0000 mgr.y (mgr.14140) 192 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T20:03:36.038 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:35 gibba023 bash[9844]: cephadm 2021-03-10T20:03:34.392199+0000 mgr.y (mgr.14140) 193 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba023 2021-03-10T20:03:36.038 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:35 gibba023 bash[9844]: cluster 2021-03-10T20:03:34.705232+0000 mgr.y (mgr.14140) 194 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:36.038 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:35 gibba023 bash[13032]: cephadm 2021-03-10T20:03:34.390230+0000 mgr.y (mgr.14140) 192 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T20:03:36.038 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:35 gibba023 bash[13032]: cephadm 2021-03-10T20:03:34.392199+0000 mgr.y (mgr.14140) 193 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba023 2021-03-10T20:03:36.039 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:35 gibba023 bash[13032]: cluster 2021-03-10T20:03:34.705232+0000 mgr.y (mgr.14140) 194 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:36.213 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:35 gibba044 bash[19086]: t=2021-03-10T20:03:35+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2021-03-10T20:03:36.214 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:36 gibba044 bash[19086]: t=2021-03-10T20:03:36+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2021-03-10T20:03:36.214 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:36 gibba044 bash[19086]: t=2021-03-10T20:03:36+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2021-03-10T20:03:36.507 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:36 gibba044 bash[19086]: t=2021-03-10T20:03:36+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2021-03-10T20:03:36.507 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:36 gibba044 bash[19086]: t=2021-03-10T20:03:36+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2021-03-10T20:03:36.508 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:36 gibba044 bash[19086]: t=2021-03-10T20:03:36+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2021-03-10T20:03:36.508 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:36 gibba044 bash[19086]: t=2021-03-10T20:03:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2021-03-10T20:03:36.771 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:36 gibba044 bash[19086]: t=2021-03-10T20:03:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2021-03-10T20:03:36.771 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:36 gibba044 bash[19086]: t=2021-03-10T20:03:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2021-03-10T20:03:36.771 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:36 gibba044 bash[19086]: t=2021-03-10T20:03:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2021-03-10T20:03:36.771 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:36 gibba044 bash[19086]: t=2021-03-10T20:03:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2021-03-10T20:03:36.772 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:36 gibba044 bash[19086]: t=2021-03-10T20:03:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2021-03-10T20:03:37.090 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:36 gibba044 bash[19086]: t=2021-03-10T20:03:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2021-03-10T20:03:37.091 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:36 gibba044 bash[19086]: t=2021-03-10T20:03:36+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2021-03-10T20:03:37.091 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:36 gibba044 bash[19086]: t=2021-03-10T20:03:36+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2021-03-10T20:03:37.091 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:37 gibba044 bash[19086]: t=2021-03-10T20:03:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2021-03-10T20:03:37.383 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:37 gibba044 bash[19086]: t=2021-03-10T20:03:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2021-03-10T20:03:37.384 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:37 gibba044 bash[19086]: t=2021-03-10T20:03:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2021-03-10T20:03:37.384 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:37 gibba044 bash[19086]: t=2021-03-10T20:03:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2021-03-10T20:03:37.642 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:37 gibba044 bash[19086]: t=2021-03-10T20:03:37+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2021-03-10T20:03:37.642 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:37 gibba044 bash[19086]: t=2021-03-10T20:03:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2021-03-10T20:03:37.643 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:37 gibba044 bash[19086]: t=2021-03-10T20:03:37+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2021-03-10T20:03:37.913 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:37 gibba044 bash[9859]: cluster 2021-03-10T20:03:36.705889+0000 mgr.y (mgr.14140) 195 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:37.914 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:37 gibba044 bash[19086]: t=2021-03-10T20:03:37+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2021-03-10T20:03:37.914 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:37 gibba044 bash[19086]: t=2021-03-10T20:03:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2021-03-10T20:03:37.914 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:37 gibba044 bash[19086]: t=2021-03-10T20:03:37+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2021-03-10T20:03:37.914 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:37 gibba044 bash[19086]: t=2021-03-10T20:03:37+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2021-03-10T20:03:38.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:37 gibba023 bash[9844]: cluster 2021-03-10T20:03:36.705889+0000 mgr.y (mgr.14140) 195 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:38.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:37 gibba023 bash[13032]: cluster 2021-03-10T20:03:36.705889+0000 mgr.y (mgr.14140) 195 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:38.186 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:37 gibba044 bash[19086]: t=2021-03-10T20:03:37+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2021-03-10T20:03:38.186 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:38 gibba044 bash[19086]: t=2021-03-10T20:03:38+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2021-03-10T20:03:38.454 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:38 gibba044 bash[19086]: t=2021-03-10T20:03:38+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2021-03-10T20:03:38.455 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:38 gibba044 bash[19086]: t=2021-03-10T20:03:38+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2021-03-10T20:03:38.455 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:38 gibba044 bash[19086]: t=2021-03-10T20:03:38+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2021-03-10T20:03:38.455 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:38 gibba044 bash[19086]: t=2021-03-10T20:03:38+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2021-03-10T20:03:38.455 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:38 gibba044 bash[19086]: t=2021-03-10T20:03:38+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2021-03-10T20:03:38.755 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:38 gibba044 bash[19086]: t=2021-03-10T20:03:38+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2021-03-10T20:03:38.756 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:38 gibba044 bash[19086]: t=2021-03-10T20:03:38+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2021-03-10T20:03:38.756 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:38 gibba044 bash[19086]: t=2021-03-10T20:03:38+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2021-03-10T20:03:38.756 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:38 gibba044 bash[19086]: t=2021-03-10T20:03:38+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2021-03-10T20:03:39.008 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:38 gibba044 bash[19086]: t=2021-03-10T20:03:38+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2021-03-10T20:03:39.008 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:38 gibba044 bash[19086]: t=2021-03-10T20:03:38+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2021-03-10T20:03:39.008 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:38 gibba044 bash[19086]: t=2021-03-10T20:03:38+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2021-03-10T20:03:39.267 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:39 gibba044 bash[19086]: t=2021-03-10T20:03:39+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2021-03-10T20:03:39.268 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:39 gibba044 bash[19086]: t=2021-03-10T20:03:39+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2021-03-10T20:03:39.268 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:39 gibba044 bash[19086]: t=2021-03-10T20:03:39+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2021-03-10T20:03:39.268 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:39 gibba044 bash[19086]: t=2021-03-10T20:03:39+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2021-03-10T20:03:39.336 INFO:teuthology.orchestra.run.gibba023.stdout: 2021-03-10T20:03:39.336 INFO:teuthology.orchestra.run.gibba023.stdout:{"epoch":48,"fsid":"dd719b26-81da-11eb-9080-001a4aab830c","created":"2021-03-10T19:58:03.970903+0000","modified":"2021-03-10T20:02:56.762243+0000","last_up_change":"2021-03-10T20:02:55.745021+0000","last_in_change":"2021-03-10T20:02:55.745021+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-03-10T19:58:14.436249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"44017fc6-e3eb-486e-b88f-073ab24f2838","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6802","nonce":1929369864},{"type":"v1","addr":"172.21.2.123:6803","nonce":1929369864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6804","nonce":1929369864},{"type":"v1","addr":"172.21.2.123:6805","nonce":1929369864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6808","nonce":1929369864},{"type":"v1","addr":"172.21.2.123:6809","nonce":1929369864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6806","nonce":1929369864},{"type":"v1","addr":"172.21.2.123:6807","nonce":1929369864}]},"public_addr":"172.21.2.123:6803/1929369864","cluster_addr":"172.21.2.123:6805/1929369864","heartbeat_back_addr":"172.21.2.123:6809/1929369864","heartbeat_front_addr":"172.21.2.123:6807/1929369864","state":["exists","up"]},{"osd":1,"uuid":"95b1ac45-85e8-43cd-9a54-ac01a8971dd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6810","nonce":1309940659},{"type":"v1","addr":"172.21.2.123:6811","nonce":1309940659}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6812","nonce":1309940659},{"type":"v1","addr":"172.21.2.123:6813","nonce":1309940659}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6816","nonce":1309940659},{"type":"v1","addr":"172.21.2.123:6817","nonce":1309940659}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6814","nonce":1309940659},{"type":"v1","addr":"172.21.2.123:6815","nonce":1309940659}]},"public_addr":"172.21.2.123:6811/1309940659","cluster_addr":"172.21.2.123:6813/1309940659","heartbeat_back_addr":"172.21.2.123:6817/1309940659","heartbeat_front_addr":"172.21.2.123:6815/1309940659","state":["exists","up"]},{"osd":2,"uuid":"a0f4e49d-c3f2-4689-a636-aeba722b895a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6818","nonce":949023223},{"type":"v1","addr":"172.21.2.123:6819","nonce":949023223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6820","nonce":949023223},{"type":"v1","addr":"172.21.2.123:6821","nonce":949023223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6824","nonce":949023223},{"type":"v1","addr":"172.21.2.123:6825","nonce":949023223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6822","nonce":949023223},{"type":"v1","addr":"172.21.2.123:6823","nonce":949023223}]},"public_addr":"172.21.2.123:6819/949023223","cluster_addr":"172.21.2.123:6821/949023223","heartbeat_back_addr":"172.21.2.123:6825/949023223","heartbeat_front_addr":"172.21.2.123:6823/949023223","state":["exists","up"]},{"osd":3,"uuid":"6613b193-a360-4fc9-a240-11ac052531a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6826","nonce":161452900},{"type":"v1","addr":"172.21.2.123:6827","nonce":161452900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6828","nonce":161452900},{"type":"v1","addr":"172.21.2.123:6829","nonce":161452900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6832","nonce":161452900},{"type":"v1","addr":"172.21.2.123:6833","nonce":161452900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.123:6830","nonce":161452900},{"type":"v1","addr":"172.21.2.123:6831","nonce":161452900}]},"public_addr":"172.21.2.123:6827/161452900","cluster_addr":"172.21.2.123:6829/161452900","heartbeat_back_addr":"172.21.2.123:6833/161452900","heartbeat_front_addr":"172.21.2.123:6831/161452900","state":["exists","up"]},{"osd":4,"uuid":"f824eb9a-50e5-46f0-a070-ab633188e079","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6800","nonce":165091654},{"type":"v1","addr":"172.21.2.144:6801","nonce":165091654}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6802","nonce":165091654},{"type":"v1","addr":"172.21.2.144:6803","nonce":165091654}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6806","nonce":165091654},{"type":"v1","addr":"172.21.2.144:6807","nonce":165091654}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6804","nonce":165091654},{"type":"v1","addr":"172.21.2.144:6805","nonce":165091654}]},"public_addr":"172.21.2.144:6801/165091654","cluster_addr":"172.21.2.144:6803/165091654","heartbeat_back_addr":"172.21.2.144:6807/165091654","heartbeat_front_addr":"172.21.2.144:6805/165091654","state":["exists","up"]},{"osd":5,"uuid":"5087ad12-b460-4867-b004-2f5082257775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6808","nonce":2575964695},{"type":"v1","addr":"172.21.2.144:6809","nonce":2575964695}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6810","nonce":2575964695},{"type":"v1","addr":"172.21.2.144:6811","nonce":2575964695}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6814","nonce":2575964695},{"type":"v1","addr":"172.21.2.144:6815","nonce":2575964695}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6812","nonce":2575964695},{"type":"v1","addr":"172.21.2.144:6813","nonce":2575964695}]},"public_addr":"172.21.2.144:6809/2575964695","cluster_addr":"172.21.2.144:6811/2575964695","heartbeat_back_addr":"172.21.2.144:6815/2575964695","heartbeat_front_addr":"172.21.2.144:6813/2575964695","state":["exists","up"]},{"osd":6,"uuid":"457d92b3-5bf6-4787-9c6d-a62b863cd4a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6816","nonce":1059379749},{"type":"v1","addr":"172.21.2.144:6817","nonce":1059379749}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6818","nonce":1059379749},{"type":"v1","addr":"172.21.2.144:6819","nonce":1059379749}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6822","nonce":1059379749},{"type":"v1","addr":"172.21.2.144:6823","nonce":1059379749}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6820","nonce":1059379749},{"type":"v1","addr":"172.21.2.144:6821","nonce":1059379749}]},"public_addr":"172.21.2.144:6817/1059379749","cluster_addr":"172.21.2.144:6819/1059379749","heartbeat_back_addr":"172.21.2.144:6823/1059379749","heartbeat_front_addr":"172.21.2.144:6821/1059379749","state":["exists","up"]},{"osd":7,"uuid":"b833ae5d-df2b-4716-9b7c-1daad27d8d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6824","nonce":3721100466},{"type":"v1","addr":"172.21.2.144:6825","nonce":3721100466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6826","nonce":3721100466},{"type":"v1","addr":"172.21.2.144:6827","nonce":3721100466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6830","nonce":3721100466},{"type":"v1","addr":"172.21.2.144:6831","nonce":3721100466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.144:6828","nonce":3721100466},{"type":"v1","addr":"172.21.2.144:6829","nonce":3721100466}]},"public_addr":"172.21.2.144:6825/3721100466","cluster_addr":"172.21.2.144:6827/3721100466","heartbeat_back_addr":"172.21.2.144:6831/3721100466","heartbeat_front_addr":"172.21.2.144:6829/3721100466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:00:16.202793+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:00:39.162431+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:01:03.430121+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:01:26.776648+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:01:46.909813+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:02:09.000532+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:02:31.672650+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2021-03-10T20:02:54.488226+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.2.123:0/1355182290":"2021-03-11T19:58:35.850574+0000","172.21.2.123:0/2011847773":"2021-03-11T19:58:35.850574+0000","172.21.2.123:0/1029094703":"2021-03-11T19:58:35.850574+0000","172.21.2.123:6801/3266400770":"2021-03-11T19:58:35.850574+0000","172.21.2.123:6800/3266400770":"2021-03-11T19:58:35.850574+0000","172.21.2.123:0/1668334859":"2021-03-11T19:58:21.167435+0000","172.21.2.123:0/2479556364":"2021-03-11T19:58:21.167435+0000","172.21.2.123:6801/1515571074":"2021-03-11T19:58:21.167435+0000","172.21.2.123:6800/1515571074":"2021-03-11T19:58:21.167435+0000","172.21.2.123:0/3654852492":"2021-03-11T19:58:21.167435+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-03-10T20:03:39.400 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:03:39 gibba023 systemd[1]: Stopping Ceph alertmanager.a for dd719b26-81da-11eb-9080-001a4aab830c... 2021-03-10T20:03:39.526 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:39 gibba044 bash[19086]: t=2021-03-10T20:03:39+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2021-03-10T20:03:39.527 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:39 gibba044 bash[19086]: t=2021-03-10T20:03:39+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2021-03-10T20:03:39.677 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:03:39 gibba023 bash[20360]: level=info ts=2021-03-10T20:03:39.396Z caller=main.go:524 msg="Received SIGTERM, exiting gracefully..." 2021-03-10T20:03:39.786 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:39 gibba044 bash[19086]: t=2021-03-10T20:03:39+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2021-03-10T20:03:39.786 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:39 gibba044 bash[19086]: t=2021-03-10T20:03:39+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2021-03-10T20:03:39.787 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:39 gibba044 bash[19086]: t=2021-03-10T20:03:39+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2021-03-10T20:03:39.787 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:39 gibba044 bash[19086]: t=2021-03-10T20:03:39+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2021-03-10T20:03:40.062 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:39 gibba044 bash[9859]: cluster 2021-03-10T20:03:38.706743+0000 mgr.y (mgr.14140) 196 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:40.062 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:39 gibba044 bash[9859]: audit 2021-03-10T20:03:39.332941+0000 mon.a (mon.0) 529 : audit [DBG] from='client.? 172.21.2.123:0/1251274226' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T20:03:40.063 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:39 gibba044 bash[19086]: t=2021-03-10T20:03:39+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2021-03-10T20:03:40.063 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:39 gibba044 bash[19086]: t=2021-03-10T20:03:39+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2021-03-10T20:03:40.063 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:40 gibba044 bash[19086]: t=2021-03-10T20:03:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2021-03-10T20:03:40.063 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:40 gibba044 bash[19086]: t=2021-03-10T20:03:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2021-03-10T20:03:40.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:39 gibba023 bash[9844]: cluster 2021-03-10T20:03:38.706743+0000 mgr.y (mgr.14140) 196 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:40.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:39 gibba023 bash[9844]: audit 2021-03-10T20:03:39.332941+0000 mon.a (mon.0) 529 : audit [DBG] from='client.? 172.21.2.123:0/1251274226' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T20:03:40.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:39 gibba023 bash[13032]: cluster 2021-03-10T20:03:38.706743+0000 mgr.y (mgr.14140) 196 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:40.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:39 gibba023 bash[13032]: audit 2021-03-10T20:03:39.332941+0000 mon.a (mon.0) 529 : audit [DBG] from='client.? 172.21.2.123:0/1251274226' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-03-10T20:03:40.347 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:40 gibba044 bash[19086]: t=2021-03-10T20:03:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2021-03-10T20:03:40.347 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:40 gibba044 bash[19086]: t=2021-03-10T20:03:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2021-03-10T20:03:40.348 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:40 gibba044 bash[19086]: t=2021-03-10T20:03:40+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2021-03-10T20:03:40.348 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:40 gibba044 bash[19086]: t=2021-03-10T20:03:40+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2021-03-10T20:03:40.348 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:40 gibba044 bash[19086]: t=2021-03-10T20:03:40+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2021-03-10T20:03:40.459 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2021-03-10T20:03:40.598 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:40 gibba044 bash[19086]: t=2021-03-10T20:03:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2021-03-10T20:03:40.598 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:40 gibba044 bash[19086]: t=2021-03-10T20:03:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2021-03-10T20:03:40.599 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:40 gibba044 bash[19086]: t=2021-03-10T20:03:40+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2021-03-10T20:03:40.804 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:03:40 gibba023 docker[21892]: ceph-dd719b26-81da-11eb-9080-001a4aab830c-alertmanager.a 2021-03-10T20:03:40.804 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:03:40 gibba023 systemd[1]: ceph-dd719b26-81da-11eb-9080-001a4aab830c@alertmanager.a.service: Succeeded. 2021-03-10T20:03:40.804 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:03:40 gibba023 systemd[1]: Stopped Ceph alertmanager.a for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:03:40.805 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:03:40 gibba023 systemd[1]: Starting Ceph alertmanager.a for dd719b26-81da-11eb-9080-001a4aab830c... 2021-03-10T20:03:40.805 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:03:40 gibba023 docker[21945]: Error: No such container: ceph-dd719b26-81da-11eb-9080-001a4aab830c-alertmanager.a 2021-03-10T20:03:40.805 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:03:40 gibba023 systemd[1]: Started Ceph alertmanager.a for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:03:41.005 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:40 gibba044 bash[19086]: t=2021-03-10T20:03:40+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2021-03-10T20:03:41.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:40 gibba044 bash[9859]: audit 2021-03-10T20:03:40.508578+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518373\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518445\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518474\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518500\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518526\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518553\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518579\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518605\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:03:41.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:40 gibba044 bash[9859]: audit 2021-03-10T20:03:40.512980+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518373\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518445\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518474\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518500\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518526\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518553\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518579\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518605\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:03:41.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:40 gibba023 bash[9844]: audit 2021-03-10T20:03:40.508578+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518373\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518445\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518474\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518500\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518526\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518553\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518579\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518605\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:03:41.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:40 gibba023 bash[9844]: audit 2021-03-10T20:03:40.512980+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518373\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518445\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518474\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518500\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518526\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518553\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518579\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518605\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:03:41.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:40 gibba023 bash[13032]: audit 2021-03-10T20:03:40.508578+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518373\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518445\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518474\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518500\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518526\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518553\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518579\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518605\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:03:41.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:40 gibba023 bash[13032]: audit 2021-03-10T20:03:40.512980+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518373\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518445\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518474\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518500\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518526\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518553\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518579\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:33.518605\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:03:41.362 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:41 gibba044 bash[19086]: t=2021-03-10T20:03:41+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2021-03-10T20:03:41.362 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:41 gibba044 bash[19086]: t=2021-03-10T20:03:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2021-03-10T20:03:41.618 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:41 gibba044 bash[19086]: t=2021-03-10T20:03:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2021-03-10T20:03:41.755 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:41 gibba044 bash[19086]: t=2021-03-10T20:03:41+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2021-03-10T20:03:41.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:41 gibba044 bash[9859]: cephadm 2021-03-10T20:03:40.513631+0000 mgr.y (mgr.14140) 197 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-03-10T20:03:41.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:41 gibba044 bash[9859]: cephadm 2021-03-10T20:03:40.516809+0000 mgr.y (mgr.14140) 198 : cephadm [INF] Reconfiguring daemon prometheus.a on gibba044 2021-03-10T20:03:41.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:41 gibba044 bash[9859]: cluster 2021-03-10T20:03:40.707393+0000 mgr.y (mgr.14140) 199 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:42.000 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:41 gibba044 bash[19086]: t=2021-03-10T20:03:41+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2021-03-10T20:03:42.089 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:41 gibba023 bash[9844]: cephadm 2021-03-10T20:03:40.513631+0000 mgr.y (mgr.14140) 197 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-03-10T20:03:42.089 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:41 gibba023 bash[9844]: cephadm 2021-03-10T20:03:40.516809+0000 mgr.y (mgr.14140) 198 : cephadm [INF] Reconfiguring daemon prometheus.a on gibba044 2021-03-10T20:03:42.090 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:41 gibba023 bash[9844]: cluster 2021-03-10T20:03:40.707393+0000 mgr.y (mgr.14140) 199 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:42.090 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:41 gibba023 bash[13032]: cephadm 2021-03-10T20:03:40.513631+0000 mgr.y (mgr.14140) 197 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-03-10T20:03:42.090 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:41 gibba023 bash[13032]: cephadm 2021-03-10T20:03:40.516809+0000 mgr.y (mgr.14140) 198 : cephadm [INF] Reconfiguring daemon prometheus.a on gibba044 2021-03-10T20:03:42.090 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:41 gibba023 bash[13032]: cluster 2021-03-10T20:03:40.707393+0000 mgr.y (mgr.14140) 199 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:42.255 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:41 gibba044 bash[19086]: t=2021-03-10T20:03:41+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2021-03-10T20:03:42.256 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:42 gibba044 bash[19086]: t=2021-03-10T20:03:42+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2021-03-10T20:03:42.378 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:03:42 gibba023 bash[21965]: level=info ts=2021-03-10T20:03:42.130Z caller=main.go:216 msg="Starting Alertmanager" version="(version=0.21.0, branch=HEAD, revision=4c6c03ebfe21009c546e4d1e9b92c371d67c021d)" 2021-03-10T20:03:42.378 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:03:42 gibba023 bash[21965]: level=info ts=2021-03-10T20:03:42.130Z caller=main.go:217 build_context="(go=go1.14.4, user=root@dee35927357f, date=20200617-08:54:02)" 2021-03-10T20:03:42.378 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:03:42 gibba023 bash[21965]: level=info ts=2021-03-10T20:03:42.131Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.2.123 port=9094 2021-03-10T20:03:42.378 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:03:42 gibba023 bash[21965]: level=info ts=2021-03-10T20:03:42.132Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-03-10T20:03:42.379 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:03:42 gibba023 bash[21965]: level=info ts=2021-03-10T20:03:42.146Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T20:03:42.379 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:03:42 gibba023 bash[21965]: level=info ts=2021-03-10T20:03:42.146Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T20:03:42.379 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:03:42 gibba023 bash[21965]: level=info ts=2021-03-10T20:03:42.148Z caller=main.go:485 msg=Listening address=:9093 2021-03-10T20:03:42.555 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:42 gibba044 bash[19086]: t=2021-03-10T20:03:42+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2021-03-10T20:03:42.556 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:42 gibba044 bash[19086]: t=2021-03-10T20:03:42+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2021-03-10T20:03:42.926 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:42 gibba044 bash[19086]: t=2021-03-10T20:03:42+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2021-03-10T20:03:42.944 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:42 gibba044 bash[19086]: t=2021-03-10T20:03:42+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2021-03-10T20:03:42.945 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:42 gibba044 bash[19086]: t=2021-03-10T20:03:42+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2021-03-10T20:03:43.215 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:42 gibba044 bash[19086]: t=2021-03-10T20:03:42+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2021-03-10T20:03:43.255 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:43 gibba044 bash[19086]: t=2021-03-10T20:03:43+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2021-03-10T20:03:43.506 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:43 gibba044 bash[19086]: t=2021-03-10T20:03:43+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2021-03-10T20:03:43.821 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:43 gibba044 bash[19086]: t=2021-03-10T20:03:43+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2021-03-10T20:03:43.822 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:43 gibba044 bash[19086]: t=2021-03-10T20:03:43+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2021-03-10T20:03:44.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:43 gibba044 bash[9859]: cluster 2021-03-10T20:03:42.708173+0000 mgr.y (mgr.14140) 200 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:44.006 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:43 gibba044 bash[19086]: t=2021-03-10T20:03:43+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2021-03-10T20:03:44.069 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:43 gibba023 bash[9844]: cluster 2021-03-10T20:03:42.708173+0000 mgr.y (mgr.14140) 200 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:44.070 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:43 gibba023 bash[13032]: cluster 2021-03-10T20:03:42.708173+0000 mgr.y (mgr.14140) 200 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:44.427 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:03:44 gibba023 bash[21965]: level=info ts=2021-03-10T20:03:44.132Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000158855s 2021-03-10T20:03:44.505 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:44 gibba044 bash[19086]: t=2021-03-10T20:03:44+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2021-03-10T20:03:44.505 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:44 gibba044 bash[19086]: t=2021-03-10T20:03:44+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2021-03-10T20:03:44.586 INFO:teuthology.orchestra.run.gibba023.stdout:42949673003 2021-03-10T20:03:44.587 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2021-03-10T20:03:45.005 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:44 gibba044 bash[19086]: t=2021-03-10T20:03:44+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2021-03-10T20:03:45.006 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:44 gibba044 bash[19086]: t=2021-03-10T20:03:44+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2021-03-10T20:03:45.006 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:44 gibba044 bash[19086]: t=2021-03-10T20:03:44+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2021-03-10T20:03:45.309 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:45 gibba044 bash[19086]: t=2021-03-10T20:03:45+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2021-03-10T20:03:45.310 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:45 gibba044 bash[19086]: t=2021-03-10T20:03:45+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2021-03-10T20:03:45.598 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:45 gibba044 bash[19086]: t=2021-03-10T20:03:45+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2021-03-10T20:03:45.599 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:45 gibba044 bash[19086]: t=2021-03-10T20:03:45+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2021-03-10T20:03:45.599 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:45 gibba044 bash[19086]: t=2021-03-10T20:03:45+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2021-03-10T20:03:45.599 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:45 gibba044 bash[19086]: t=2021-03-10T20:03:45+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2021-03-10T20:03:45.877 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:45 gibba044 bash[9859]: cluster 2021-03-10T20:03:44.708610+0000 mgr.y (mgr.14140) 201 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:45.878 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:45 gibba044 bash[19086]: t=2021-03-10T20:03:45+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2021-03-10T20:03:46.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:45 gibba023 bash[9844]: cluster 2021-03-10T20:03:44.708610+0000 mgr.y (mgr.14140) 201 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:46.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:45 gibba023 bash[13032]: cluster 2021-03-10T20:03:44.708610+0000 mgr.y (mgr.14140) 201 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:46.244 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:45 gibba044 bash[19086]: t=2021-03-10T20:03:45+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2021-03-10T20:03:46.505 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:46 gibba044 systemd[1]: Stopping Ceph prometheus.a for dd719b26-81da-11eb-9080-001a4aab830c... 2021-03-10T20:03:46.505 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:46 gibba044 bash[19086]: t=2021-03-10T20:03:46+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2021-03-10T20:03:46.506 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:46 gibba044 bash[19086]: t=2021-03-10T20:03:46+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2021-03-10T20:03:46.506 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:46 gibba044 bash[19086]: t=2021-03-10T20:03:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2021-03-10T20:03:46.909 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:46 gibba044 bash[19086]: t=2021-03-10T20:03:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2021-03-10T20:03:46.909 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:46 gibba044 bash[19086]: t=2021-03-10T20:03:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2021-03-10T20:03:46.910 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:46 gibba044 bash[19086]: t=2021-03-10T20:03:46+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2021-03-10T20:03:46.910 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:46 gibba044 bash[17859]: level=warn ts=2021-03-10T20:03:46.629Z caller=main.go:629 msg="Received SIGTERM, exiting gracefully..." 2021-03-10T20:03:46.910 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:46 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:46.629Z caller=main.go:652 msg="Stopping scrape discovery manager..." 2021-03-10T20:03:46.911 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:46 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:46.629Z caller=main.go:666 msg="Stopping notify discovery manager..." 2021-03-10T20:03:46.911 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:46 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:46.629Z caller=main.go:688 msg="Stopping scrape manager..." 2021-03-10T20:03:46.911 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:46 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:46.629Z caller=main.go:648 msg="Scrape discovery manager stopped" 2021-03-10T20:03:46.911 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:46 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:46.629Z caller=manager.go:924 component="rule manager" msg="Stopping rule manager..." 2021-03-10T20:03:46.912 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:46 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:46.629Z caller=manager.go:934 component="rule manager" msg="Rule manager stopped" 2021-03-10T20:03:46.912 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:46 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:46.629Z caller=main.go:662 msg="Notify discovery manager stopped" 2021-03-10T20:03:46.912 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:46 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:46.629Z caller=main.go:682 msg="Scrape manager stopped" 2021-03-10T20:03:46.912 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:46 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:46.630Z caller=notifier.go:601 component=notifier msg="Stopping notification manager..." 2021-03-10T20:03:46.913 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:46 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:46.630Z caller=main.go:856 msg="Notifier manager stopped" 2021-03-10T20:03:46.913 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:46 gibba044 bash[17859]: level=info ts=2021-03-10T20:03:46.630Z caller=main.go:868 msg="See you next time!" 2021-03-10T20:03:47.255 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:46 gibba044 bash[19086]: t=2021-03-10T20:03:46+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2021-03-10T20:03:47.256 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:47 gibba044 bash[19086]: t=2021-03-10T20:03:47+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2021-03-10T20:03:47.730 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:47 gibba044 bash[19086]: t=2021-03-10T20:03:47+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2021-03-10T20:03:47.731 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:47 gibba044 bash[19086]: t=2021-03-10T20:03:47+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2021-03-10T20:03:47.731 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:47 gibba044 bash[19086]: t=2021-03-10T20:03:47+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2021-03-10T20:03:48.005 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:47 gibba044 bash[19086]: t=2021-03-10T20:03:47+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2021-03-10T20:03:48.006 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:47 gibba044 bash[19086]: t=2021-03-10T20:03:47+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2021-03-10T20:03:48.006 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:47 gibba044 docker[19669]: ceph-dd719b26-81da-11eb-9080-001a4aab830c-prometheus.a 2021-03-10T20:03:48.006 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:47 gibba044 systemd[1]: ceph-dd719b26-81da-11eb-9080-001a4aab830c@prometheus.a.service: Succeeded. 2021-03-10T20:03:48.007 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:47 gibba044 systemd[1]: Stopped Ceph prometheus.a for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:03:48.007 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:47 gibba044 systemd[1]: Starting Ceph prometheus.a for dd719b26-81da-11eb-9080-001a4aab830c... 2021-03-10T20:03:48.007 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:47 gibba044 docker[19705]: Error: No such container: ceph-dd719b26-81da-11eb-9080-001a4aab830c-prometheus.a 2021-03-10T20:03:48.007 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:47 gibba044 systemd[1]: Started Ceph prometheus.a for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:03:48.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:47 gibba044 bash[9859]: cluster 2021-03-10T20:03:46.709372+0000 mgr.y (mgr.14140) 202 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:48.009 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:47 gibba044 bash[9859]: audit 2021-03-10T20:03:47.772914+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.374763\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375026\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375195\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375350\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375498\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375647\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375797\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.376092\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.376241\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:03:48.009 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:47 gibba044 bash[9859]: audit 2021-03-10T20:03:47.781866+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.374763\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375026\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375195\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375350\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375498\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375647\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375797\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.376092\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.376241\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:03:48.009 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:47 gibba044 bash[9859]: audit 2021-03-10T20:03:47.782527+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://gibba044:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2021-03-10T20:03:48.010 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:47 gibba044 bash[9859]: audit 2021-03-10T20:03:47.785721+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://gibba044:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2021-03-10T20:03:48.010 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:47 gibba044 bash[9859]: audit 2021-03-10T20:03:47.787042+0000 mon.a (mon.0) 536 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:48.011 INFO:teuthology.orchestra.run.gibba023.stdout:68719476777 2021-03-10T20:03:48.012 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2021-03-10T20:03:48.099 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:47 gibba023 bash[13032]: cluster 2021-03-10T20:03:46.709372+0000 mgr.y (mgr.14140) 202 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:48.099 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:47 gibba023 bash[9844]: cluster 2021-03-10T20:03:46.709372+0000 mgr.y (mgr.14140) 202 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:48.100 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:47 gibba023 bash[13032]: audit 2021-03-10T20:03:47.772914+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.374763\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375026\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375195\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375350\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375498\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375647\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375797\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.376092\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.376241\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:03:48.101 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:47 gibba023 bash[9844]: audit 2021-03-10T20:03:47.772914+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.374763\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375026\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375195\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375350\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375498\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375647\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375797\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.376092\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.376241\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:03:48.101 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:47 gibba023 bash[9844]: audit 2021-03-10T20:03:47.781866+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.374763\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375026\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375195\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375350\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375498\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375647\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375797\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.376092\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.376241\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:03:48.102 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:47 gibba023 bash[9844]: audit 2021-03-10T20:03:47.782527+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://gibba044:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2021-03-10T20:03:48.102 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:47 gibba023 bash[9844]: audit 2021-03-10T20:03:47.785721+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://gibba044:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2021-03-10T20:03:48.102 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:47 gibba023 bash[9844]: audit 2021-03-10T20:03:47.787042+0000 mon.a (mon.0) 536 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:48.102 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:47 gibba023 bash[13032]: audit 2021-03-10T20:03:47.781866+0000 mon.a (mon.0) 533 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.374763\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375026\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375195\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375350\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375498\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375647\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.375797\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.376092\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:34.376241\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:03:48.103 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:47 gibba023 bash[13032]: audit 2021-03-10T20:03:47.782527+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://gibba044:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2021-03-10T20:03:48.103 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:47 gibba023 bash[13032]: audit 2021-03-10T20:03:47.785721+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://gibba044:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2021-03-10T20:03:48.103 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:47 gibba023 bash[13032]: audit 2021-03-10T20:03:47.787042+0000 mon.a (mon.0) 536 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:48.755 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:48 gibba044 bash[19086]: t=2021-03-10T20:03:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2021-03-10T20:03:48.756 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:48 gibba044 bash[19086]: t=2021-03-10T20:03:48+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2021-03-10T20:03:49.061 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:48 gibba023 bash[9844]: cephadm 2021-03-10T20:03:47.782374+0000 mgr.y (mgr.14140) 203 : cephadm [INF] Setting dashboard grafana config to https://gibba044:3000 2021-03-10T20:03:49.061 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:48 gibba023 bash[13032]: cephadm 2021-03-10T20:03:47.782374+0000 mgr.y (mgr.14140) 203 : cephadm [INF] Setting dashboard grafana config to https://gibba044:3000 2021-03-10T20:03:49.063 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:48 gibba044 bash[9859]: cephadm 2021-03-10T20:03:47.782374+0000 mgr.y (mgr.14140) 203 : cephadm [INF] Setting dashboard grafana config to https://gibba044:3000 2021-03-10T20:03:49.064 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:48 gibba044 bash[19086]: t=2021-03-10T20:03:48+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2021-03-10T20:03:49.064 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:48 gibba044 bash[19086]: t=2021-03-10T20:03:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2021-03-10T20:03:49.325 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19086]: t=2021-03-10T20:03:49+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2021-03-10T20:03:49.325 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19086]: t=2021-03-10T20:03:49+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2021-03-10T20:03:49.325 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19086]: t=2021-03-10T20:03:49+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2021-03-10T20:03:49.581 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19086]: t=2021-03-10T20:03:49+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2021-03-10T20:03:49.582 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19086]: t=2021-03-10T20:03:49+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2021-03-10T20:03:49.582 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19723]: level=info ts=2021-03-10T20:03:49.388Z caller=main.go:366 msg="No time or size retention was set so using the default time retention" duration=15d 2021-03-10T20:03:49.583 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19723]: level=info ts=2021-03-10T20:03:49.389Z caller=main.go:404 msg="Starting Prometheus" version="(version=2.25.0, branch=HEAD, revision=a6be548dbc17780d562a39c0e4bd0bd4c00ad6e2)" 2021-03-10T20:03:49.583 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19723]: level=info ts=2021-03-10T20:03:49.389Z caller=main.go:409 build_context="(go=go1.15.8, user=root@615f028225c9, date=20210217-14:17:24)" 2021-03-10T20:03:49.583 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19723]: level=info ts=2021-03-10T20:03:49.389Z caller=main.go:410 host_details="(Linux 5.4.0-66-generic #74-Ubuntu SMP Wed Jan 27 22:54:38 UTC 2021 x86_64 gibba044 (none))" 2021-03-10T20:03:49.584 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19723]: level=info ts=2021-03-10T20:03:49.389Z caller=main.go:411 fd_limits="(soft=1048576, hard=1048576)" 2021-03-10T20:03:49.584 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19723]: level=info ts=2021-03-10T20:03:49.389Z caller=main.go:412 vm_limits="(soft=unlimited, hard=unlimited)" 2021-03-10T20:03:49.584 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19723]: level=info ts=2021-03-10T20:03:49.390Z caller=web.go:532 component=web msg="Start listening for connections" address=:9095 2021-03-10T20:03:49.584 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19723]: level=info ts=2021-03-10T20:03:49.390Z caller=main.go:779 msg="Starting TSDB ..." 2021-03-10T20:03:49.585 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19723]: level=info ts=2021-03-10T20:03:49.391Z caller=tls_config.go:191 component=web msg="TLS is disabled." http2=false 2021-03-10T20:03:49.585 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19723]: level=info ts=2021-03-10T20:03:49.392Z caller=head.go:668 component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2021-03-10T20:03:49.585 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19723]: level=info ts=2021-03-10T20:03:49.392Z caller=head.go:682 component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.377µs 2021-03-10T20:03:49.585 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19723]: level=info ts=2021-03-10T20:03:49.392Z caller=head.go:688 component=tsdb msg="Replaying WAL, this may take a while" 2021-03-10T20:03:49.585 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19723]: level=info ts=2021-03-10T20:03:49.393Z caller=head.go:740 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2021-03-10T20:03:49.586 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19723]: level=info ts=2021-03-10T20:03:49.393Z caller=head.go:740 component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2021-03-10T20:03:49.586 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19723]: level=info ts=2021-03-10T20:03:49.393Z caller=head.go:745 component=tsdb msg="WAL replay completed" checkpoint_replay_duration=12.994µs wal_replay_duration=948.782µs total_replay_duration=971.228µs 2021-03-10T20:03:49.586 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19723]: level=info ts=2021-03-10T20:03:49.394Z caller=main.go:799 fs_type=XFS_SUPER_MAGIC 2021-03-10T20:03:49.586 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19723]: level=info ts=2021-03-10T20:03:49.394Z caller=main.go:802 msg="TSDB started" 2021-03-10T20:03:49.587 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19723]: level=info ts=2021-03-10T20:03:49.394Z caller=main.go:928 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2021-03-10T20:03:49.587 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19723]: level=info ts=2021-03-10T20:03:49.394Z caller=main.go:959 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=417.21µs remote_storage=773ns web_handler=146ns query_engine=380ns scrape=194.796µs scrape_sd=19.987µs notify=9.843µs notify_sd=5.306µs rules=17.216µs 2021-03-10T20:03:49.587 INFO:journalctl@ceph.prometheus.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19723]: level=info ts=2021-03-10T20:03:49.394Z caller=main.go:751 msg="Server is ready to receive web requests." 2021-03-10T20:03:49.859 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19086]: t=2021-03-10T20:03:49+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2021-03-10T20:03:49.859 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19086]: t=2021-03-10T20:03:49+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2021-03-10T20:03:49.860 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19086]: t=2021-03-10T20:03:49+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2021-03-10T20:03:49.860 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19086]: t=2021-03-10T20:03:49+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2021-03-10T20:03:50.135 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19086]: t=2021-03-10T20:03:49+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2021-03-10T20:03:50.135 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[19086]: t=2021-03-10T20:03:49+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2021-03-10T20:03:50.135 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:50 gibba044 bash[19086]: t=2021-03-10T20:03:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2021-03-10T20:03:50.136 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[9859]: cluster 2021-03-10T20:03:48.710223+0000 mgr.y (mgr.14140) 204 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:50.136 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[9859]: audit 2021-03-10T20:03:48.849046+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848040\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848098\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848127\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848154\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848180\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848205\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848231\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848256\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848281\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:40.524411\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236\"}}, \"last_daemon_update\": \"2021-03-10T20:03:48.848340\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:03:50.136 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[9859]: audit 2021-03-10T20:03:48.851592+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848040\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848098\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848127\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848154\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848180\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848205\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848231\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848256\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848281\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:40.524411\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236\"}}, \"last_daemon_update\": \"2021-03-10T20:03:48.848340\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:03:50.137 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:49 gibba044 bash[9859]: audit 2021-03-10T20:03:48.852117+0000 mon.a (mon.0) 539 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:50.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:49 gibba023 bash[9844]: cluster 2021-03-10T20:03:48.710223+0000 mgr.y (mgr.14140) 204 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:50.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:49 gibba023 bash[13032]: cluster 2021-03-10T20:03:48.710223+0000 mgr.y (mgr.14140) 204 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:50.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:49 gibba023 bash[9844]: audit 2021-03-10T20:03:48.849046+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848040\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848098\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848127\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848154\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848180\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848205\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848231\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848256\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848281\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:40.524411\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236\"}}, \"last_daemon_update\": \"2021-03-10T20:03:48.848340\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:03:50.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:49 gibba023 bash[9844]: audit 2021-03-10T20:03:48.851592+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848040\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848098\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848127\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848154\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848180\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848205\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848231\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848256\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848281\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:40.524411\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236\"}}, \"last_daemon_update\": \"2021-03-10T20:03:48.848340\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:03:50.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:49 gibba023 bash[9844]: audit 2021-03-10T20:03:48.852117+0000 mon.a (mon.0) 539 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:50.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:49 gibba023 bash[13032]: audit 2021-03-10T20:03:48.849046+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848040\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848098\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848127\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848154\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848180\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848205\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848231\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848256\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848281\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:40.524411\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236\"}}, \"last_daemon_update\": \"2021-03-10T20:03:48.848340\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:03:50.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:49 gibba023 bash[13032]: audit 2021-03-10T20:03:48.851592+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848040\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848098\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848127\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848154\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848180\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848205\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848231\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848256\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848281\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:40.524411\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236\"}}, \"last_daemon_update\": \"2021-03-10T20:03:48.848340\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:03:50.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:49 gibba023 bash[13032]: audit 2021-03-10T20:03:48.852117+0000 mon.a (mon.0) 539 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:03:50.386 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:50 gibba044 bash[19086]: t=2021-03-10T20:03:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2021-03-10T20:03:50.387 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:50 gibba044 bash[19086]: t=2021-03-10T20:03:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2021-03-10T20:03:50.387 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:50 gibba044 bash[19086]: t=2021-03-10T20:03:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2021-03-10T20:03:50.387 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:50 gibba044 bash[19086]: t=2021-03-10T20:03:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2021-03-10T20:03:50.663 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:50 gibba044 bash[19086]: t=2021-03-10T20:03:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2021-03-10T20:03:50.663 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:50 gibba044 bash[19086]: t=2021-03-10T20:03:50+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2021-03-10T20:03:50.663 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:50 gibba044 bash[19086]: t=2021-03-10T20:03:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2021-03-10T20:03:50.956 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:50 gibba044 bash[19086]: t=2021-03-10T20:03:50+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2021-03-10T20:03:50.956 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:50 gibba044 bash[19086]: t=2021-03-10T20:03:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2021-03-10T20:03:50.957 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:50 gibba044 bash[19086]: t=2021-03-10T20:03:50+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2021-03-10T20:03:50.957 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:50 gibba044 bash[19086]: t=2021-03-10T20:03:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2021-03-10T20:03:50.957 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:50 gibba044 bash[19086]: t=2021-03-10T20:03:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2021-03-10T20:03:50.958 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:50 gibba044 bash[9859]: audit 2021-03-10T20:03:49.895903+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894670\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894738\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894775\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894808\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894841\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894873\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894905\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894938\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894971\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.895003\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}}, \"last_daemon_update\": \"2021-03-10T20:03:49.895077\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:03:50.958 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:50 gibba044 bash[9859]: audit 2021-03-10T20:03:49.898863+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894670\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894738\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894775\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894808\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894841\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894873\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894905\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894938\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894971\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.895003\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}}, \"last_daemon_update\": \"2021-03-10T20:03:49.895077\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:03:51.128 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:50 gibba023 bash[13032]: audit 2021-03-10T20:03:49.895903+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894670\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894738\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894775\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894808\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894841\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894873\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894905\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894938\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894971\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.895003\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}}, \"last_daemon_update\": \"2021-03-10T20:03:49.895077\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:03:51.129 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:50 gibba023 bash[13032]: audit 2021-03-10T20:03:49.898863+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894670\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894738\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894775\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894808\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894841\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894873\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894905\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894938\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894971\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.895003\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}}, \"last_daemon_update\": \"2021-03-10T20:03:49.895077\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:03:51.129 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:50 gibba023 bash[9844]: audit 2021-03-10T20:03:49.895903+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894670\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894738\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894775\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894808\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894841\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894873\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894905\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894938\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894971\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.895003\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}}, \"last_daemon_update\": \"2021-03-10T20:03:49.895077\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:03:51.130 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:50 gibba023 bash[9844]: audit 2021-03-10T20:03:49.898863+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894670\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894738\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894775\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894808\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894841\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894873\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894905\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894938\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894971\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.895003\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}}, \"last_daemon_update\": \"2021-03-10T20:03:49.895077\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:03:51.255 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:51 gibba044 bash[19086]: t=2021-03-10T20:03:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2021-03-10T20:03:51.256 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:51 gibba044 bash[19086]: t=2021-03-10T20:03:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2021-03-10T20:03:51.256 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:51 gibba044 bash[19086]: t=2021-03-10T20:03:51+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2021-03-10T20:03:51.595 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:51 gibba044 bash[19086]: t=2021-03-10T20:03:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2021-03-10T20:03:51.595 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:51 gibba044 bash[19086]: t=2021-03-10T20:03:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2021-03-10T20:03:51.595 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:51 gibba044 bash[19086]: t=2021-03-10T20:03:51+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2021-03-10T20:03:51.595 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:51 gibba044 bash[19086]: t=2021-03-10T20:03:51+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2021-03-10T20:03:51.636 INFO:teuthology.orchestra.run.gibba023.stdout:90194313253 2021-03-10T20:03:51.637 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2021-03-10T20:03:51.903 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:51 gibba044 bash[19086]: t=2021-03-10T20:03:51+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2021-03-10T20:03:51.903 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:51 gibba044 bash[19086]: t=2021-03-10T20:03:51+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2021-03-10T20:03:51.903 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:51 gibba044 bash[19086]: t=2021-03-10T20:03:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2021-03-10T20:03:51.903 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:51 gibba044 bash[19086]: t=2021-03-10T20:03:51+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2021-03-10T20:03:51.904 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:51 gibba044 bash[19086]: t=2021-03-10T20:03:51+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2021-03-10T20:03:52.136 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:51 gibba023 bash[13032]: cluster 2021-03-10T20:03:50.710908+0000 mgr.y (mgr.14140) 205 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:52.137 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:51 gibba023 bash[9844]: cluster 2021-03-10T20:03:50.710908+0000 mgr.y (mgr.14140) 205 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:52.177 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:03:52 gibba023 bash[21965]: level=info ts=2021-03-10T20:03:52.133Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.001080803s 2021-03-10T20:03:52.204 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:51 gibba044 bash[9859]: cluster 2021-03-10T20:03:50.710908+0000 mgr.y (mgr.14140) 205 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:52.204 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:51 gibba044 bash[19086]: t=2021-03-10T20:03:51+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2021-03-10T20:03:52.205 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:52 gibba044 bash[19086]: t=2021-03-10T20:03:52+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2021-03-10T20:03:52.205 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:52 gibba044 bash[19086]: t=2021-03-10T20:03:52+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2021-03-10T20:03:52.464 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:52 gibba044 bash[19086]: t=2021-03-10T20:03:52+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2021-03-10T20:03:52.464 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:52 gibba044 bash[19086]: t=2021-03-10T20:03:52+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2021-03-10T20:03:52.465 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:52 gibba044 bash[19086]: t=2021-03-10T20:03:52+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2021-03-10T20:03:52.465 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:52 gibba044 bash[19086]: t=2021-03-10T20:03:52+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2021-03-10T20:03:52.465 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:52 gibba044 bash[19086]: t=2021-03-10T20:03:52+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2021-03-10T20:03:52.756 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:52 gibba044 bash[19086]: t=2021-03-10T20:03:52+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2021-03-10T20:03:53.031 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:52 gibba044 bash[19086]: t=2021-03-10T20:03:52+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2021-03-10T20:03:53.032 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:52 gibba044 bash[19086]: t=2021-03-10T20:03:52+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2021-03-10T20:03:53.033 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:52 gibba044 bash[19086]: t=2021-03-10T20:03:52+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2021-03-10T20:03:53.034 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:52 gibba044 bash[19086]: t=2021-03-10T20:03:52+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2021-03-10T20:03:53.034 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:52 gibba044 bash[19086]: t=2021-03-10T20:03:52+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2021-03-10T20:03:53.035 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:53 gibba044 bash[19086]: t=2021-03-10T20:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2021-03-10T20:03:53.369 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:53 gibba044 bash[19086]: t=2021-03-10T20:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2021-03-10T20:03:53.370 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:53 gibba044 bash[19086]: t=2021-03-10T20:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2021-03-10T20:03:53.370 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:53 gibba044 bash[19086]: t=2021-03-10T20:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2021-03-10T20:03:53.371 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:53 gibba044 bash[19086]: t=2021-03-10T20:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2021-03-10T20:03:53.671 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:53 gibba044 bash[19086]: t=2021-03-10T20:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2021-03-10T20:03:53.672 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:53 gibba044 bash[19086]: t=2021-03-10T20:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2021-03-10T20:03:53.672 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:53 gibba044 bash[19086]: t=2021-03-10T20:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2021-03-10T20:03:53.923 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:53 gibba044 bash[19086]: t=2021-03-10T20:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2021-03-10T20:03:53.923 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:53 gibba044 bash[19086]: t=2021-03-10T20:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2021-03-10T20:03:53.923 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:53 gibba044 bash[19086]: t=2021-03-10T20:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2021-03-10T20:03:53.923 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:53 gibba044 bash[19086]: t=2021-03-10T20:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2021-03-10T20:03:53.924 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:53 gibba044 bash[19086]: t=2021-03-10T20:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2021-03-10T20:03:54.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:53 gibba023 bash[9844]: cluster 2021-03-10T20:03:52.711715+0000 mgr.y (mgr.14140) 206 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:54.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:53 gibba023 bash[13032]: cluster 2021-03-10T20:03:52.711715+0000 mgr.y (mgr.14140) 206 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:54.215 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:53 gibba044 bash[9859]: cluster 2021-03-10T20:03:52.711715+0000 mgr.y (mgr.14140) 206 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:54.216 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:53 gibba044 bash[19086]: t=2021-03-10T20:03:53+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2021-03-10T20:03:54.217 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:54 gibba044 bash[19086]: t=2021-03-10T20:03:54+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2021-03-10T20:03:54.217 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:54 gibba044 bash[19086]: t=2021-03-10T20:03:54+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2021-03-10T20:03:54.505 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:54 gibba044 bash[19086]: t=2021-03-10T20:03:54+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2021-03-10T20:03:54.506 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:54 gibba044 bash[19086]: t=2021-03-10T20:03:54+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2021-03-10T20:03:54.506 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:54 gibba044 bash[19086]: t=2021-03-10T20:03:54+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2021-03-10T20:03:54.506 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:54 gibba044 bash[19086]: t=2021-03-10T20:03:54+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2021-03-10T20:03:54.793 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:54 gibba044 bash[19086]: t=2021-03-10T20:03:54+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2021-03-10T20:03:54.794 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:54 gibba044 bash[19086]: t=2021-03-10T20:03:54+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2021-03-10T20:03:54.794 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:54 gibba044 bash[19086]: t=2021-03-10T20:03:54+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2021-03-10T20:03:54.794 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:54 gibba044 bash[19086]: t=2021-03-10T20:03:54+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2021-03-10T20:03:55.137 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:54 gibba044 bash[19086]: t=2021-03-10T20:03:54+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2021-03-10T20:03:55.137 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:54 gibba044 bash[19086]: t=2021-03-10T20:03:54+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2021-03-10T20:03:55.137 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2021-03-10T20:03:55.138 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2021-03-10T20:03:55.161 INFO:teuthology.orchestra.run.gibba023.stdout:115964117023 2021-03-10T20:03:55.162 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2021-03-10T20:03:55.405 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2021-03-10T20:03:55.406 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2021-03-10T20:03:55.406 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2021-03-10T20:03:55.406 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2021-03-10T20:03:55.666 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Created default admin" logger=sqlstore user=admin 2021-03-10T20:03:55.666 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Initializing HTTPServer" logger=server 2021-03-10T20:03:55.667 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Initializing BackendPluginManager" logger=server 2021-03-10T20:03:55.667 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Initializing PluginManager" logger=server 2021-03-10T20:03:55.667 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Starting plugin search" logger=plugins 2021-03-10T20:03:55.667 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Registering plugin" logger=plugins name="Pie Chart" 2021-03-10T20:03:55.667 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Registering plugin" logger=plugins name="Status Panel" 2021-03-10T20:03:55.668 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Initializing HooksService" logger=server 2021-03-10T20:03:55.668 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Initializing OSSLicensingService" logger=server 2021-03-10T20:03:55.668 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Initializing InternalMetricsService" logger=server 2021-03-10T20:03:55.668 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Initializing RemoteCache" logger=server 2021-03-10T20:03:55.669 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Initializing QuotaService" logger=server 2021-03-10T20:03:55.669 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Initializing ServerLockService" logger=server 2021-03-10T20:03:55.669 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Initializing UserAuthTokenService" logger=server 2021-03-10T20:03:55.669 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Initializing RenderingService" logger=server 2021-03-10T20:03:55.669 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Initializing AlertEngine" logger=server 2021-03-10T20:03:55.670 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Initializing DatasourceCacheService" logger=server 2021-03-10T20:03:55.670 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Initializing LoginService" logger=server 2021-03-10T20:03:55.670 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Initializing SearchService" logger=server 2021-03-10T20:03:55.670 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Initializing TracingService" logger=server 2021-03-10T20:03:55.671 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Initializing UsageStatsService" logger=server 2021-03-10T20:03:55.671 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Initializing CleanUpService" logger=server 2021-03-10T20:03:55.671 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Initializing NotificationService" logger=server 2021-03-10T20:03:55.672 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Initializing provisioningServiceImpl" logger=server 2021-03-10T20:03:55.672 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2021-03-10T20:03:55.672 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name="Dashboard 1" 2021-03-10T20:03:55.672 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Backend rendering via phantomJS" logger=rendering renderer=phantomJS 2021-03-10T20:03:55.673 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=warn msg="phantomJS is deprecated and will be removed in a future release. You should consider migrating from phantomJS to grafana-image-renderer plugin." logger=rendering renderer=phantomJS 2021-03-10T20:03:55.936 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="Initializing Stream Manager" 2021-03-10T20:03:55.937 INFO:journalctl@ceph.grafana.a.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[19086]: t=2021-03-10T20:03:55+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=127.0.0.1:3000 protocol=https subUrl= socket= 2021-03-10T20:03:56.240 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:55 gibba023 bash[9844]: cluster 2021-03-10T20:03:54.712433+0000 mgr.y (mgr.14140) 207 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:56.241 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:55 gibba023 bash[13032]: cluster 2021-03-10T20:03:54.712433+0000 mgr.y (mgr.14140) 207 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:56.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:55 gibba044 bash[9859]: cluster 2021-03-10T20:03:54.712433+0000 mgr.y (mgr.14140) 207 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:58.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:57 gibba044 bash[9859]: cluster 2021-03-10T20:03:56.713281+0000 mgr.y (mgr.14140) 208 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:58.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:57 gibba023 bash[9844]: cluster 2021-03-10T20:03:56.713281+0000 mgr.y (mgr.14140) 208 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:58.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:57 gibba023 bash[13032]: cluster 2021-03-10T20:03:56.713281+0000 mgr.y (mgr.14140) 208 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:03:58.453 INFO:teuthology.orchestra.run.gibba023.stdout:137438953501 2021-03-10T20:03:58.453 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2021-03-10T20:04:00.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:03:59 gibba044 bash[9859]: cluster 2021-03-10T20:03:58.714106+0000 mgr.y (mgr.14140) 209 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:00.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:03:59 gibba023 bash[9844]: cluster 2021-03-10T20:03:58.714106+0000 mgr.y (mgr.14140) 209 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:00.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:03:59 gibba023 bash[13032]: cluster 2021-03-10T20:03:58.714106+0000 mgr.y (mgr.14140) 209 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:01.815 INFO:teuthology.orchestra.run.gibba023.stdout:158913789977 2021-03-10T20:04:01.815 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2021-03-10T20:04:02.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:01 gibba023 bash[9844]: cluster 2021-03-10T20:04:00.714948+0000 mgr.y (mgr.14140) 210 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:02.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:01 gibba023 bash[13032]: cluster 2021-03-10T20:04:00.714948+0000 mgr.y (mgr.14140) 210 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:02.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:01 gibba044 bash[9859]: cluster 2021-03-10T20:04:00.714948+0000 mgr.y (mgr.14140) 210 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:04.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:03 gibba044 bash[9859]: cluster 2021-03-10T20:04:02.715645+0000 mgr.y (mgr.14140) 211 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:04.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:03 gibba023 bash[9844]: cluster 2021-03-10T20:04:02.715645+0000 mgr.y (mgr.14140) 211 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:04.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:03 gibba023 bash[13032]: cluster 2021-03-10T20:04:02.715645+0000 mgr.y (mgr.14140) 211 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:05.417 INFO:teuthology.orchestra.run.gibba023.stdout:180388626454 2021-03-10T20:04:05.418 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2021-03-10T20:04:06.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:05 gibba044 bash[9859]: cluster 2021-03-10T20:04:04.715963+0000 mgr.y (mgr.14140) 212 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:06.295 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:05 gibba023 bash[9844]: cluster 2021-03-10T20:04:04.715963+0000 mgr.y (mgr.14140) 212 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:06.296 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:05 gibba023 bash[13032]: cluster 2021-03-10T20:04:04.715963+0000 mgr.y (mgr.14140) 212 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:08.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:07 gibba044 bash[9859]: cluster 2021-03-10T20:04:06.716780+0000 mgr.y (mgr.14140) 213 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:08.319 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:07 gibba023 bash[9844]: cluster 2021-03-10T20:04:06.716780+0000 mgr.y (mgr.14140) 213 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:08.320 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:07 gibba023 bash[13032]: cluster 2021-03-10T20:04:06.716780+0000 mgr.y (mgr.14140) 213 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:08.796 INFO:teuthology.orchestra.run.gibba023.stdout:201863462928 2021-03-10T20:04:08.797 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.0 2021-03-10T20:04:10.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:10 gibba023 bash[9844]: cluster 2021-03-10T20:04:08.717616+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:10.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:10 gibba023 bash[13032]: cluster 2021-03-10T20:04:08.717616+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:10.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:10 gibba044 bash[9859]: cluster 2021-03-10T20:04:08.717616+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:11.592 INFO:teuthology.orchestra.run.gibba023.stdout:42949673008 2021-03-10T20:04:12.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:12 gibba023 bash[9844]: cluster 2021-03-10T20:04:10.718391+0000 mgr.y (mgr.14140) 215 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:12.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:12 gibba023 bash[9844]: audit 2021-03-10T20:04:11.589514+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.2.123:0/3376129855' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-03-10T20:04:12.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:12 gibba023 bash[13032]: cluster 2021-03-10T20:04:10.718391+0000 mgr.y (mgr.14140) 215 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:12.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:12 gibba023 bash[13032]: audit 2021-03-10T20:04:11.589514+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.2.123:0/3376129855' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-03-10T20:04:12.274 INFO:tasks.cephadm.ceph_manager.ceph:need seq 42949673003 got 42949673008 for osd.0 2021-03-10T20:04:12.275 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.1 2021-03-10T20:04:12.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:12 gibba044 bash[9859]: cluster 2021-03-10T20:04:10.718391+0000 mgr.y (mgr.14140) 215 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:12.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:12 gibba044 bash[9859]: audit 2021-03-10T20:04:11.589514+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.2.123:0/3376129855' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-03-10T20:04:14.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:14 gibba023 bash[9844]: cluster 2021-03-10T20:04:12.719457+0000 mgr.y (mgr.14140) 216 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:14.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:14 gibba023 bash[13032]: cluster 2021-03-10T20:04:12.719457+0000 mgr.y (mgr.14140) 216 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:14.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:14 gibba044 bash[9859]: cluster 2021-03-10T20:04:12.719457+0000 mgr.y (mgr.14140) 216 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:15.182 INFO:teuthology.orchestra.run.gibba023.stdout:68719476782 2021-03-10T20:04:15.923 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476777 got 68719476782 for osd.1 2021-03-10T20:04:15.924 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.2 2021-03-10T20:04:16.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:16 gibba023 bash[9844]: cluster 2021-03-10T20:04:14.720123+0000 mgr.y (mgr.14140) 217 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:16.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:16 gibba023 bash[9844]: audit 2021-03-10T20:04:15.179789+0000 mon.a (mon.0) 542 : audit [DBG] from='client.? 172.21.2.123:0/1922346539' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-03-10T20:04:16.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:16 gibba023 bash[13032]: cluster 2021-03-10T20:04:14.720123+0000 mgr.y (mgr.14140) 217 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:16.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:16 gibba023 bash[13032]: audit 2021-03-10T20:04:15.179789+0000 mon.a (mon.0) 542 : audit [DBG] from='client.? 172.21.2.123:0/1922346539' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-03-10T20:04:16.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:16 gibba044 bash[9859]: cluster 2021-03-10T20:04:14.720123+0000 mgr.y (mgr.14140) 217 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:16.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:16 gibba044 bash[9859]: audit 2021-03-10T20:04:15.179789+0000 mon.a (mon.0) 542 : audit [DBG] from='client.? 172.21.2.123:0/1922346539' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-03-10T20:04:18.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:18 gibba023 bash[9844]: cluster 2021-03-10T20:04:16.720857+0000 mgr.y (mgr.14140) 218 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:18.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:18 gibba023 bash[13032]: cluster 2021-03-10T20:04:16.720857+0000 mgr.y (mgr.14140) 218 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:18.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:18 gibba044 bash[9859]: cluster 2021-03-10T20:04:16.720857+0000 mgr.y (mgr.14140) 218 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:18.856 INFO:teuthology.orchestra.run.gibba023.stdout:90194313258 2021-03-10T20:04:19.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:19 gibba023 bash[9844]: audit 2021-03-10T20:04:18.852750+0000 mon.a (mon.0) 543 : audit [DBG] from='client.? 172.21.2.123:0/2138796693' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-03-10T20:04:19.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:19 gibba023 bash[13032]: audit 2021-03-10T20:04:18.852750+0000 mon.a (mon.0) 543 : audit [DBG] from='client.? 172.21.2.123:0/2138796693' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-03-10T20:04:19.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:19 gibba044 bash[9859]: audit 2021-03-10T20:04:18.852750+0000 mon.a (mon.0) 543 : audit [DBG] from='client.? 172.21.2.123:0/2138796693' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-03-10T20:04:19.559 INFO:tasks.cephadm.ceph_manager.ceph:need seq 90194313253 got 90194313258 for osd.2 2021-03-10T20:04:19.560 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.3 2021-03-10T20:04:20.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:20 gibba023 bash[9844]: cluster 2021-03-10T20:04:18.721209+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:20.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:20 gibba023 bash[13032]: cluster 2021-03-10T20:04:18.721209+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:20.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:20 gibba044 bash[9859]: cluster 2021-03-10T20:04:18.721209+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:22.338 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:22 gibba023 bash[9844]: cluster 2021-03-10T20:04:20.721789+0000 mgr.y (mgr.14140) 220 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:22.339 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:22 gibba023 bash[13032]: cluster 2021-03-10T20:04:20.721789+0000 mgr.y (mgr.14140) 220 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:22.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:22 gibba044 bash[9859]: cluster 2021-03-10T20:04:20.721789+0000 mgr.y (mgr.14140) 220 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:22.517 INFO:teuthology.orchestra.run.gibba023.stdout:115964117029 2021-03-10T20:04:23.148 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117023 got 115964117029 for osd.3 2021-03-10T20:04:23.148 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.4 2021-03-10T20:04:23.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:23 gibba023 bash[9844]: audit 2021-03-10T20:04:22.514545+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.2.123:0/3481436848' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-03-10T20:04:23.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:23 gibba023 bash[13032]: audit 2021-03-10T20:04:22.514545+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.2.123:0/3481436848' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-03-10T20:04:23.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:23 gibba044 bash[9859]: audit 2021-03-10T20:04:22.514545+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.2.123:0/3481436848' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-03-10T20:04:24.394 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:24 gibba023 bash[9844]: cluster 2021-03-10T20:04:22.722504+0000 mgr.y (mgr.14140) 221 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:24.395 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:24 gibba023 bash[13032]: cluster 2021-03-10T20:04:22.722504+0000 mgr.y (mgr.14140) 221 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:24.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:24 gibba044 bash[9859]: cluster 2021-03-10T20:04:22.722504+0000 mgr.y (mgr.14140) 221 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:26.062 INFO:teuthology.orchestra.run.gibba023.stdout:137438953507 2021-03-10T20:04:26.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:26 gibba023 bash[9844]: cluster 2021-03-10T20:04:24.723156+0000 mgr.y (mgr.14140) 222 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:26.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:26 gibba023 bash[9844]: audit 2021-03-10T20:04:26.059476+0000 mon.a (mon.0) 544 : audit [DBG] from='client.? 172.21.2.123:0/1086579412' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-03-10T20:04:26.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:26 gibba023 bash[13032]: cluster 2021-03-10T20:04:24.723156+0000 mgr.y (mgr.14140) 222 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:26.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:26 gibba023 bash[13032]: audit 2021-03-10T20:04:26.059476+0000 mon.a (mon.0) 544 : audit [DBG] from='client.? 172.21.2.123:0/1086579412' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-03-10T20:04:26.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:26 gibba044 bash[9859]: cluster 2021-03-10T20:04:24.723156+0000 mgr.y (mgr.14140) 222 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:26.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:26 gibba044 bash[9859]: audit 2021-03-10T20:04:26.059476+0000 mon.a (mon.0) 544 : audit [DBG] from='client.? 172.21.2.123:0/1086579412' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-03-10T20:04:26.746 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953501 got 137438953507 for osd.4 2021-03-10T20:04:26.746 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.5 2021-03-10T20:04:28.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:28 gibba023 bash[9844]: cluster 2021-03-10T20:04:26.723858+0000 mgr.y (mgr.14140) 223 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:28.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:28 gibba023 bash[13032]: cluster 2021-03-10T20:04:26.723858+0000 mgr.y (mgr.14140) 223 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:28.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:28 gibba044 bash[9859]: cluster 2021-03-10T20:04:26.723858+0000 mgr.y (mgr.14140) 223 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:29.579 INFO:teuthology.orchestra.run.gibba023.stdout:158913789983 2021-03-10T20:04:30.248 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789977 got 158913789983 for osd.5 2021-03-10T20:04:30.248 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.6 2021-03-10T20:04:30.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:30 gibba023 bash[9844]: cluster 2021-03-10T20:04:28.724899+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:30.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:30 gibba023 bash[9844]: audit 2021-03-10T20:04:29.576540+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.2.123:0/4094912744' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-03-10T20:04:30.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:30 gibba023 bash[13032]: cluster 2021-03-10T20:04:28.724899+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:30.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:30 gibba023 bash[13032]: audit 2021-03-10T20:04:29.576540+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.2.123:0/4094912744' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-03-10T20:04:30.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:30 gibba044 bash[9859]: cluster 2021-03-10T20:04:28.724899+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:30.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:30 gibba044 bash[9859]: audit 2021-03-10T20:04:29.576540+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.2.123:0/4094912744' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-03-10T20:04:32.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:32 gibba023 bash[9844]: cluster 2021-03-10T20:04:30.725485+0000 mgr.y (mgr.14140) 225 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:32.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:32 gibba023 bash[13032]: cluster 2021-03-10T20:04:30.725485+0000 mgr.y (mgr.14140) 225 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:32.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:32 gibba044 bash[9859]: cluster 2021-03-10T20:04:30.725485+0000 mgr.y (mgr.14140) 225 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:33.125 INFO:teuthology.orchestra.run.gibba023.stdout:180388626459 2021-03-10T20:04:33.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:33 gibba023 bash[9844]: audit 2021-03-10T20:04:33.122749+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.2.123:0/1525738810' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-03-10T20:04:33.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:33 gibba023 bash[13032]: audit 2021-03-10T20:04:33.122749+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.2.123:0/1525738810' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-03-10T20:04:33.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:33 gibba044 bash[9859]: audit 2021-03-10T20:04:33.122749+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.2.123:0/1525738810' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-03-10T20:04:33.789 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626454 got 180388626459 for osd.6 2021-03-10T20:04:33.790 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph osd last-stat-seq osd.7 2021-03-10T20:04:34.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:34 gibba023 bash[9844]: cluster 2021-03-10T20:04:32.726152+0000 mgr.y (mgr.14140) 226 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:34.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:34 gibba023 bash[13032]: cluster 2021-03-10T20:04:32.726152+0000 mgr.y (mgr.14140) 226 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:34.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:34 gibba044 bash[9859]: cluster 2021-03-10T20:04:32.726152+0000 mgr.y (mgr.14140) 226 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:35.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:35 gibba023 bash[9844]: cluster 2021-03-10T20:04:34.727028+0000 mgr.y (mgr.14140) 227 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:35.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:35 gibba023 bash[13032]: cluster 2021-03-10T20:04:34.727028+0000 mgr.y (mgr.14140) 227 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:36.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:35 gibba044 bash[9859]: cluster 2021-03-10T20:04:34.727028+0000 mgr.y (mgr.14140) 227 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:36.765 INFO:teuthology.orchestra.run.gibba023.stdout:201863462934 2021-03-10T20:04:37.432 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462928 got 201863462934 for osd.7 2021-03-10T20:04:37.432 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2021-03-10T20:04:37.433 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph pg dump --format=json 2021-03-10T20:04:37.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:37 gibba023 bash[9844]: cluster 2021-03-10T20:04:36.727341+0000 mgr.y (mgr.14140) 228 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:37.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:37 gibba023 bash[9844]: audit 2021-03-10T20:04:36.761355+0000 mon.a (mon.0) 545 : audit [DBG] from='client.? 172.21.2.123:0/3425582507' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-03-10T20:04:37.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:37 gibba023 bash[13032]: cluster 2021-03-10T20:04:36.727341+0000 mgr.y (mgr.14140) 228 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:37.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:37 gibba023 bash[13032]: audit 2021-03-10T20:04:36.761355+0000 mon.a (mon.0) 545 : audit [DBG] from='client.? 172.21.2.123:0/3425582507' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-03-10T20:04:38.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:37 gibba044 bash[9859]: cluster 2021-03-10T20:04:36.727341+0000 mgr.y (mgr.14140) 228 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:38.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:37 gibba044 bash[9859]: audit 2021-03-10T20:04:36.761355+0000 mon.a (mon.0) 545 : audit [DBG] from='client.? 172.21.2.123:0/3425582507' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-03-10T20:04:40.031 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:39 gibba023 bash[9844]: cluster 2021-03-10T20:04:38.727949+0000 mgr.y (mgr.14140) 229 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:40.032 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:39 gibba023 bash[13032]: cluster 2021-03-10T20:04:38.727949+0000 mgr.y (mgr.14140) 229 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:40.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:39 gibba044 bash[9859]: cluster 2021-03-10T20:04:38.727949+0000 mgr.y (mgr.14140) 229 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:40.286 INFO:teuthology.orchestra.run.gibba023.stdout: 2021-03-10T20:04:40.287 INFO:teuthology.orchestra.run.gibba023.stderr:dumped all 2021-03-10T20:04:41.054 INFO:teuthology.orchestra.run.gibba023.stdout:{"pg_ready":true,"pg_map":{"version":217,"stamp":"2021-03-10T20:04:38.727597+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":704643072,"kb_used":8392284,"kb_used_data":3612,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":696250788,"statfs":{"total":721554505728,"available":712960806912,"internally_reserved":8589934592,"allocated":3698688,"data_stored":1468378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004090"},"pg_stats":[{"pgid":"1.0","version":"17'1","reported_seq":"14","reported_epoch":"48","state":"active+clean","last_fresh":"2021-03-10T20:02:56.774833+0000","last_change":"2021-03-10T20:02:56.774833+0000","last_active":"2021-03-10T20:02:56.774833+0000","last_peered":"2021-03-10T20:02:56.774833+0000","last_clean":"2021-03-10T20:02:56.774833+0000","last_became_active":"2021-03-10T20:02:56.773256+0000","last_became_peered":"2021-03-10T20:02:56.773256+0000","last_unstale":"2021-03-10T20:02:56.774833+0000","last_undegraded":"2021-03-10T20:02:56.774833+0000","last_fullsized":"2021-03-10T20:02:56.774833+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":2,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-10T19:58:14.436273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-10T19:58:14.436273+0000","last_clean_scrub_stamp":"2021-03-10T19:58:14.436273+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":47,"seq":201863462934,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 20:03:58 2021","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.7850000000000001,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":0.94299999999999995}]},{"osd":1,"last update":"Wed Mar 10 20:03:58 2021","interfaces":[{"interface":"back","average":{"1min":1.546,"5min":1.546,"15min":1.546},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.7440000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.7240000000000002,"5min":2.7240000000000002,"15min":2.7240000000000002},"last":0.96799999999999997}]},{"osd":2,"last update":"Wed Mar 10 20:03:58 2021","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.4649999999999999,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.6099999999999999,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":0.753}]},{"osd":3,"last update":"Wed Mar 10 20:03:58 2021","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":2.8759999999999999,"5min":2.8759999999999999,"15min":2.8759999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.9649999999999999,"5min":2.9649999999999999,"15min":2.9649999999999999},"last":0.80700000000000005}]},{"osd":4,"last update":"Wed Mar 10 20:03:58 2021","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":0.26800000000000002},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.22500000000000001}]},{"osd":5,"last update":"Wed Mar 10 20:03:58 2021","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":2.46,"5min":2.46,"15min":2.46},"last":0.20899999999999999},{"interface":"front","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":2.206,"5min":2.206,"15min":2.206},"last":0.29899999999999999}]},{"osd":6,"last update":"Wed Mar 10 20:03:58 2021","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":2.7040000000000002,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":0.317}]}]},{"osd":6,"up_from":42,"seq":180388626460,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049032,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031352,"statfs":{"total":90194313216,"available":89120104448,"internally_reserved":1073741824,"allocated":458752,"data_stored":183290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 20:03:35 2021","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":2.173},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.5740000000000001}]},{"osd":1,"last update":"Wed Mar 10 20:03:35 2021","interfaces":[{"interface":"back","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.5630000000000002,"5min":2.5630000000000002,"15min":2.5630000000000002},"last":2.2959999999999998},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.46,"5min":2.46,"15min":2.46},"last":2.6030000000000002}]},{"osd":2,"last update":"Wed Mar 10 20:03:35 2021","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.46},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":1.903}]},{"osd":3,"last update":"Wed Mar 10 20:03:35 2021","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":2.4369999999999998},{"interface":"front","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":2.3759999999999999}]},{"osd":4,"last update":"Wed Mar 10 20:03:35 2021","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":2.1480000000000001,"5min":2.1480000000000001,"15min":2.1480000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":1.179}]},{"osd":5,"last update":"Wed Mar 10 20:03:35 2021","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":2.4009999999999998,"5min":2.4009999999999998,"15min":2.4009999999999998},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":2.8439999999999999,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":1.629}]},{"osd":7,"last update":"Wed Mar 10 20:03:58 2021","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":2.766,"5min":2.766,"15min":2.766},"last":2.024},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.7529999999999999}]}]},{"osd":1,"up_from":16,"seq":68719476787,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 20:03:48 2021","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.747,"15min":0.70599999999999996},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.83299999999999996,"15min":0.79300000000000004},"min":{"1min":0.16500000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":1.0109999999999999}]},{"osd":2,"last update":"Wed Mar 10 20:04:12 2021","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.006,"15min":0.97999999999999998},"min":{"1min":0.316,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.8129999999999999,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.4510000000000001},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.032,"15min":1.0189999999999999},"min":{"1min":0.19800000000000001,"5min":0.182,"15min":0.182},"max":{"1min":2.2909999999999999,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":0.84699999999999998}]},{"osd":3,"last update":"Wed Mar 10 20:03:37 2021","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.95599999999999996,"15min":0.96199999999999997},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2509999999999999,"15min":1.2589999999999999},"min":{"1min":0.17499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":2.6200000000000001,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":1.165}]},{"osd":4,"last update":"Wed Mar 10 20:03:54 2021","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.421,"15min":1.431},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.274,"5min":2.274,"15min":2.274},"last":1.327},{"interface":"front","average":{"1min":1.431,"5min":1.506,"15min":1.518},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.788}]},{"osd":5,"last update":"Wed Mar 10 20:04:12 2021","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":2.306,"5min":2.391,"15min":2.391},"last":1.5549999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.3839999999999999,"15min":1.3919999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.8779999999999999,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.2689999999999999}]},{"osd":6,"last update":"Wed Mar 10 20:03:37 2021","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":2.5760000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":1.623},{"interface":"front","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":1.661}]},{"osd":7,"last update":"Wed Mar 10 20:04:00 2021","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":1.702}]}]},{"osd":0,"up_from":10,"seq":42949673014,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 10 20:03:46 2021","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.75600000000000001,"15min":0.752},"min":{"1min":0.16300000000000001,"5min":0.155,"15min":0.155},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.89200000000000002,"15min":0.83699999999999997},"min":{"1min":0.27500000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":1.179}]},{"osd":2,"last update":"Wed Mar 10 20:04:09 2021","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0780000000000001,"15min":1.0680000000000001},"min":{"1min":0.255,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":1.978,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.014},{"interface":"front","average":{"1min":1.012,"5min":1.038,"15min":1.048},"min":{"1min":0.223,"5min":0.184,"15min":0.184},"max":{"1min":1.8260000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.88400000000000001}]},{"osd":3,"last update":"Wed Mar 10 20:04:37 2021","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.2609999999999999,"15min":1.2869999999999999},"min":{"1min":0.26500000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.9199999999999999,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":1.27},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.129,"15min":1.169},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.581,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.1040000000000001}]},{"osd":4,"last update":"Wed Mar 10 20:03:53 2021","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.4339999999999999,"15min":1.4350000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3500000000000001,"15min":1.351},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.663}]},{"osd":5,"last update":"Wed Mar 10 20:04:15 2021","interfaces":[{"interface":"back","average":{"1min":1.6359999999999999,"5min":1.5640000000000001,"15min":1.552},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.2999999999999998,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":2.1949999999999998},{"interface":"front","average":{"1min":1.431,"5min":1.3140000000000001,"15min":1.294},"min":{"1min":0.41499999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":2.0859999999999999}]},{"osd":6,"last update":"Wed Mar 10 20:04:37 2021","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.234,"15min":1.224},"min":{"1min":0.51400000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.7250000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.76,"5min":1.5129999999999999,"15min":1.472},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.8120000000000001}]},{"osd":7,"last update":"Wed Mar 10 20:03:58 2021","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.0059999999999998,"5min":2.0059999999999998,"15min":2.0059999999999998},"last":1.9430000000000001},{"interface":"front","average":{"1min":1.718,"5min":1.718,"15min":1.718},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":2.5,"5min":2.5,"15min":2.5},"last":2.3719999999999999}]}]},{"osd":2,"up_from":21,"seq":90194313262,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 20:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76100000000000001,"15min":0.72099999999999997},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.385,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.92000000000000004,"15min":0.90400000000000003},"min":{"1min":0.253,"5min":0.189,"15min":0.189},"max":{"1min":1.7350000000000001,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.83999999999999997}]},{"osd":1,"last update":"Wed Mar 10 20:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.88400000000000001,"15min":0.85799999999999998},"min":{"1min":0.22900000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":2.4489999999999998,"5min":2.4489999999999998,"15min":2.4489999999999998},"last":1.01},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.008,"15min":0.94199999999999995},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.1599999999999999}]},{"osd":3,"last update":"Wed Mar 10 20:03:34 2021","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.171,"15min":1.167},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":2.1800000000000002,"5min":2.1800000000000002,"15min":2.1800000000000002},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.347,"5min":1.2969999999999999,"15min":1.2889999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.5449999999999999}]},{"osd":4,"last update":"Wed Mar 10 20:03:50 2021","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.47,"15min":1.5049999999999999},"min":{"1min":0.65600000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.3460000000000001,"5min":2.4380000000000002,"15min":2.4380000000000002},"last":1.6799999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.4690000000000001,"15min":1.5109999999999999},"min":{"1min":0.45500000000000002,"5min":0.433,"15min":0.433},"max":{"1min":2.2749999999999999,"5min":2.319,"15min":2.319},"last":1.972}]},{"osd":5,"last update":"Wed Mar 10 20:04:15 2021","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.6970000000000001,"15min":1.722},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.5070000000000001,"5min":2.5790000000000002,"15min":2.5790000000000002},"last":2.5830000000000002},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.5009999999999999,"15min":1.5349999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":1.819}]},{"osd":6,"last update":"Wed Mar 10 20:03:34 2021","interfaces":[{"interface":"back","average":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.508,"5min":2.508,"15min":2.508},"last":2.4670000000000001},{"interface":"front","average":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"min":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":2.7490000000000001}]},{"osd":7,"last update":"Wed Mar 10 20:03:58 2021","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":2.3530000000000002,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":2.1240000000000001},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":2.2530000000000001}]}]},{"osd":3,"up_from":27,"seq":115964117032,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 20:03:33 2021","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":1.0589999999999999,"15min":1.075},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":2.2069999999999999,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.26400000000000001},{"interface":"front","average":{"1min":1.222,"5min":0.995,"15min":0.95699999999999996},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":2.3690000000000002,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":0.35499999999999998}]},{"osd":1,"last update":"Wed Mar 10 20:03:33 2021","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.95899999999999996,"15min":0.95699999999999996},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.24099999999999999},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.1950000000000001,"15min":1.177},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":2.214,"5min":2.214,"15min":2.214},"last":0.29299999999999998}]},{"osd":2,"last update":"Wed Mar 10 20:03:33 2021","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.27,"15min":1.238},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":2.4849999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":0.28100000000000003},{"interface":"front","average":{"1min":1.1950000000000001,"5min":1.2150000000000001,"15min":1.218},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":2.5800000000000001,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.32400000000000001}]},{"osd":4,"last update":"Wed Mar 10 20:03:50 2021","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.4590000000000001,"15min":1.4690000000000001},"min":{"1min":0.435,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.087},{"interface":"front","average":{"1min":1.232,"5min":1.409,"15min":1.4390000000000001},"min":{"1min":0.56899999999999995,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.214}]},{"osd":5,"last update":"Wed Mar 10 20:04:15 2021","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.556,"15min":1.571},"min":{"1min":0.44700000000000001,"5min":0.436,"15min":0.436},"max":{"1min":2.629,"5min":2.629,"15min":2.629},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.145,"5min":1.1850000000000001,"15min":1.1919999999999999},"min":{"1min":0.48099999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.681,"5min":1.764,"15min":1.764},"last":1.1699999999999999}]},{"osd":6,"last update":"Wed Mar 10 20:03:33 2021","interfaces":[{"interface":"back","average":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.2480000000000002,"5min":2.2480000000000002,"15min":2.2480000000000002},"last":0.997},{"interface":"front","average":{"1min":1.72,"5min":1.72,"15min":1.72},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.0680000000000001}]},{"osd":7,"last update":"Wed Mar 10 20:03:57 2021","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.23},{"interface":"front","average":{"1min":1.643,"5min":1.643,"15min":1.643},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.5049999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":1.1000000000000001}]}]},{"osd":4,"up_from":32,"seq":137438953509,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 20:03:52 2021","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.413,"15min":1.454},"min":{"1min":0.34200000000000003,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.7889999999999999,"5min":2.121,"15min":2.121},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.321,"5min":1.512,"15min":1.544},"min":{"1min":0.42899999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":2.4420000000000002,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":0.755}]},{"osd":1,"last update":"Wed Mar 10 20:03:52 2021","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.1879999999999999,"15min":1.2250000000000001},"min":{"1min":0.38600000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.6930000000000001,"5min":1.919,"15min":1.919},"last":1.01},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.4259999999999999,"15min":1.4419999999999999},"min":{"1min":0.47799999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.7240000000000002,"5min":2.7240000000000002,"15min":2.7240000000000002},"last":1.123}]},{"osd":2,"last update":"Wed Mar 10 20:03:52 2021","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.3859999999999999,"15min":1.4039999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.6120000000000001,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.252,"5min":1.427,"15min":1.456},"min":{"1min":0.46000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.891,"5min":2.891,"15min":2.891},"last":1.9330000000000001}]},{"osd":3,"last update":"Wed Mar 10 20:03:52 2021","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.393,"15min":1.421},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.0840000000000001,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.274},{"interface":"front","average":{"1min":1.331,"5min":1.5189999999999999,"15min":1.55},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":2.456,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":1.496}]},{"osd":5,"last update":"Wed Mar 10 20:04:12 2021","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":0.95799999999999996,"15min":0.90800000000000003},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.3420000000000001,"5min":2.472,"15min":2.472},"last":1.6870000000000001},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.0920000000000001,"15min":1.0329999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":2.5630000000000002,"5min":2.6859999999999999,"15min":2.6859999999999999},"last":2.214}]},{"osd":6,"last update":"Wed Mar 10 20:03:34 2021","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":2.1789999999999998,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.4059999999999999},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":2.0630000000000002}]},{"osd":7,"last update":"Wed Mar 10 20:03:59 2021","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":2.714,"5min":2.714,"15min":2.714},"last":2.379},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":1.806}]}]},{"osd":5,"up_from":37,"seq":158913789985,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 20:04:14 2021","interfaces":[{"interface":"back","average":{"1min":1.585,"5min":1.5960000000000001,"15min":1.5980000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.7029999999999998,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":0.997},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.3069999999999999,"15min":1.329},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.55}]},{"osd":1,"last update":"Wed Mar 10 20:04:14 2021","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.482,"15min":1.502},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.6920000000000002,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":1.4410000000000001},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.429,"15min":1.4390000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":2.0390000000000001}]},{"osd":2,"last update":"Wed Mar 10 20:04:14 2021","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.3149999999999999,"5min":2.3149999999999999,"15min":2.3149999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":1.556,"5min":1.706,"15min":1.7310000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.8400000000000001}]},{"osd":3,"last update":"Wed Mar 10 20:04:14 2021","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.4950000000000001,"15min":1.5209999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.302},{"interface":"front","average":{"1min":1.498,"5min":1.542,"15min":1.55},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":2.2589999999999999}]},{"osd":4,"last update":"Wed Mar 10 20:04:14 2021","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":0.92800000000000005,"15min":0.90200000000000002},"min":{"1min":0.21199999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.119},{"interface":"front","average":{"1min":1.276,"5min":1.083,"15min":1.0509999999999999},"min":{"1min":0.32900000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":2.2490000000000001,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.6859999999999999}]},{"osd":6,"last update":"Wed Mar 10 20:04:34 2021","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.0660000000000001,"15min":1.002},"min":{"1min":0.60799999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":2.46,"5min":2.46,"15min":2.46},"last":2.1269999999999998},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.048,"15min":0.96099999999999997},"min":{"1min":0.57699999999999996,"5min":0.224,"15min":0.224},"max":{"1min":2.4420000000000002,"5min":2.5459999999999998,"15min":2.5459999999999998},"last":2.4289999999999998}]},{"osd":7,"last update":"Wed Mar 10 20:03:57 2021","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":2.6419999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":2.5630000000000002},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":2.2040000000000002}]}]}]}} 2021-03-10T20:04:41.056 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph pg dump --format=json 2021-03-10T20:04:42.030 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:41 gibba023 bash[13032]: audit 2021-03-10T20:04:40.280535+0000 mgr.y (mgr.14140) 230 : audit [DBG] from='client.24352 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T20:04:42.030 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:41 gibba023 bash[13032]: cluster 2021-03-10T20:04:40.728764+0000 mgr.y (mgr.14140) 231 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:42.031 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:41 gibba023 bash[9844]: audit 2021-03-10T20:04:40.280535+0000 mgr.y (mgr.14140) 230 : audit [DBG] from='client.24352 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T20:04:42.031 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:41 gibba023 bash[9844]: cluster 2021-03-10T20:04:40.728764+0000 mgr.y (mgr.14140) 231 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:42.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:41 gibba044 bash[9859]: audit 2021-03-10T20:04:40.280535+0000 mgr.y (mgr.14140) 230 : audit [DBG] from='client.24352 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T20:04:42.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:41 gibba044 bash[9859]: cluster 2021-03-10T20:04:40.728764+0000 mgr.y (mgr.14140) 231 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:44.063 INFO:teuthology.orchestra.run.gibba023.stdout: 2021-03-10T20:04:44.064 INFO:teuthology.orchestra.run.gibba023.stderr:dumped all 2021-03-10T20:04:44.159 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:43 gibba023 bash[9844]: cluster 2021-03-10T20:04:42.729566+0000 mgr.y (mgr.14140) 232 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:44.159 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:43 gibba023 bash[13032]: cluster 2021-03-10T20:04:42.729566+0000 mgr.y (mgr.14140) 232 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:44.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:43 gibba044 bash[9859]: cluster 2021-03-10T20:04:42.729566+0000 mgr.y (mgr.14140) 232 : cluster [DBG] pgmap v219: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:44.775 INFO:teuthology.orchestra.run.gibba023.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2021-03-10T20:04:42.729195+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":704643072,"kb_used":8392284,"kb_used_data":3612,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":696250788,"statfs":{"total":721554505728,"available":712960806912,"internally_reserved":8589934592,"allocated":3698688,"data_stored":1468378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003816"},"pg_stats":[{"pgid":"1.0","version":"17'1","reported_seq":"14","reported_epoch":"48","state":"active+clean","last_fresh":"2021-03-10T20:02:56.774833+0000","last_change":"2021-03-10T20:02:56.774833+0000","last_active":"2021-03-10T20:02:56.774833+0000","last_peered":"2021-03-10T20:02:56.774833+0000","last_clean":"2021-03-10T20:02:56.774833+0000","last_became_active":"2021-03-10T20:02:56.773256+0000","last_became_peered":"2021-03-10T20:02:56.773256+0000","last_unstale":"2021-03-10T20:02:56.774833+0000","last_undegraded":"2021-03-10T20:02:56.774833+0000","last_fullsized":"2021-03-10T20:02:56.774833+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":2,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-03-10T19:58:14.436273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-03-10T19:58:14.436273+0000","last_clean_scrub_stamp":"2021-03-10T19:58:14.436273+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":47,"seq":201863462935,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 20:03:58 2021","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":2.7850000000000001,"5min":2.7850000000000001,"15min":2.7850000000000001},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.8210000000000002,"5min":2.8210000000000002,"15min":2.8210000000000002},"last":2.6800000000000002}]},{"osd":1,"last update":"Wed Mar 10 20:03:58 2021","interfaces":[{"interface":"back","average":{"1min":1.546,"5min":1.546,"15min":1.546},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.7440000000000002,"5min":2.7440000000000002,"15min":2.7440000000000002},"last":2.5790000000000002},{"interface":"front","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":2.7240000000000002,"5min":2.7240000000000002,"15min":2.7240000000000002},"last":2.4769999999999999}]},{"osd":2,"last update":"Wed Mar 10 20:03:58 2021","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.4649999999999999,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":2.6099999999999999,"5min":2.6099999999999999,"15min":2.6099999999999999},"last":2.3410000000000002}]},{"osd":3,"last update":"Wed Mar 10 20:03:58 2021","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":2.8759999999999999,"5min":2.8759999999999999,"15min":2.8759999999999999},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":2.9649999999999999,"5min":2.9649999999999999,"15min":2.9649999999999999},"last":1.419}]},{"osd":4,"last update":"Wed Mar 10 20:03:58 2021","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":2.0369999999999999},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":2.1600000000000001}]},{"osd":5,"last update":"Wed Mar 10 20:03:58 2021","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":2.46,"5min":2.46,"15min":2.46},"last":1.871},{"interface":"front","average":{"1min":1.284,"5min":1.284,"15min":1.284},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":2.206,"5min":2.206,"15min":2.206},"last":1.5880000000000001}]},{"osd":6,"last update":"Wed Mar 10 20:03:58 2021","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":2.7040000000000002,"5min":2.7040000000000002,"15min":2.7040000000000002},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":2.4079999999999999,"5min":2.4079999999999999,"15min":2.4079999999999999},"last":1.734}]}]},{"osd":6,"up_from":42,"seq":180388626461,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049032,"kb_used_data":448,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031352,"statfs":{"total":90194313216,"available":89120104448,"internally_reserved":1073741824,"allocated":458752,"data_stored":183290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 20:04:36 2021","interfaces":[{"interface":"back","average":{"1min":1.5369999999999999,"5min":1.256,"15min":1.2090000000000001},"min":{"1min":0.81000000000000005,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.411,"5min":2.718,"15min":2.718},"last":1.621},{"interface":"front","average":{"1min":1.619,"5min":1.2410000000000001,"15min":1.1779999999999999},"min":{"1min":0.81399999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.46,"5min":2.46,"15min":2.46},"last":1.131}]},{"osd":1,"last update":"Wed Mar 10 20:04:36 2021","interfaces":[{"interface":"back","average":{"1min":1.673,"5min":1.367,"15min":1.3160000000000001},"min":{"1min":0.92300000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.649,"5min":2.649,"15min":2.649},"last":2.7010000000000001},{"interface":"front","average":{"1min":1.7130000000000001,"5min":1.3240000000000001,"15min":1.2589999999999999},"min":{"1min":0.80300000000000005,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.661,"5min":2.661,"15min":2.661},"last":1.381}]},{"osd":2,"last update":"Wed Mar 10 20:04:36 2021","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.359,"15min":1.3200000000000001},"min":{"1min":0.76300000000000001,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.238},{"interface":"front","average":{"1min":1.8779999999999999,"5min":1.3979999999999999,"15min":1.3180000000000001},"min":{"1min":0.85099999999999998,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.665,"5min":2.665,"15min":2.665},"last":2.2589999999999999}]},{"osd":3,"last update":"Wed Mar 10 20:04:36 2021","interfaces":[{"interface":"back","average":{"1min":1.728,"5min":1.415,"15min":1.363},"min":{"1min":0.753,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.5379999999999998,"5min":2.5379999999999998,"15min":2.5379999999999998},"last":1.744},{"interface":"front","average":{"1min":1.694,"5min":1.2969999999999999,"15min":1.2310000000000001},"min":{"1min":0.93200000000000005,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":2.5760000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":1.9710000000000001}]},{"osd":4,"last update":"Wed Mar 10 20:04:36 2021","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.157,"15min":1.1140000000000001},"min":{"1min":0.25600000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":2.823,"5min":2.823,"15min":2.823},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.1679999999999999,"15min":1.1080000000000001},"min":{"1min":0.26900000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":2.5609999999999999,"5min":2.5609999999999999,"15min":2.5609999999999999},"last":2.5739999999999998}]},{"osd":5,"last update":"Wed Mar 10 20:04:35 2021","interfaces":[{"interface":"back","average":{"1min":1.627,"5min":1.3240000000000001,"15min":1.274},"min":{"1min":0.28299999999999997,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":2.5790000000000002,"5min":2.5790000000000002,"15min":2.5790000000000002},"last":1.8680000000000001},{"interface":"front","average":{"1min":1.6799999999999999,"5min":1.423,"15min":1.3799999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":2.7240000000000002,"5min":2.8439999999999999,"15min":2.8439999999999999},"last":2.101}]},{"osd":7,"last update":"Wed Mar 10 20:03:58 2021","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":2.766,"5min":2.766,"15min":2.766},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.363,"5min":1.363,"15min":1.363},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":2.4319999999999999}]}]},{"osd":1,"up_from":16,"seq":68719476788,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 20:03:48 2021","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.747,"15min":0.70599999999999996},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.83299999999999996,"15min":0.79300000000000004},"min":{"1min":0.16500000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":1.3069999999999999}]},{"osd":2,"last update":"Wed Mar 10 20:04:12 2021","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":1.006,"15min":0.97999999999999998},"min":{"1min":0.316,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.8129999999999999,"5min":2.2919999999999998,"15min":2.2919999999999998},"last":1.6819999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.032,"15min":1.0189999999999999},"min":{"1min":0.19800000000000001,"5min":0.182,"15min":0.182},"max":{"1min":2.2909999999999999,"5min":2.4540000000000002,"15min":2.4540000000000002},"last":0.92100000000000004}]},{"osd":3,"last update":"Wed Mar 10 20:03:37 2021","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.95599999999999996,"15min":0.96199999999999997},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2509999999999999,"15min":1.2589999999999999},"min":{"1min":0.17499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":2.6200000000000001,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":1.129}]},{"osd":4,"last update":"Wed Mar 10 20:03:54 2021","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.421,"15min":1.431},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.274,"5min":2.274,"15min":2.274},"last":1.8400000000000001},{"interface":"front","average":{"1min":1.431,"5min":1.506,"15min":1.518},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":2.391}]},{"osd":5,"last update":"Wed Mar 10 20:04:12 2021","interfaces":[{"interface":"back","average":{"1min":1.452,"5min":1.452,"15min":1.452},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":2.306,"5min":2.391,"15min":2.391},"last":1.9490000000000001},{"interface":"front","average":{"1min":1.333,"5min":1.3839999999999999,"15min":1.3919999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.8779999999999999,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":1.5509999999999999}]},{"osd":6,"last update":"Wed Mar 10 20:03:37 2021","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":2.5760000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":1.8839999999999999},{"interface":"front","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.6280000000000001,"5min":2.6280000000000001,"15min":2.6280000000000001},"last":2.0409999999999999}]},{"osd":7,"last update":"Wed Mar 10 20:04:00 2021","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":2.2469999999999999},{"interface":"front","average":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":2.794,"5min":2.794,"15min":2.794},"last":2.1230000000000002}]}]},{"osd":0,"up_from":10,"seq":42949673014,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 10 20:03:46 2021","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.75600000000000001,"15min":0.752},"min":{"1min":0.16300000000000001,"5min":0.155,"15min":0.155},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.89200000000000002,"15min":0.83699999999999997},"min":{"1min":0.27500000000000002,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":2.391,"5min":2.391,"15min":2.391},"last":1.179}]},{"osd":2,"last update":"Wed Mar 10 20:04:09 2021","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0780000000000001,"15min":1.0680000000000001},"min":{"1min":0.255,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":1.978,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.014},{"interface":"front","average":{"1min":1.012,"5min":1.038,"15min":1.048},"min":{"1min":0.223,"5min":0.184,"15min":0.184},"max":{"1min":1.8260000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"last":0.88400000000000001}]},{"osd":3,"last update":"Wed Mar 10 20:04:37 2021","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.2609999999999999,"15min":1.2869999999999999},"min":{"1min":0.26500000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.9199999999999999,"5min":2.4910000000000001,"15min":2.4910000000000001},"last":1.27},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.129,"15min":1.169},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":1.581,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.1040000000000001}]},{"osd":4,"last update":"Wed Mar 10 20:03:53 2021","interfaces":[{"interface":"back","average":{"1min":1.429,"5min":1.4339999999999999,"15min":1.4350000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":2.2799999999999998,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3500000000000001,"15min":1.351},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"last":1.663}]},{"osd":5,"last update":"Wed Mar 10 20:04:15 2021","interfaces":[{"interface":"back","average":{"1min":1.6359999999999999,"5min":1.5640000000000001,"15min":1.552},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.2999999999999998,"5min":2.2999999999999998,"15min":2.2999999999999998},"last":2.1949999999999998},{"interface":"front","average":{"1min":1.431,"5min":1.3140000000000001,"15min":1.294},"min":{"1min":0.41499999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":2.0859999999999999}]},{"osd":6,"last update":"Wed Mar 10 20:04:37 2021","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.234,"15min":1.224},"min":{"1min":0.51400000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.7250000000000001,"5min":1.9570000000000001,"15min":1.9570000000000001},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.76,"5min":1.5129999999999999,"15min":1.472},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.5169999999999999,"5min":2.5169999999999999,"15min":2.5169999999999999},"last":1.8120000000000001}]},{"osd":7,"last update":"Wed Mar 10 20:03:58 2021","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.0059999999999998,"5min":2.0059999999999998,"15min":2.0059999999999998},"last":1.9430000000000001},{"interface":"front","average":{"1min":1.718,"5min":1.718,"15min":1.718},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":2.5,"5min":2.5,"15min":2.5},"last":2.3719999999999999}]}]},{"osd":2,"up_from":21,"seq":90194313263,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 20:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76100000000000001,"15min":0.72099999999999997},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.385,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.92000000000000004,"15min":0.90400000000000003},"min":{"1min":0.253,"5min":0.189,"15min":0.189},"max":{"1min":1.7350000000000001,"5min":1.7889999999999999,"15min":1.7889999999999999},"last":0.60599999999999998}]},{"osd":1,"last update":"Wed Mar 10 20:04:09 2021","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.88400000000000001,"15min":0.85799999999999998},"min":{"1min":0.22900000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":2.4489999999999998,"5min":2.4489999999999998,"15min":2.4489999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.008,"15min":0.94199999999999995},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.497}]},{"osd":3,"last update":"Wed Mar 10 20:04:37 2021","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.155,"15min":1.161},"min":{"1min":0.34799999999999998,"5min":0.313,"15min":0.313},"max":{"1min":3.5030000000000001,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":0.441},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.2769999999999999,"15min":1.282},"min":{"1min":0.33000000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.3849999999999998,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":0.65700000000000003}]},{"osd":4,"last update":"Wed Mar 10 20:03:50 2021","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.47,"15min":1.5049999999999999},"min":{"1min":0.65600000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.3460000000000001,"5min":2.4380000000000002,"15min":2.4380000000000002},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.4690000000000001,"15min":1.5109999999999999},"min":{"1min":0.45500000000000002,"5min":0.433,"15min":0.433},"max":{"1min":2.2749999999999999,"5min":2.319,"15min":2.319},"last":1.1459999999999999}]},{"osd":5,"last update":"Wed Mar 10 20:04:15 2021","interfaces":[{"interface":"back","average":{"1min":1.548,"5min":1.6970000000000001,"15min":1.722},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":2.5070000000000001,"5min":2.5790000000000002,"15min":2.5790000000000002},"last":1.1950000000000001},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.5009999999999999,"15min":1.5349999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":1.4590000000000001}]},{"osd":6,"last update":"Wed Mar 10 20:04:37 2021","interfaces":[{"interface":"back","average":{"1min":1.7330000000000001,"5min":1.6020000000000001,"15min":1.5800000000000001},"min":{"1min":0.627,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":4.133,"5min":4.133,"15min":4.133},"last":1.319},{"interface":"front","average":{"1min":1.9219999999999999,"5min":1.8340000000000001,"15min":1.8200000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":4.3220000000000001,"5min":4.3220000000000001,"15min":4.3220000000000001},"last":1.5820000000000001}]},{"osd":7,"last update":"Wed Mar 10 20:03:58 2021","interfaces":[{"interface":"back","average":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":2.3530000000000002,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":2.4620000000000002,"5min":2.4620000000000002,"15min":2.4620000000000002},"last":1.2529999999999999}]}]},{"osd":3,"up_from":27,"seq":115964117033,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 20:04:39 2021","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.96799999999999997,"15min":1.0449999999999999},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":1.1970000000000001,"5min":2.2069999999999999,"15min":2.2069999999999999},"last":0.754},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.96499999999999997,"15min":0.94699999999999995},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":1.6220000000000001,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":1.0860000000000001}]},{"osd":1,"last update":"Wed Mar 10 20:04:39 2021","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.90200000000000002,"15min":0.93799999999999994},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.202,"5min":1.579,"15min":1.579},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":1.149,"15min":1.161},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.8220000000000001,"5min":2.214,"15min":2.214},"last":0.91400000000000003}]},{"osd":2,"last update":"Wed Mar 10 20:04:39 2021","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":1.208,"15min":1.2170000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.7569999999999999,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":1.163},{"interface":"front","average":{"1min":0.82499999999999996,"5min":1.1359999999999999,"15min":1.1919999999999999},"min":{"1min":0.245,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.883,"5min":2.5800000000000001,"15min":2.5800000000000001},"last":0.84399999999999997}]},{"osd":4,"last update":"Wed Mar 10 20:03:50 2021","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.4590000000000001,"15min":1.4690000000000001},"min":{"1min":0.435,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.3450000000000002,"5min":2.3450000000000002,"15min":2.3450000000000002},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.409,"15min":1.4390000000000001},"min":{"1min":0.56899999999999995,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.3330000000000002,"5min":2.3330000000000002,"15min":2.3330000000000002},"last":1.4430000000000001}]},{"osd":5,"last update":"Wed Mar 10 20:04:15 2021","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.556,"15min":1.571},"min":{"1min":0.44700000000000001,"5min":0.436,"15min":0.436},"max":{"1min":2.629,"5min":2.629,"15min":2.629},"last":1.395},{"interface":"front","average":{"1min":1.145,"5min":1.1850000000000001,"15min":1.1919999999999999},"min":{"1min":0.48099999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.681,"5min":1.764,"15min":1.764},"last":1.6359999999999999}]},{"osd":6,"last update":"Wed Mar 10 20:04:39 2021","interfaces":[{"interface":"back","average":{"1min":1.571,"5min":1.6180000000000001,"15min":1.6259999999999999},"min":{"1min":0.51800000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.472,"5min":1.6699999999999999,"15min":1.7030000000000001},"min":{"1min":0.51200000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":2.3519999999999999,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.7010000000000001}]},{"osd":7,"last update":"Wed Mar 10 20:03:57 2021","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.643,"5min":1.643,"15min":1.643},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":2.5049999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":1.345}]}]},{"osd":4,"up_from":32,"seq":137438953510,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 20:03:52 2021","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.413,"15min":1.454},"min":{"1min":0.34200000000000003,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.7889999999999999,"5min":2.121,"15min":2.121},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.321,"5min":1.512,"15min":1.544},"min":{"1min":0.42899999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":2.4420000000000002,"5min":2.4420000000000002,"15min":2.4420000000000002},"last":2.5009999999999999}]},{"osd":1,"last update":"Wed Mar 10 20:03:52 2021","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":1.1879999999999999,"15min":1.2250000000000001},"min":{"1min":0.38600000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":1.6930000000000001,"5min":1.919,"15min":1.919},"last":2.173},{"interface":"front","average":{"1min":1.3340000000000001,"5min":1.4259999999999999,"15min":1.4419999999999999},"min":{"1min":0.47799999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":2.7240000000000002,"5min":2.7240000000000002,"15min":2.7240000000000002},"last":1.627}]},{"osd":2,"last update":"Wed Mar 10 20:03:52 2021","interfaces":[{"interface":"back","average":{"1min":1.2789999999999999,"5min":1.3859999999999999,"15min":1.4039999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":2.6120000000000001,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":2.3260000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.427,"15min":1.456},"min":{"1min":0.46000000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":2.891,"5min":2.891,"15min":2.891},"last":2.0979999999999999}]},{"osd":3,"last update":"Wed Mar 10 20:03:52 2021","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.393,"15min":1.421},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.0840000000000001,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.9490000000000001},{"interface":"front","average":{"1min":1.331,"5min":1.5189999999999999,"15min":1.55},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":2.456,"5min":2.5089999999999999,"15min":2.5089999999999999},"last":2.6739999999999999}]},{"osd":5,"last update":"Wed Mar 10 20:04:12 2021","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":0.95799999999999996,"15min":0.90800000000000003},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":2.3420000000000001,"5min":2.472,"15min":2.472},"last":1.486},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.0920000000000001,"15min":1.0329999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":2.5630000000000002,"5min":2.6859999999999999,"15min":2.6859999999999999},"last":1.214}]},{"osd":6,"last update":"Wed Mar 10 20:04:34 2021","interfaces":[{"interface":"back","average":{"1min":1.3089999999999999,"5min":0.97999999999999998,"15min":0.92500000000000004},"min":{"1min":0.246,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":2.1419999999999999,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.772},{"interface":"front","average":{"1min":1.514,"5min":1.018,"15min":0.93600000000000005},"min":{"1min":0.32900000000000001,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":2.3969999999999998,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":1.0820000000000001}]},{"osd":7,"last update":"Wed Mar 10 20:03:59 2021","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":2.714,"5min":2.714,"15min":2.714},"last":2.2429999999999999},{"interface":"front","average":{"1min":1.137,"5min":1.137,"15min":1.137},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":2.2549999999999999,"5min":2.2549999999999999,"15min":2.2549999999999999},"last":0.97299999999999998}]}]},{"osd":5,"up_from":37,"seq":158913789986,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88080384,"kb_used":1049036,"kb_used_data":452,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":87031348,"statfs":{"total":90194313216,"available":89120100352,"internally_reserved":1073741824,"allocated":462848,"data_stored":183584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 10 20:04:14 2021","interfaces":[{"interface":"back","average":{"1min":1.585,"5min":1.5960000000000001,"15min":1.5980000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.7029999999999998,"5min":2.7029999999999998,"15min":2.7029999999999998},"last":2.0680000000000001},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.3069999999999999,"15min":1.329},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.8280000000000001}]},{"osd":1,"last update":"Wed Mar 10 20:04:14 2021","interfaces":[{"interface":"back","average":{"1min":1.3620000000000001,"5min":1.482,"15min":1.502},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.6920000000000002,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.3660000000000001,"5min":1.429,"15min":1.4390000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.1739999999999999,"5min":2.1739999999999999,"15min":2.1739999999999999},"last":1.054}]},{"osd":2,"last update":"Wed Mar 10 20:04:14 2021","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.417,"15min":1.417},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.3149999999999999,"5min":2.3149999999999999,"15min":2.3149999999999999},"last":1.5569999999999999},{"interface":"front","average":{"1min":1.556,"5min":1.706,"15min":1.7310000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"last":1.3080000000000001}]},{"osd":3,"last update":"Wed Mar 10 20:04:14 2021","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.4950000000000001,"15min":1.5209999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":2.202,"5min":2.202,"15min":2.202},"last":1.9490000000000001},{"interface":"front","average":{"1min":1.498,"5min":1.542,"15min":1.55},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":2.4870000000000001,"5min":2.4870000000000001,"15min":2.4870000000000001},"last":2.6819999999999999}]},{"osd":4,"last update":"Wed Mar 10 20:04:14 2021","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":0.92800000000000005,"15min":0.90200000000000002},"min":{"1min":0.21199999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.276,"5min":1.083,"15min":1.0509999999999999},"min":{"1min":0.32900000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":2.2490000000000001,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.194}]},{"osd":6,"last update":"Wed Mar 10 20:04:34 2021","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.0660000000000001,"15min":1.002},"min":{"1min":0.60799999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":2.46,"5min":2.46,"15min":2.46},"last":2.3860000000000001},{"interface":"front","average":{"1min":1.5680000000000001,"5min":1.048,"15min":0.96099999999999997},"min":{"1min":0.57699999999999996,"5min":0.224,"15min":0.224},"max":{"1min":2.4420000000000002,"5min":2.5459999999999998,"15min":2.5459999999999998},"last":1.7030000000000001}]},{"osd":7,"last update":"Wed Mar 10 20:03:57 2021","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":2.6419999999999999,"5min":2.6419999999999999,"15min":2.6419999999999999},"last":2.5139999999999998},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":2.2639999999999998}]}]}]}} 2021-03-10T20:04:45.266 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2021-03-10T20:04:45.267 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-03-10T20:04:45.267 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2021-03-10T20:04:45.267 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid dd719b26-81da-11eb-9080-001a4aab830c -- ceph health --format=json 2021-03-10T20:04:45.269 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:44 gibba044 bash[9859]: audit 2021-03-10T20:04:44.058449+0000 mgr.y (mgr.14140) 233 : audit [DBG] from='client.24358 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T20:04:45.269 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:44 gibba023 bash[9844]: audit 2021-03-10T20:04:44.058449+0000 mgr.y (mgr.14140) 233 : audit [DBG] from='client.24358 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T20:04:45.269 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:44 gibba023 bash[13032]: audit 2021-03-10T20:04:44.058449+0000 mgr.y (mgr.14140) 233 : audit [DBG] from='client.24358 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-03-10T20:04:46.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:45 gibba023 bash[9844]: cluster 2021-03-10T20:04:44.730452+0000 mgr.y (mgr.14140) 234 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:46.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:45 gibba023 bash[13032]: cluster 2021-03-10T20:04:44.730452+0000 mgr.y (mgr.14140) 234 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:46.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:45 gibba044 bash[9859]: cluster 2021-03-10T20:04:44.730452+0000 mgr.y (mgr.14140) 234 : cluster [DBG] pgmap v220: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:48.132 INFO:teuthology.orchestra.run.gibba023.stdout: 2021-03-10T20:04:48.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:47 gibba023 bash[9844]: cluster 2021-03-10T20:04:46.731267+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:48.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:47 gibba023 bash[13032]: cluster 2021-03-10T20:04:46.731267+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:48.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:47 gibba044 bash[9859]: cluster 2021-03-10T20:04:46.731267+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v221: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:48.885 INFO:teuthology.orchestra.run.gibba023.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-03-10T20:04:48.885 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2021-03-10T20:04:48.886 INFO:tasks.cephadm:Setup complete, yielding 2021-03-10T20:04:48.886 INFO:teuthology.run_tasks:Running task cephadm.shell... 2021-03-10T20:04:48.893 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@gibba023.front.sepia.ceph.com 2021-03-10T20:04:48.894 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest false --force' 2021-03-10T20:04:49.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:48 gibba023 bash[9844]: audit 2021-03-10T20:04:48.128695+0000 mon.a (mon.0) 546 : audit [DBG] from='client.? 172.21.2.123:0/3795075028' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-03-10T20:04:49.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:48 gibba023 bash[13032]: audit 2021-03-10T20:04:48.128695+0000 mon.a (mon.0) 546 : audit [DBG] from='client.? 172.21.2.123:0/3795075028' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-03-10T20:04:49.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:48 gibba044 bash[9859]: audit 2021-03-10T20:04:48.128695+0000 mon.a (mon.0) 546 : audit [DBG] from='client.? 172.21.2.123:0/3795075028' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-03-10T20:04:50.145 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:49 gibba023 bash[9844]: cluster 2021-03-10T20:04:48.732230+0000 mgr.y (mgr.14140) 236 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:50.146 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:49 gibba023 bash[13032]: cluster 2021-03-10T20:04:48.732230+0000 mgr.y (mgr.14140) 236 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:50.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:49 gibba044 bash[9859]: cluster 2021-03-10T20:04:48.732230+0000 mgr.y (mgr.14140) 236 : cluster [DBG] pgmap v222: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:52.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:51 gibba023 bash[9844]: cluster 2021-03-10T20:04:50.732993+0000 mgr.y (mgr.14140) 237 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:52.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:51 gibba023 bash[9844]: audit 2021-03-10T20:04:51.764829+0000 mon.a (mon.0) 547 : audit [INF] from='client.? 172.21.2.123:0/472350220' entity='client.admin' cmd=[{"prefix": "config set", "who": "mgr", "name": "mgr/cephadm/use_repo_digest", "value": "false", "force": true}]: dispatch 2021-03-10T20:04:52.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:51 gibba023 bash[9844]: audit 2021-03-10T20:04:51.769847+0000 mon.a (mon.0) 548 : audit [INF] from='client.? 172.21.2.123:0/472350220' entity='client.admin' cmd='[{"prefix": "config set", "who": "mgr", "name": "mgr/cephadm/use_repo_digest", "value": "false", "force": true}]': finished 2021-03-10T20:04:52.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:51 gibba023 bash[13032]: cluster 2021-03-10T20:04:50.732993+0000 mgr.y (mgr.14140) 237 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:52.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:51 gibba023 bash[13032]: audit 2021-03-10T20:04:51.764829+0000 mon.a (mon.0) 547 : audit [INF] from='client.? 172.21.2.123:0/472350220' entity='client.admin' cmd=[{"prefix": "config set", "who": "mgr", "name": "mgr/cephadm/use_repo_digest", "value": "false", "force": true}]: dispatch 2021-03-10T20:04:52.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:51 gibba023 bash[13032]: audit 2021-03-10T20:04:51.769847+0000 mon.a (mon.0) 548 : audit [INF] from='client.? 172.21.2.123:0/472350220' entity='client.admin' cmd='[{"prefix": "config set", "who": "mgr", "name": "mgr/cephadm/use_repo_digest", "value": "false", "force": true}]': finished 2021-03-10T20:04:52.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:51 gibba044 bash[9859]: cluster 2021-03-10T20:04:50.732993+0000 mgr.y (mgr.14140) 237 : cluster [DBG] pgmap v223: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:52.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:51 gibba044 bash[9859]: audit 2021-03-10T20:04:51.764829+0000 mon.a (mon.0) 547 : audit [INF] from='client.? 172.21.2.123:0/472350220' entity='client.admin' cmd=[{"prefix": "config set", "who": "mgr", "name": "mgr/cephadm/use_repo_digest", "value": "false", "force": true}]: dispatch 2021-03-10T20:04:52.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:51 gibba044 bash[9859]: audit 2021-03-10T20:04:51.769847+0000 mon.a (mon.0) 548 : audit [INF] from='client.? 172.21.2.123:0/472350220' entity='client.admin' cmd='[{"prefix": "config set", "who": "mgr", "name": "mgr/cephadm/use_repo_digest", "value": "false", "force": true}]': finished 2021-03-10T20:04:52.506 INFO:teuthology.run_tasks:Running task cephadm.shell... 2021-03-10T20:04:52.529 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@gibba023.front.sepia.ceph.com 2021-03-10T20:04:52.530 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'radosgw-admin realm create --rgw-realm=r --default' 2021-03-10T20:04:54.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:53 gibba023 bash[9844]: cluster 2021-03-10T20:04:52.733721+0000 mgr.y (mgr.14140) 238 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:54.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:53 gibba023 bash[13032]: cluster 2021-03-10T20:04:52.733721+0000 mgr.y (mgr.14140) 238 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:54.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:53 gibba044 bash[9859]: cluster 2021-03-10T20:04:52.733721+0000 mgr.y (mgr.14140) 238 : cluster [DBG] pgmap v224: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:56.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:55 gibba023 bash[9844]: cluster 2021-03-10T20:04:54.734672+0000 mgr.y (mgr.14140) 239 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:56.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:55 gibba023 bash[13032]: cluster 2021-03-10T20:04:54.734672+0000 mgr.y (mgr.14140) 239 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:56.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:55 gibba044 bash[9859]: cluster 2021-03-10T20:04:54.734672+0000 mgr.y (mgr.14140) 239 : cluster [DBG] pgmap v225: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:56.897 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:04:56.898 INFO:teuthology.orchestra.run.gibba023.stdout: "id": "33867f59-0c27-483a-9fdf-d2dccb5a7059", 2021-03-10T20:04:56.898 INFO:teuthology.orchestra.run.gibba023.stdout: "name": "r", 2021-03-10T20:04:56.898 INFO:teuthology.orchestra.run.gibba023.stdout: "current_period": "9296034c-9b5f-4d76-953e-b4bdeb26251f", 2021-03-10T20:04:56.899 INFO:teuthology.orchestra.run.gibba023.stdout: "epoch": 1 2021-03-10T20:04:56.899 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:04:57.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:56 gibba023 bash[9844]: cluster 2021-03-10T20:04:55.870363+0000 mon.a (mon.0) 549 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2021-03-10T20:04:57.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:56 gibba023 bash[9844]: audit 2021-03-10T20:04:55.871540+0000 mon.c (mon.1) 24 : audit [INF] from='client.? 172.21.2.123:0/3830739171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T20:04:57.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:56 gibba023 bash[9844]: audit 2021-03-10T20:04:55.875686+0000 mon.a (mon.0) 550 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T20:04:57.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:56 gibba023 bash[13032]: cluster 2021-03-10T20:04:55.870363+0000 mon.a (mon.0) 549 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2021-03-10T20:04:57.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:56 gibba023 bash[13032]: audit 2021-03-10T20:04:55.871540+0000 mon.c (mon.1) 24 : audit [INF] from='client.? 172.21.2.123:0/3830739171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T20:04:57.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:56 gibba023 bash[13032]: audit 2021-03-10T20:04:55.875686+0000 mon.a (mon.0) 550 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T20:04:57.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:56 gibba044 bash[9859]: cluster 2021-03-10T20:04:55.870363+0000 mon.a (mon.0) 549 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2021-03-10T20:04:57.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:56 gibba044 bash[9859]: audit 2021-03-10T20:04:55.871540+0000 mon.c (mon.1) 24 : audit [INF] from='client.? 172.21.2.123:0/3830739171' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T20:04:57.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:56 gibba044 bash[9859]: audit 2021-03-10T20:04:55.875686+0000 mon.a (mon.0) 550 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-03-10T20:04:57.594 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'radosgw-admin zonegroup create --rgw-zonegroup=default --master --default' 2021-03-10T20:04:58.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:57 gibba023 bash[9844]: cluster 2021-03-10T20:04:56.735750+0000 mgr.y (mgr.14140) 240 : cluster [DBG] pgmap v227: 33 pgs: 11 creating+peering, 1 active+clean, 21 unknown; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:58.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:57 gibba023 bash[9844]: audit 2021-03-10T20:04:56.874136+0000 mon.a (mon.0) 551 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-03-10T20:04:58.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:57 gibba023 bash[9844]: cluster 2021-03-10T20:04:56.874213+0000 mon.a (mon.0) 552 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-03-10T20:04:58.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:57 gibba023 bash[13032]: cluster 2021-03-10T20:04:56.735750+0000 mgr.y (mgr.14140) 240 : cluster [DBG] pgmap v227: 33 pgs: 11 creating+peering, 1 active+clean, 21 unknown; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:58.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:57 gibba023 bash[13032]: audit 2021-03-10T20:04:56.874136+0000 mon.a (mon.0) 551 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-03-10T20:04:58.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:57 gibba023 bash[13032]: cluster 2021-03-10T20:04:56.874213+0000 mon.a (mon.0) 552 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-03-10T20:04:58.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:57 gibba044 bash[9859]: cluster 2021-03-10T20:04:56.735750+0000 mgr.y (mgr.14140) 240 : cluster [DBG] pgmap v227: 33 pgs: 11 creating+peering, 1 active+clean, 21 unknown; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:04:58.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:57 gibba044 bash[9859]: audit 2021-03-10T20:04:56.874136+0000 mon.a (mon.0) 551 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-03-10T20:04:58.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:57 gibba044 bash[9859]: cluster 2021-03-10T20:04:56.874213+0000 mon.a (mon.0) 552 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-03-10T20:04:59.061 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:58 gibba023 bash[9844]: cluster 2021-03-10T20:04:57.889146+0000 mon.a (mon.0) 553 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-03-10T20:04:59.062 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:58 gibba023 bash[13032]: cluster 2021-03-10T20:04:57.889146+0000 mon.a (mon.0) 553 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-03-10T20:04:59.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:58 gibba044 bash[9859]: cluster 2021-03-10T20:04:57.889146+0000 mon.a (mon.0) 553 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-03-10T20:05:00.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:04:59 gibba023 bash[9844]: cluster 2021-03-10T20:04:58.736485+0000 mgr.y (mgr.14140) 241 : cluster [DBG] pgmap v230: 33 pgs: 11 creating+peering, 3 active+clean, 19 unknown; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:00.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:04:59 gibba023 bash[13032]: cluster 2021-03-10T20:04:58.736485+0000 mgr.y (mgr.14140) 241 : cluster [DBG] pgmap v230: 33 pgs: 11 creating+peering, 3 active+clean, 19 unknown; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:00.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:04:59 gibba044 bash[9859]: cluster 2021-03-10T20:04:58.736485+0000 mgr.y (mgr.14140) 241 : cluster [DBG] pgmap v230: 33 pgs: 11 creating+peering, 3 active+clean, 19 unknown; 0 B data, 3.6 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:05:00.491 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:05:00.492 INFO:teuthology.orchestra.run.gibba023.stdout: "id": "dec014ee-4337-42f3-a392-a861e6e486a3", 2021-03-10T20:05:00.492 INFO:teuthology.orchestra.run.gibba023.stdout: "name": "default", 2021-03-10T20:05:00.492 INFO:teuthology.orchestra.run.gibba023.stdout: "api_name": "default", 2021-03-10T20:05:00.492 INFO:teuthology.orchestra.run.gibba023.stdout: "is_master": "true", 2021-03-10T20:05:00.493 INFO:teuthology.orchestra.run.gibba023.stdout: "endpoints": [], 2021-03-10T20:05:00.493 INFO:teuthology.orchestra.run.gibba023.stdout: "hostnames": [], 2021-03-10T20:05:00.493 INFO:teuthology.orchestra.run.gibba023.stdout: "hostnames_s3website": [], 2021-03-10T20:05:00.493 INFO:teuthology.orchestra.run.gibba023.stdout: "master_zone": "", 2021-03-10T20:05:00.493 INFO:teuthology.orchestra.run.gibba023.stdout: "zones": [], 2021-03-10T20:05:00.494 INFO:teuthology.orchestra.run.gibba023.stdout: "placement_targets": [], 2021-03-10T20:05:00.494 INFO:teuthology.orchestra.run.gibba023.stdout: "default_placement": "", 2021-03-10T20:05:00.494 INFO:teuthology.orchestra.run.gibba023.stdout: "realm_id": "33867f59-0c27-483a-9fdf-d2dccb5a7059", 2021-03-10T20:05:00.494 INFO:teuthology.orchestra.run.gibba023.stdout: "sync_policy": { 2021-03-10T20:05:00.495 INFO:teuthology.orchestra.run.gibba023.stdout: "groups": [] 2021-03-10T20:05:00.495 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:05:00.495 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:05:01.245 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default' 2021-03-10T20:05:02.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:01 gibba023 bash[9844]: cluster 2021-03-10T20:05:00.737407+0000 mgr.y (mgr.14140) 242 : cluster [DBG] pgmap v231: 33 pgs: 11 creating+peering, 12 active+clean, 10 unknown; 80 B data, 3.8 MiB used, 664 GiB / 672 GiB avail; 341 B/s wr, 0 op/s 2021-03-10T20:05:02.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:01 gibba023 bash[13032]: cluster 2021-03-10T20:05:00.737407+0000 mgr.y (mgr.14140) 242 : cluster [DBG] pgmap v231: 33 pgs: 11 creating+peering, 12 active+clean, 10 unknown; 80 B data, 3.8 MiB used, 664 GiB / 672 GiB avail; 341 B/s wr, 0 op/s 2021-03-10T20:05:02.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:01 gibba044 bash[9859]: cluster 2021-03-10T20:05:00.737407+0000 mgr.y (mgr.14140) 242 : cluster [DBG] pgmap v231: 33 pgs: 11 creating+peering, 12 active+clean, 10 unknown; 80 B data, 3.8 MiB used, 664 GiB / 672 GiB avail; 341 B/s wr, 0 op/s 2021-03-10T20:05:04.064 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:05:04.064 INFO:teuthology.orchestra.run.gibba023.stdout: "id": "b88f2ada-634f-4325-86fe-6efdf34ae03d", 2021-03-10T20:05:04.064 INFO:teuthology.orchestra.run.gibba023.stdout: "name": "z", 2021-03-10T20:05:04.064 INFO:teuthology.orchestra.run.gibba023.stdout: "domain_root": "z.rgw.meta:root", 2021-03-10T20:05:04.065 INFO:teuthology.orchestra.run.gibba023.stdout: "control_pool": "z.rgw.control", 2021-03-10T20:05:04.065 INFO:teuthology.orchestra.run.gibba023.stdout: "gc_pool": "z.rgw.log:gc", 2021-03-10T20:05:04.065 INFO:teuthology.orchestra.run.gibba023.stdout: "lc_pool": "z.rgw.log:lc", 2021-03-10T20:05:04.065 INFO:teuthology.orchestra.run.gibba023.stdout: "log_pool": "z.rgw.log", 2021-03-10T20:05:04.066 INFO:teuthology.orchestra.run.gibba023.stdout: "intent_log_pool": "z.rgw.log:intent", 2021-03-10T20:05:04.066 INFO:teuthology.orchestra.run.gibba023.stdout: "usage_log_pool": "z.rgw.log:usage", 2021-03-10T20:05:04.066 INFO:teuthology.orchestra.run.gibba023.stdout: "roles_pool": "z.rgw.meta:roles", 2021-03-10T20:05:04.066 INFO:teuthology.orchestra.run.gibba023.stdout: "reshard_pool": "z.rgw.log:reshard", 2021-03-10T20:05:04.066 INFO:teuthology.orchestra.run.gibba023.stdout: "user_keys_pool": "z.rgw.meta:users.keys", 2021-03-10T20:05:04.067 INFO:teuthology.orchestra.run.gibba023.stdout: "user_email_pool": "z.rgw.meta:users.email", 2021-03-10T20:05:04.067 INFO:teuthology.orchestra.run.gibba023.stdout: "user_swift_pool": "z.rgw.meta:users.swift", 2021-03-10T20:05:04.067 INFO:teuthology.orchestra.run.gibba023.stdout: "user_uid_pool": "z.rgw.meta:users.uid", 2021-03-10T20:05:04.067 INFO:teuthology.orchestra.run.gibba023.stdout: "otp_pool": "z.rgw.otp", 2021-03-10T20:05:04.068 INFO:teuthology.orchestra.run.gibba023.stdout: "system_key": { 2021-03-10T20:05:04.068 INFO:teuthology.orchestra.run.gibba023.stdout: "access_key": "", 2021-03-10T20:05:04.068 INFO:teuthology.orchestra.run.gibba023.stdout: "secret_key": "" 2021-03-10T20:05:04.068 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:05:04.069 INFO:teuthology.orchestra.run.gibba023.stdout: "placement_pools": [ 2021-03-10T20:05:04.069 INFO:teuthology.orchestra.run.gibba023.stdout: { 2021-03-10T20:05:04.069 INFO:teuthology.orchestra.run.gibba023.stdout: "key": "default-placement", 2021-03-10T20:05:04.069 INFO:teuthology.orchestra.run.gibba023.stdout: "val": { 2021-03-10T20:05:04.070 INFO:teuthology.orchestra.run.gibba023.stdout: "index_pool": "z.rgw.buckets.index", 2021-03-10T20:05:04.070 INFO:teuthology.orchestra.run.gibba023.stdout: "storage_classes": { 2021-03-10T20:05:04.070 INFO:teuthology.orchestra.run.gibba023.stdout: "STANDARD": { 2021-03-10T20:05:04.070 INFO:teuthology.orchestra.run.gibba023.stdout: "data_pool": "z.rgw.buckets.data" 2021-03-10T20:05:04.070 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:05:04.071 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:05:04.071 INFO:teuthology.orchestra.run.gibba023.stdout: "data_extra_pool": "z.rgw.buckets.non-ec", 2021-03-10T20:05:04.071 INFO:teuthology.orchestra.run.gibba023.stdout: "index_type": 0 2021-03-10T20:05:04.071 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:05:04.071 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:05:04.072 INFO:teuthology.orchestra.run.gibba023.stdout: ], 2021-03-10T20:05:04.072 INFO:teuthology.orchestra.run.gibba023.stdout: "realm_id": "33867f59-0c27-483a-9fdf-d2dccb5a7059" 2021-03-10T20:05:04.075 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:05:04.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:03 gibba044 bash[9859]: cluster 2021-03-10T20:05:02.738357+0000 mgr.y (mgr.14140) 243 : cluster [DBG] pgmap v232: 33 pgs: 33 active+clean; 680 B data, 3.9 MiB used, 664 GiB / 672 GiB avail; 297 B/s rd, 1.3 KiB/s wr, 2 op/s 2021-03-10T20:05:04.285 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:03 gibba023 bash[9844]: cluster 2021-03-10T20:05:02.738357+0000 mgr.y (mgr.14140) 243 : cluster [DBG] pgmap v232: 33 pgs: 33 active+clean; 680 B data, 3.9 MiB used, 664 GiB / 672 GiB avail; 297 B/s rd, 1.3 KiB/s wr, 2 op/s 2021-03-10T20:05:04.285 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:03 gibba023 bash[13032]: cluster 2021-03-10T20:05:02.738357+0000 mgr.y (mgr.14140) 243 : cluster [DBG] pgmap v232: 33 pgs: 33 active+clean; 680 B data, 3.9 MiB used, 664 GiB / 672 GiB avail; 297 B/s rd, 1.3 KiB/s wr, 2 op/s 2021-03-10T20:05:04.747 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'radosgw-admin period update --rgw-realm=r --commit' 2021-03-10T20:05:06.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:05 gibba044 bash[9859]: cluster 2021-03-10T20:05:04.738743+0000 mgr.y (mgr.14140) 244 : cluster [DBG] pgmap v233: 33 pgs: 33 active+clean; 818 B data, 4.0 MiB used, 664 GiB / 672 GiB avail; 383 B/s rd, 1.6 KiB/s wr, 2 op/s 2021-03-10T20:05:06.413 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:05 gibba023 bash[9844]: cluster 2021-03-10T20:05:04.738743+0000 mgr.y (mgr.14140) 244 : cluster [DBG] pgmap v233: 33 pgs: 33 active+clean; 818 B data, 4.0 MiB used, 664 GiB / 672 GiB avail; 383 B/s rd, 1.6 KiB/s wr, 2 op/s 2021-03-10T20:05:06.413 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:05 gibba023 bash[13032]: cluster 2021-03-10T20:05:04.738743+0000 mgr.y (mgr.14140) 244 : cluster [DBG] pgmap v233: 33 pgs: 33 active+clean; 818 B data, 4.0 MiB used, 664 GiB / 672 GiB avail; 383 B/s rd, 1.6 KiB/s wr, 2 op/s 2021-03-10T20:05:08.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:07 gibba044 bash[9859]: cluster 2021-03-10T20:05:06.739359+0000 mgr.y (mgr.14140) 245 : cluster [DBG] pgmap v234: 33 pgs: 33 active+clean; 1.8 KiB data, 4.0 MiB used, 664 GiB / 672 GiB avail; 518 B/s rd, 1.6 KiB/s wr, 2 op/s 2021-03-10T20:05:08.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:07 gibba023 bash[9844]: cluster 2021-03-10T20:05:06.739359+0000 mgr.y (mgr.14140) 245 : cluster [DBG] pgmap v234: 33 pgs: 33 active+clean; 1.8 KiB data, 4.0 MiB used, 664 GiB / 672 GiB avail; 518 B/s rd, 1.6 KiB/s wr, 2 op/s 2021-03-10T20:05:08.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:07 gibba023 bash[13032]: cluster 2021-03-10T20:05:06.739359+0000 mgr.y (mgr.14140) 245 : cluster [DBG] pgmap v234: 33 pgs: 33 active+clean; 1.8 KiB data, 4.0 MiB used, 664 GiB / 672 GiB avail; 518 B/s rd, 1.6 KiB/s wr, 2 op/s 2021-03-10T20:05:09.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:08 gibba044 bash[9859]: cluster 2021-03-10T20:05:07.954367+0000 mon.a (mon.0) 554 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-03-10T20:05:09.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:08 gibba044 bash[9859]: audit 2021-03-10T20:05:07.955425+0000 mon.a (mon.0) 555 : audit [INF] from='client.? 172.21.2.123:0/2261331745' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2021-03-10T20:05:09.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:08 gibba023 bash[9844]: cluster 2021-03-10T20:05:07.954367+0000 mon.a (mon.0) 554 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-03-10T20:05:09.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:08 gibba023 bash[9844]: audit 2021-03-10T20:05:07.955425+0000 mon.a (mon.0) 555 : audit [INF] from='client.? 172.21.2.123:0/2261331745' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2021-03-10T20:05:09.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:08 gibba023 bash[13032]: cluster 2021-03-10T20:05:07.954367+0000 mon.a (mon.0) 554 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-03-10T20:05:09.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:08 gibba023 bash[13032]: audit 2021-03-10T20:05:07.955425+0000 mon.a (mon.0) 555 : audit [INF] from='client.? 172.21.2.123:0/2261331745' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2021-03-10T20:05:10.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:09 gibba044 bash[9859]: cluster 2021-03-10T20:05:08.740466+0000 mgr.y (mgr.14140) 246 : cluster [DBG] pgmap v236: 65 pgs: 6 creating+peering, 26 unknown, 33 active+clean; 1.8 KiB data, 4.0 MiB used, 664 GiB / 672 GiB avail; 511 B/s rd, 1.6 KiB/s wr, 2 op/s 2021-03-10T20:05:10.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:09 gibba044 bash[9859]: audit 2021-03-10T20:05:08.958326+0000 mon.a (mon.0) 556 : audit [INF] from='client.? 172.21.2.123:0/2261331745' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2021-03-10T20:05:10.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:09 gibba044 bash[9859]: cluster 2021-03-10T20:05:08.958383+0000 mon.a (mon.0) 557 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-03-10T20:05:10.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:09 gibba023 bash[9844]: cluster 2021-03-10T20:05:08.740466+0000 mgr.y (mgr.14140) 246 : cluster [DBG] pgmap v236: 65 pgs: 6 creating+peering, 26 unknown, 33 active+clean; 1.8 KiB data, 4.0 MiB used, 664 GiB / 672 GiB avail; 511 B/s rd, 1.6 KiB/s wr, 2 op/s 2021-03-10T20:05:10.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:09 gibba023 bash[9844]: audit 2021-03-10T20:05:08.958326+0000 mon.a (mon.0) 556 : audit [INF] from='client.? 172.21.2.123:0/2261331745' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2021-03-10T20:05:10.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:09 gibba023 bash[9844]: cluster 2021-03-10T20:05:08.958383+0000 mon.a (mon.0) 557 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-03-10T20:05:10.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:09 gibba023 bash[13032]: cluster 2021-03-10T20:05:08.740466+0000 mgr.y (mgr.14140) 246 : cluster [DBG] pgmap v236: 65 pgs: 6 creating+peering, 26 unknown, 33 active+clean; 1.8 KiB data, 4.0 MiB used, 664 GiB / 672 GiB avail; 511 B/s rd, 1.6 KiB/s wr, 2 op/s 2021-03-10T20:05:10.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:09 gibba023 bash[13032]: audit 2021-03-10T20:05:08.958326+0000 mon.a (mon.0) 556 : audit [INF] from='client.? 172.21.2.123:0/2261331745' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2021-03-10T20:05:10.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:09 gibba023 bash[13032]: cluster 2021-03-10T20:05:08.958383+0000 mon.a (mon.0) 557 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-03-10T20:05:11.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:10 gibba044 bash[9859]: cluster 2021-03-10T20:05:09.978775+0000 mon.a (mon.0) 558 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-03-10T20:05:11.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:10 gibba044 bash[9859]: audit 2021-03-10T20:05:09.979197+0000 mon.a (mon.0) 559 : audit [INF] from='client.? 172.21.2.123:0/2261331745' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2021-03-10T20:05:11.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:10 gibba023 bash[9844]: cluster 2021-03-10T20:05:09.978775+0000 mon.a (mon.0) 558 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-03-10T20:05:11.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:10 gibba023 bash[9844]: audit 2021-03-10T20:05:09.979197+0000 mon.a (mon.0) 559 : audit [INF] from='client.? 172.21.2.123:0/2261331745' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2021-03-10T20:05:11.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:10 gibba023 bash[13032]: cluster 2021-03-10T20:05:09.978775+0000 mon.a (mon.0) 558 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-03-10T20:05:11.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:10 gibba023 bash[13032]: audit 2021-03-10T20:05:09.979197+0000 mon.a (mon.0) 559 : audit [INF] from='client.? 172.21.2.123:0/2261331745' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2021-03-10T20:05:12.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:12 gibba023 bash[9844]: cluster 2021-03-10T20:05:10.741561+0000 mgr.y (mgr.14140) 247 : cluster [DBG] pgmap v239: 97 pgs: 8 creating+peering, 46 unknown, 43 active+clean; 1.8 KiB data, 4.1 MiB used, 664 GiB / 672 GiB avail; 1023 B/s rd, 511 B/s wr, 1 op/s 2021-03-10T20:05:12.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:12 gibba023 bash[9844]: audit 2021-03-10T20:05:11.000971+0000 mon.a (mon.0) 560 : audit [INF] from='client.? 172.21.2.123:0/2261331745' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2021-03-10T20:05:12.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:12 gibba023 bash[9844]: cluster 2021-03-10T20:05:11.001088+0000 mon.a (mon.0) 561 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-03-10T20:05:12.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:12 gibba023 bash[13032]: cluster 2021-03-10T20:05:10.741561+0000 mgr.y (mgr.14140) 247 : cluster [DBG] pgmap v239: 97 pgs: 8 creating+peering, 46 unknown, 43 active+clean; 1.8 KiB data, 4.1 MiB used, 664 GiB / 672 GiB avail; 1023 B/s rd, 511 B/s wr, 1 op/s 2021-03-10T20:05:12.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:12 gibba023 bash[13032]: audit 2021-03-10T20:05:11.000971+0000 mon.a (mon.0) 560 : audit [INF] from='client.? 172.21.2.123:0/2261331745' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2021-03-10T20:05:12.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:12 gibba023 bash[13032]: cluster 2021-03-10T20:05:11.001088+0000 mon.a (mon.0) 561 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-03-10T20:05:12.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:12 gibba044 bash[9859]: cluster 2021-03-10T20:05:10.741561+0000 mgr.y (mgr.14140) 247 : cluster [DBG] pgmap v239: 97 pgs: 8 creating+peering, 46 unknown, 43 active+clean; 1.8 KiB data, 4.1 MiB used, 664 GiB / 672 GiB avail; 1023 B/s rd, 511 B/s wr, 1 op/s 2021-03-10T20:05:12.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:12 gibba044 bash[9859]: audit 2021-03-10T20:05:11.000971+0000 mon.a (mon.0) 560 : audit [INF] from='client.? 172.21.2.123:0/2261331745' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2021-03-10T20:05:12.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:12 gibba044 bash[9859]: cluster 2021-03-10T20:05:11.001088+0000 mon.a (mon.0) 561 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-03-10T20:05:13.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:13 gibba023 bash[9844]: cluster 2021-03-10T20:05:12.014317+0000 mon.a (mon.0) 562 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-03-10T20:05:13.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:13 gibba023 bash[9844]: audit 2021-03-10T20:05:12.014833+0000 mon.a (mon.0) 563 : audit [INF] from='client.? 172.21.2.123:0/667138557' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2021-03-10T20:05:13.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:13 gibba023 bash[13032]: cluster 2021-03-10T20:05:12.014317+0000 mon.a (mon.0) 562 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-03-10T20:05:13.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:13 gibba023 bash[13032]: audit 2021-03-10T20:05:12.014833+0000 mon.a (mon.0) 563 : audit [INF] from='client.? 172.21.2.123:0/667138557' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2021-03-10T20:05:13.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:13 gibba044 bash[9859]: cluster 2021-03-10T20:05:12.014317+0000 mon.a (mon.0) 562 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-03-10T20:05:13.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:13 gibba044 bash[9859]: audit 2021-03-10T20:05:12.014833+0000 mon.a (mon.0) 563 : audit [INF] from='client.? 172.21.2.123:0/667138557' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2021-03-10T20:05:14.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:14 gibba023 bash[9844]: cluster 2021-03-10T20:05:12.742721+0000 mgr.y (mgr.14140) 248 : cluster [DBG] pgmap v242: 129 pgs: 9 creating+peering, 56 unknown, 64 active+clean; 1.8 KiB data, 4.2 MiB used, 664 GiB / 672 GiB avail; 4.2 KiB/s rd, 4 op/s 2021-03-10T20:05:14.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:14 gibba023 bash[9844]: audit 2021-03-10T20:05:13.030961+0000 mon.a (mon.0) 564 : audit [INF] from='client.? 172.21.2.123:0/667138557' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2021-03-10T20:05:14.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:14 gibba023 bash[9844]: cluster 2021-03-10T20:05:13.031061+0000 mon.a (mon.0) 565 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-03-10T20:05:14.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:14 gibba023 bash[9844]: audit 2021-03-10T20:05:13.031921+0000 mon.a (mon.0) 566 : audit [INF] from='client.? 172.21.2.123:0/667138557' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-03-10T20:05:14.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:14 gibba023 bash[13032]: cluster 2021-03-10T20:05:12.742721+0000 mgr.y (mgr.14140) 248 : cluster [DBG] pgmap v242: 129 pgs: 9 creating+peering, 56 unknown, 64 active+clean; 1.8 KiB data, 4.2 MiB used, 664 GiB / 672 GiB avail; 4.2 KiB/s rd, 4 op/s 2021-03-10T20:05:14.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:14 gibba023 bash[13032]: audit 2021-03-10T20:05:13.030961+0000 mon.a (mon.0) 564 : audit [INF] from='client.? 172.21.2.123:0/667138557' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2021-03-10T20:05:14.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:14 gibba023 bash[13032]: cluster 2021-03-10T20:05:13.031061+0000 mon.a (mon.0) 565 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-03-10T20:05:14.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:14 gibba023 bash[13032]: audit 2021-03-10T20:05:13.031921+0000 mon.a (mon.0) 566 : audit [INF] from='client.? 172.21.2.123:0/667138557' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-03-10T20:05:14.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:14 gibba044 bash[9859]: cluster 2021-03-10T20:05:12.742721+0000 mgr.y (mgr.14140) 248 : cluster [DBG] pgmap v242: 129 pgs: 9 creating+peering, 56 unknown, 64 active+clean; 1.8 KiB data, 4.2 MiB used, 664 GiB / 672 GiB avail; 4.2 KiB/s rd, 4 op/s 2021-03-10T20:05:14.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:14 gibba044 bash[9859]: audit 2021-03-10T20:05:13.030961+0000 mon.a (mon.0) 564 : audit [INF] from='client.? 172.21.2.123:0/667138557' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2021-03-10T20:05:14.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:14 gibba044 bash[9859]: cluster 2021-03-10T20:05:13.031061+0000 mon.a (mon.0) 565 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-03-10T20:05:14.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:14 gibba044 bash[9859]: audit 2021-03-10T20:05:13.031921+0000 mon.a (mon.0) 566 : audit [INF] from='client.? 172.21.2.123:0/667138557' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-03-10T20:05:15.274 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:05:15.275 INFO:teuthology.orchestra.run.gibba023.stdout: "id": "8ea3f271-46e3-4155-9b97-5d9455d78211", 2021-03-10T20:05:15.275 INFO:teuthology.orchestra.run.gibba023.stdout: "epoch": 1, 2021-03-10T20:05:15.275 INFO:teuthology.orchestra.run.gibba023.stdout: "predecessor_uuid": "9296034c-9b5f-4d76-953e-b4bdeb26251f", 2021-03-10T20:05:15.275 INFO:teuthology.orchestra.run.gibba023.stdout: "sync_status": [], 2021-03-10T20:05:15.276 INFO:teuthology.orchestra.run.gibba023.stdout: "period_map": { 2021-03-10T20:05:15.276 INFO:teuthology.orchestra.run.gibba023.stdout: "id": "8ea3f271-46e3-4155-9b97-5d9455d78211", 2021-03-10T20:05:15.276 INFO:teuthology.orchestra.run.gibba023.stdout: "zonegroups": [ 2021-03-10T20:05:15.276 INFO:teuthology.orchestra.run.gibba023.stdout: { 2021-03-10T20:05:15.276 INFO:teuthology.orchestra.run.gibba023.stdout: "id": "dec014ee-4337-42f3-a392-a861e6e486a3", 2021-03-10T20:05:15.277 INFO:teuthology.orchestra.run.gibba023.stdout: "name": "default", 2021-03-10T20:05:15.277 INFO:teuthology.orchestra.run.gibba023.stdout: "api_name": "default", 2021-03-10T20:05:15.277 INFO:teuthology.orchestra.run.gibba023.stdout: "is_master": "true", 2021-03-10T20:05:15.277 INFO:teuthology.orchestra.run.gibba023.stdout: "endpoints": [], 2021-03-10T20:05:15.278 INFO:teuthology.orchestra.run.gibba023.stdout: "hostnames": [], 2021-03-10T20:05:15.278 INFO:teuthology.orchestra.run.gibba023.stdout: "hostnames_s3website": [], 2021-03-10T20:05:15.278 INFO:teuthology.orchestra.run.gibba023.stdout: "master_zone": "b88f2ada-634f-4325-86fe-6efdf34ae03d", 2021-03-10T20:05:15.278 INFO:teuthology.orchestra.run.gibba023.stdout: "zones": [ 2021-03-10T20:05:15.279 INFO:teuthology.orchestra.run.gibba023.stdout: { 2021-03-10T20:05:15.279 INFO:teuthology.orchestra.run.gibba023.stdout: "id": "b88f2ada-634f-4325-86fe-6efdf34ae03d", 2021-03-10T20:05:15.279 INFO:teuthology.orchestra.run.gibba023.stdout: "name": "z", 2021-03-10T20:05:15.279 INFO:teuthology.orchestra.run.gibba023.stdout: "endpoints": [], 2021-03-10T20:05:15.280 INFO:teuthology.orchestra.run.gibba023.stdout: "log_meta": "false", 2021-03-10T20:05:15.280 INFO:teuthology.orchestra.run.gibba023.stdout: "log_data": "false", 2021-03-10T20:05:15.280 INFO:teuthology.orchestra.run.gibba023.stdout: "bucket_index_max_shards": 11, 2021-03-10T20:05:15.280 INFO:teuthology.orchestra.run.gibba023.stdout: "read_only": "false", 2021-03-10T20:05:15.281 INFO:teuthology.orchestra.run.gibba023.stdout: "tier_type": "", 2021-03-10T20:05:15.281 INFO:teuthology.orchestra.run.gibba023.stdout: "sync_from_all": "true", 2021-03-10T20:05:15.281 INFO:teuthology.orchestra.run.gibba023.stdout: "sync_from": [], 2021-03-10T20:05:15.281 INFO:teuthology.orchestra.run.gibba023.stdout: "redirect_zone": "" 2021-03-10T20:05:15.281 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:05:15.282 INFO:teuthology.orchestra.run.gibba023.stdout: ], 2021-03-10T20:05:15.282 INFO:teuthology.orchestra.run.gibba023.stdout: "placement_targets": [ 2021-03-10T20:05:15.282 INFO:teuthology.orchestra.run.gibba023.stdout: { 2021-03-10T20:05:15.282 INFO:teuthology.orchestra.run.gibba023.stdout: "name": "default-placement", 2021-03-10T20:05:15.283 INFO:teuthology.orchestra.run.gibba023.stdout: "tags": [], 2021-03-10T20:05:15.283 INFO:teuthology.orchestra.run.gibba023.stdout: "storage_classes": [ 2021-03-10T20:05:15.283 INFO:teuthology.orchestra.run.gibba023.stdout: "STANDARD" 2021-03-10T20:05:15.283 INFO:teuthology.orchestra.run.gibba023.stdout: ] 2021-03-10T20:05:15.284 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:05:15.284 INFO:teuthology.orchestra.run.gibba023.stdout: ], 2021-03-10T20:05:15.284 INFO:teuthology.orchestra.run.gibba023.stdout: "default_placement": "default-placement", 2021-03-10T20:05:15.284 INFO:teuthology.orchestra.run.gibba023.stdout: "realm_id": "33867f59-0c27-483a-9fdf-d2dccb5a7059", 2021-03-10T20:05:15.285 INFO:teuthology.orchestra.run.gibba023.stdout: "sync_policy": { 2021-03-10T20:05:15.285 INFO:teuthology.orchestra.run.gibba023.stdout: "groups": [] 2021-03-10T20:05:15.285 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:05:15.285 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:05:15.285 INFO:teuthology.orchestra.run.gibba023.stdout: ], 2021-03-10T20:05:15.286 INFO:teuthology.orchestra.run.gibba023.stdout: "short_zone_ids": [ 2021-03-10T20:05:15.286 INFO:teuthology.orchestra.run.gibba023.stdout: { 2021-03-10T20:05:15.286 INFO:teuthology.orchestra.run.gibba023.stdout: "key": "b88f2ada-634f-4325-86fe-6efdf34ae03d", 2021-03-10T20:05:15.286 INFO:teuthology.orchestra.run.gibba023.stdout: "val": 2411391181 2021-03-10T20:05:15.287 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:05:15.287 INFO:teuthology.orchestra.run.gibba023.stdout: ] 2021-03-10T20:05:15.287 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:05:15.287 INFO:teuthology.orchestra.run.gibba023.stdout: "master_zonegroup": "dec014ee-4337-42f3-a392-a861e6e486a3", 2021-03-10T20:05:15.288 INFO:teuthology.orchestra.run.gibba023.stdout: "master_zone": "b88f2ada-634f-4325-86fe-6efdf34ae03d", 2021-03-10T20:05:15.288 INFO:teuthology.orchestra.run.gibba023.stdout: "period_config": { 2021-03-10T20:05:15.288 INFO:teuthology.orchestra.run.gibba023.stdout: "bucket_quota": { 2021-03-10T20:05:15.288 INFO:teuthology.orchestra.run.gibba023.stdout: "enabled": false, 2021-03-10T20:05:15.288 INFO:teuthology.orchestra.run.gibba023.stdout: "check_on_raw": false, 2021-03-10T20:05:15.289 INFO:teuthology.orchestra.run.gibba023.stdout: "max_size": -1, 2021-03-10T20:05:15.289 INFO:teuthology.orchestra.run.gibba023.stdout: "max_size_kb": 0, 2021-03-10T20:05:15.289 INFO:teuthology.orchestra.run.gibba023.stdout: "max_objects": -1 2021-03-10T20:05:15.289 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:05:15.290 INFO:teuthology.orchestra.run.gibba023.stdout: "user_quota": { 2021-03-10T20:05:15.290 INFO:teuthology.orchestra.run.gibba023.stdout: "enabled": false, 2021-03-10T20:05:15.290 INFO:teuthology.orchestra.run.gibba023.stdout: "check_on_raw": false, 2021-03-10T20:05:15.290 INFO:teuthology.orchestra.run.gibba023.stdout: "max_size": -1, 2021-03-10T20:05:15.290 INFO:teuthology.orchestra.run.gibba023.stdout: "max_size_kb": 0, 2021-03-10T20:05:15.291 INFO:teuthology.orchestra.run.gibba023.stdout: "max_objects": -1 2021-03-10T20:05:15.291 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:05:15.291 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:05:15.291 INFO:teuthology.orchestra.run.gibba023.stdout: "realm_id": "33867f59-0c27-483a-9fdf-d2dccb5a7059", 2021-03-10T20:05:15.292 INFO:teuthology.orchestra.run.gibba023.stdout: "realm_name": "r", 2021-03-10T20:05:15.292 INFO:teuthology.orchestra.run.gibba023.stdout: "realm_epoch": 2 2021-03-10T20:05:15.292 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:05:15.413 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:15 gibba023 bash[13032]: audit 2021-03-10T20:05:14.041286+0000 mon.a (mon.0) 567 : audit [INF] from='client.? 172.21.2.123:0/667138557' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-03-10T20:05:15.414 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:15 gibba023 bash[13032]: cluster 2021-03-10T20:05:14.041419+0000 mon.a (mon.0) 568 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-03-10T20:05:15.414 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:15 gibba023 bash[13032]: audit 2021-03-10T20:05:14.042543+0000 mon.a (mon.0) 569 : audit [INF] from='client.? 172.21.2.123:0/667138557' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-03-10T20:05:15.414 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:15 gibba023 bash[13032]: audit 2021-03-10T20:05:15.045299+0000 mon.a (mon.0) 570 : audit [INF] from='client.? 172.21.2.123:0/667138557' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-03-10T20:05:15.415 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:15 gibba023 bash[13032]: cluster 2021-03-10T20:05:15.045360+0000 mon.a (mon.0) 571 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-03-10T20:05:15.415 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:15 gibba023 bash[9844]: audit 2021-03-10T20:05:14.041286+0000 mon.a (mon.0) 567 : audit [INF] from='client.? 172.21.2.123:0/667138557' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-03-10T20:05:15.415 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:15 gibba023 bash[9844]: cluster 2021-03-10T20:05:14.041419+0000 mon.a (mon.0) 568 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-03-10T20:05:15.415 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:15 gibba023 bash[9844]: audit 2021-03-10T20:05:14.042543+0000 mon.a (mon.0) 569 : audit [INF] from='client.? 172.21.2.123:0/667138557' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-03-10T20:05:15.416 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:15 gibba023 bash[9844]: audit 2021-03-10T20:05:15.045299+0000 mon.a (mon.0) 570 : audit [INF] from='client.? 172.21.2.123:0/667138557' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-03-10T20:05:15.416 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:15 gibba023 bash[9844]: cluster 2021-03-10T20:05:15.045360+0000 mon.a (mon.0) 571 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-03-10T20:05:15.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:15 gibba044 bash[9859]: audit 2021-03-10T20:05:14.041286+0000 mon.a (mon.0) 567 : audit [INF] from='client.? 172.21.2.123:0/667138557' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-03-10T20:05:15.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:15 gibba044 bash[9859]: cluster 2021-03-10T20:05:14.041419+0000 mon.a (mon.0) 568 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-03-10T20:05:15.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:15 gibba044 bash[9859]: audit 2021-03-10T20:05:14.042543+0000 mon.a (mon.0) 569 : audit [INF] from='client.? 172.21.2.123:0/667138557' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-03-10T20:05:15.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:15 gibba044 bash[9859]: audit 2021-03-10T20:05:15.045299+0000 mon.a (mon.0) 570 : audit [INF] from='client.? 172.21.2.123:0/667138557' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-03-10T20:05:15.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:15 gibba044 bash[9859]: cluster 2021-03-10T20:05:15.045360+0000 mon.a (mon.0) 571 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-03-10T20:05:16.131 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'ceph orch apply rgw r z --placement=2' 2021-03-10T20:05:16.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:16 gibba023 bash[9844]: cluster 2021-03-10T20:05:14.743878+0000 mgr.y (mgr.14140) 249 : cluster [DBG] pgmap v245: 129 pgs: 1 creating+peering, 18 unknown, 110 active+clean; 1.8 KiB data, 4.5 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 3 op/s 2021-03-10T20:05:16.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:16 gibba023 bash[13032]: cluster 2021-03-10T20:05:14.743878+0000 mgr.y (mgr.14140) 249 : cluster [DBG] pgmap v245: 129 pgs: 1 creating+peering, 18 unknown, 110 active+clean; 1.8 KiB data, 4.5 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 3 op/s 2021-03-10T20:05:16.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:16 gibba044 bash[9859]: cluster 2021-03-10T20:05:14.743878+0000 mgr.y (mgr.14140) 249 : cluster [DBG] pgmap v245: 129 pgs: 1 creating+peering, 18 unknown, 110 active+clean; 1.8 KiB data, 4.5 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 3 op/s 2021-03-10T20:05:18.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:18 gibba023 bash[9844]: cluster 2021-03-10T20:05:16.745297+0000 mgr.y (mgr.14140) 250 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 5.2 KiB data, 4.9 MiB used, 664 GiB / 672 GiB avail; 865 B/s rd, 4.4 KiB/s wr, 15 op/s 2021-03-10T20:05:18.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:18 gibba023 bash[13032]: cluster 2021-03-10T20:05:16.745297+0000 mgr.y (mgr.14140) 250 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 5.2 KiB data, 4.9 MiB used, 664 GiB / 672 GiB avail; 865 B/s rd, 4.4 KiB/s wr, 15 op/s 2021-03-10T20:05:18.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:18 gibba044 bash[9859]: cluster 2021-03-10T20:05:16.745297+0000 mgr.y (mgr.14140) 250 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 5.2 KiB data, 4.9 MiB used, 664 GiB / 672 GiB avail; 865 B/s rd, 4.4 KiB/s wr, 15 op/s 2021-03-10T20:05:19.101 INFO:teuthology.orchestra.run.gibba023.stdout:Scheduled rgw update... 2021-03-10T20:05:19.847 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'sleep 120' 2021-03-10T20:05:20.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[9844]: cluster 2021-03-10T20:05:18.746332+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 5.5 KiB data, 5.0 MiB used, 664 GiB / 672 GiB avail; 682 B/s rd, 4.0 KiB/s wr, 14 op/s 2021-03-10T20:05:20.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[9844]: audit 2021-03-10T20:05:19.094387+0000 mgr.y (mgr.14140) 252 : audit [DBG] from='client.14520 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:05:20.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[9844]: cephadm 2021-03-10T20:05:19.094754+0000 mgr.y (mgr.14140) 253 : cephadm [INF] Saving service rgw.r.z spec with placement count:2 2021-03-10T20:05:20.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[9844]: audit 2021-03-10T20:05:19.095006+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T20:05:19.094763\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2021-03-10T20:05:20.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[9844]: audit 2021-03-10T20:05:19.097643+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T20:05:19.094763\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2021-03-10T20:05:20.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[9844]: audit 2021-03-10T20:05:19.099443+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2021-03-10T20:05:20.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[9844]: audit 2021-03-10T20:05:19.102253+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2021-03-10T20:05:20.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[9844]: audit 2021-03-10T20:05:19.102985+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2021-03-10T20:05:20.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[9844]: audit 2021-03-10T20:05:19.105527+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2021-03-10T20:05:20.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[9844]: audit 2021-03-10T20:05:19.106106+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]: dispatch 2021-03-10T20:05:20.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[9844]: audit 2021-03-10T20:05:19.108721+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]': finished 2021-03-10T20:05:20.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[9844]: audit 2021-03-10T20:05:19.109392+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba044.rblqpl", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2021-03-10T20:05:20.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[9844]: audit 2021-03-10T20:05:19.111506+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba044.rblqpl", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2021-03-10T20:05:20.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[9844]: audit 2021-03-10T20:05:19.112247+0000 mon.a (mon.0) 582 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:05:20.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[9844]: cephadm 2021-03-10T20:05:19.112879+0000 mgr.y (mgr.14140) 254 : cephadm [INF] Deploying daemon rgw.r.z.gibba044.rblqpl on gibba044 2021-03-10T20:05:20.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[9844]: audit 2021-03-10T20:05:19.113091+0000 mon.a (mon.0) 583 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.gibba044.rblqpl", "key": "container_image"}]: dispatch 2021-03-10T20:05:20.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[13032]: cluster 2021-03-10T20:05:18.746332+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 5.5 KiB data, 5.0 MiB used, 664 GiB / 672 GiB avail; 682 B/s rd, 4.0 KiB/s wr, 14 op/s 2021-03-10T20:05:20.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[13032]: audit 2021-03-10T20:05:19.094387+0000 mgr.y (mgr.14140) 252 : audit [DBG] from='client.14520 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:05:20.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[13032]: cephadm 2021-03-10T20:05:19.094754+0000 mgr.y (mgr.14140) 253 : cephadm [INF] Saving service rgw.r.z spec with placement count:2 2021-03-10T20:05:20.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[13032]: audit 2021-03-10T20:05:19.095006+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T20:05:19.094763\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2021-03-10T20:05:20.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[13032]: audit 2021-03-10T20:05:19.097643+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T20:05:19.094763\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2021-03-10T20:05:20.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[13032]: audit 2021-03-10T20:05:19.099443+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2021-03-10T20:05:20.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[13032]: audit 2021-03-10T20:05:19.102253+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2021-03-10T20:05:20.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[13032]: audit 2021-03-10T20:05:19.102985+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2021-03-10T20:05:20.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[13032]: audit 2021-03-10T20:05:19.105527+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2021-03-10T20:05:20.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[13032]: audit 2021-03-10T20:05:19.106106+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]: dispatch 2021-03-10T20:05:20.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[13032]: audit 2021-03-10T20:05:19.108721+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]': finished 2021-03-10T20:05:20.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[13032]: audit 2021-03-10T20:05:19.109392+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba044.rblqpl", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2021-03-10T20:05:20.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[13032]: audit 2021-03-10T20:05:19.111506+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba044.rblqpl", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2021-03-10T20:05:20.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[13032]: audit 2021-03-10T20:05:19.112247+0000 mon.a (mon.0) 582 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:05:20.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[13032]: cephadm 2021-03-10T20:05:19.112879+0000 mgr.y (mgr.14140) 254 : cephadm [INF] Deploying daemon rgw.r.z.gibba044.rblqpl on gibba044 2021-03-10T20:05:20.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:20 gibba023 bash[13032]: audit 2021-03-10T20:05:19.113091+0000 mon.a (mon.0) 583 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.gibba044.rblqpl", "key": "container_image"}]: dispatch 2021-03-10T20:05:20.320 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:20 gibba044 bash[9859]: cluster 2021-03-10T20:05:18.746332+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 5.5 KiB data, 5.0 MiB used, 664 GiB / 672 GiB avail; 682 B/s rd, 4.0 KiB/s wr, 14 op/s 2021-03-10T20:05:20.320 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:20 gibba044 bash[9859]: audit 2021-03-10T20:05:19.094387+0000 mgr.y (mgr.14140) 252 : audit [DBG] from='client.14520 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "2", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:05:20.321 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:20 gibba044 bash[9859]: cephadm 2021-03-10T20:05:19.094754+0000 mgr.y (mgr.14140) 253 : cephadm [INF] Saving service rgw.r.z spec with placement count:2 2021-03-10T20:05:20.321 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:20 gibba044 bash[9859]: audit 2021-03-10T20:05:19.095006+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T20:05:19.094763\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2021-03-10T20:05:20.321 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:20 gibba044 bash[9859]: audit 2021-03-10T20:05:19.097643+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2021-03-10T20:05:19.094763\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2021-03-10T20:05:20.321 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:20 gibba044 bash[9859]: audit 2021-03-10T20:05:19.099443+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2021-03-10T20:05:20.322 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:20 gibba044 bash[9859]: audit 2021-03-10T20:05:19.102253+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2021-03-10T20:05:20.322 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:20 gibba044 bash[9859]: audit 2021-03-10T20:05:19.102985+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2021-03-10T20:05:20.322 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:20 gibba044 bash[9859]: audit 2021-03-10T20:05:19.105527+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2021-03-10T20:05:20.322 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:20 gibba044 bash[9859]: audit 2021-03-10T20:05:19.106106+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]: dispatch 2021-03-10T20:05:20.323 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:20 gibba044 bash[9859]: audit 2021-03-10T20:05:19.108721+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=80"}]': finished 2021-03-10T20:05:20.323 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:20 gibba044 bash[9859]: audit 2021-03-10T20:05:19.109392+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba044.rblqpl", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2021-03-10T20:05:20.323 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:20 gibba044 bash[9859]: audit 2021-03-10T20:05:19.111506+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba044.rblqpl", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2021-03-10T20:05:20.323 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:20 gibba044 bash[9859]: audit 2021-03-10T20:05:19.112247+0000 mon.a (mon.0) 582 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:05:20.323 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:20 gibba044 bash[9859]: cephadm 2021-03-10T20:05:19.112879+0000 mgr.y (mgr.14140) 254 : cephadm [INF] Deploying daemon rgw.r.z.gibba044.rblqpl on gibba044 2021-03-10T20:05:20.324 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:20 gibba044 bash[9859]: audit 2021-03-10T20:05:19.113091+0000 mon.a (mon.0) 583 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.gibba044.rblqpl", "key": "container_image"}]: dispatch 2021-03-10T20:05:21.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:21 gibba023 bash[9844]: audit 2021-03-10T20:05:21.059013+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894670\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894738\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894775\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894808\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894841\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894873\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894905\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894938\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894971\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.895003\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:05:21.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:21 gibba023 bash[13032]: audit 2021-03-10T20:05:21.059013+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894670\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894738\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894775\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894808\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894841\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894873\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894905\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894938\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894971\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.895003\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:05:21.433 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:21 gibba023 bash[9844]: audit 2021-03-10T20:05:21.063122+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894670\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894738\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894775\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894808\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894841\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894873\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894905\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894938\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894971\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.895003\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:05:21.434 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:21 gibba023 bash[9844]: audit 2021-03-10T20:05:21.063811+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba023.rsfdop", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2021-03-10T20:05:21.435 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:21 gibba023 bash[9844]: audit 2021-03-10T20:05:21.067809+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba023.rsfdop", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2021-03-10T20:05:21.435 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:21 gibba023 bash[9844]: audit 2021-03-10T20:05:21.068809+0000 mon.a (mon.0) 588 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:05:21.436 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:21 gibba023 bash[9844]: audit 2021-03-10T20:05:21.069980+0000 mon.a (mon.0) 589 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.gibba023.rsfdop", "key": "container_image"}]: dispatch 2021-03-10T20:05:21.437 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:21 gibba023 bash[13032]: audit 2021-03-10T20:05:21.063122+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894670\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894738\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894775\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894808\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894841\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894873\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894905\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894938\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894971\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.895003\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:05:21.438 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:21 gibba023 bash[13032]: audit 2021-03-10T20:05:21.063811+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba023.rsfdop", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2021-03-10T20:05:21.439 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:21 gibba023 bash[13032]: audit 2021-03-10T20:05:21.067809+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba023.rsfdop", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2021-03-10T20:05:21.440 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:21 gibba023 bash[13032]: audit 2021-03-10T20:05:21.068809+0000 mon.a (mon.0) 588 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:05:21.440 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:21 gibba023 bash[13032]: audit 2021-03-10T20:05:21.069980+0000 mon.a (mon.0) 589 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.gibba023.rsfdop", "key": "container_image"}]: dispatch 2021-03-10T20:05:21.517 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:21 gibba044 bash[9859]: audit 2021-03-10T20:05:21.059013+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894670\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894738\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894775\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894808\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894841\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894873\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894905\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894938\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894971\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.895003\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:05:21.517 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:21 gibba044 bash[9859]: audit 2021-03-10T20:05:21.063122+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894670\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894738\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894775\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894808\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894841\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894873\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894905\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894938\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.894971\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:49.895003\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:05:21.517 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:21 gibba044 bash[9859]: audit 2021-03-10T20:05:21.063811+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba023.rsfdop", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2021-03-10T20:05:21.518 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:21 gibba044 bash[9859]: audit 2021-03-10T20:05:21.067809+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba023.rsfdop", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2021-03-10T20:05:21.518 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:21 gibba044 bash[9859]: audit 2021-03-10T20:05:21.068809+0000 mon.a (mon.0) 588 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:05:21.518 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:21 gibba044 bash[9859]: audit 2021-03-10T20:05:21.069980+0000 mon.a (mon.0) 589 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.gibba023.rsfdop", "key": "container_image"}]: dispatch 2021-03-10T20:05:22.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:22 gibba044 bash[9859]: cluster 2021-03-10T20:05:20.747574+0000 mgr.y (mgr.14140) 255 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 928 B/s rd, 5.1 KiB/s wr, 18 op/s 2021-03-10T20:05:22.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:22 gibba044 bash[9859]: cephadm 2021-03-10T20:05:21.069759+0000 mgr.y (mgr.14140) 256 : cephadm [INF] Deploying daemon rgw.r.z.gibba023.rsfdop on gibba023 2021-03-10T20:05:22.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:22 gibba023 bash[9844]: cluster 2021-03-10T20:05:20.747574+0000 mgr.y (mgr.14140) 255 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 928 B/s rd, 5.1 KiB/s wr, 18 op/s 2021-03-10T20:05:22.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:22 gibba023 bash[9844]: cephadm 2021-03-10T20:05:21.069759+0000 mgr.y (mgr.14140) 256 : cephadm [INF] Deploying daemon rgw.r.z.gibba023.rsfdop on gibba023 2021-03-10T20:05:22.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:22 gibba023 bash[13032]: cluster 2021-03-10T20:05:20.747574+0000 mgr.y (mgr.14140) 255 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 928 B/s rd, 5.1 KiB/s wr, 18 op/s 2021-03-10T20:05:22.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:22 gibba023 bash[13032]: cephadm 2021-03-10T20:05:21.069759+0000 mgr.y (mgr.14140) 256 : cephadm [INF] Deploying daemon rgw.r.z.gibba023.rsfdop on gibba023 2021-03-10T20:05:24.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:24 gibba023 bash[9844]: cluster 2021-03-10T20:05:22.749043+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 822 B/s rd, 4.5 KiB/s wr, 16 op/s 2021-03-10T20:05:24.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:24 gibba023 bash[13032]: cluster 2021-03-10T20:05:22.749043+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 822 B/s rd, 4.5 KiB/s wr, 16 op/s 2021-03-10T20:05:24.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:24 gibba044 bash[9859]: cluster 2021-03-10T20:05:22.749043+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 822 B/s rd, 4.5 KiB/s wr, 16 op/s 2021-03-10T20:05:25.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:25 gibba023 bash[13032]: audit 2021-03-10T20:05:24.453240+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848040\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848098\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848127\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848154\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848180\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848205\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848231\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848256\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848281\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:40.524411\"}, \"rgw.r.z.gibba023.rsfdop\": {\"hostname\": \"gibba023\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:05:25.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:25 gibba023 bash[13032]: audit 2021-03-10T20:05:24.457367+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848040\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848098\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848127\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848154\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848180\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848205\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848231\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848256\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848281\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:40.524411\"}, \"rgw.r.z.gibba023.rsfdop\": {\"hostname\": \"gibba023\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:05:25.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:25 gibba023 bash[13032]: audit 2021-03-10T20:05:24.457833+0000 mon.a (mon.0) 592 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:25.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:25 gibba023 bash[9844]: audit 2021-03-10T20:05:24.453240+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848040\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848098\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848127\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848154\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848180\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848205\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848231\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848256\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848281\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:40.524411\"}, \"rgw.r.z.gibba023.rsfdop\": {\"hostname\": \"gibba023\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:05:25.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:25 gibba023 bash[9844]: audit 2021-03-10T20:05:24.457367+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848040\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848098\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848127\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848154\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848180\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848205\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848231\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848256\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848281\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:40.524411\"}, \"rgw.r.z.gibba023.rsfdop\": {\"hostname\": \"gibba023\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:05:25.432 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:25 gibba023 bash[9844]: audit 2021-03-10T20:05:24.457833+0000 mon.a (mon.0) 592 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:25.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:25 gibba044 bash[9859]: audit 2021-03-10T20:05:24.453240+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848040\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848098\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848127\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848154\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848180\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848205\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848231\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848256\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848281\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:40.524411\"}, \"rgw.r.z.gibba023.rsfdop\": {\"hostname\": \"gibba023\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:05:25.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:25 gibba044 bash[9859]: audit 2021-03-10T20:05:24.457367+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848040\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848098\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848127\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848154\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848180\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848205\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848231\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848256\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:03:48.848281\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:40.524411\"}, \"rgw.r.z.gibba023.rsfdop\": {\"hostname\": \"gibba023\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:05:25.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:25 gibba044 bash[9859]: audit 2021-03-10T20:05:24.457833+0000 mon.a (mon.0) 592 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:26.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:26 gibba023 bash[13032]: cluster 2021-03-10T20:05:24.750485+0000 mgr.y (mgr.14140) 258 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.3 KiB/s rd, 3.9 KiB/s wr, 17 op/s 2021-03-10T20:05:26.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:26 gibba023 bash[9844]: cluster 2021-03-10T20:05:24.750485+0000 mgr.y (mgr.14140) 258 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.3 KiB/s rd, 3.9 KiB/s wr, 17 op/s 2021-03-10T20:05:26.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:26 gibba023 bash[13032]: audit 2021-03-10T20:05:25.528527+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527196\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527275\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527317\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527356\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527394\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527432\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527470\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527507\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527544\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:40.524411\"}, \"rgw.r.z.gibba023.rsfdop\": {\"hostname\": \"gibba023\", \"container_id\": \"479c1eeb4a51\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527581\", \"created\": \"2021-03-10T20:05:24.438946\", \"started\": \"2021-03-10T20:05:24.466542\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542\"}}, \"last_daemon_update\": \"2021-03-10T20:05:25.527667\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:05:26.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:26 gibba023 bash[13032]: audit 2021-03-10T20:05:25.531799+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527196\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527275\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527317\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527356\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527394\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527432\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527470\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527507\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527544\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:40.524411\"}, \"rgw.r.z.gibba023.rsfdop\": {\"hostname\": \"gibba023\", \"container_id\": \"479c1eeb4a51\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527581\", \"created\": \"2021-03-10T20:05:24.438946\", \"started\": \"2021-03-10T20:05:24.466542\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542\"}}, \"last_daemon_update\": \"2021-03-10T20:05:25.527667\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:05:26.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:26 gibba023 bash[13032]: audit 2021-03-10T20:05:25.532466+0000 mon.a (mon.0) 595 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:26.432 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:26 gibba023 bash[9844]: audit 2021-03-10T20:05:25.528527+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527196\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527275\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527317\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527356\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527394\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527432\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527470\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527507\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527544\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:40.524411\"}, \"rgw.r.z.gibba023.rsfdop\": {\"hostname\": \"gibba023\", \"container_id\": \"479c1eeb4a51\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527581\", \"created\": \"2021-03-10T20:05:24.438946\", \"started\": \"2021-03-10T20:05:24.466542\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542\"}}, \"last_daemon_update\": \"2021-03-10T20:05:25.527667\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:05:26.432 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:26 gibba023 bash[9844]: audit 2021-03-10T20:05:25.531799+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527196\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527275\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527317\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527356\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527394\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527432\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527470\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527507\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527544\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:40.524411\"}, \"rgw.r.z.gibba023.rsfdop\": {\"hostname\": \"gibba023\", \"container_id\": \"479c1eeb4a51\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527581\", \"created\": \"2021-03-10T20:05:24.438946\", \"started\": \"2021-03-10T20:05:24.466542\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542\"}}, \"last_daemon_update\": \"2021-03-10T20:05:25.527667\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:05:26.432 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:26 gibba023 bash[9844]: audit 2021-03-10T20:05:25.532466+0000 mon.a (mon.0) 595 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:26.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:26 gibba044 bash[9859]: cluster 2021-03-10T20:05:24.750485+0000 mgr.y (mgr.14140) 258 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 6.9 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.3 KiB/s rd, 3.9 KiB/s wr, 17 op/s 2021-03-10T20:05:26.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:26 gibba044 bash[9859]: audit 2021-03-10T20:05:25.528527+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527196\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527275\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527317\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527356\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527394\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527432\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527470\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527507\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527544\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:40.524411\"}, \"rgw.r.z.gibba023.rsfdop\": {\"hostname\": \"gibba023\", \"container_id\": \"479c1eeb4a51\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527581\", \"created\": \"2021-03-10T20:05:24.438946\", \"started\": \"2021-03-10T20:05:24.466542\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542\"}}, \"last_daemon_update\": \"2021-03-10T20:05:25.527667\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]: dispatch 2021-03-10T20:05:26.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:26 gibba044 bash[9859]: audit 2021-03-10T20:05:25.531799+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527196\", \"created\": \"2021-03-10T19:58:02.889146\", \"started\": \"2021-03-10T19:58:08.564889\"}, \"mgr.y\": {\"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527275\", \"created\": \"2021-03-10T19:58:10.609146\", \"started\": \"2021-03-10T19:58:10.632912\"}, \"mon.c\": {\"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527317\", \"created\": \"2021-03-10T19:59:18.289146\", \"started\": \"2021-03-10T19:59:18.312130\"}, \"osd.0\": {\"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527356\", \"created\": \"2021-03-10T20:00:07.565145\", \"started\": \"2021-03-10T20:00:11.808125\"}, \"osd.1\": {\"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527394\", \"created\": \"2021-03-10T20:00:31.149145\", \"started\": \"2021-03-10T20:00:34.745419\"}, \"osd.2\": {\"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527432\", \"created\": \"2021-03-10T20:00:55.158947\", \"started\": \"2021-03-10T20:00:58.791505\"}, \"osd.3\": {\"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527470\", \"created\": \"2021-03-10T20:01:19.922947\", \"started\": \"2021-03-10T20:01:23.320992\"}, \"node-exporter.a\": {\"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527507\", \"created\": \"2021-03-10T20:03:08.746947\", \"started\": \"2021-03-10T20:03:11.078015\"}, \"alertmanager.a\": {\"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527544\", \"created\": \"2021-03-10T20:03:18.574947\", \"started\": \"2021-03-10T20:03:40.524411\"}, \"rgw.r.z.gibba023.rsfdop\": {\"hostname\": \"gibba023\", \"container_id\": \"479c1eeb4a51\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:25.527581\", \"created\": \"2021-03-10T20:05:24.438946\", \"started\": \"2021-03-10T20:05:24.466542\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542\"}}, \"last_daemon_update\": \"2021-03-10T20:05:25.527667\", \"last_device_update\": \"2021-03-10T20:01:26.426201\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T19:58:29.871054\"}"}]': finished 2021-03-10T20:05:26.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:26 gibba044 bash[9859]: audit 2021-03-10T20:05:25.532466+0000 mon.a (mon.0) 595 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:05:27.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:27 gibba023 bash[13032]: audit 2021-03-10T20:05:26.470024+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.464802\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465064\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465226\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465385\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465535\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465684\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465831\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465979\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.466127\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.466305\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2021-03-10T20:05:26.466459\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_daemon_update\": \"2021-03-10T20:05:26.466759\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:05:27.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:27 gibba023 bash[13032]: audit 2021-03-10T20:05:26.478782+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.464802\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465064\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465226\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465385\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465535\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465684\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465831\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465979\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.466127\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.466305\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2021-03-10T20:05:26.466459\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_daemon_update\": \"2021-03-10T20:05:26.466759\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:05:27.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:27 gibba023 bash[9844]: audit 2021-03-10T20:05:26.470024+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.464802\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465064\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465226\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465385\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465535\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465684\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465831\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465979\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.466127\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.466305\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2021-03-10T20:05:26.466459\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_daemon_update\": \"2021-03-10T20:05:26.466759\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:05:27.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:27 gibba023 bash[9844]: audit 2021-03-10T20:05:26.478782+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.464802\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465064\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465226\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465385\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465535\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465684\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465831\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465979\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.466127\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.466305\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2021-03-10T20:05:26.466459\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_daemon_update\": \"2021-03-10T20:05:26.466759\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:05:27.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:27 gibba044 bash[9859]: audit 2021-03-10T20:05:26.470024+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.464802\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465064\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465226\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465385\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465535\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465684\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465831\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465979\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.466127\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.466305\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2021-03-10T20:05:26.466459\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_daemon_update\": \"2021-03-10T20:05:26.466759\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:05:27.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:27 gibba044 bash[9859]: audit 2021-03-10T20:05:26.478782+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.464802\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"1de4a3ab7018\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465064\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T19:59:48.177447\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465226\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465385\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465535\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465684\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465831\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465979\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.466127\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.466305\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2021-03-10T20:05:26.466459\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:45.954605\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_daemon_update\": \"2021-03-10T20:05:26.466759\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:05:28.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:28 gibba023 bash[9844]: cluster 2021-03-10T20:05:26.752144+0000 mgr.y (mgr.14140) 259 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 6.3 KiB/s rd, 3.5 KiB/s wr, 21 op/s 2021-03-10T20:05:28.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:28 gibba023 bash[13032]: cluster 2021-03-10T20:05:26.752144+0000 mgr.y (mgr.14140) 259 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 6.3 KiB/s rd, 3.5 KiB/s wr, 21 op/s 2021-03-10T20:05:28.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:28 gibba044 bash[9859]: cluster 2021-03-10T20:05:26.752144+0000 mgr.y (mgr.14140) 259 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 6.3 KiB/s rd, 3.5 KiB/s wr, 21 op/s 2021-03-10T20:05:30.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:30 gibba023 bash[9844]: cluster 2021-03-10T20:05:28.753294+0000 mgr.y (mgr.14140) 260 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 5.8 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2021-03-10T20:05:30.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:30 gibba023 bash[13032]: cluster 2021-03-10T20:05:28.753294+0000 mgr.y (mgr.14140) 260 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 5.8 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2021-03-10T20:05:30.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:30 gibba044 bash[9859]: cluster 2021-03-10T20:05:28.753294+0000 mgr.y (mgr.14140) 260 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 5.8 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2021-03-10T20:05:32.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:32 gibba023 bash[9844]: cluster 2021-03-10T20:05:30.754887+0000 mgr.y (mgr.14140) 261 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 6.1 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2021-03-10T20:05:32.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:32 gibba023 bash[13032]: cluster 2021-03-10T20:05:30.754887+0000 mgr.y (mgr.14140) 261 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 6.1 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2021-03-10T20:05:32.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:32 gibba044 bash[9859]: cluster 2021-03-10T20:05:30.754887+0000 mgr.y (mgr.14140) 261 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 6.1 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2021-03-10T20:05:34.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:34 gibba023 bash[9844]: cluster 2021-03-10T20:05:32.756387+0000 mgr.y (mgr.14140) 262 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 8 op/s 2021-03-10T20:05:34.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:34 gibba023 bash[13032]: cluster 2021-03-10T20:05:32.756387+0000 mgr.y (mgr.14140) 262 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 8 op/s 2021-03-10T20:05:34.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:34 gibba044 bash[9859]: cluster 2021-03-10T20:05:32.756387+0000 mgr.y (mgr.14140) 262 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 5.8 KiB/s rd, 170 B/s wr, 8 op/s 2021-03-10T20:05:36.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:36 gibba023 bash[9844]: cluster 2021-03-10T20:05:34.757952+0000 mgr.y (mgr.14140) 263 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 8 op/s 2021-03-10T20:05:36.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:36 gibba023 bash[13032]: cluster 2021-03-10T20:05:34.757952+0000 mgr.y (mgr.14140) 263 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 8 op/s 2021-03-10T20:05:36.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:36 gibba044 bash[9859]: cluster 2021-03-10T20:05:34.757952+0000 mgr.y (mgr.14140) 263 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 6.1 KiB/s rd, 170 B/s wr, 8 op/s 2021-03-10T20:05:38.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:38 gibba044 bash[9859]: cluster 2021-03-10T20:05:36.759474+0000 mgr.y (mgr.14140) 264 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 6.8 KiB/s rd, 255 B/s wr, 9 op/s 2021-03-10T20:05:38.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:38 gibba023 bash[9844]: cluster 2021-03-10T20:05:36.759474+0000 mgr.y (mgr.14140) 264 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 6.8 KiB/s rd, 255 B/s wr, 9 op/s 2021-03-10T20:05:38.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:38 gibba023 bash[13032]: cluster 2021-03-10T20:05:36.759474+0000 mgr.y (mgr.14140) 264 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 6.8 KiB/s rd, 255 B/s wr, 9 op/s 2021-03-10T20:05:39.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:39 gibba044 bash[9859]: cluster 2021-03-10T20:05:38.760778+0000 mgr.y (mgr.14140) 265 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.8 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:05:39.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:39 gibba023 bash[9844]: cluster 2021-03-10T20:05:38.760778+0000 mgr.y (mgr.14140) 265 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.8 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:05:39.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:39 gibba023 bash[13032]: cluster 2021-03-10T20:05:38.760778+0000 mgr.y (mgr.14140) 265 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.8 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:05:42.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:41 gibba023 bash[9844]: cluster 2021-03-10T20:05:40.762370+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.5 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:05:42.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:41 gibba023 bash[13032]: cluster 2021-03-10T20:05:40.762370+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.5 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:05:42.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:41 gibba044 bash[9859]: cluster 2021-03-10T20:05:40.762370+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.5 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:05:44.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:43 gibba023 bash[9844]: cluster 2021-03-10T20:05:42.763958+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:05:44.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:43 gibba023 bash[13032]: cluster 2021-03-10T20:05:42.763958+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:05:44.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:43 gibba044 bash[9859]: cluster 2021-03-10T20:05:42.763958+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:05:46.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:45 gibba023 bash[9844]: cluster 2021-03-10T20:05:44.765440+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.9 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:05:46.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:45 gibba023 bash[13032]: cluster 2021-03-10T20:05:44.765440+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.9 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:05:46.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:45 gibba044 bash[9859]: cluster 2021-03-10T20:05:44.765440+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.9 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:05:47.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:47 gibba023 bash[9844]: cluster 2021-03-10T20:05:46.766033+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.9 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:05:47.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:47 gibba023 bash[13032]: cluster 2021-03-10T20:05:46.766033+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.9 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:05:48.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:47 gibba044 bash[9859]: cluster 2021-03-10T20:05:46.766033+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.9 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:05:50.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:49 gibba023 bash[9844]: cluster 2021-03-10T20:05:48.767069+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T20:05:50.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:49 gibba023 bash[13032]: cluster 2021-03-10T20:05:48.767069+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T20:05:50.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:49 gibba044 bash[9859]: cluster 2021-03-10T20:05:48.767069+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T20:05:52.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:51 gibba023 bash[9844]: cluster 2021-03-10T20:05:50.768522+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T20:05:52.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:51 gibba023 bash[13032]: cluster 2021-03-10T20:05:50.768522+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T20:05:52.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:51 gibba044 bash[9859]: cluster 2021-03-10T20:05:50.768522+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.1 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T20:05:54.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:53 gibba023 bash[9844]: cluster 2021-03-10T20:05:52.770164+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:05:54.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:53 gibba023 bash[13032]: cluster 2021-03-10T20:05:52.770164+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:05:54.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:53 gibba044 bash[9859]: cluster 2021-03-10T20:05:52.770164+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:05:56.164 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:55 gibba044 bash[9859]: cluster 2021-03-10T20:05:54.771533+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:05:56.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:55 gibba023 bash[9844]: cluster 2021-03-10T20:05:54.771533+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:05:56.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:55 gibba023 bash[13032]: cluster 2021-03-10T20:05:54.771533+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:05:58.152 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:57 gibba023 bash[9844]: cluster 2021-03-10T20:05:56.772800+0000 mgr.y (mgr.14140) 274 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 4.3 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T20:05:58.152 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:57 gibba023 bash[13032]: cluster 2021-03-10T20:05:56.772800+0000 mgr.y (mgr.14140) 274 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 4.3 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T20:05:58.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:57 gibba044 bash[9859]: cluster 2021-03-10T20:05:56.772800+0000 mgr.y (mgr.14140) 274 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 4.3 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T20:06:00.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:05:59 gibba023 bash[9844]: cluster 2021-03-10T20:05:58.773686+0000 mgr.y (mgr.14140) 275 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 4.3 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T20:06:00.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:05:59 gibba023 bash[13032]: cluster 2021-03-10T20:05:58.773686+0000 mgr.y (mgr.14140) 275 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 4.3 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T20:06:00.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:05:59 gibba044 bash[9859]: cluster 2021-03-10T20:05:58.773686+0000 mgr.y (mgr.14140) 275 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 4.3 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T20:06:02.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:01 gibba023 bash[9844]: cluster 2021-03-10T20:06:00.775189+0000 mgr.y (mgr.14140) 276 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 4.6 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T20:06:02.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:01 gibba023 bash[13032]: cluster 2021-03-10T20:06:00.775189+0000 mgr.y (mgr.14140) 276 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 4.6 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T20:06:02.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:01 gibba044 bash[9859]: cluster 2021-03-10T20:06:00.775189+0000 mgr.y (mgr.14140) 276 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 4.6 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T20:06:04.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:03 gibba023 bash[9844]: cluster 2021-03-10T20:06:02.776832+0000 mgr.y (mgr.14140) 277 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 6 op/s 2021-03-10T20:06:04.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:03 gibba023 bash[13032]: cluster 2021-03-10T20:06:02.776832+0000 mgr.y (mgr.14140) 277 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 6 op/s 2021-03-10T20:06:04.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:03 gibba044 bash[9859]: cluster 2021-03-10T20:06:02.776832+0000 mgr.y (mgr.14140) 277 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 6 op/s 2021-03-10T20:06:06.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:05 gibba023 bash[9844]: cluster 2021-03-10T20:06:04.778233+0000 mgr.y (mgr.14140) 278 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:06.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:05 gibba023 bash[13032]: cluster 2021-03-10T20:06:04.778233+0000 mgr.y (mgr.14140) 278 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:06.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:05 gibba044 bash[9859]: cluster 2021-03-10T20:06:04.778233+0000 mgr.y (mgr.14140) 278 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:08.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:07 gibba023 bash[9844]: cluster 2021-03-10T20:06:06.779858+0000 mgr.y (mgr.14140) 279 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:08.420 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:07 gibba023 bash[13032]: cluster 2021-03-10T20:06:06.779858+0000 mgr.y (mgr.14140) 279 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:08.421 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:07 gibba044 bash[9859]: cluster 2021-03-10T20:06:06.779858+0000 mgr.y (mgr.14140) 279 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:10.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:09 gibba023 bash[9844]: cluster 2021-03-10T20:06:08.781056+0000 mgr.y (mgr.14140) 280 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T20:06:10.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:09 gibba023 bash[13032]: cluster 2021-03-10T20:06:08.781056+0000 mgr.y (mgr.14140) 280 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T20:06:10.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:09 gibba044 bash[9859]: cluster 2021-03-10T20:06:08.781056+0000 mgr.y (mgr.14140) 280 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.7 KiB/s rd, 0 B/s wr, 2 op/s 2021-03-10T20:06:12.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:11 gibba023 bash[9844]: cluster 2021-03-10T20:06:10.782648+0000 mgr.y (mgr.14140) 281 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T20:06:12.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:11 gibba023 bash[13032]: cluster 2021-03-10T20:06:10.782648+0000 mgr.y (mgr.14140) 281 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T20:06:12.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:11 gibba044 bash[9859]: cluster 2021-03-10T20:06:10.782648+0000 mgr.y (mgr.14140) 281 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T20:06:14.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:13 gibba023 bash[9844]: cluster 2021-03-10T20:06:12.784015+0000 mgr.y (mgr.14140) 282 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.8 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:06:14.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:13 gibba023 bash[13032]: cluster 2021-03-10T20:06:12.784015+0000 mgr.y (mgr.14140) 282 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.8 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:06:14.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:13 gibba044 bash[9859]: cluster 2021-03-10T20:06:12.784015+0000 mgr.y (mgr.14140) 282 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.8 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:06:16.094 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:15 gibba023 bash[9844]: cluster 2021-03-10T20:06:14.785370+0000 mgr.y (mgr.14140) 283 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.3 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:16.094 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:15 gibba023 bash[13032]: cluster 2021-03-10T20:06:14.785370+0000 mgr.y (mgr.14140) 283 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.3 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:16.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:15 gibba044 bash[9859]: cluster 2021-03-10T20:06:14.785370+0000 mgr.y (mgr.14140) 283 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.3 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:18.072 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:17 gibba044 bash[9859]: cluster 2021-03-10T20:06:16.786859+0000 mgr.y (mgr.14140) 284 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.3 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:18.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:17 gibba023 bash[9844]: cluster 2021-03-10T20:06:16.786859+0000 mgr.y (mgr.14140) 284 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.3 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:18.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:17 gibba023 bash[13032]: cluster 2021-03-10T20:06:16.786859+0000 mgr.y (mgr.14140) 284 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.3 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:20.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:19 gibba023 bash[9844]: cluster 2021-03-10T20:06:18.788119+0000 mgr.y (mgr.14140) 285 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.3 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:20.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:19 gibba023 bash[13032]: cluster 2021-03-10T20:06:18.788119+0000 mgr.y (mgr.14140) 285 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.3 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:20.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:19 gibba044 bash[9859]: cluster 2021-03-10T20:06:18.788119+0000 mgr.y (mgr.14140) 285 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.3 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:22.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:21 gibba023 bash[9844]: cluster 2021-03-10T20:06:20.789610+0000 mgr.y (mgr.14140) 286 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.3 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:22.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:21 gibba023 bash[13032]: cluster 2021-03-10T20:06:20.789610+0000 mgr.y (mgr.14140) 286 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.3 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:22.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:21 gibba044 bash[9859]: cluster 2021-03-10T20:06:20.789610+0000 mgr.y (mgr.14140) 286 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.3 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:24.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:23 gibba023 bash[9844]: cluster 2021-03-10T20:06:22.791152+0000 mgr.y (mgr.14140) 287 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 6 op/s 2021-03-10T20:06:24.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:23 gibba023 bash[13032]: cluster 2021-03-10T20:06:22.791152+0000 mgr.y (mgr.14140) 287 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 6 op/s 2021-03-10T20:06:24.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:23 gibba044 bash[9859]: cluster 2021-03-10T20:06:22.791152+0000 mgr.y (mgr.14140) 287 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 6 op/s 2021-03-10T20:06:26.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:25 gibba023 bash[9844]: cluster 2021-03-10T20:06:24.792535+0000 mgr.y (mgr.14140) 288 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.5 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:26.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:25 gibba023 bash[13032]: cluster 2021-03-10T20:06:24.792535+0000 mgr.y (mgr.14140) 288 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.5 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:26.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:25 gibba044 bash[9859]: cluster 2021-03-10T20:06:24.792535+0000 mgr.y (mgr.14140) 288 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.5 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:28.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:27 gibba023 bash[9844]: cluster 2021-03-10T20:06:26.793268+0000 mgr.y (mgr.14140) 289 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:28.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:27 gibba023 bash[13032]: cluster 2021-03-10T20:06:26.793268+0000 mgr.y (mgr.14140) 289 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:28.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:27 gibba044 bash[9859]: cluster 2021-03-10T20:06:26.793268+0000 mgr.y (mgr.14140) 289 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:30.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:29 gibba023 bash[9844]: cluster 2021-03-10T20:06:28.794503+0000 mgr.y (mgr.14140) 290 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.5 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:06:30.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:29 gibba023 bash[13032]: cluster 2021-03-10T20:06:28.794503+0000 mgr.y (mgr.14140) 290 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.5 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:06:30.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:29 gibba044 bash[9859]: cluster 2021-03-10T20:06:28.794503+0000 mgr.y (mgr.14140) 290 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.5 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:06:32.096 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:31 gibba023 bash[9844]: cluster 2021-03-10T20:06:30.796067+0000 mgr.y (mgr.14140) 291 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.7 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:06:32.097 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:31 gibba023 bash[13032]: cluster 2021-03-10T20:06:30.796067+0000 mgr.y (mgr.14140) 291 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.7 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:06:32.151 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:31 gibba044 bash[9859]: cluster 2021-03-10T20:06:30.796067+0000 mgr.y (mgr.14140) 291 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.7 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:06:34.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:33 gibba023 bash[9844]: cluster 2021-03-10T20:06:32.797677+0000 mgr.y (mgr.14140) 292 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 4.1 KiB/s rd, 85 B/s wr, 6 op/s 2021-03-10T20:06:34.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:33 gibba023 bash[13032]: cluster 2021-03-10T20:06:32.797677+0000 mgr.y (mgr.14140) 292 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 4.1 KiB/s rd, 85 B/s wr, 6 op/s 2021-03-10T20:06:34.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:33 gibba044 bash[9859]: cluster 2021-03-10T20:06:32.797677+0000 mgr.y (mgr.14140) 292 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 4.1 KiB/s rd, 85 B/s wr, 6 op/s 2021-03-10T20:06:36.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:35 gibba023 bash[9844]: cluster 2021-03-10T20:06:34.798945+0000 mgr.y (mgr.14140) 293 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T20:06:36.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:35 gibba023 bash[13032]: cluster 2021-03-10T20:06:34.798945+0000 mgr.y (mgr.14140) 293 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T20:06:36.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:35 gibba044 bash[9859]: cluster 2021-03-10T20:06:34.798945+0000 mgr.y (mgr.14140) 293 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T20:06:38.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:37 gibba023 bash[9844]: cluster 2021-03-10T20:06:36.800205+0000 mgr.y (mgr.14140) 294 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:38.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:37 gibba023 bash[13032]: cluster 2021-03-10T20:06:36.800205+0000 mgr.y (mgr.14140) 294 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:38.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:37 gibba044 bash[9859]: cluster 2021-03-10T20:06:36.800205+0000 mgr.y (mgr.14140) 294 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:40.150 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:39 gibba044 bash[9859]: cluster 2021-03-10T20:06:38.801466+0000 mgr.y (mgr.14140) 295 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:40.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:39 gibba023 bash[9844]: cluster 2021-03-10T20:06:38.801466+0000 mgr.y (mgr.14140) 295 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:40.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:39 gibba023 bash[13032]: cluster 2021-03-10T20:06:38.801466+0000 mgr.y (mgr.14140) 295 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.2 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:42.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:41 gibba023 bash[9844]: cluster 2021-03-10T20:06:40.802983+0000 mgr.y (mgr.14140) 296 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.9 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:06:42.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:41 gibba023 bash[13032]: cluster 2021-03-10T20:06:40.802983+0000 mgr.y (mgr.14140) 296 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.9 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:06:42.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:41 gibba044 bash[9859]: cluster 2021-03-10T20:06:40.802983+0000 mgr.y (mgr.14140) 296 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.9 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:06:44.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:43 gibba023 bash[9844]: cluster 2021-03-10T20:06:42.804389+0000 mgr.y (mgr.14140) 297 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T20:06:44.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:43 gibba023 bash[13032]: cluster 2021-03-10T20:06:42.804389+0000 mgr.y (mgr.14140) 297 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T20:06:44.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:43 gibba044 bash[9859]: cluster 2021-03-10T20:06:42.804389+0000 mgr.y (mgr.14140) 297 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 4.5 KiB/s rd, 170 B/s wr, 5 op/s 2021-03-10T20:06:46.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:45 gibba023 bash[9844]: cluster 2021-03-10T20:06:44.804964+0000 mgr.y (mgr.14140) 298 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 6 op/s 2021-03-10T20:06:46.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:45 gibba023 bash[13032]: cluster 2021-03-10T20:06:44.804964+0000 mgr.y (mgr.14140) 298 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 6 op/s 2021-03-10T20:06:46.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:45 gibba044 bash[9859]: cluster 2021-03-10T20:06:44.804964+0000 mgr.y (mgr.14140) 298 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 5.1 KiB/s rd, 170 B/s wr, 6 op/s 2021-03-10T20:06:48.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:47 gibba023 bash[9844]: cluster 2021-03-10T20:06:46.806340+0000 mgr.y (mgr.14140) 299 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 6 op/s 2021-03-10T20:06:48.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:47 gibba023 bash[13032]: cluster 2021-03-10T20:06:46.806340+0000 mgr.y (mgr.14140) 299 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 6 op/s 2021-03-10T20:06:48.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:47 gibba044 bash[9859]: cluster 2021-03-10T20:06:46.806340+0000 mgr.y (mgr.14140) 299 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 4.9 KiB/s rd, 170 B/s wr, 6 op/s 2021-03-10T20:06:50.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:49 gibba023 bash[9844]: cluster 2021-03-10T20:06:48.807305+0000 mgr.y (mgr.14140) 300 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:50.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:49 gibba023 bash[13032]: cluster 2021-03-10T20:06:48.807305+0000 mgr.y (mgr.14140) 300 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:50.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:49 gibba044 bash[9859]: cluster 2021-03-10T20:06:48.807305+0000 mgr.y (mgr.14140) 300 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:52.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:51 gibba023 bash[9844]: cluster 2021-03-10T20:06:50.808812+0000 mgr.y (mgr.14140) 301 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:52.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:51 gibba023 bash[13032]: cluster 2021-03-10T20:06:50.808812+0000 mgr.y (mgr.14140) 301 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:52.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:51 gibba044 bash[9859]: cluster 2021-03-10T20:06:50.808812+0000 mgr.y (mgr.14140) 301 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:54.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:53 gibba023 bash[9844]: cluster 2021-03-10T20:06:52.810310+0000 mgr.y (mgr.14140) 302 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.5 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:06:54.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:53 gibba023 bash[13032]: cluster 2021-03-10T20:06:52.810310+0000 mgr.y (mgr.14140) 302 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.5 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:06:54.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:53 gibba044 bash[9859]: cluster 2021-03-10T20:06:52.810310+0000 mgr.y (mgr.14140) 302 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.5 KiB/s rd, 85 B/s wr, 5 op/s 2021-03-10T20:06:56.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:55 gibba023 bash[9844]: cluster 2021-03-10T20:06:54.810758+0000 mgr.y (mgr.14140) 303 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.4 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T20:06:56.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:55 gibba023 bash[13032]: cluster 2021-03-10T20:06:54.810758+0000 mgr.y (mgr.14140) 303 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.4 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T20:06:56.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:55 gibba044 bash[9859]: cluster 2021-03-10T20:06:54.810758+0000 mgr.y (mgr.14140) 303 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.4 KiB/s rd, 0 B/s wr, 3 op/s 2021-03-10T20:06:58.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:57 gibba023 bash[9844]: cluster 2021-03-10T20:06:56.811356+0000 mgr.y (mgr.14140) 304 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:58.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:57 gibba023 bash[13032]: cluster 2021-03-10T20:06:56.811356+0000 mgr.y (mgr.14140) 304 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:06:58.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:57 gibba044 bash[9859]: cluster 2021-03-10T20:06:56.811356+0000 mgr.y (mgr.14140) 304 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.1 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:07:00.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:06:59 gibba023 bash[9844]: cluster 2021-03-10T20:06:58.812454+0000 mgr.y (mgr.14140) 305 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.0 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:07:00.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:06:59 gibba023 bash[13032]: cluster 2021-03-10T20:06:58.812454+0000 mgr.y (mgr.14140) 305 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.0 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:07:00.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:06:59 gibba044 bash[9859]: cluster 2021-03-10T20:06:58.812454+0000 mgr.y (mgr.14140) 305 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.0 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:07:02.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:01 gibba023 bash[9844]: cluster 2021-03-10T20:07:00.813972+0000 mgr.y (mgr.14140) 306 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.0 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:07:02.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:01 gibba023 bash[13032]: cluster 2021-03-10T20:07:00.813972+0000 mgr.y (mgr.14140) 306 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.0 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:07:02.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:01 gibba044 bash[9859]: cluster 2021-03-10T20:07:00.813972+0000 mgr.y (mgr.14140) 306 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.0 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:07:04.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:03 gibba023 bash[9844]: cluster 2021-03-10T20:07:02.815461+0000 mgr.y (mgr.14140) 307 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.0 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:07:04.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:03 gibba023 bash[13032]: cluster 2021-03-10T20:07:02.815461+0000 mgr.y (mgr.14140) 307 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.0 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:07:04.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:03 gibba044 bash[9859]: cluster 2021-03-10T20:07:02.815461+0000 mgr.y (mgr.14140) 307 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 3.0 KiB/s rd, 85 B/s wr, 4 op/s 2021-03-10T20:07:05.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:05 gibba023 bash[9844]: cluster 2021-03-10T20:07:04.816831+0000 mgr.y (mgr.14140) 308 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.6 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:07:05.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:05 gibba023 bash[13032]: cluster 2021-03-10T20:07:04.816831+0000 mgr.y (mgr.14140) 308 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.6 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:07:06.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:05 gibba044 bash[9859]: cluster 2021-03-10T20:07:04.816831+0000 mgr.y (mgr.14140) 308 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.6 KiB/s rd, 85 B/s wr, 3 op/s 2021-03-10T20:07:08.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:07 gibba023 bash[9844]: cluster 2021-03-10T20:07:06.818318+0000 mgr.y (mgr.14140) 309 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T20:07:08.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:07 gibba023 bash[13032]: cluster 2021-03-10T20:07:06.818318+0000 mgr.y (mgr.14140) 309 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T20:07:08.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:07 gibba044 bash[9859]: cluster 2021-03-10T20:07:06.818318+0000 mgr.y (mgr.14140) 309 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 2.2 KiB/s rd, 85 B/s wr, 2 op/s 2021-03-10T20:07:10.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:09 gibba023 bash[9844]: cluster 2021-03-10T20:07:08.819237+0000 mgr.y (mgr.14140) 310 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 682 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:07:10.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:09 gibba023 bash[13032]: cluster 2021-03-10T20:07:08.819237+0000 mgr.y (mgr.14140) 310 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 682 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:07:10.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:09 gibba044 bash[9859]: cluster 2021-03-10T20:07:08.819237+0000 mgr.y (mgr.14140) 310 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 682 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:07:12.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:11 gibba023 bash[9844]: cluster 2021-03-10T20:07:10.820752+0000 mgr.y (mgr.14140) 311 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:07:12.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:11 gibba023 bash[13032]: cluster 2021-03-10T20:07:10.820752+0000 mgr.y (mgr.14140) 311 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:07:12.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:11 gibba044 bash[9859]: cluster 2021-03-10T20:07:10.820752+0000 mgr.y (mgr.14140) 311 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:07:14.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:13 gibba023 bash[9844]: cluster 2021-03-10T20:07:12.822434+0000 mgr.y (mgr.14140) 312 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:07:14.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:13 gibba023 bash[13032]: cluster 2021-03-10T20:07:12.822434+0000 mgr.y (mgr.14140) 312 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:07:14.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:13 gibba044 bash[9859]: cluster 2021-03-10T20:07:12.822434+0000 mgr.y (mgr.14140) 312 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:07:16.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:15 gibba023 bash[9844]: cluster 2021-03-10T20:07:14.822933+0000 mgr.y (mgr.14140) 313 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:07:16.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:15 gibba023 bash[13032]: cluster 2021-03-10T20:07:14.822933+0000 mgr.y (mgr.14140) 313 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:07:16.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:15 gibba044 bash[9859]: cluster 2021-03-10T20:07:14.822933+0000 mgr.y (mgr.14140) 313 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:07:18.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:17 gibba023 bash[9844]: cluster 2021-03-10T20:07:16.824189+0000 mgr.y (mgr.14140) 314 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:07:18.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:17 gibba023 bash[13032]: cluster 2021-03-10T20:07:16.824189+0000 mgr.y (mgr.14140) 314 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:07:18.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:17 gibba044 bash[9859]: cluster 2021-03-10T20:07:16.824189+0000 mgr.y (mgr.14140) 314 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2021-03-10T20:07:20.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:19 gibba023 bash[9844]: cluster 2021-03-10T20:07:18.825300+0000 mgr.y (mgr.14140) 315 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 511 B/s rd, 0 B/s wr, 0 op/s 2021-03-10T20:07:20.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:19 gibba023 bash[13032]: cluster 2021-03-10T20:07:18.825300+0000 mgr.y (mgr.14140) 315 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 511 B/s rd, 0 B/s wr, 0 op/s 2021-03-10T20:07:20.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:19 gibba044 bash[9859]: cluster 2021-03-10T20:07:18.825300+0000 mgr.y (mgr.14140) 315 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 511 B/s rd, 0 B/s wr, 0 op/s 2021-03-10T20:07:22.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:21 gibba023 bash[9844]: cluster 2021-03-10T20:07:20.826929+0000 mgr.y (mgr.14140) 316 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 255 B/s rd, 0 B/s wr, 0 op/s 2021-03-10T20:07:22.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:21 gibba023 bash[13032]: cluster 2021-03-10T20:07:20.826929+0000 mgr.y (mgr.14140) 316 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 255 B/s rd, 0 B/s wr, 0 op/s 2021-03-10T20:07:22.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:21 gibba044 bash[9859]: cluster 2021-03-10T20:07:20.826929+0000 mgr.y (mgr.14140) 316 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail; 255 B/s rd, 0 B/s wr, 0 op/s 2021-03-10T20:07:24.161 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:23 gibba023 bash[9844]: cluster 2021-03-10T20:07:22.828376+0000 mgr.y (mgr.14140) 317 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:24.162 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:23 gibba023 bash[13032]: cluster 2021-03-10T20:07:22.828376+0000 mgr.y (mgr.14140) 317 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:24.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:23 gibba044 bash[9859]: cluster 2021-03-10T20:07:22.828376+0000 mgr.y (mgr.14140) 317 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:24.619 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2021-03-10T20:07:25.856 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:25 gibba023 bash[9844]: cluster 2021-03-10T20:07:24.829101+0000 mgr.y (mgr.14140) 318 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:26.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:25 gibba023 bash[13032]: cluster 2021-03-10T20:07:24.829101+0000 mgr.y (mgr.14140) 318 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:26.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:25 gibba044 bash[9859]: cluster 2021-03-10T20:07:24.829101+0000 mgr.y (mgr.14140) 318 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:27.502 INFO:teuthology.orchestra.run.gibba023.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T20:07:28.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:27 gibba023 bash[9844]: cluster 2021-03-10T20:07:26.830504+0000 mgr.y (mgr.14140) 319 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:28.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:27 gibba023 bash[9844]: audit 2021-03-10T20:07:27.496373+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4b57f637-3662-4ca4-adab-66834c925771\"}"}]: dispatch 2021-03-10T20:07:28.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:27 gibba023 bash[9844]: audit 2021-03-10T20:07:27.500155+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4b57f637-3662-4ca4-adab-66834c925771\"}"}]': finished 2021-03-10T20:07:28.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:27 gibba023 bash[13032]: cluster 2021-03-10T20:07:26.830504+0000 mgr.y (mgr.14140) 319 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:28.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:27 gibba023 bash[13032]: audit 2021-03-10T20:07:27.496373+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4b57f637-3662-4ca4-adab-66834c925771\"}"}]: dispatch 2021-03-10T20:07:28.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:27 gibba023 bash[13032]: audit 2021-03-10T20:07:27.500155+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4b57f637-3662-4ca4-adab-66834c925771\"}"}]': finished 2021-03-10T20:07:28.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:27 gibba044 bash[9859]: cluster 2021-03-10T20:07:26.830504+0000 mgr.y (mgr.14140) 319 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:28.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:27 gibba044 bash[9859]: audit 2021-03-10T20:07:27.496373+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4b57f637-3662-4ca4-adab-66834c925771\"}"}]: dispatch 2021-03-10T20:07:28.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:27 gibba044 bash[9859]: audit 2021-03-10T20:07:27.500155+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4b57f637-3662-4ca4-adab-66834c925771\"}"}]': finished 2021-03-10T20:07:28.372 INFO:teuthology.run_tasks:Running task cephadm.shell... 2021-03-10T20:07:28.385 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@gibba023.front.sepia.ceph.com 2021-03-10T20:07:28.385 DEBUG:teuthology.orchestra.run.gibba023:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd719b26-81da-11eb-9080-001a4aab830c -e sha1=b26fc080937a021ce826cdc94d1adb52c064381a -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true ; do ceph orch ps ; ceph versions ; sleep 30 ; done' 2021-03-10T20:07:29.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:28 gibba023 bash[9844]: audit 2021-03-10T20:07:27.495758+0000 mgr.y (mgr.14140) 320 : audit [DBG] from='client.14631 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:07:29.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:28 gibba023 bash[9844]: cephadm 2021-03-10T20:07:27.501836+0000 mgr.y (mgr.14140) 321 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T20:07:29.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:28 gibba023 bash[13032]: audit 2021-03-10T20:07:27.495758+0000 mgr.y (mgr.14140) 320 : audit [DBG] from='client.14631 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:07:29.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:28 gibba023 bash[13032]: cephadm 2021-03-10T20:07:27.501836+0000 mgr.y (mgr.14140) 321 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T20:07:29.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:28 gibba044 bash[9859]: audit 2021-03-10T20:07:27.495758+0000 mgr.y (mgr.14140) 320 : audit [DBG] from='client.14631 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:07:29.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:28 gibba044 bash[9859]: cephadm 2021-03-10T20:07:27.501836+0000 mgr.y (mgr.14140) 321 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T20:07:30.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:29 gibba023 bash[9844]: cluster 2021-03-10T20:07:28.830911+0000 mgr.y (mgr.14140) 322 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:30.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:29 gibba023 bash[13032]: cluster 2021-03-10T20:07:28.830911+0000 mgr.y (mgr.14140) 322 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:30.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:29 gibba044 bash[9859]: cluster 2021-03-10T20:07:28.830911+0000 mgr.y (mgr.14140) 322 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:32.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:31 gibba023 bash[9844]: cluster 2021-03-10T20:07:30.831263+0000 mgr.y (mgr.14140) 323 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:32.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:31 gibba023 bash[13032]: cluster 2021-03-10T20:07:30.831263+0000 mgr.y (mgr.14140) 323 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:32.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:31 gibba044 bash[9859]: cluster 2021-03-10T20:07:30.831263+0000 mgr.y (mgr.14140) 323 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:34.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:33 gibba023 bash[9844]: cluster 2021-03-10T20:07:32.831620+0000 mgr.y (mgr.14140) 324 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:34.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:33 gibba023 bash[13032]: cluster 2021-03-10T20:07:32.831620+0000 mgr.y (mgr.14140) 324 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:34.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:33 gibba044 bash[9859]: cluster 2021-03-10T20:07:32.831620+0000 mgr.y (mgr.14140) 324 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:36.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:35 gibba023 bash[9844]: cluster 2021-03-10T20:07:34.831990+0000 mgr.y (mgr.14140) 325 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:36.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:35 gibba023 bash[13032]: cluster 2021-03-10T20:07:34.831990+0000 mgr.y (mgr.14140) 325 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:36.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:35 gibba044 bash[9859]: cluster 2021-03-10T20:07:34.831990+0000 mgr.y (mgr.14140) 325 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:38.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:37 gibba023 bash[9844]: cluster 2021-03-10T20:07:36.832779+0000 mgr.y (mgr.14140) 326 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:38.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:37 gibba023 bash[13032]: cluster 2021-03-10T20:07:36.832779+0000 mgr.y (mgr.14140) 326 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:38.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:37 gibba044 bash[9859]: cluster 2021-03-10T20:07:36.832779+0000 mgr.y (mgr.14140) 326 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:40.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:39 gibba023 bash[9844]: cluster 2021-03-10T20:07:38.833923+0000 mgr.y (mgr.14140) 327 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:40.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:39 gibba023 bash[13032]: cluster 2021-03-10T20:07:38.833923+0000 mgr.y (mgr.14140) 327 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:40.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:39 gibba044 bash[9859]: cluster 2021-03-10T20:07:38.833923+0000 mgr.y (mgr.14140) 327 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:42.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:41 gibba023 bash[9844]: cluster 2021-03-10T20:07:40.835241+0000 mgr.y (mgr.14140) 328 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:42.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:41 gibba023 bash[13032]: cluster 2021-03-10T20:07:40.835241+0000 mgr.y (mgr.14140) 328 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:42.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:41 gibba044 bash[9859]: cluster 2021-03-10T20:07:40.835241+0000 mgr.y (mgr.14140) 328 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:43.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:42 gibba023 bash[9844]: audit 2021-03-10T20:07:42.862929+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4b57f637-3662-4ca4-adab-66834c925771\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]: dispatch 2021-03-10T20:07:43.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:42 gibba023 bash[9844]: audit 2021-03-10T20:07:42.867145+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4b57f637-3662-4ca4-adab-66834c925771\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]': finished 2021-03-10T20:07:43.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:42 gibba023 bash[9844]: audit 2021-03-10T20:07:42.867651+0000 mon.a (mon.0) 602 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:07:43.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:42 gibba023 bash[13032]: audit 2021-03-10T20:07:42.862929+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4b57f637-3662-4ca4-adab-66834c925771\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]: dispatch 2021-03-10T20:07:43.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:42 gibba023 bash[13032]: audit 2021-03-10T20:07:42.867145+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4b57f637-3662-4ca4-adab-66834c925771\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]': finished 2021-03-10T20:07:43.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:42 gibba023 bash[13032]: audit 2021-03-10T20:07:42.867651+0000 mon.a (mon.0) 602 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:07:43.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:42 gibba044 bash[9859]: audit 2021-03-10T20:07:42.862929+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4b57f637-3662-4ca4-adab-66834c925771\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]: dispatch 2021-03-10T20:07:43.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:42 gibba044 bash[9859]: audit 2021-03-10T20:07:42.867145+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4b57f637-3662-4ca4-adab-66834c925771\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_version\": \"ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)\"}"}]': finished 2021-03-10T20:07:43.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:42 gibba044 bash[9859]: audit 2021-03-10T20:07:42.867651+0000 mon.a (mon.0) 602 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:07:43.519 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:07:43.710 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:07:43.710 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (4m) 2m ago 4m 0.21.0 prom/alertmanager c876f5897d7b e401b3f03287 2021-03-10T20:07:43.711 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (4m) 2m ago 4m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:07:43.711 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 4c08d4f918fd 2021-03-10T20:07:43.711 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 1de4a3ab7018 2021-03-10T20:07:43.711 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (9m) 2m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b62b2d90ce7a 2021-03-10T20:07:43.711 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (9m) 2m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 295953e7c788 2021-03-10T20:07:43.712 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (8m) 2m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 0e96acfc200a 2021-03-10T20:07:43.712 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (8m) 2m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 c1745ed327ed 2021-03-10T20:07:43.712 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (4m) 2m ago 4m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:07:43.712 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (4m) 2m ago 4m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:07:43.713 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a8e662729287 2021-03-10T20:07:43.713 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 aba825ce9058 2021-03-10T20:07:43.713 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 0b4c19578b20 2021-03-10T20:07:43.713 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 25229602755c 2021-03-10T20:07:43.713 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a745be9e28cb 2021-03-10T20:07:43.714 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0313bf557eb 2021-03-10T20:07:43.714 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 ffa9fe94cea1 2021-03-10T20:07:43.714 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (4m) 2m ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 082d0fe68f90 2021-03-10T20:07:43.715 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (3m) 2m ago 4m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:07:43.715 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 running (2m) 2m ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 479c1eeb4a51 2021-03-10T20:07:43.715 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 2m ago 2m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:07:43.929 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:07:43.929 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:07:43.929 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T20:07:43.929 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:07:43.930 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:07:43.930 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T20:07:43.930 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:07:43.930 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:07:43.931 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T20:07:43.931 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:07:43.931 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:07:43.931 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:07:43.931 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 14 2021-03-10T20:07:43.932 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:07:43.932 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:07:44.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:43 gibba023 bash[9844]: cluster 2021-03-10T20:07:42.836544+0000 mgr.y (mgr.14140) 329 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:44.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:43 gibba023 bash[9844]: cephadm 2021-03-10T20:07:42.867485+0000 mgr.y (mgr.14140) 330 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T20:07:44.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:43 gibba023 bash[9844]: cephadm 2021-03-10T20:07:42.868511+0000 mgr.y (mgr.14140) 331 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T20:07:44.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:43 gibba023 bash[9844]: cephadm 2021-03-10T20:07:42.868577+0000 mgr.y (mgr.14140) 332 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T20:07:44.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:43 gibba023 bash[9844]: cephadm 2021-03-10T20:07:42.990604+0000 mgr.y (mgr.14140) 333 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a on gibba044 2021-03-10T20:07:44.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:43 gibba023 bash[13032]: cluster 2021-03-10T20:07:42.836544+0000 mgr.y (mgr.14140) 329 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:44.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:43 gibba023 bash[13032]: cephadm 2021-03-10T20:07:42.867485+0000 mgr.y (mgr.14140) 330 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T20:07:44.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:43 gibba023 bash[13032]: cephadm 2021-03-10T20:07:42.868511+0000 mgr.y (mgr.14140) 331 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T20:07:44.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:43 gibba023 bash[13032]: cephadm 2021-03-10T20:07:42.868577+0000 mgr.y (mgr.14140) 332 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T20:07:44.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:43 gibba023 bash[13032]: cephadm 2021-03-10T20:07:42.990604+0000 mgr.y (mgr.14140) 333 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a on gibba044 2021-03-10T20:07:44.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:43 gibba044 bash[9859]: cluster 2021-03-10T20:07:42.836544+0000 mgr.y (mgr.14140) 329 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:44.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:43 gibba044 bash[9859]: cephadm 2021-03-10T20:07:42.867485+0000 mgr.y (mgr.14140) 330 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T20:07:44.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:43 gibba044 bash[9859]: cephadm 2021-03-10T20:07:42.868511+0000 mgr.y (mgr.14140) 331 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T20:07:44.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:43 gibba044 bash[9859]: cephadm 2021-03-10T20:07:42.868577+0000 mgr.y (mgr.14140) 332 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T20:07:44.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:43 gibba044 bash[9859]: cephadm 2021-03-10T20:07:42.990604+0000 mgr.y (mgr.14140) 333 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a on gibba044 2021-03-10T20:07:45.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:44 gibba023 bash[9844]: audit 2021-03-10T20:07:43.511968+0000 mgr.y (mgr.14140) 334 : audit [DBG] from='client.14637 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:07:45.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:44 gibba023 bash[9844]: audit 2021-03-10T20:07:43.706482+0000 mgr.y (mgr.14140) 335 : audit [DBG] from='client.24556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:07:45.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:44 gibba023 bash[9844]: audit 2021-03-10T20:07:43.928940+0000 mon.b (mon.2) 25 : audit [DBG] from='client.? 172.21.2.123:0/4074651765' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:07:45.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:44 gibba023 bash[13032]: audit 2021-03-10T20:07:43.511968+0000 mgr.y (mgr.14140) 334 : audit [DBG] from='client.14637 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:07:45.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:44 gibba023 bash[13032]: audit 2021-03-10T20:07:43.706482+0000 mgr.y (mgr.14140) 335 : audit [DBG] from='client.24556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:07:45.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:44 gibba023 bash[13032]: audit 2021-03-10T20:07:43.928940+0000 mon.b (mon.2) 25 : audit [DBG] from='client.? 172.21.2.123:0/4074651765' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:07:45.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:44 gibba044 bash[9859]: audit 2021-03-10T20:07:43.511968+0000 mgr.y (mgr.14140) 334 : audit [DBG] from='client.14637 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:07:45.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:44 gibba044 bash[9859]: audit 2021-03-10T20:07:43.706482+0000 mgr.y (mgr.14140) 335 : audit [DBG] from='client.24556 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:07:45.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:44 gibba044 bash[9859]: audit 2021-03-10T20:07:43.928940+0000 mon.b (mon.2) 25 : audit [DBG] from='client.? 172.21.2.123:0/4074651765' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:07:46.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:45 gibba023 bash[9844]: cluster 2021-03-10T20:07:44.837320+0000 mgr.y (mgr.14140) 336 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:46.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:45 gibba023 bash[13032]: cluster 2021-03-10T20:07:44.837320+0000 mgr.y (mgr.14140) 336 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:46.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:45 gibba044 bash[9859]: cluster 2021-03-10T20:07:44.837320+0000 mgr.y (mgr.14140) 336 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:48.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:47 gibba023 bash[9844]: cluster 2021-03-10T20:07:46.838793+0000 mgr.y (mgr.14140) 337 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:48.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:47 gibba023 bash[13032]: cluster 2021-03-10T20:07:46.838793+0000 mgr.y (mgr.14140) 337 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:48.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:47 gibba044 bash[9859]: cluster 2021-03-10T20:07:46.838793+0000 mgr.y (mgr.14140) 337 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:50.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:49 gibba044 bash[9859]: cluster 2021-03-10T20:07:48.839781+0000 mgr.y (mgr.14140) 338 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:50.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:49 gibba023 bash[9844]: cluster 2021-03-10T20:07:48.839781+0000 mgr.y (mgr.14140) 338 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:50.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:49 gibba023 bash[13032]: cluster 2021-03-10T20:07:48.839781+0000 mgr.y (mgr.14140) 338 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:52.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:51 gibba023 bash[9844]: cluster 2021-03-10T20:07:50.841416+0000 mgr.y (mgr.14140) 339 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:52.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:51 gibba023 bash[13032]: cluster 2021-03-10T20:07:50.841416+0000 mgr.y (mgr.14140) 339 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:52.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:51 gibba044 bash[9859]: cluster 2021-03-10T20:07:50.841416+0000 mgr.y (mgr.14140) 339 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:54.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:53 gibba023 bash[9844]: cluster 2021-03-10T20:07:52.843028+0000 mgr.y (mgr.14140) 340 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:54.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:53 gibba023 bash[13032]: cluster 2021-03-10T20:07:52.843028+0000 mgr.y (mgr.14140) 340 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:54.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:53 gibba044 bash[9859]: cluster 2021-03-10T20:07:52.843028+0000 mgr.y (mgr.14140) 340 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:56.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:55 gibba023 bash[9844]: cluster 2021-03-10T20:07:54.844497+0000 mgr.y (mgr.14140) 341 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:56.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:55 gibba023 bash[13032]: cluster 2021-03-10T20:07:54.844497+0000 mgr.y (mgr.14140) 341 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:56.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:55 gibba044 bash[9859]: cluster 2021-03-10T20:07:54.844497+0000 mgr.y (mgr.14140) 341 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:58.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:57 gibba023 bash[9844]: cluster 2021-03-10T20:07:56.846049+0000 mgr.y (mgr.14140) 342 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:58.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:57 gibba023 bash[13032]: cluster 2021-03-10T20:07:56.846049+0000 mgr.y (mgr.14140) 342 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:07:58.230 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:57 gibba044 bash[9859]: cluster 2021-03-10T20:07:56.846049+0000 mgr.y (mgr.14140) 342 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:00.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:59 gibba023 bash[9844]: cluster 2021-03-10T20:07:58.847334+0000 mgr.y (mgr.14140) 343 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:00.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:59 gibba023 bash[9844]: cephadm 2021-03-10T20:07:59.103773+0000 mgr.y (mgr.14140) 344 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2021-03-10T20:08:00.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:59 gibba023 bash[9844]: cephadm 2021-03-10T20:07:59.103985+0000 mgr.y (mgr.14140) 345 : cephadm [INF] Upgrade: Redeploying mgr.x 2021-03-10T20:08:00.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:59 gibba023 bash[9844]: audit 2021-03-10T20:07:59.104887+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]: dispatch 2021-03-10T20:08:00.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:59 gibba023 bash[9844]: audit 2021-03-10T20:07:59.114186+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]': finished 2021-03-10T20:08:00.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:59 gibba023 bash[9844]: audit 2021-03-10T20:07:59.114960+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2021-03-10T20:08:00.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:59 gibba023 bash[9844]: audit 2021-03-10T20:07:59.115757+0000 mon.a (mon.0) 606 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:08:00.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:59 gibba023 bash[9844]: cephadm 2021-03-10T20:07:59.116302+0000 mgr.y (mgr.14140) 346 : cephadm [INF] Deploying daemon mgr.x on gibba044 2021-03-10T20:08:00.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:07:59 gibba023 bash[9844]: audit 2021-03-10T20:07:59.116519+0000 mon.a (mon.0) 607 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T20:08:00.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:59 gibba023 bash[13032]: cluster 2021-03-10T20:07:58.847334+0000 mgr.y (mgr.14140) 343 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:00.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:59 gibba023 bash[13032]: cephadm 2021-03-10T20:07:59.103773+0000 mgr.y (mgr.14140) 344 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2021-03-10T20:08:00.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:59 gibba023 bash[13032]: cephadm 2021-03-10T20:07:59.103985+0000 mgr.y (mgr.14140) 345 : cephadm [INF] Upgrade: Redeploying mgr.x 2021-03-10T20:08:00.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:59 gibba023 bash[13032]: audit 2021-03-10T20:07:59.104887+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]: dispatch 2021-03-10T20:08:00.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:59 gibba023 bash[13032]: audit 2021-03-10T20:07:59.114186+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]': finished 2021-03-10T20:08:00.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:59 gibba023 bash[13032]: audit 2021-03-10T20:07:59.114960+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2021-03-10T20:08:00.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:59 gibba023 bash[13032]: audit 2021-03-10T20:07:59.115757+0000 mon.a (mon.0) 606 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:08:00.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:59 gibba023 bash[13032]: cephadm 2021-03-10T20:07:59.116302+0000 mgr.y (mgr.14140) 346 : cephadm [INF] Deploying daemon mgr.x on gibba044 2021-03-10T20:08:00.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:07:59 gibba023 bash[13032]: audit 2021-03-10T20:07:59.116519+0000 mon.a (mon.0) 607 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T20:08:00.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:59 gibba044 bash[9859]: cluster 2021-03-10T20:07:58.847334+0000 mgr.y (mgr.14140) 343 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:00.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:59 gibba044 bash[9859]: cephadm 2021-03-10T20:07:59.103773+0000 mgr.y (mgr.14140) 344 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2021-03-10T20:08:00.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:59 gibba044 bash[9859]: cephadm 2021-03-10T20:07:59.103985+0000 mgr.y (mgr.14140) 345 : cephadm [INF] Upgrade: Redeploying mgr.x 2021-03-10T20:08:00.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:59 gibba044 bash[9859]: audit 2021-03-10T20:07:59.104887+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]: dispatch 2021-03-10T20:08:00.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:59 gibba044 bash[9859]: audit 2021-03-10T20:07:59.114186+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.x"}]': finished 2021-03-10T20:08:00.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:59 gibba044 bash[9859]: audit 2021-03-10T20:07:59.114960+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2021-03-10T20:08:00.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:59 gibba044 bash[9859]: audit 2021-03-10T20:07:59.115757+0000 mon.a (mon.0) 606 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:08:00.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:59 gibba044 bash[9859]: cephadm 2021-03-10T20:07:59.116302+0000 mgr.y (mgr.14140) 346 : cephadm [INF] Deploying daemon mgr.x on gibba044 2021-03-10T20:08:00.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:07:59 gibba044 bash[9859]: audit 2021-03-10T20:07:59.116519+0000 mon.a (mon.0) 607 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-03-10T20:08:01.251 INFO:journalctl@ceph.mgr.x.gibba044.stdout:Mar 10 20:08:00 gibba044 systemd[1]: Stopping Ceph mgr.x for dd719b26-81da-11eb-9080-001a4aab830c... 2021-03-10T20:08:02.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:01 gibba044 bash[9859]: cluster 2021-03-10T20:08:00.848837+0000 mgr.y (mgr.14140) 347 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:02.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:01 gibba023 bash[9844]: cluster 2021-03-10T20:08:00.848837+0000 mgr.y (mgr.14140) 347 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:02.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:01 gibba023 bash[13032]: cluster 2021-03-10T20:08:00.848837+0000 mgr.y (mgr.14140) 347 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:04.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:03 gibba044 bash[9859]: cluster 2021-03-10T20:08:02.850399+0000 mgr.y (mgr.14140) 348 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:04.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:03 gibba023 bash[9844]: cluster 2021-03-10T20:08:02.850399+0000 mgr.y (mgr.14140) 348 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:04.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:03 gibba023 bash[13032]: cluster 2021-03-10T20:08:02.850399+0000 mgr.y (mgr.14140) 348 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:06.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:05 gibba023 bash[9844]: cluster 2021-03-10T20:08:04.851732+0000 mgr.y (mgr.14140) 349 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:06.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:05 gibba023 bash[13032]: cluster 2021-03-10T20:08:04.851732+0000 mgr.y (mgr.14140) 349 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:06.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:05 gibba044 bash[9859]: cluster 2021-03-10T20:08:04.851732+0000 mgr.y (mgr.14140) 349 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:08.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:07 gibba023 bash[9844]: cluster 2021-03-10T20:08:06.852652+0000 mgr.y (mgr.14140) 350 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:08.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:07 gibba023 bash[13032]: cluster 2021-03-10T20:08:06.852652+0000 mgr.y (mgr.14140) 350 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:08.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:07 gibba044 bash[9859]: cluster 2021-03-10T20:08:06.852652+0000 mgr.y (mgr.14140) 350 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:10.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:09 gibba023 bash[9844]: cluster 2021-03-10T20:08:08.853665+0000 mgr.y (mgr.14140) 351 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:10.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:09 gibba023 bash[13032]: cluster 2021-03-10T20:08:08.853665+0000 mgr.y (mgr.14140) 351 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:10.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:09 gibba044 bash[9859]: cluster 2021-03-10T20:08:08.853665+0000 mgr.y (mgr.14140) 351 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:12.161 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:11 gibba044 bash[9859]: cluster 2021-03-10T20:08:10.855433+0000 mgr.y (mgr.14140) 352 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:12.162 INFO:journalctl@ceph.mgr.x.gibba044.stdout:Mar 10 20:08:11 gibba044 docker[22004]: ceph-dd719b26-81da-11eb-9080-001a4aab830c-mgr.x 2021-03-10T20:08:12.162 INFO:journalctl@ceph.mgr.x.gibba044.stdout:Mar 10 20:08:11 gibba044 systemd[1]: ceph-dd719b26-81da-11eb-9080-001a4aab830c@mgr.x.service: Main process exited, code=exited, status=137/n/a 2021-03-10T20:08:12.163 INFO:journalctl@ceph.mgr.x.gibba044.stdout:Mar 10 20:08:11 gibba044 systemd[1]: ceph-dd719b26-81da-11eb-9080-001a4aab830c@mgr.x.service: Failed with result 'exit-code'. 2021-03-10T20:08:12.163 INFO:journalctl@ceph.mgr.x.gibba044.stdout:Mar 10 20:08:11 gibba044 systemd[1]: Stopped Ceph mgr.x for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:08:12.163 INFO:journalctl@ceph.mgr.x.gibba044.stdout:Mar 10 20:08:11 gibba044 systemd[1]: Starting Ceph mgr.x for dd719b26-81da-11eb-9080-001a4aab830c... 2021-03-10T20:08:12.163 INFO:journalctl@ceph.mgr.x.gibba044.stdout:Mar 10 20:08:11 gibba044 docker[22080]: Error: No such container: ceph-dd719b26-81da-11eb-9080-001a4aab830c-mgr.x 2021-03-10T20:08:12.163 INFO:journalctl@ceph.mgr.x.gibba044.stdout:Mar 10 20:08:11 gibba044 systemd[1]: Started Ceph mgr.x for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:08:12.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:11 gibba023 bash[9844]: cluster 2021-03-10T20:08:10.855433+0000 mgr.y (mgr.14140) 352 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:12.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:11 gibba023 bash[13032]: cluster 2021-03-10T20:08:10.855433+0000 mgr.y (mgr.14140) 352 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:13.251 INFO:journalctl@ceph.mgr.x.gibba044.stdout:Mar 10 20:08:12 gibba044 bash[22100]: debug 2021-03-10T20:08:12.982+0000 7fe15247a700 1 -- 172.21.2.144:0/1914943297 <== mon.2 v2:172.21.2.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d9820524e0 con 0x55d982140800 2021-03-10T20:08:13.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:12 gibba044 bash[9859]: audit 2021-03-10T20:08:11.945949+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.464802\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465226\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465385\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465535\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465684\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465831\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465979\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.466127\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.466305\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2021-03-10T20:05:26.466459\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:08:13.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:12 gibba044 bash[9859]: audit 2021-03-10T20:08:11.948609+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.464802\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465226\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465385\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465535\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465684\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465831\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465979\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.466127\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.466305\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2021-03-10T20:05:26.466459\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:08:13.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:12 gibba044 bash[9859]: audit 2021-03-10T20:08:11.949195+0000 mon.a (mon.0) 610 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:08:13.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:12 gibba023 bash[9844]: audit 2021-03-10T20:08:11.945949+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.464802\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465226\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465385\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465535\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465684\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465831\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465979\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.466127\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.466305\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2021-03-10T20:05:26.466459\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:08:13.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:12 gibba023 bash[9844]: audit 2021-03-10T20:08:11.948609+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.464802\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465226\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465385\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465535\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465684\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465831\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465979\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.466127\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.466305\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2021-03-10T20:05:26.466459\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:08:13.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:12 gibba023 bash[9844]: audit 2021-03-10T20:08:11.949195+0000 mon.a (mon.0) 610 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:08:13.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:12 gibba023 bash[13032]: audit 2021-03-10T20:08:11.945949+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.464802\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465226\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465385\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465535\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465684\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465831\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465979\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.466127\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.466305\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2021-03-10T20:05:26.466459\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:08:13.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:12 gibba023 bash[13032]: audit 2021-03-10T20:08:11.948609+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.464802\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465226\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465385\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465535\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465684\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465831\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.465979\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.466127\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:05:26.466305\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"unknown\", \"last_refresh\": \"2021-03-10T20:05:26.466459\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:08:13.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:12 gibba023 bash[13032]: audit 2021-03-10T20:08:11.949195+0000 mon.a (mon.0) 610 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:08:14.150 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:08:14.226 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:13 gibba044 bash[9859]: cluster 2021-03-10T20:08:12.856785+0000 mgr.y (mgr.14140) 353 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:14.228 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:13 gibba044 bash[9859]: audit 2021-03-10T20:08:13.019420+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.014875\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015085\", \"created\": \"2021-03-10T19:59:48.153504\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015163\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015284\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015396\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015506\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015615\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015725\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015833\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015942\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:08:13.016051\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_daemon_update\": \"2021-03-10T20:08:13.016262\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:08:14.229 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:13 gibba044 bash[9859]: audit 2021-03-10T20:08:13.028432+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.014875\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015085\", \"created\": \"2021-03-10T19:59:48.153504\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015163\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015284\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015396\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015506\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015615\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015725\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015833\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015942\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:08:13.016051\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_daemon_update\": \"2021-03-10T20:08:13.016262\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:08:14.229 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:13 gibba044 bash[9859]: cephadm 2021-03-10T20:08:13.030159+0000 mgr.y (mgr.14140) 354 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T20:08:14.230 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:13 gibba044 bash[9859]: audit 2021-03-10T20:08:13.030277+0000 mon.a (mon.0) 613 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:08:14.230 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:13 gibba044 bash[9859]: cephadm 2021-03-10T20:08:13.031461+0000 mgr.y (mgr.14140) 355 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T20:08:14.230 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:13 gibba044 bash[9859]: cephadm 2021-03-10T20:08:13.031603+0000 mgr.y (mgr.14140) 356 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T20:08:14.338 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:08:14.338 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (4m) 2m ago 4m 0.21.0 prom/alertmanager c876f5897d7b e401b3f03287 2021-03-10T20:08:14.338 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (4m) 1s ago 4m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:08:14.339 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (8m) 1s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 4c08d4f918fd 2021-03-10T20:08:14.339 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running 1s ago 8m quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T20:08:14.339 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (10m) 2m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b62b2d90ce7a 2021-03-10T20:08:14.339 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (10m) 2m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 295953e7c788 2021-03-10T20:08:14.340 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (8m) 1s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 0e96acfc200a 2021-03-10T20:08:14.340 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (8m) 2m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 c1745ed327ed 2021-03-10T20:08:14.340 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (5m) 2m ago 5m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:08:14.340 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (5m) 1s ago 5m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:08:14.340 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (8m) 2m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a8e662729287 2021-03-10T20:08:14.341 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 aba825ce9058 2021-03-10T20:08:14.341 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 0b4c19578b20 2021-03-10T20:08:14.341 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 25229602755c 2021-03-10T20:08:14.341 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (6m) 1s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a745be9e28cb 2021-03-10T20:08:14.342 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (6m) 1s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0313bf557eb 2021-03-10T20:08:14.342 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (5m) 1s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 ffa9fe94cea1 2021-03-10T20:08:14.342 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (5m) 1s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 082d0fe68f90 2021-03-10T20:08:14.342 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (4m) 1s ago 5m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:08:14.342 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 running (2m) 2m ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 479c1eeb4a51 2021-03-10T20:08:14.343 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 1s ago 2m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:08:14.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:13 gibba023 bash[9844]: cluster 2021-03-10T20:08:12.856785+0000 mgr.y (mgr.14140) 353 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:14.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:13 gibba023 bash[13032]: cluster 2021-03-10T20:08:12.856785+0000 mgr.y (mgr.14140) 353 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:14.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:13 gibba023 bash[13032]: audit 2021-03-10T20:08:13.019420+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.014875\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015085\", \"created\": \"2021-03-10T19:59:48.153504\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015163\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015284\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015396\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015506\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015615\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015725\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015833\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015942\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:08:13.016051\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_daemon_update\": \"2021-03-10T20:08:13.016262\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:08:14.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:13 gibba023 bash[13032]: audit 2021-03-10T20:08:13.028432+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.014875\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015085\", \"created\": \"2021-03-10T19:59:48.153504\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015163\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015284\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015396\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015506\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015615\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015725\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015833\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015942\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:08:13.016051\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_daemon_update\": \"2021-03-10T20:08:13.016262\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:08:14.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:13 gibba023 bash[13032]: cephadm 2021-03-10T20:08:13.030159+0000 mgr.y (mgr.14140) 354 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T20:08:14.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:13 gibba023 bash[13032]: audit 2021-03-10T20:08:13.030277+0000 mon.a (mon.0) 613 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:08:14.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:13 gibba023 bash[13032]: cephadm 2021-03-10T20:08:13.031461+0000 mgr.y (mgr.14140) 355 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T20:08:14.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:13 gibba023 bash[13032]: cephadm 2021-03-10T20:08:13.031603+0000 mgr.y (mgr.14140) 356 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T20:08:14.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:13 gibba023 bash[9844]: audit 2021-03-10T20:08:13.019420+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.014875\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015085\", \"created\": \"2021-03-10T19:59:48.153504\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015163\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015284\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015396\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015506\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015615\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015725\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015833\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015942\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:08:13.016051\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_daemon_update\": \"2021-03-10T20:08:13.016262\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:08:14.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:13 gibba023 bash[9844]: audit 2021-03-10T20:08:13.028432+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.014875\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015085\", \"created\": \"2021-03-10T19:59:48.153504\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"4c08d4f918fd\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015163\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T19:59:50.511898\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015284\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015396\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015506\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015615\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015725\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015833\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015942\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:08:13.016051\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:48.184501\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_daemon_update\": \"2021-03-10T20:08:13.016262\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:08:14.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:13 gibba023 bash[9844]: cephadm 2021-03-10T20:08:13.030159+0000 mgr.y (mgr.14140) 354 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T20:08:14.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:13 gibba023 bash[9844]: audit 2021-03-10T20:08:13.030277+0000 mon.a (mon.0) 613 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:08:14.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:13 gibba023 bash[9844]: cephadm 2021-03-10T20:08:13.031461+0000 mgr.y (mgr.14140) 355 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T20:08:14.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:13 gibba023 bash[9844]: cephadm 2021-03-10T20:08:13.031603+0000 mgr.y (mgr.14140) 356 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T20:08:14.555 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:08:14.556 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:08:14.556 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T20:08:14.556 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:08:14.557 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:08:14.557 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T20:08:14.558 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:08:14.558 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:08:14.559 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T20:08:14.559 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:08:14.561 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:08:14.561 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:08:14.562 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 14 2021-03-10T20:08:14.564 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:08:14.564 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:08:15.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:14 gibba044 bash[9859]: audit 2021-03-10T20:08:14.141346+0000 mgr.y (mgr.14140) 357 : audit [DBG] from='client.14661 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:08:15.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:14 gibba044 bash[9859]: audit 2021-03-10T20:08:14.554150+0000 mon.a (mon.0) 614 : audit [DBG] from='client.? 172.21.2.123:0/117425440' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:08:15.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:14 gibba023 bash[9844]: audit 2021-03-10T20:08:14.141346+0000 mgr.y (mgr.14140) 357 : audit [DBG] from='client.14661 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:08:15.433 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:14 gibba023 bash[9844]: audit 2021-03-10T20:08:14.554150+0000 mon.a (mon.0) 614 : audit [DBG] from='client.? 172.21.2.123:0/117425440' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:08:15.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:14 gibba023 bash[13032]: audit 2021-03-10T20:08:14.141346+0000 mgr.y (mgr.14140) 357 : audit [DBG] from='client.14661 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:08:15.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:14 gibba023 bash[13032]: audit 2021-03-10T20:08:14.554150+0000 mon.a (mon.0) 614 : audit [DBG] from='client.? 172.21.2.123:0/117425440' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:08:16.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:15 gibba044 bash[9859]: audit 2021-03-10T20:08:14.334568+0000 mgr.y (mgr.14140) 358 : audit [DBG] from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:08:16.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:15 gibba044 bash[9859]: cluster 2021-03-10T20:08:14.858395+0000 mgr.y (mgr.14140) 359 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:16.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:15 gibba023 bash[9844]: audit 2021-03-10T20:08:14.334568+0000 mgr.y (mgr.14140) 358 : audit [DBG] from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:08:16.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:15 gibba023 bash[9844]: cluster 2021-03-10T20:08:14.858395+0000 mgr.y (mgr.14140) 359 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:16.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:15 gibba023 bash[13032]: audit 2021-03-10T20:08:14.334568+0000 mgr.y (mgr.14140) 358 : audit [DBG] from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:08:16.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:15 gibba023 bash[13032]: cluster 2021-03-10T20:08:14.858395+0000 mgr.y (mgr.14140) 359 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:17.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:16 gibba044 bash[9859]: audit 2021-03-10T20:08:16.300157+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba044.wflcwh"}]: dispatch 2021-03-10T20:08:17.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:16 gibba044 bash[9859]: audit 2021-03-10T20:08:16.309497+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba044.wflcwh"}]': finished 2021-03-10T20:08:17.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:16 gibba044 bash[9859]: audit 2021-03-10T20:08:16.310594+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.gibba044.wflcwh"}]: dispatch 2021-03-10T20:08:17.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:16 gibba044 bash[9859]: audit 2021-03-10T20:08:16.311493+0000 mon.a (mon.0) 618 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:08:17.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:16 gibba044 bash[9859]: audit 2021-03-10T20:08:16.312428+0000 mon.a (mon.0) 619 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba044.wflcwh", "key": "container_image"}]: dispatch 2021-03-10T20:08:17.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:16 gibba044 bash[9859]: audit 2021-03-10T20:08:16.834933+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.2.144:0/2315216308' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:08:17.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:16 gibba044 bash[9859]: cluster 2021-03-10T20:08:16.835059+0000 mon.a (mon.0) 620 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T20:08:17.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:16 gibba044 bash[9859]: cluster 2021-03-10T20:08:16.835450+0000 mon.a (mon.0) 621 : cluster [DBG] Standby manager daemon x started 2021-03-10T20:08:17.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:16 gibba044 bash[9859]: audit 2021-03-10T20:08:16.835929+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.? 172.21.2.144:0/2315216308' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:08:17.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:16 gibba023 bash[9844]: audit 2021-03-10T20:08:16.300157+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba044.wflcwh"}]: dispatch 2021-03-10T20:08:17.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:16 gibba023 bash[9844]: audit 2021-03-10T20:08:16.309497+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba044.wflcwh"}]': finished 2021-03-10T20:08:17.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:16 gibba023 bash[9844]: audit 2021-03-10T20:08:16.310594+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.gibba044.wflcwh"}]: dispatch 2021-03-10T20:08:17.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:16 gibba023 bash[9844]: audit 2021-03-10T20:08:16.311493+0000 mon.a (mon.0) 618 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:08:17.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:16 gibba023 bash[9844]: audit 2021-03-10T20:08:16.312428+0000 mon.a (mon.0) 619 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba044.wflcwh", "key": "container_image"}]: dispatch 2021-03-10T20:08:17.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:16 gibba023 bash[9844]: audit 2021-03-10T20:08:16.834933+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.2.144:0/2315216308' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:08:17.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:16 gibba023 bash[9844]: cluster 2021-03-10T20:08:16.835059+0000 mon.a (mon.0) 620 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T20:08:17.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:16 gibba023 bash[9844]: cluster 2021-03-10T20:08:16.835450+0000 mon.a (mon.0) 621 : cluster [DBG] Standby manager daemon x started 2021-03-10T20:08:17.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:16 gibba023 bash[9844]: audit 2021-03-10T20:08:16.835929+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.? 172.21.2.144:0/2315216308' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:08:17.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:16 gibba023 bash[13032]: audit 2021-03-10T20:08:16.300157+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba044.wflcwh"}]: dispatch 2021-03-10T20:08:17.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:16 gibba023 bash[13032]: audit 2021-03-10T20:08:16.309497+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.gibba044.wflcwh"}]': finished 2021-03-10T20:08:17.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:16 gibba023 bash[13032]: audit 2021-03-10T20:08:16.310594+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.gibba044.wflcwh"}]: dispatch 2021-03-10T20:08:17.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:16 gibba023 bash[13032]: audit 2021-03-10T20:08:16.311493+0000 mon.a (mon.0) 618 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:08:17.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:16 gibba023 bash[13032]: audit 2021-03-10T20:08:16.312428+0000 mon.a (mon.0) 619 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.gibba044.wflcwh", "key": "container_image"}]: dispatch 2021-03-10T20:08:17.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:16 gibba023 bash[13032]: audit 2021-03-10T20:08:16.834933+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.2.144:0/2315216308' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:08:17.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:16 gibba023 bash[13032]: cluster 2021-03-10T20:08:16.835059+0000 mon.a (mon.0) 620 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T20:08:17.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:16 gibba023 bash[13032]: cluster 2021-03-10T20:08:16.835450+0000 mon.a (mon.0) 621 : cluster [DBG] Standby manager daemon x started 2021-03-10T20:08:17.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:16 gibba023 bash[13032]: audit 2021-03-10T20:08:16.835929+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.? 172.21.2.144:0/2315216308' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:08:18.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:17 gibba044 bash[9859]: cephadm 2021-03-10T20:08:16.299073+0000 mgr.y (mgr.14140) 360 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.gibba044.wflcwh 2021-03-10T20:08:18.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:17 gibba044 bash[9859]: cephadm 2021-03-10T20:08:16.299293+0000 mgr.y (mgr.14140) 361 : cephadm [INF] Upgrade: Redeploying mgr.gibba044.wflcwh 2021-03-10T20:08:18.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:17 gibba044 bash[9859]: cephadm 2021-03-10T20:08:16.312218+0000 mgr.y (mgr.14140) 362 : cephadm [INF] Deploying daemon mgr.gibba044.wflcwh on gibba044 2021-03-10T20:08:18.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:17 gibba044 bash[9859]: cluster 2021-03-10T20:08:16.859734+0000 mgr.y (mgr.14140) 363 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:18.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:17 gibba044 bash[9859]: cluster 2021-03-10T20:08:17.318678+0000 mon.a (mon.0) 622 : cluster [DBG] mgrmap e16: y(active, since 9m), standbys: gibba044.wflcwh, x 2021-03-10T20:08:18.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:17 gibba023 bash[9844]: cephadm 2021-03-10T20:08:16.299073+0000 mgr.y (mgr.14140) 360 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.gibba044.wflcwh 2021-03-10T20:08:18.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:17 gibba023 bash[9844]: cephadm 2021-03-10T20:08:16.299293+0000 mgr.y (mgr.14140) 361 : cephadm [INF] Upgrade: Redeploying mgr.gibba044.wflcwh 2021-03-10T20:08:18.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:17 gibba023 bash[9844]: cephadm 2021-03-10T20:08:16.312218+0000 mgr.y (mgr.14140) 362 : cephadm [INF] Deploying daemon mgr.gibba044.wflcwh on gibba044 2021-03-10T20:08:18.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:17 gibba023 bash[9844]: cluster 2021-03-10T20:08:16.859734+0000 mgr.y (mgr.14140) 363 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:18.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:17 gibba023 bash[9844]: cluster 2021-03-10T20:08:17.318678+0000 mon.a (mon.0) 622 : cluster [DBG] mgrmap e16: y(active, since 9m), standbys: gibba044.wflcwh, x 2021-03-10T20:08:18.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:17 gibba023 bash[13032]: cephadm 2021-03-10T20:08:16.299073+0000 mgr.y (mgr.14140) 360 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.gibba044.wflcwh 2021-03-10T20:08:18.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:17 gibba023 bash[13032]: cephadm 2021-03-10T20:08:16.299293+0000 mgr.y (mgr.14140) 361 : cephadm [INF] Upgrade: Redeploying mgr.gibba044.wflcwh 2021-03-10T20:08:18.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:17 gibba023 bash[13032]: cephadm 2021-03-10T20:08:16.312218+0000 mgr.y (mgr.14140) 362 : cephadm [INF] Deploying daemon mgr.gibba044.wflcwh on gibba044 2021-03-10T20:08:18.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:17 gibba023 bash[13032]: cluster 2021-03-10T20:08:16.859734+0000 mgr.y (mgr.14140) 363 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:18.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:17 gibba023 bash[13032]: cluster 2021-03-10T20:08:17.318678+0000 mon.a (mon.0) 622 : cluster [DBG] mgrmap e16: y(active, since 9m), standbys: gibba044.wflcwh, x 2021-03-10T20:08:20.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:19 gibba044 bash[9859]: cluster 2021-03-10T20:08:18.860849+0000 mgr.y (mgr.14140) 364 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:20.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:19 gibba023 bash[9844]: cluster 2021-03-10T20:08:18.860849+0000 mgr.y (mgr.14140) 364 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:20.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:19 gibba023 bash[13032]: cluster 2021-03-10T20:08:18.860849+0000 mgr.y (mgr.14140) 364 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:22.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:21 gibba044 bash[9859]: cluster 2021-03-10T20:08:20.862378+0000 mgr.y (mgr.14140) 365 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:22.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:21 gibba023 bash[9844]: cluster 2021-03-10T20:08:20.862378+0000 mgr.y (mgr.14140) 365 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:22.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:21 gibba023 bash[13032]: cluster 2021-03-10T20:08:20.862378+0000 mgr.y (mgr.14140) 365 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:24.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:24 gibba023 bash[9844]: cluster 2021-03-10T20:08:22.863676+0000 mgr.y (mgr.14140) 366 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:24.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:24 gibba023 bash[13032]: cluster 2021-03-10T20:08:22.863676+0000 mgr.y (mgr.14140) 366 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:24.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:24 gibba044 bash[9859]: cluster 2021-03-10T20:08:22.863676+0000 mgr.y (mgr.14140) 366 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:26.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:25 gibba023 bash[9844]: cluster 2021-03-10T20:08:24.864357+0000 mgr.y (mgr.14140) 367 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:26.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:25 gibba023 bash[13032]: cluster 2021-03-10T20:08:24.864357+0000 mgr.y (mgr.14140) 367 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:26.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:25 gibba044 bash[9859]: cluster 2021-03-10T20:08:24.864357+0000 mgr.y (mgr.14140) 367 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:28.219 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:27 gibba044 bash[9859]: cluster 2021-03-10T20:08:26.865560+0000 mgr.y (mgr.14140) 368 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:28.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:27 gibba023 bash[9844]: cluster 2021-03-10T20:08:26.865560+0000 mgr.y (mgr.14140) 368 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:28.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:27 gibba023 bash[13032]: cluster 2021-03-10T20:08:26.865560+0000 mgr.y (mgr.14140) 368 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:30.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:29 gibba044 bash[9859]: cluster 2021-03-10T20:08:28.866849+0000 mgr.y (mgr.14140) 369 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:30.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:29 gibba044 bash[9859]: audit 2021-03-10T20:08:29.126907+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.014875\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015085\", \"created\": \"2021-03-10T19:59:48.153504\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015284\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015396\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015506\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015615\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015725\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015833\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015942\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:08:13.016051\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:08:30.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:29 gibba044 bash[9859]: audit 2021-03-10T20:08:29.135989+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.014875\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015085\", \"created\": \"2021-03-10T19:59:48.153504\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015284\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015396\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015506\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015615\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015725\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015833\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015942\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:08:13.016051\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:08:30.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:29 gibba044 bash[9859]: audit 2021-03-10T20:08:29.137511+0000 mon.a (mon.0) 625 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:08:30.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:29 gibba023 bash[9844]: cluster 2021-03-10T20:08:28.866849+0000 mgr.y (mgr.14140) 369 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:30.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:29 gibba023 bash[13032]: cluster 2021-03-10T20:08:28.866849+0000 mgr.y (mgr.14140) 369 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:30.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:29 gibba023 bash[13032]: audit 2021-03-10T20:08:29.126907+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.014875\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015085\", \"created\": \"2021-03-10T19:59:48.153504\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015284\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015396\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015506\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015615\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015725\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015833\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015942\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:08:13.016051\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:08:30.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:29 gibba023 bash[13032]: audit 2021-03-10T20:08:29.135989+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.014875\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015085\", \"created\": \"2021-03-10T19:59:48.153504\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015284\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015396\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015506\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015615\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015725\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015833\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015942\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:08:13.016051\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:08:30.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:29 gibba023 bash[13032]: audit 2021-03-10T20:08:29.137511+0000 mon.a (mon.0) 625 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:08:30.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:29 gibba023 bash[9844]: audit 2021-03-10T20:08:29.126907+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.014875\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015085\", \"created\": \"2021-03-10T19:59:48.153504\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015284\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015396\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015506\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015615\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015725\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015833\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015942\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:08:13.016051\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:08:30.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:29 gibba023 bash[9844]: audit 2021-03-10T20:08:29.135989+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.014875\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015085\", \"created\": \"2021-03-10T19:59:48.153504\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015284\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015396\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015506\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015615\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015725\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015833\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:13.015942\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:08:13.016051\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:08:30.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:29 gibba023 bash[9844]: audit 2021-03-10T20:08:29.137511+0000 mon.a (mon.0) 625 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-03-10T20:08:31.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:30 gibba044 bash[9859]: audit 2021-03-10T20:08:30.802832+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.797586\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.797849\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T20:08:11.961006\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798017\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T20:08:29.136885\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798174\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798356\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798506\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798653\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798802\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798951\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.799097\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:08:30.799246\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_daemon_update\": \"2021-03-10T20:08:30.799522\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:08:31.616 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:30 gibba044 bash[9859]: audit 2021-03-10T20:08:30.811585+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.797586\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.797849\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T20:08:11.961006\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798017\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T20:08:29.136885\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798174\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798356\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798506\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798653\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798802\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798951\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.799097\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:08:30.799246\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_daemon_update\": \"2021-03-10T20:08:30.799522\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:08:31.617 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:30 gibba044 bash[9859]: audit 2021-03-10T20:08:30.813396+0000 mon.a (mon.0) 628 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:08:31.617 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:30 gibba044 bash[9859]: audit 2021-03-10T20:08:30.816557+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2021-03-10T20:08:31.617 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:30 gibba044 bash[9859]: cluster 2021-03-10T20:08:30.819580+0000 mon.a (mon.0) 630 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-03-10T20:08:31.619 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:30 gibba023 bash[13032]: audit 2021-03-10T20:08:30.802832+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.797586\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.797849\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T20:08:11.961006\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798017\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T20:08:29.136885\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798174\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798356\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798506\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798653\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798802\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798951\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.799097\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:08:30.799246\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_daemon_update\": \"2021-03-10T20:08:30.799522\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:08:31.619 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:30 gibba023 bash[13032]: audit 2021-03-10T20:08:30.811585+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.797586\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.797849\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T20:08:11.961006\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798017\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T20:08:29.136885\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798174\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798356\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798506\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798653\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798802\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798951\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.799097\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:08:30.799246\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_daemon_update\": \"2021-03-10T20:08:30.799522\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:08:31.619 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:30 gibba023 bash[13032]: audit 2021-03-10T20:08:30.813396+0000 mon.a (mon.0) 628 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:08:31.620 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:30 gibba023 bash[13032]: audit 2021-03-10T20:08:30.816557+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2021-03-10T20:08:31.620 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:30 gibba023 bash[13032]: cluster 2021-03-10T20:08:30.819580+0000 mon.a (mon.0) 630 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-03-10T20:08:31.620 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:30 gibba023 bash[9844]: audit 2021-03-10T20:08:30.802832+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.797586\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.797849\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T20:08:11.961006\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798017\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T20:08:29.136885\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798174\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798356\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798506\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798653\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798802\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798951\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.799097\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:08:30.799246\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_daemon_update\": \"2021-03-10T20:08:30.799522\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]: dispatch 2021-03-10T20:08:31.621 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:30 gibba023 bash[9844]: audit 2021-03-10T20:08:30.811585+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.797586\", \"created\": \"2021-03-10T19:59:31.557503\", \"started\": \"2021-03-10T19:59:31.580699\"}, \"mgr.x\": {\"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.797849\", \"created\": \"2021-03-10T19:59:48.153504\", \"started\": \"2021-03-10T20:08:11.961006\"}, \"mgr.gibba044.wflcwh\": {\"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"daemon_id\": \"gibba044.wflcwh\", \"daemon_type\": \"mgr\", \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798017\", \"created\": \"2021-03-10T19:59:50.485504\", \"started\": \"2021-03-10T20:08:29.136885\"}, \"osd.4\": {\"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798174\", \"created\": \"2021-03-10T20:01:39.757721\", \"started\": \"2021-03-10T20:01:42.851748\"}, \"osd.5\": {\"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798356\", \"created\": \"2021-03-10T20:02:01.645721\", \"started\": \"2021-03-10T20:02:04.782354\"}, \"osd.6\": {\"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798506\", \"created\": \"2021-03-10T20:02:24.101721\", \"started\": \"2021-03-10T20:02:27.476972\"}, \"osd.7\": {\"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798653\", \"created\": \"2021-03-10T20:02:46.941722\", \"started\": \"2021-03-10T20:02:50.129668\"}, \"prometheus.a\": {\"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798802\", \"created\": \"2021-03-10T20:03:07.141722\", \"started\": \"2021-03-10T20:03:47.780812\"}, \"node-exporter.b\": {\"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.798951\", \"created\": \"2021-03-10T20:03:08.333722\", \"started\": \"2021-03-10T20:03:10.325445\"}, \"grafana.a\": {\"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2021-03-10T20:08:30.799097\", \"created\": \"2021-03-10T20:03:32.209722\", \"started\": \"2021-03-10T20:03:32.232820\"}, \"rgw.r.z.gibba044.rblqpl\": {\"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"daemon_type\": \"rgw\", \"status\": -1, \"status_desc\": \"error\", \"last_refresh\": \"2021-03-10T20:08:30.799246\", \"created\": \"2021-03-10T20:05:21.045724\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088\"}}, \"last_daemon_update\": \"2021-03-10T20:08:30.799522\", \"last_device_update\": \"2021-03-10T20:02:54.556329\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452\"}"}]': finished 2021-03-10T20:08:31.621 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:30 gibba023 bash[9844]: audit 2021-03-10T20:08:30.813396+0000 mon.a (mon.0) 628 : audit [DBG] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:08:31.621 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:30 gibba023 bash[9844]: audit 2021-03-10T20:08:30.816557+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2021-03-10T20:08:31.622 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:30 gibba023 bash[9844]: cluster 2021-03-10T20:08:30.819580+0000 mon.a (mon.0) 630 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-03-10T20:08:32.174 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 20:08:31 gibba023 bash[10078]: debug 2021-03-10T20:08:31.816+0000 7f72556f6700 -1 mgr handle_mgr_map I was active but no longer am 2021-03-10T20:08:32.175 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 20:08:31 gibba023 bash[10078]: ignoring --setuser ceph since I am not root 2021-03-10T20:08:32.175 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 20:08:31 gibba023 bash[10078]: ignoring --setgroup ceph since I am not root 2021-03-10T20:08:32.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:31 gibba023 bash[13032]: cephadm 2021-03-10T20:08:30.813191+0000 mgr.y (mgr.14140) 370 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T20:08:32.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:31 gibba023 bash[13032]: cephadm 2021-03-10T20:08:30.814390+0000 mgr.y (mgr.14140) 371 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T20:08:32.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:31 gibba023 bash[13032]: cephadm 2021-03-10T20:08:30.814449+0000 mgr.y (mgr.14140) 372 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T20:08:32.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:31 gibba023 bash[13032]: cephadm 2021-03-10T20:08:30.816196+0000 mgr.y (mgr.14140) 373 : cephadm [INF] Upgrade: there are 2 other already-upgraded standby mgrs, failing over 2021-03-10T20:08:32.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:31 gibba023 bash[13032]: cluster 2021-03-10T20:08:30.867530+0000 mgr.y (mgr.14140) 374 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:32.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:31 gibba023 bash[13032]: cluster 2021-03-10T20:08:31.632946+0000 mon.a (mon.0) 631 : cluster [DBG] Standby manager daemon y started 2021-03-10T20:08:32.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:31 gibba023 bash[13032]: audit 2021-03-10T20:08:31.821470+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2021-03-10T20:08:32.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:31 gibba023 bash[13032]: cluster 2021-03-10T20:08:31.821531+0000 mon.a (mon.0) 633 : cluster [DBG] mgrmap e17: gibba044.wflcwh(active, starting, since 1.00462s), standbys: y, x 2021-03-10T20:08:32.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:31 gibba023 bash[9844]: cephadm 2021-03-10T20:08:30.813191+0000 mgr.y (mgr.14140) 370 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T20:08:32.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:31 gibba023 bash[9844]: cephadm 2021-03-10T20:08:30.814390+0000 mgr.y (mgr.14140) 371 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T20:08:32.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:31 gibba023 bash[9844]: cephadm 2021-03-10T20:08:30.814449+0000 mgr.y (mgr.14140) 372 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T20:08:32.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:31 gibba023 bash[9844]: cephadm 2021-03-10T20:08:30.816196+0000 mgr.y (mgr.14140) 373 : cephadm [INF] Upgrade: there are 2 other already-upgraded standby mgrs, failing over 2021-03-10T20:08:32.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:31 gibba023 bash[9844]: cluster 2021-03-10T20:08:30.867530+0000 mgr.y (mgr.14140) 374 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:32.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:31 gibba023 bash[9844]: cluster 2021-03-10T20:08:31.632946+0000 mon.a (mon.0) 631 : cluster [DBG] Standby manager daemon y started 2021-03-10T20:08:32.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:31 gibba023 bash[9844]: audit 2021-03-10T20:08:31.821470+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2021-03-10T20:08:32.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:31 gibba023 bash[9844]: cluster 2021-03-10T20:08:31.821531+0000 mon.a (mon.0) 633 : cluster [DBG] mgrmap e17: gibba044.wflcwh(active, starting, since 1.00462s), standbys: y, x 2021-03-10T20:08:32.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:31 gibba044 bash[9859]: cephadm 2021-03-10T20:08:30.813191+0000 mgr.y (mgr.14140) 370 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a with id d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14 2021-03-10T20:08:32.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:31 gibba044 bash[9859]: cephadm 2021-03-10T20:08:30.814390+0000 mgr.y (mgr.14140) 371 : cephadm [INF] Upgrade: Checking mgr daemons... 2021-03-10T20:08:32.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:31 gibba044 bash[9859]: cephadm 2021-03-10T20:08:30.814449+0000 mgr.y (mgr.14140) 372 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-03-10T20:08:32.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:31 gibba044 bash[9859]: cephadm 2021-03-10T20:08:30.816196+0000 mgr.y (mgr.14140) 373 : cephadm [INF] Upgrade: there are 2 other already-upgraded standby mgrs, failing over 2021-03-10T20:08:32.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:31 gibba044 bash[9859]: cluster 2021-03-10T20:08:30.867530+0000 mgr.y (mgr.14140) 374 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 7.0 KiB data, 5.2 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:32.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:31 gibba044 bash[9859]: cluster 2021-03-10T20:08:31.632946+0000 mon.a (mon.0) 631 : cluster [DBG] Standby manager daemon y started 2021-03-10T20:08:32.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:31 gibba044 bash[9859]: audit 2021-03-10T20:08:31.821470+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14140 172.21.2.123:0/3274609222' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2021-03-10T20:08:32.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:31 gibba044 bash[9859]: cluster 2021-03-10T20:08:31.821531+0000 mon.a (mon.0) 633 : cluster [DBG] mgrmap e17: gibba044.wflcwh(active, starting, since 1.00462s), standbys: y, x 2021-03-10T20:08:34.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:34 gibba023 bash[9844]: cluster 2021-03-10T20:08:33.984673+0000 mon.a (mon.0) 634 : cluster [INF] Active manager daemon gibba044.wflcwh restarted 2021-03-10T20:08:34.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:34 gibba023 bash[9844]: cluster 2021-03-10T20:08:33.985281+0000 mon.a (mon.0) 635 : cluster [INF] Activating manager daemon gibba044.wflcwh 2021-03-10T20:08:34.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:34 gibba023 bash[9844]: audit 2021-03-10T20:08:33.986563+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.? 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:08:34.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:34 gibba023 bash[9844]: cluster 2021-03-10T20:08:33.988316+0000 mon.a (mon.0) 636 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-03-10T20:08:34.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:34 gibba023 bash[9844]: audit 2021-03-10T20:08:33.989969+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.? 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:08:34.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:34 gibba023 bash[13032]: cluster 2021-03-10T20:08:33.984673+0000 mon.a (mon.0) 634 : cluster [INF] Active manager daemon gibba044.wflcwh restarted 2021-03-10T20:08:34.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:34 gibba023 bash[13032]: cluster 2021-03-10T20:08:33.985281+0000 mon.a (mon.0) 635 : cluster [INF] Activating manager daemon gibba044.wflcwh 2021-03-10T20:08:34.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:34 gibba023 bash[13032]: audit 2021-03-10T20:08:33.986563+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.? 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:08:34.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:34 gibba023 bash[13032]: cluster 2021-03-10T20:08:33.988316+0000 mon.a (mon.0) 636 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-03-10T20:08:34.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:34 gibba023 bash[13032]: audit 2021-03-10T20:08:33.989969+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.? 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:08:34.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:34 gibba044 bash[9859]: cluster 2021-03-10T20:08:33.984673+0000 mon.a (mon.0) 634 : cluster [INF] Active manager daemon gibba044.wflcwh restarted 2021-03-10T20:08:34.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:34 gibba044 bash[9859]: cluster 2021-03-10T20:08:33.985281+0000 mon.a (mon.0) 635 : cluster [INF] Activating manager daemon gibba044.wflcwh 2021-03-10T20:08:34.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:34 gibba044 bash[9859]: audit 2021-03-10T20:08:33.986563+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.? 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:08:34.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:34 gibba044 bash[9859]: cluster 2021-03-10T20:08:33.988316+0000 mon.a (mon.0) 636 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-03-10T20:08:34.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:34 gibba044 bash[9859]: audit 2021-03-10T20:08:33.989969+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.? 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:08:35.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: cluster 2021-03-10T20:08:34.040089+0000 mon.a (mon.0) 637 : cluster [DBG] mgrmap e18: gibba044.wflcwh(active, starting, since 0.0549178s), standbys: y, x 2021-03-10T20:08:35.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.046073+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr metadata", "who": "gibba044.wflcwh", "id": "gibba044.wflcwh"}]: dispatch 2021-03-10T20:08:35.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.046213+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T20:08:35.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.046351+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T20:08:35.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.046475+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:08:35.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.046625+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:08:35.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.046764+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:08:35.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.046908+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:08:35.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.047048+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:08:35.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.047193+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:08:35.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.047333+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:08:35.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.047476+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:08:35.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.047635+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T20:08:35.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.047741+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T20:08:35.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.048044+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T20:08:35.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.048774+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T20:08:35.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.049489+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T20:08:35.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: cluster 2021-03-10T20:08:34.040089+0000 mon.a (mon.0) 637 : cluster [DBG] mgrmap e18: gibba044.wflcwh(active, starting, since 0.0549178s), standbys: y, x 2021-03-10T20:08:35.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.046073+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr metadata", "who": "gibba044.wflcwh", "id": "gibba044.wflcwh"}]: dispatch 2021-03-10T20:08:35.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.046213+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T20:08:35.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.046351+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T20:08:35.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.046475+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:08:35.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.046625+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:08:35.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.046764+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:08:35.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.046908+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:08:35.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.047048+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:08:35.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.047193+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:08:35.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.047333+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:08:35.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.047476+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:08:35.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.047635+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T20:08:35.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.047741+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T20:08:35.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.048044+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T20:08:35.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.048774+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T20:08:35.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.049489+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T20:08:35.434 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.049878+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T20:08:35.434 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.050240+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba023"}]: dispatch 2021-03-10T20:08:35.434 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.050541+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba044"}]: dispatch 2021-03-10T20:08:35.435 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.050838+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T20:08:35.435 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.051100+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T20:08:35.435 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.051380+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T20:08:35.435 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.051595+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T20:08:35.436 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.051997+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T20:08:35.436 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.052358+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T20:08:35.436 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.052587+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T20:08:35.436 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.052867+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T20:08:35.437 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.053159+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T20:08:35.437 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.053424+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T20:08:35.437 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.053678+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T20:08:35.437 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.053954+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:08:35.438 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.054169+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:08:35.438 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.049878+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T20:08:35.438 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.050240+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba023"}]: dispatch 2021-03-10T20:08:35.439 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.050541+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba044"}]: dispatch 2021-03-10T20:08:35.439 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.050838+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T20:08:35.439 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.051100+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T20:08:35.439 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.051380+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T20:08:35.439 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.051595+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T20:08:35.440 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.051997+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T20:08:35.440 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.052358+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T20:08:35.440 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.052587+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T20:08:35.440 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.052867+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T20:08:35.441 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.053159+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T20:08:35.441 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.053424+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T20:08:35.441 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.053678+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T20:08:35.442 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.053954+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:08:35.442 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.054169+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:08:35.442 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.054388+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T20:08:35.443 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.054628+0000 mon.b (mon.2) 63 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T20:08:35.443 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.054877+0000 mon.b (mon.2) 64 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T20:08:35.443 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.055154+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T20:08:35.443 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: cluster 2021-03-10T20:08:34.573390+0000 mon.a (mon.0) 638 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T20:08:35.444 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: cluster 2021-03-10T20:08:34.573471+0000 mon.a (mon.0) 639 : cluster [DBG] Standby manager daemon y started 2021-03-10T20:08:35.444 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.574073+0000 mon.c (mon.1) 25 : audit [DBG] from='mgr.? 172.21.2.123:0/1851719461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:08:35.444 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:34.575095+0000 mon.c (mon.1) 26 : audit [DBG] from='mgr.? 172.21.2.123:0/1851719461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:08:35.444 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: cluster 2021-03-10T20:08:35.026118+0000 mon.a (mon.0) 640 : cluster [INF] Manager daemon gibba044.wflcwh is now available 2021-03-10T20:08:35.445 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:35.033952+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:08:35.445 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[9844]: audit 2021-03-10T20:08:35.034211+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:08:35.445 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.054388+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T20:08:35.446 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.054628+0000 mon.b (mon.2) 63 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T20:08:35.446 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.054877+0000 mon.b (mon.2) 64 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T20:08:35.446 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.055154+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T20:08:35.446 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: cluster 2021-03-10T20:08:34.573390+0000 mon.a (mon.0) 638 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T20:08:35.446 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: cluster 2021-03-10T20:08:34.573471+0000 mon.a (mon.0) 639 : cluster [DBG] Standby manager daemon y started 2021-03-10T20:08:35.447 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.574073+0000 mon.c (mon.1) 25 : audit [DBG] from='mgr.? 172.21.2.123:0/1851719461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:08:35.447 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:34.575095+0000 mon.c (mon.1) 26 : audit [DBG] from='mgr.? 172.21.2.123:0/1851719461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:08:35.447 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: cluster 2021-03-10T20:08:35.026118+0000 mon.a (mon.0) 640 : cluster [INF] Manager daemon gibba044.wflcwh is now available 2021-03-10T20:08:35.448 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:35.033952+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:08:35.448 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:35 gibba023 bash[13032]: audit 2021-03-10T20:08:35.034211+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:08:35.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: cluster 2021-03-10T20:08:34.040089+0000 mon.a (mon.0) 637 : cluster [DBG] mgrmap e18: gibba044.wflcwh(active, starting, since 0.0549178s), standbys: y, x 2021-03-10T20:08:35.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.046073+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr metadata", "who": "gibba044.wflcwh", "id": "gibba044.wflcwh"}]: dispatch 2021-03-10T20:08:35.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.046213+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T20:08:35.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.046351+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T20:08:35.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.046475+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:08:35.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.046625+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:08:35.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.046764+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:08:35.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.046908+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:08:35.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.047048+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:08:35.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.047193+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:08:35.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.047333+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:08:35.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.047476+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:08:35.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.047635+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T20:08:35.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.047741+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T20:08:35.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.048044+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T20:08:35.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.048774+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T20:08:35.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.049489+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T20:08:35.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.049878+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T20:08:35.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.050240+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba023"}]: dispatch 2021-03-10T20:08:35.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.050541+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba044"}]: dispatch 2021-03-10T20:08:35.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.050838+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T20:08:35.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.051100+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T20:08:35.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.051380+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T20:08:35.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.051595+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T20:08:35.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.051997+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T20:08:35.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.052358+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T20:08:35.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.052587+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T20:08:35.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.052867+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T20:08:35.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.053159+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T20:08:35.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.053424+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T20:08:35.508 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.053678+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T20:08:35.508 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.053954+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:08:35.508 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.054169+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:08:35.508 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.054388+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T20:08:35.508 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.054628+0000 mon.b (mon.2) 63 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T20:08:35.509 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.054877+0000 mon.b (mon.2) 64 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T20:08:35.509 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.055154+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T20:08:35.509 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: cluster 2021-03-10T20:08:34.573390+0000 mon.a (mon.0) 638 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T20:08:35.509 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: cluster 2021-03-10T20:08:34.573471+0000 mon.a (mon.0) 639 : cluster [DBG] Standby manager daemon y started 2021-03-10T20:08:35.510 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.574073+0000 mon.c (mon.1) 25 : audit [DBG] from='mgr.? 172.21.2.123:0/1851719461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:08:35.510 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:34.575095+0000 mon.c (mon.1) 26 : audit [DBG] from='mgr.? 172.21.2.123:0/1851719461' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:08:35.510 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: cluster 2021-03-10T20:08:35.026118+0000 mon.a (mon.0) 640 : cluster [INF] Manager daemon gibba044.wflcwh is now available 2021-03-10T20:08:35.510 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:35.033952+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:08:35.510 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:35 gibba044 bash[9859]: audit 2021-03-10T20:08:35.034211+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:08:36.340 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:36 gibba044 bash[9859]: audit 2021-03-10T20:08:35.043284+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T20:08:36.341 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:36 gibba044 bash[9859]: cephadm 2021-03-10T20:08:35.046619+0000 mgr.gibba044.wflcwh (mgr.34430) 2 : cephadm [INF] Migrating to explicit placement 2021-03-10T20:08:36.341 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:36 gibba044 bash[9859]: audit 2021-03-10T20:08:35.051411+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T20:08:35.046633Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba023=y\", \"gibba044=x\", \"gibba044=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T20:08:36.341 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:36 gibba044 bash[9859]: audit 2021-03-10T20:08:35.051935+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T20:08:35.046633Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba023=y\", \"gibba044=x\", \"gibba044=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T20:08:36.341 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:36 gibba044 bash[9859]: cluster 2021-03-10T20:08:35.053541+0000 mon.a (mon.0) 644 : cluster [DBG] mgrmap e19: gibba044.wflcwh(active, since 1.06837s), standbys: y, x 2021-03-10T20:08:36.341 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:36 gibba044 bash[9859]: audit 2021-03-10T20:08:35.059675+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T20:08:35.046633Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba023=y\", \"gibba044=x\", \"gibba044=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T20:08:36.342 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:36 gibba044 bash[9859]: cluster 2021-03-10T20:08:35.060169+0000 mgr.gibba044.wflcwh (mgr.34430) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:36.342 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:36 gibba044 bash[9859]: audit 2021-03-10T20:08:35.062125+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:08:36.342 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:36 gibba044 bash[9859]: audit 2021-03-10T20:08:35.062651+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:08:36.342 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:36 gibba044 bash[9859]: audit 2021-03-10T20:08:35.065494+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T20:08:36.343 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:36 gibba044 bash[9859]: audit 2021-03-10T20:08:35.069220+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:08:36.343 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:36 gibba044 bash[9859]: audit 2021-03-10T20:08:35.069440+0000 mon.b (mon.2) 69 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:08:36.343 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:36 gibba044 bash[9859]: audit 2021-03-10T20:08:35.072702+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T20:08:36.343 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:36 gibba044 bash[9859]: audit 2021-03-10T20:08:35.203836+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:08:36.344 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:36 gibba044 bash[9859]: audit 2021-03-10T20:08:35.203996+0000 mon.b (mon.2) 70 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:08:36.345 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:36 gibba044 bash[9859]: audit 2021-03-10T20:08:35.206735+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:08:36.345 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:36 gibba044 bash[9859]: audit 2021-03-10T20:08:35.207222+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:08:36.345 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:36 gibba044 bash[9859]: audit 2021-03-10T20:08:35.332807+0000 mon.b (mon.2) 72 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:08:36.346 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:36 gibba044 bash[9859]: audit 2021-03-10T20:08:35.801632+0000 mon.b (mon.2) 73 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527196Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527275Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527317Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527356Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527394Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527432Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527470Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527507Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527544Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_id\": \"479c1eeb4a51\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527581Z\", \"created\": \"2021-03-10T20:05:24.438946Z\", \"started\": \"2021-03-10T20:05:24.466542Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:36.346 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:36 gibba044 bash[9859]: audit 2021-03-10T20:08:35.801909+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527196Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527275Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527317Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527356Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527394Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527432Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527470Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527507Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527544Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_id\": \"479c1eeb4a51\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527581Z\", \"created\": \"2021-03-10T20:05:24.438946Z\", \"started\": \"2021-03-10T20:05:24.466542Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:36.346 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:36 gibba044 bash[9859]: audit 2021-03-10T20:08:35.806372+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527196Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527275Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527317Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527356Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527394Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527432Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527470Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527507Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527544Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_id\": \"479c1eeb4a51\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527581Z\", \"created\": \"2021-03-10T20:05:24.438946Z\", \"started\": \"2021-03-10T20:05:24.466542Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T20:08:36.347 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:36 gibba044 bash[9859]: audit 2021-03-10T20:08:35.813074+0000 mon.b (mon.2) 74 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:08:36.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[9844]: audit 2021-03-10T20:08:35.043284+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T20:08:36.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[9844]: cephadm 2021-03-10T20:08:35.046619+0000 mgr.gibba044.wflcwh (mgr.34430) 2 : cephadm [INF] Migrating to explicit placement 2021-03-10T20:08:36.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[9844]: audit 2021-03-10T20:08:35.051411+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T20:08:35.046633Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba023=y\", \"gibba044=x\", \"gibba044=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T20:08:36.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[9844]: audit 2021-03-10T20:08:35.051935+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T20:08:35.046633Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba023=y\", \"gibba044=x\", \"gibba044=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T20:08:36.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[9844]: cluster 2021-03-10T20:08:35.053541+0000 mon.a (mon.0) 644 : cluster [DBG] mgrmap e19: gibba044.wflcwh(active, since 1.06837s), standbys: y, x 2021-03-10T20:08:36.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[9844]: audit 2021-03-10T20:08:35.059675+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T20:08:35.046633Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba023=y\", \"gibba044=x\", \"gibba044=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T20:08:36.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[9844]: cluster 2021-03-10T20:08:35.060169+0000 mgr.gibba044.wflcwh (mgr.34430) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:36.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[9844]: audit 2021-03-10T20:08:35.062125+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:08:36.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[9844]: audit 2021-03-10T20:08:35.062651+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:08:36.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[9844]: audit 2021-03-10T20:08:35.065494+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T20:08:36.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[9844]: audit 2021-03-10T20:08:35.069220+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:08:36.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[9844]: audit 2021-03-10T20:08:35.069440+0000 mon.b (mon.2) 69 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:08:36.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[9844]: audit 2021-03-10T20:08:35.072702+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T20:08:36.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[9844]: audit 2021-03-10T20:08:35.203836+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:08:36.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[13032]: audit 2021-03-10T20:08:35.043284+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config set","value":"0","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T20:08:36.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[13032]: cephadm 2021-03-10T20:08:35.046619+0000 mgr.gibba044.wflcwh (mgr.34430) 2 : cephadm [INF] Migrating to explicit placement 2021-03-10T20:08:36.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[13032]: audit 2021-03-10T20:08:35.051411+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T20:08:35.046633Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba023=y\", \"gibba044=x\", \"gibba044=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T20:08:36.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[13032]: audit 2021-03-10T20:08:35.051935+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T20:08:35.046633Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba023=y\", \"gibba044=x\", \"gibba044=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]: dispatch 2021-03-10T20:08:36.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[13032]: cluster 2021-03-10T20:08:35.053541+0000 mon.a (mon.0) 644 : cluster [DBG] mgrmap e19: gibba044.wflcwh(active, since 1.06837s), standbys: y, x 2021-03-10T20:08:36.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[13032]: audit 2021-03-10T20:08:35.059675+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2021-03-10T20:08:35.046633Z\", \"spec\": {\"placement\": {\"count\": 3, \"hosts\": [\"gibba023=y\", \"gibba044=x\", \"gibba044=x\"]}, \"service_name\": \"mgr\", \"service_type\": \"mgr\"}}"}]': finished 2021-03-10T20:08:36.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[13032]: cluster 2021-03-10T20:08:35.060169+0000 mgr.gibba044.wflcwh (mgr.34430) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:36.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[13032]: audit 2021-03-10T20:08:35.062125+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:08:36.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[13032]: audit 2021-03-10T20:08:35.062651+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:08:36.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[13032]: audit 2021-03-10T20:08:35.065494+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config set","value":"1","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T20:08:36.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[13032]: audit 2021-03-10T20:08:35.069220+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:08:36.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[13032]: audit 2021-03-10T20:08:35.069440+0000 mon.b (mon.2) 69 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2021-03-10T20:08:36.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[13032]: audit 2021-03-10T20:08:35.072702+0000 mon.a (mon.0) 649 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config set","value":"2","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2021-03-10T20:08:36.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[13032]: audit 2021-03-10T20:08:35.203836+0000 mon.a (mon.0) 650 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:08:36.434 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[9844]: audit 2021-03-10T20:08:35.203996+0000 mon.b (mon.2) 70 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:08:36.434 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[9844]: audit 2021-03-10T20:08:35.206735+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:08:36.434 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[9844]: audit 2021-03-10T20:08:35.207222+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:08:36.434 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[9844]: audit 2021-03-10T20:08:35.332807+0000 mon.b (mon.2) 72 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:08:36.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[13032]: audit 2021-03-10T20:08:35.203996+0000 mon.b (mon.2) 70 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:08:36.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[13032]: audit 2021-03-10T20:08:35.206735+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:08:36.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[13032]: audit 2021-03-10T20:08:35.207222+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:08:36.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[13032]: audit 2021-03-10T20:08:35.332807+0000 mon.b (mon.2) 72 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:08:36.436 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[9844]: audit 2021-03-10T20:08:35.801632+0000 mon.b (mon.2) 73 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527196Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527275Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527317Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527356Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527394Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527432Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527470Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527507Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527544Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_id\": \"479c1eeb4a51\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527581Z\", \"created\": \"2021-03-10T20:05:24.438946Z\", \"started\": \"2021-03-10T20:05:24.466542Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:36.437 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[13032]: audit 2021-03-10T20:08:35.801632+0000 mon.b (mon.2) 73 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527196Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527275Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527317Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527356Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527394Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527432Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527470Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527507Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527544Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_id\": \"479c1eeb4a51\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527581Z\", \"created\": \"2021-03-10T20:05:24.438946Z\", \"started\": \"2021-03-10T20:05:24.466542Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:36.437 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[9844]: audit 2021-03-10T20:08:35.801909+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527196Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527275Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527317Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527356Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527394Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527432Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527470Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527507Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527544Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_id\": \"479c1eeb4a51\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527581Z\", \"created\": \"2021-03-10T20:05:24.438946Z\", \"started\": \"2021-03-10T20:05:24.466542Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:36.438 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[9844]: audit 2021-03-10T20:08:35.806372+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527196Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527275Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527317Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527356Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527394Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527432Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527470Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527507Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527544Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_id\": \"479c1eeb4a51\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527581Z\", \"created\": \"2021-03-10T20:05:24.438946Z\", \"started\": \"2021-03-10T20:05:24.466542Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T20:08:36.438 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[9844]: audit 2021-03-10T20:08:35.813074+0000 mon.b (mon.2) 74 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:08:36.438 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[9844]: debug 2021-03-10T20:08:36.056+0000 7f596968b700 -1 log_channel(cluster) log [ERR] : Health check failed: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) (MGR_MODULE_ERROR) 2021-03-10T20:08:36.439 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[13032]: audit 2021-03-10T20:08:35.801909+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527196Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527275Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527317Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527356Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527394Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527432Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527470Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527507Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527544Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_id\": \"479c1eeb4a51\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527581Z\", \"created\": \"2021-03-10T20:05:24.438946Z\", \"started\": \"2021-03-10T20:05:24.466542Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:36.439 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[13032]: audit 2021-03-10T20:08:35.806372+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527196Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527275Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527317Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527356Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527394Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527432Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527470Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527507Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527544Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_id\": \"479c1eeb4a51\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:05:25.527581Z\", \"created\": \"2021-03-10T20:05:24.438946Z\", \"started\": \"2021-03-10T20:05:24.466542Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T20:08:36.439 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:36 gibba023 bash[13032]: audit 2021-03-10T20:08:35.813074+0000 mon.b (mon.2) 74 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:08:37.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:37 gibba023 bash[9844]: cluster 2021-03-10T20:08:36.048113+0000 mgr.gibba044.wflcwh (mgr.34430) 4 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:37.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:37 gibba023 bash[9844]: cluster 2021-03-10T20:08:36.058714+0000 mon.a (mon.0) 654 : cluster [ERR] Health check failed: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) (MGR_MODULE_ERROR) 2021-03-10T20:08:37.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:37 gibba023 bash[9844]: cluster 2021-03-10T20:08:36.817872+0000 mon.a (mon.0) 655 : cluster [DBG] mgrmap e20: gibba044.wflcwh(active, since 2s), standbys: y, x 2021-03-10T20:08:37.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:37 gibba023 bash[13032]: cluster 2021-03-10T20:08:36.048113+0000 mgr.gibba044.wflcwh (mgr.34430) 4 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:37.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:37 gibba023 bash[13032]: cluster 2021-03-10T20:08:36.058714+0000 mon.a (mon.0) 654 : cluster [ERR] Health check failed: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) (MGR_MODULE_ERROR) 2021-03-10T20:08:37.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:37 gibba023 bash[13032]: cluster 2021-03-10T20:08:36.817872+0000 mon.a (mon.0) 655 : cluster [DBG] mgrmap e20: gibba044.wflcwh(active, since 2s), standbys: y, x 2021-03-10T20:08:37.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:37 gibba044 bash[9859]: cluster 2021-03-10T20:08:36.048113+0000 mgr.gibba044.wflcwh (mgr.34430) 4 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:37.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:37 gibba044 bash[9859]: cluster 2021-03-10T20:08:36.058714+0000 mon.a (mon.0) 654 : cluster [ERR] Health check failed: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) (MGR_MODULE_ERROR) 2021-03-10T20:08:37.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:37 gibba044 bash[9859]: cluster 2021-03-10T20:08:36.817872+0000 mon.a (mon.0) 655 : cluster [DBG] mgrmap e20: gibba044.wflcwh(active, since 2s), standbys: y, x 2021-03-10T20:08:38.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:38 gibba023 bash[9844]: cluster 2021-03-10T20:08:36.339878+0000 mgr.gibba044.wflcwh (mgr.34430) 5 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba044.wflcwh: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:08:38.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:38 gibba023 bash[13032]: cluster 2021-03-10T20:08:36.339878+0000 mgr.gibba044.wflcwh (mgr.34430) 5 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba044.wflcwh: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:08:38.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:38 gibba044 bash[9859]: cluster 2021-03-10T20:08:36.339878+0000 mgr.gibba044.wflcwh (mgr.34430) 5 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba044.wflcwh: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:08:39.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:39 gibba023 bash[9844]: cluster 2021-03-10T20:08:38.049154+0000 mgr.gibba044.wflcwh (mgr.34430) 6 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:39.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:39 gibba023 bash[13032]: cluster 2021-03-10T20:08:38.049154+0000 mgr.gibba044.wflcwh (mgr.34430) 6 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:39.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:39 gibba044 bash[9859]: cluster 2021-03-10T20:08:38.049154+0000 mgr.gibba044.wflcwh (mgr.34430) 6 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:40.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:40 gibba023 bash[9844]: audit 2021-03-10T20:08:39.387648+0000 mon.b (mon.2) 75 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13516144, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382803Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.383490Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:40.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:40 gibba023 bash[13032]: audit 2021-03-10T20:08:39.387648+0000 mon.b (mon.2) 75 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13516144, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382803Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.383490Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:40.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:40 gibba023 bash[9844]: audit 2021-03-10T20:08:39.388165+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13516144, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382803Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.383490Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:40.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:40 gibba023 bash[13032]: audit 2021-03-10T20:08:39.388165+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13516144, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382803Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.383490Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:40.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:40 gibba023 bash[9844]: audit 2021-03-10T20:08:39.391698+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13516144, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382803Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.383490Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T20:08:40.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:40 gibba023 bash[13032]: audit 2021-03-10T20:08:39.391698+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13516144, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382803Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.383490Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T20:08:40.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:40 gibba023 bash[9844]: audit 2021-03-10T20:08:39.494131+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99897835, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492498Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371510476, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492604Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400136601, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492659Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50593792, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492711Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492863Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47416606, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492977Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48611983, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493089Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33239859, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493199Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493257Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29999759, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493309Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493360Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.493429Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:40.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:40 gibba023 bash[13032]: audit 2021-03-10T20:08:39.494131+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99897835, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492498Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371510476, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492604Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400136601, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492659Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50593792, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492711Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492863Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47416606, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492977Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48611983, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493089Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33239859, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493199Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493257Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29999759, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493309Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493360Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.493429Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:40.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:40 gibba023 bash[9844]: audit 2021-03-10T20:08:39.494345+0000 mon.b (mon.2) 76 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99897835, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492498Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371510476, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492604Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400136601, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492659Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50593792, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492711Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492863Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47416606, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492977Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48611983, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493089Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33239859, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493199Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493257Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29999759, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493309Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493360Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.493429Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:40.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:40 gibba023 bash[13032]: audit 2021-03-10T20:08:39.494345+0000 mon.b (mon.2) 76 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99897835, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492498Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371510476, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492604Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400136601, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492659Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50593792, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492711Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492863Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47416606, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492977Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48611983, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493089Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33239859, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493199Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493257Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29999759, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493309Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493360Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.493429Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:40.183 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:40 gibba023 bash[9844]: audit 2021-03-10T20:08:39.497071+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99897835, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492498Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371510476, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492604Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400136601, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492659Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50593792, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492711Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492863Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47416606, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492977Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48611983, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493089Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33239859, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493199Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493257Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29999759, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493309Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493360Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.493429Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T20:08:40.183 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:40 gibba023 bash[9844]: audit 2021-03-10T20:08:39.707859+0000 mon.b (mon.2) 77 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:08:40.183 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:40 gibba023 bash[9844]: audit 2021-03-10T20:08:39.709908+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:08:40.184 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:40 gibba023 bash[9844]: audit 2021-03-10T20:08:39.718559+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T20:08:40.184 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:40 gibba023 bash[9844]: audit 2021-03-10T20:08:39.721791+0000 mon.b (mon.2) 78 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:08:40.184 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:40 gibba023 bash[9844]: audit 2021-03-10T20:08:39.722452+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:08:40.184 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:40 gibba023 bash[9844]: audit 2021-03-10T20:08:39.723026+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:08:40.184 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:40 gibba023 bash[9844]: audit 2021-03-10T20:08:39.723964+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T20:08:40.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:40 gibba023 bash[13032]: audit 2021-03-10T20:08:39.497071+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99897835, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492498Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371510476, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492604Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400136601, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492659Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50593792, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492711Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492863Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47416606, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492977Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48611983, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493089Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33239859, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493199Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493257Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29999759, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493309Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493360Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.493429Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T20:08:40.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:40 gibba023 bash[13032]: audit 2021-03-10T20:08:39.707859+0000 mon.b (mon.2) 77 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:08:40.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:40 gibba023 bash[13032]: audit 2021-03-10T20:08:39.709908+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:08:40.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:40 gibba023 bash[13032]: audit 2021-03-10T20:08:39.718559+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T20:08:40.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:40 gibba023 bash[13032]: audit 2021-03-10T20:08:39.721791+0000 mon.b (mon.2) 78 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:08:40.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:40 gibba023 bash[13032]: audit 2021-03-10T20:08:39.722452+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:08:40.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:40 gibba023 bash[13032]: audit 2021-03-10T20:08:39.723026+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:08:40.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:40 gibba023 bash[13032]: audit 2021-03-10T20:08:39.723964+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T20:08:40.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:40 gibba044 bash[9859]: audit 2021-03-10T20:08:39.387648+0000 mon.b (mon.2) 75 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13516144, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382803Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.383490Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:40.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:40 gibba044 bash[9859]: audit 2021-03-10T20:08:39.388165+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13516144, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382803Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.383490Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:40.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:40 gibba044 bash[9859]: audit 2021-03-10T20:08:39.391698+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13516144, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382803Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.383490Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T20:08:40.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:40 gibba044 bash[9859]: audit 2021-03-10T20:08:39.494131+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99897835, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492498Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371510476, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492604Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400136601, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492659Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50593792, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492711Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492863Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47416606, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492977Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48611983, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493089Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33239859, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493199Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493257Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29999759, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493309Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493360Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.493429Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:40.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:40 gibba044 bash[9859]: audit 2021-03-10T20:08:39.494345+0000 mon.b (mon.2) 76 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99897835, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492498Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371510476, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492604Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400136601, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492659Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50593792, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492711Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492863Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47416606, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492977Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48611983, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493089Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33239859, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493199Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493257Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29999759, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493309Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493360Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.493429Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:40.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:40 gibba044 bash[9859]: audit 2021-03-10T20:08:39.497071+0000 mon.a (mon.0) 659 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99897835, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492498Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371510476, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492604Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400136601, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492659Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50593792, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492711Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492863Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47416606, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492977Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48611983, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493089Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33239859, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493199Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493257Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29999759, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493309Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493360Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:28.048666Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.493429Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T20:08:40.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:40 gibba044 bash[9859]: audit 2021-03-10T20:08:39.707859+0000 mon.b (mon.2) 77 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:08:40.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:40 gibba044 bash[9859]: audit 2021-03-10T20:08:39.709908+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:08:40.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:40 gibba044 bash[9859]: audit 2021-03-10T20:08:39.718559+0000 mon.a (mon.0) 661 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T20:08:40.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:40 gibba044 bash[9859]: audit 2021-03-10T20:08:39.721791+0000 mon.b (mon.2) 78 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:08:40.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:40 gibba044 bash[9859]: audit 2021-03-10T20:08:39.722452+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:08:40.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:40 gibba044 bash[9859]: audit 2021-03-10T20:08:39.723026+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:08:40.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:40 gibba044 bash[9859]: audit 2021-03-10T20:08:39.723964+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T20:08:41.256 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:41 gibba023 bash[9844]: cephadm 2021-03-10T20:08:39.399323+0000 mgr.gibba044.wflcwh (mgr.34430) 7 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:08:41.257 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:41 gibba023 bash[9844]: cephadm 2021-03-10T20:08:39.498575+0000 mgr.gibba044.wflcwh (mgr.34430) 8 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:08:41.257 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:41 gibba023 bash[9844]: cluster 2021-03-10T20:08:39.707499+0000 mgr.gibba044.wflcwh (mgr.34430) 9 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:41.257 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:41 gibba023 bash[9844]: cephadm 2021-03-10T20:08:39.721608+0000 mgr.gibba044.wflcwh (mgr.34430) 10 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2021-03-10T20:08:41.258 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:41 gibba023 bash[9844]: cephadm 2021-03-10T20:08:39.723745+0000 mgr.gibba044.wflcwh (mgr.34430) 11 : cephadm [INF] Reconfiguring daemon mon.a on gibba023 2021-03-10T20:08:41.258 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:41 gibba023 bash[9844]: cluster 2021-03-10T20:08:40.495985+0000 mon.a (mon.0) 662 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T20:08:41.259 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:41 gibba023 bash[13032]: cephadm 2021-03-10T20:08:39.399323+0000 mgr.gibba044.wflcwh (mgr.34430) 7 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:08:41.260 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:41 gibba023 bash[13032]: cephadm 2021-03-10T20:08:39.498575+0000 mgr.gibba044.wflcwh (mgr.34430) 8 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:08:41.260 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:41 gibba023 bash[13032]: cluster 2021-03-10T20:08:39.707499+0000 mgr.gibba044.wflcwh (mgr.34430) 9 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:41.261 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:41 gibba023 bash[13032]: cephadm 2021-03-10T20:08:39.721608+0000 mgr.gibba044.wflcwh (mgr.34430) 10 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2021-03-10T20:08:41.261 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:41 gibba023 bash[13032]: cephadm 2021-03-10T20:08:39.723745+0000 mgr.gibba044.wflcwh (mgr.34430) 11 : cephadm [INF] Reconfiguring daemon mon.a on gibba023 2021-03-10T20:08:41.261 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:41 gibba023 bash[13032]: cluster 2021-03-10T20:08:40.495985+0000 mon.a (mon.0) 662 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T20:08:41.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:41 gibba044 bash[9859]: cephadm 2021-03-10T20:08:39.399323+0000 mgr.gibba044.wflcwh (mgr.34430) 7 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:08:41.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:41 gibba044 bash[9859]: cephadm 2021-03-10T20:08:39.498575+0000 mgr.gibba044.wflcwh (mgr.34430) 8 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:08:41.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:41 gibba044 bash[9859]: cluster 2021-03-10T20:08:39.707499+0000 mgr.gibba044.wflcwh (mgr.34430) 9 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.3 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:41.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:41 gibba044 bash[9859]: cephadm 2021-03-10T20:08:39.721608+0000 mgr.gibba044.wflcwh (mgr.34430) 10 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2021-03-10T20:08:41.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:41 gibba044 bash[9859]: cephadm 2021-03-10T20:08:39.723745+0000 mgr.gibba044.wflcwh (mgr.34430) 11 : cephadm [INF] Reconfiguring daemon mon.a on gibba023 2021-03-10T20:08:41.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:41 gibba044 bash[9859]: cluster 2021-03-10T20:08:40.495985+0000 mon.a (mon.0) 662 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T20:08:42.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:42 gibba023 bash[9844]: audit 2021-03-10T20:08:41.796935+0000 mon.b (mon.2) 82 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13516144, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382803Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.383490Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:42.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:42 gibba023 bash[13032]: audit 2021-03-10T20:08:41.796935+0000 mon.b (mon.2) 82 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13516144, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382803Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.383490Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:42.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:42 gibba023 bash[9844]: audit 2021-03-10T20:08:41.797364+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13516144, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382803Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.383490Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:42.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:42 gibba023 bash[9844]: audit 2021-03-10T20:08:41.801917+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13516144, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382803Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.383490Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T20:08:42.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:42 gibba023 bash[9844]: audit 2021-03-10T20:08:41.809399+0000 mon.b (mon.2) 83 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:08:42.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:42 gibba023 bash[9844]: audit 2021-03-10T20:08:41.810496+0000 mon.b (mon.2) 84 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:08:42.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:42 gibba023 bash[9844]: audit 2021-03-10T20:08:41.811547+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:08:42.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:42 gibba023 bash[9844]: audit 2021-03-10T20:08:41.812392+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T20:08:42.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:42 gibba023 bash[13032]: audit 2021-03-10T20:08:41.797364+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13516144, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382803Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.383490Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:42.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:42 gibba023 bash[13032]: audit 2021-03-10T20:08:41.801917+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13516144, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382803Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.383490Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T20:08:42.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:42 gibba023 bash[13032]: audit 2021-03-10T20:08:41.809399+0000 mon.b (mon.2) 83 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:08:42.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:42 gibba023 bash[13032]: audit 2021-03-10T20:08:41.810496+0000 mon.b (mon.2) 84 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:08:42.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:42 gibba023 bash[13032]: audit 2021-03-10T20:08:41.811547+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:08:42.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:42 gibba023 bash[13032]: audit 2021-03-10T20:08:41.812392+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T20:08:42.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:42 gibba044 bash[9859]: audit 2021-03-10T20:08:41.796935+0000 mon.b (mon.2) 82 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13516144, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382803Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.383490Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:42.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:42 gibba044 bash[9859]: audit 2021-03-10T20:08:41.797364+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13516144, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382803Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.383490Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:42.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:42 gibba044 bash[9859]: audit 2021-03-10T20:08:41.801917+0000 mon.a (mon.0) 664 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13516144, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382803Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:14.976164Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.383490Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T20:08:42.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:42 gibba044 bash[9859]: audit 2021-03-10T20:08:41.809399+0000 mon.b (mon.2) 83 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:08:42.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:42 gibba044 bash[9859]: audit 2021-03-10T20:08:41.810496+0000 mon.b (mon.2) 84 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:08:42.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:42 gibba044 bash[9859]: audit 2021-03-10T20:08:41.811547+0000 mon.b (mon.2) 85 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:08:42.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:42 gibba044 bash[9859]: audit 2021-03-10T20:08:41.812392+0000 mon.b (mon.2) 86 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T20:08:43.147 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:43 gibba023 bash[13032]: cluster 2021-03-10T20:08:41.709725+0000 mgr.gibba044.wflcwh (mgr.34430) 12 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:43.148 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:43 gibba023 bash[13032]: cephadm 2021-03-10T20:08:41.809046+0000 mgr.gibba044.wflcwh (mgr.34430) 13 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T20:08:43.148 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:43 gibba023 bash[13032]: cephadm 2021-03-10T20:08:41.812141+0000 mgr.gibba044.wflcwh (mgr.34430) 14 : cephadm [INF] Reconfiguring daemon mon.c on gibba023 2021-03-10T20:08:43.148 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:43 gibba023 bash[9844]: cluster 2021-03-10T20:08:41.709725+0000 mgr.gibba044.wflcwh (mgr.34430) 12 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:43.149 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:43 gibba023 bash[9844]: cephadm 2021-03-10T20:08:41.809046+0000 mgr.gibba044.wflcwh (mgr.34430) 13 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T20:08:43.149 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:43 gibba023 bash[9844]: cephadm 2021-03-10T20:08:41.812141+0000 mgr.gibba044.wflcwh (mgr.34430) 14 : cephadm [INF] Reconfiguring daemon mon.c on gibba023 2021-03-10T20:08:43.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:43 gibba044 bash[9859]: cluster 2021-03-10T20:08:41.709725+0000 mgr.gibba044.wflcwh (mgr.34430) 12 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:43.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:43 gibba044 bash[9859]: cephadm 2021-03-10T20:08:41.809046+0000 mgr.gibba044.wflcwh (mgr.34430) 13 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T20:08:43.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:43 gibba044 bash[9859]: cephadm 2021-03-10T20:08:41.812141+0000 mgr.gibba044.wflcwh (mgr.34430) 14 : cephadm [INF] Reconfiguring daemon mon.c on gibba023 2021-03-10T20:08:44.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:44 gibba023 bash[13032]: audit 2021-03-10T20:08:43.680602+0000 mon.b (mon.2) 87 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13516144, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382803Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.383490Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]: dispatch 2021-03-10T20:08:44.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:44 gibba023 bash[9844]: audit 2021-03-10T20:08:43.680602+0000 mon.b (mon.2) 87 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13516144, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382803Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.383490Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]: dispatch 2021-03-10T20:08:44.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:44 gibba023 bash[9844]: audit 2021-03-10T20:08:43.681028+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13516144, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382803Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.383490Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]: dispatch 2021-03-10T20:08:44.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:44 gibba023 bash[9844]: audit 2021-03-10T20:08:43.685275+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13516144, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382803Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.383490Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]': finished 2021-03-10T20:08:44.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:44 gibba023 bash[13032]: audit 2021-03-10T20:08:43.681028+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13516144, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382803Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.383490Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]: dispatch 2021-03-10T20:08:44.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:44 gibba023 bash[13032]: audit 2021-03-10T20:08:43.685275+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13516144, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382803Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.383490Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]': finished 2021-03-10T20:08:44.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:44 gibba044 bash[9859]: audit 2021-03-10T20:08:43.680602+0000 mon.b (mon.2) 87 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13516144, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382803Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.383490Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]: dispatch 2021-03-10T20:08:44.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:44 gibba044 bash[9859]: audit 2021-03-10T20:08:43.681028+0000 mon.a (mon.0) 665 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13516144, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382803Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.383490Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]: dispatch 2021-03-10T20:08:44.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:44 gibba044 bash[9859]: audit 2021-03-10T20:08:43.685275+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"e401b3f03287\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13516144, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382803Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:03:40.524411Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2021-03-10T20:03:34.390236Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.383490Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]': finished 2021-03-10T20:08:44.800 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:08:45.060 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:08:45.061 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (5m) 5s ago 5m 0.21.0 prom/alertmanager c876f5897d7b e401b3f03287 2021-03-10T20:08:45.061 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (5m) 5s ago 5m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:08:45.061 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (15s) 5s ago 8m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:08:45.061 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (33s) 5s ago 8m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:08:45.062 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (10m) 5s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 b62b2d90ce7a 2021-03-10T20:08:45.062 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (10m) 5s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 295953e7c788 2021-03-10T20:08:45.062 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (9m) 5s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 0e96acfc200a 2021-03-10T20:08:45.062 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (9m) 5s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 c1745ed327ed 2021-03-10T20:08:45.063 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (5m) 5s ago 5m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:08:45.063 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (5m) 5s ago 5m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:08:45.063 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (8m) 5s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a8e662729287 2021-03-10T20:08:45.063 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (8m) 5s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 aba825ce9058 2021-03-10T20:08:45.064 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (7m) 5s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 0b4c19578b20 2021-03-10T20:08:45.064 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (7m) 5s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 25229602755c 2021-03-10T20:08:45.064 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (7m) 5s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a745be9e28cb 2021-03-10T20:08:45.064 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (6m) 5s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0313bf557eb 2021-03-10T20:08:45.065 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (6m) 5s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 ffa9fe94cea1 2021-03-10T20:08:45.065 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (5m) 5s ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 082d0fe68f90 2021-03-10T20:08:45.065 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (4m) 5s ago 5m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:08:45.065 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 5s ago 3m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:08:45.065 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 5s ago 3m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:08:45.332 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:08:45.333 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:08:45.333 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T20:08:45.333 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:08:45.334 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:08:45.334 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2021-03-10T20:08:45.334 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 2 2021-03-10T20:08:45.334 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:08:45.335 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:08:45.335 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T20:08:45.335 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:08:45.335 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:08:45.335 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:08:45.336 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 12, 2021-03-10T20:08:45.336 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 2 2021-03-10T20:08:45.336 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:08:45.336 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:08:45.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:45 gibba023 bash[9844]: cephadm 2021-03-10T20:08:43.692291+0000 mgr.gibba044.wflcwh (mgr.34430) 15 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T20:08:45.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:45 gibba023 bash[9844]: cephadm 2021-03-10T20:08:43.698444+0000 mgr.gibba044.wflcwh (mgr.34430) 16 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba023 2021-03-10T20:08:45.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:45 gibba023 bash[9844]: cluster 2021-03-10T20:08:43.710164+0000 mgr.gibba044.wflcwh (mgr.34430) 17 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:45.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:45 gibba023 bash[13032]: cephadm 2021-03-10T20:08:43.692291+0000 mgr.gibba044.wflcwh (mgr.34430) 15 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T20:08:45.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:45 gibba023 bash[13032]: cephadm 2021-03-10T20:08:43.698444+0000 mgr.gibba044.wflcwh (mgr.34430) 16 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba023 2021-03-10T20:08:45.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:45 gibba023 bash[13032]: cluster 2021-03-10T20:08:43.710164+0000 mgr.gibba044.wflcwh (mgr.34430) 17 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:45.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:45 gibba044 bash[9859]: cephadm 2021-03-10T20:08:43.692291+0000 mgr.gibba044.wflcwh (mgr.34430) 15 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-03-10T20:08:45.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:45 gibba044 bash[9859]: cephadm 2021-03-10T20:08:43.698444+0000 mgr.gibba044.wflcwh (mgr.34430) 16 : cephadm [INF] Reconfiguring daemon alertmanager.a on gibba023 2021-03-10T20:08:45.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:45 gibba044 bash[9859]: cluster 2021-03-10T20:08:43.710164+0000 mgr.gibba044.wflcwh (mgr.34430) 17 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:46.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:46 gibba023 bash[9844]: audit 2021-03-10T20:08:44.792073+0000 mgr.gibba044.wflcwh (mgr.34430) 18 : audit [DBG] from='client.24601 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:08:46.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:46 gibba023 bash[9844]: audit 2021-03-10T20:08:45.023088+0000 mgr.gibba044.wflcwh (mgr.34430) 19 : audit [DBG] from='client.14697 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:08:46.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:46 gibba023 bash[9844]: audit 2021-03-10T20:08:45.332531+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.2.123:0/3110467334' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:08:46.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:46 gibba023 bash[13032]: audit 2021-03-10T20:08:44.792073+0000 mgr.gibba044.wflcwh (mgr.34430) 18 : audit [DBG] from='client.24601 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:08:46.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:46 gibba023 bash[13032]: audit 2021-03-10T20:08:45.023088+0000 mgr.gibba044.wflcwh (mgr.34430) 19 : audit [DBG] from='client.14697 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:08:46.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:46 gibba023 bash[13032]: audit 2021-03-10T20:08:45.332531+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.2.123:0/3110467334' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:08:46.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:46 gibba044 bash[9859]: audit 2021-03-10T20:08:44.792073+0000 mgr.gibba044.wflcwh (mgr.34430) 18 : audit [DBG] from='client.24601 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:08:46.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:46 gibba044 bash[9859]: audit 2021-03-10T20:08:45.023088+0000 mgr.gibba044.wflcwh (mgr.34430) 19 : audit [DBG] from='client.14697 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:08:46.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:46 gibba044 bash[9859]: audit 2021-03-10T20:08:45.332531+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.2.123:0/3110467334' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:08:47.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:47 gibba023 bash[9844]: cluster 2021-03-10T20:08:45.712160+0000 mgr.gibba044.wflcwh (mgr.34430) 20 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:47.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:47 gibba023 bash[13032]: cluster 2021-03-10T20:08:45.712160+0000 mgr.gibba044.wflcwh (mgr.34430) 20 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:47.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:47 gibba044 bash[9859]: cluster 2021-03-10T20:08:45.712160+0000 mgr.gibba044.wflcwh (mgr.34430) 20 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:49.272 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:49 gibba023 bash[9844]: cluster 2021-03-10T20:08:47.713235+0000 mgr.gibba044.wflcwh (mgr.34430) 21 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:49.273 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:49 gibba023 bash[13032]: cluster 2021-03-10T20:08:47.713235+0000 mgr.gibba044.wflcwh (mgr.34430) 21 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:49.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:49 gibba044 bash[9859]: cluster 2021-03-10T20:08:47.713235+0000 mgr.gibba044.wflcwh (mgr.34430) 21 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:50.047 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:08:49 gibba023 systemd[1]: Stopping Ceph alertmanager.a for dd719b26-81da-11eb-9080-001a4aab830c... 2021-03-10T20:08:50.048 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:08:49 gibba023 bash[21965]: level=info ts=2021-03-10T20:08:49.862Z caller=main.go:524 msg="Received SIGTERM, exiting gracefully..." 2021-03-10T20:08:50.925 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:08:50 gibba023 docker[29365]: ceph-dd719b26-81da-11eb-9080-001a4aab830c-alertmanager.a 2021-03-10T20:08:50.925 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:08:50 gibba023 systemd[1]: ceph-dd719b26-81da-11eb-9080-001a4aab830c@alertmanager.a.service: Succeeded. 2021-03-10T20:08:50.926 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:08:50 gibba023 systemd[1]: Stopped Ceph alertmanager.a for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:08:50.926 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:08:50 gibba023 systemd[1]: Starting Ceph alertmanager.a for dd719b26-81da-11eb-9080-001a4aab830c... 2021-03-10T20:08:50.926 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:08:50 gibba023 docker[29399]: Error: No such container: ceph-dd719b26-81da-11eb-9080-001a4aab830c-alertmanager.a 2021-03-10T20:08:50.926 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:08:50 gibba023 systemd[1]: Started Ceph alertmanager.a for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:08:51.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:51 gibba023 bash[9844]: cluster 2021-03-10T20:08:49.713850+0000 mgr.gibba044.wflcwh (mgr.34430) 22 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:51.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:51 gibba023 bash[13032]: cluster 2021-03-10T20:08:49.713850+0000 mgr.gibba044.wflcwh (mgr.34430) 22 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:51.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:51 gibba023 bash[9844]: audit 2021-03-10T20:08:50.592697+0000 mon.b (mon.2) 88 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]: dispatch 2021-03-10T20:08:51.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:51 gibba023 bash[13032]: audit 2021-03-10T20:08:50.592697+0000 mon.b (mon.2) 88 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]: dispatch 2021-03-10T20:08:51.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:51 gibba023 bash[9844]: audit 2021-03-10T20:08:50.592843+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]: dispatch 2021-03-10T20:08:51.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:51 gibba023 bash[9844]: audit 2021-03-10T20:08:50.597117+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]': finished 2021-03-10T20:08:51.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:51 gibba023 bash[9844]: audit 2021-03-10T20:08:50.604689+0000 mon.b (mon.2) 89 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:08:51.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:51 gibba023 bash[9844]: audit 2021-03-10T20:08:50.605757+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:08:51.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:51 gibba023 bash[9844]: audit 2021-03-10T20:08:50.606827+0000 mon.b (mon.2) 91 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:08:51.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:51 gibba023 bash[9844]: audit 2021-03-10T20:08:50.607845+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T20:08:51.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:51 gibba023 bash[13032]: audit 2021-03-10T20:08:50.592843+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]: dispatch 2021-03-10T20:08:51.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:51 gibba023 bash[13032]: audit 2021-03-10T20:08:50.597117+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]': finished 2021-03-10T20:08:51.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:51 gibba023 bash[13032]: audit 2021-03-10T20:08:50.604689+0000 mon.b (mon.2) 89 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:08:51.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:51 gibba023 bash[13032]: audit 2021-03-10T20:08:50.605757+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:08:51.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:51 gibba023 bash[13032]: audit 2021-03-10T20:08:50.606827+0000 mon.b (mon.2) 91 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:08:51.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:51 gibba023 bash[13032]: audit 2021-03-10T20:08:50.607845+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T20:08:51.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:51 gibba044 bash[9859]: cluster 2021-03-10T20:08:49.713850+0000 mgr.gibba044.wflcwh (mgr.34430) 22 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:51.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:51 gibba044 bash[9859]: audit 2021-03-10T20:08:50.592697+0000 mon.b (mon.2) 88 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]: dispatch 2021-03-10T20:08:51.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:51 gibba044 bash[9859]: audit 2021-03-10T20:08:50.592843+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]: dispatch 2021-03-10T20:08:51.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:51 gibba044 bash[9859]: audit 2021-03-10T20:08:50.597117+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"b62b2d90ce7a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 306708480, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378991Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T19:58:10.632912Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T19:59:50.933413Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]': finished 2021-03-10T20:08:51.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:51 gibba044 bash[9859]: audit 2021-03-10T20:08:50.604689+0000 mon.b (mon.2) 89 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:08:51.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:51 gibba044 bash[9859]: audit 2021-03-10T20:08:50.605757+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:08:51.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:51 gibba044 bash[9859]: audit 2021-03-10T20:08:50.606827+0000 mon.b (mon.2) 91 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:08:51.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:51 gibba044 bash[9859]: audit 2021-03-10T20:08:50.607845+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T20:08:51.925 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:08:51 gibba023 bash[29415]: level=info ts=2021-03-10T20:08:51.596Z caller=main.go:216 msg="Starting Alertmanager" version="(version=0.21.0, branch=HEAD, revision=4c6c03ebfe21009c546e4d1e9b92c371d67c021d)" 2021-03-10T20:08:51.925 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:08:51 gibba023 bash[29415]: level=info ts=2021-03-10T20:08:51.596Z caller=main.go:217 build_context="(go=go1.14.4, user=root@dee35927357f, date=20200617-08:54:02)" 2021-03-10T20:08:51.926 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:08:51 gibba023 bash[29415]: level=info ts=2021-03-10T20:08:51.597Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.2.123 port=9094 2021-03-10T20:08:51.926 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:08:51 gibba023 bash[29415]: level=info ts=2021-03-10T20:08:51.598Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-03-10T20:08:51.926 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:08:51 gibba023 bash[29415]: level=info ts=2021-03-10T20:08:51.614Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T20:08:51.926 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:08:51 gibba023 bash[29415]: level=info ts=2021-03-10T20:08:51.614Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-03-10T20:08:51.927 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:08:51 gibba023 bash[29415]: level=info ts=2021-03-10T20:08:51.616Z caller=main.go:485 msg=Listening address=:9093 2021-03-10T20:08:52.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:52 gibba023 bash[9844]: cephadm 2021-03-10T20:08:50.604340+0000 mgr.gibba044.wflcwh (mgr.34430) 23 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T20:08:52.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:52 gibba023 bash[9844]: cephadm 2021-03-10T20:08:50.607605+0000 mgr.gibba044.wflcwh (mgr.34430) 24 : cephadm [INF] Reconfiguring daemon mon.b on gibba044 2021-03-10T20:08:52.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:52 gibba023 bash[13032]: cephadm 2021-03-10T20:08:50.604340+0000 mgr.gibba044.wflcwh (mgr.34430) 23 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T20:08:52.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:52 gibba023 bash[13032]: cephadm 2021-03-10T20:08:50.607605+0000 mgr.gibba044.wflcwh (mgr.34430) 24 : cephadm [INF] Reconfiguring daemon mon.b on gibba044 2021-03-10T20:08:52.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:52 gibba044 bash[9859]: cephadm 2021-03-10T20:08:50.604340+0000 mgr.gibba044.wflcwh (mgr.34430) 23 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T20:08:52.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:52 gibba044 bash[9859]: cephadm 2021-03-10T20:08:50.607605+0000 mgr.gibba044.wflcwh (mgr.34430) 24 : cephadm [INF] Reconfiguring daemon mon.b on gibba044 2021-03-10T20:08:53.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:53 gibba023 bash[9844]: cluster 2021-03-10T20:08:51.715689+0000 mgr.gibba044.wflcwh (mgr.34430) 25 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:53.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:53 gibba023 bash[13032]: cluster 2021-03-10T20:08:51.715689+0000 mgr.gibba044.wflcwh (mgr.34430) 25 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:53.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:53 gibba023 bash[9844]: audit 2021-03-10T20:08:52.493115+0000 mon.b (mon.2) 93 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99897835, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492498Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371510476, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492604Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400136601, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492659Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50593792, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492711Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492863Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47416606, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492977Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48611983, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493089Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33239859, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493199Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493257Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29999759, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493309Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493360Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:50.607552Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.493429Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:53.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:53 gibba023 bash[13032]: audit 2021-03-10T20:08:52.493115+0000 mon.b (mon.2) 93 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99897835, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492498Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371510476, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492604Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400136601, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492659Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50593792, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492711Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492863Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47416606, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492977Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48611983, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493089Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33239859, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493199Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493257Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29999759, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493309Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493360Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:50.607552Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.493429Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:53.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:53 gibba023 bash[9844]: audit 2021-03-10T20:08:52.493744+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99897835, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492498Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371510476, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492604Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400136601, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492659Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50593792, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492711Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492863Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47416606, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492977Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48611983, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493089Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33239859, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493199Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493257Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29999759, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493309Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493360Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:50.607552Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.493429Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:53.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:53 gibba023 bash[9844]: audit 2021-03-10T20:08:52.502714+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99897835, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492498Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371510476, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492604Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400136601, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492659Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50593792, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492711Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492863Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47416606, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492977Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48611983, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493089Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33239859, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493199Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493257Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29999759, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493309Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493360Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:50.607552Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.493429Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T20:08:53.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:53 gibba023 bash[9844]: audit 2021-03-10T20:08:52.507270+0000 mon.b (mon.2) 94 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T20:08:53.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:53 gibba023 bash[13032]: audit 2021-03-10T20:08:52.493744+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99897835, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492498Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371510476, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492604Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400136601, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492659Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50593792, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492711Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492863Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47416606, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492977Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48611983, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493089Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33239859, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493199Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493257Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29999759, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493309Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493360Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:50.607552Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.493429Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:53.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:53 gibba023 bash[13032]: audit 2021-03-10T20:08:52.502714+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99897835, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492498Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371510476, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492604Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400136601, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492659Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50593792, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492711Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492863Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47416606, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492977Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48611983, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493089Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33239859, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493199Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493257Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29999759, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493309Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493360Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:50.607552Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.493429Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T20:08:53.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:53 gibba023 bash[13032]: audit 2021-03-10T20:08:52.507270+0000 mon.b (mon.2) 94 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T20:08:53.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:53 gibba044 bash[9859]: cluster 2021-03-10T20:08:51.715689+0000 mgr.gibba044.wflcwh (mgr.34430) 25 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:53.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:53 gibba044 bash[9859]: audit 2021-03-10T20:08:52.493115+0000 mon.b (mon.2) 93 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99897835, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492498Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371510476, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492604Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400136601, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492659Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50593792, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492711Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492863Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47416606, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492977Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48611983, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493089Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33239859, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493199Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493257Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29999759, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493309Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493360Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:50.607552Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.493429Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:53.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:53 gibba044 bash[9859]: audit 2021-03-10T20:08:52.493744+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99897835, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492498Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371510476, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492604Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400136601, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492659Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50593792, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492711Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492863Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47416606, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492977Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48611983, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493089Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33239859, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493199Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493257Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29999759, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493309Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493360Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:50.607552Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.493429Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:08:53.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:53 gibba044 bash[9859]: audit 2021-03-10T20:08:52.502714+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99897835, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492498Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371510476, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492604Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400136601, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492659Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50593792, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492711Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492863Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47416606, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492977Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48611983, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493089Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33239859, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493199Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493257Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29999759, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493309Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493360Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:50.607552Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.493429Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T19:59:03.080452Z\", \"scheduled_daemon_actions\": {}}"}]': finished 2021-03-10T20:08:53.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:53 gibba044 bash[9859]: audit 2021-03-10T20:08:52.507270+0000 mon.b (mon.2) 94 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T20:08:53.925 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:08:53 gibba023 bash[29415]: level=info ts=2021-03-10T20:08:53.599Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000167945s 2021-03-10T20:08:54.378 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:54 gibba023 bash[9844]: audit 2021-03-10T20:08:52.507574+0000 mgr.gibba044.wflcwh (mgr.34430) 26 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T20:08:54.379 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:54 gibba023 bash[9844]: cephadm 2021-03-10T20:08:52.508550+0000 mgr.gibba044.wflcwh (mgr.34430) 27 : cephadm [WRN] Failed to get Dashboard config for AlertManager: dashboard get-alertmanager-api-host failed: Module 'dashboard' has experienced an error and cannot handle commands: Timeout('Port 8443 not free on ::.',) retval: -5 2021-03-10T20:08:54.379 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:54 gibba023 bash[9844]: cephadm 2021-03-10T20:08:52.508608+0000 mgr.gibba044.wflcwh (mgr.34430) 28 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T20:08:54.380 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:54 gibba023 bash[13032]: audit 2021-03-10T20:08:52.507574+0000 mgr.gibba044.wflcwh (mgr.34430) 26 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T20:08:54.380 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:54 gibba023 bash[13032]: cephadm 2021-03-10T20:08:52.508550+0000 mgr.gibba044.wflcwh (mgr.34430) 27 : cephadm [WRN] Failed to get Dashboard config for AlertManager: dashboard get-alertmanager-api-host failed: Module 'dashboard' has experienced an error and cannot handle commands: Timeout('Port 8443 not free on ::.',) retval: -5 2021-03-10T20:08:54.380 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:54 gibba023 bash[13032]: cephadm 2021-03-10T20:08:52.508608+0000 mgr.gibba044.wflcwh (mgr.34430) 28 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T20:08:54.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:54 gibba044 bash[9859]: audit 2021-03-10T20:08:52.507574+0000 mgr.gibba044.wflcwh (mgr.34430) 26 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-03-10T20:08:54.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:54 gibba044 bash[9859]: cephadm 2021-03-10T20:08:52.508550+0000 mgr.gibba044.wflcwh (mgr.34430) 27 : cephadm [WRN] Failed to get Dashboard config for AlertManager: dashboard get-alertmanager-api-host failed: Module 'dashboard' has experienced an error and cannot handle commands: Timeout('Port 8443 not free on ::.',) retval: -5 2021-03-10T20:08:54.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:54 gibba044 bash[9859]: cephadm 2021-03-10T20:08:52.508608+0000 mgr.gibba044.wflcwh (mgr.34430) 28 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a 2021-03-10T20:08:55.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:55 gibba023 bash[9844]: cluster 2021-03-10T20:08:53.716761+0000 mgr.gibba044.wflcwh (mgr.34430) 29 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:55.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:55 gibba023 bash[9844]: audit 2021-03-10T20:08:54.919440+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4b57f637-3662-4ca4-adab-66834c925771\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T20:08:55.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:55 gibba023 bash[9844]: audit 2021-03-10T20:08:54.919672+0000 mon.b (mon.2) 95 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4b57f637-3662-4ca4-adab-66834c925771\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T20:08:55.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:55 gibba023 bash[9844]: audit 2021-03-10T20:08:54.922721+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4b57f637-3662-4ca4-adab-66834c925771\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]': finished 2021-03-10T20:08:55.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:55 gibba023 bash[9844]: audit 2021-03-10T20:08:54.929319+0000 mon.b (mon.2) 96 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:08:55.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:55 gibba023 bash[13032]: cluster 2021-03-10T20:08:53.716761+0000 mgr.gibba044.wflcwh (mgr.34430) 29 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:55.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:55 gibba023 bash[13032]: audit 2021-03-10T20:08:54.919440+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4b57f637-3662-4ca4-adab-66834c925771\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T20:08:55.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:55 gibba023 bash[13032]: audit 2021-03-10T20:08:54.919672+0000 mon.b (mon.2) 95 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4b57f637-3662-4ca4-adab-66834c925771\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T20:08:55.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:55 gibba023 bash[13032]: audit 2021-03-10T20:08:54.922721+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4b57f637-3662-4ca4-adab-66834c925771\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]': finished 2021-03-10T20:08:55.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:55 gibba023 bash[13032]: audit 2021-03-10T20:08:54.929319+0000 mon.b (mon.2) 96 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:08:55.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:55 gibba044 bash[9859]: cluster 2021-03-10T20:08:53.716761+0000 mgr.gibba044.wflcwh (mgr.34430) 29 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:55.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:55 gibba044 bash[9859]: audit 2021-03-10T20:08:54.919440+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4b57f637-3662-4ca4-adab-66834c925771\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T20:08:55.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:55 gibba044 bash[9859]: audit 2021-03-10T20:08:54.919672+0000 mon.b (mon.2) 95 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4b57f637-3662-4ca4-adab-66834c925771\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]: dispatch 2021-03-10T20:08:55.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:55 gibba044 bash[9859]: audit 2021-03-10T20:08:54.922721+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"progress_id\": \"4b57f637-3662-4ca4-adab-66834c925771\", \"target_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"target_version\": \"17.0.0-1749-gb26fc080\", \"fs_original_max_mds\": null, \"error\": null, \"paused\": false}"}]': finished 2021-03-10T20:08:55.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:55 gibba044 bash[9859]: audit 2021-03-10T20:08:54.929319+0000 mon.b (mon.2) 96 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:08:56.312 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:56 gibba023 bash[9844]: cephadm 2021-03-10T20:08:54.926967+0000 mgr.gibba044.wflcwh (mgr.34430) 30 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:08:56.313 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:56 gibba023 bash[9844]: cephadm 2021-03-10T20:08:54.932220+0000 mgr.gibba044.wflcwh (mgr.34430) 31 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:08:56.313 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:56 gibba023 bash[9844]: cephadm 2021-03-10T20:08:54.933539+0000 mgr.gibba044.wflcwh (mgr.34430) 32 : cephadm [INF] Upgrade: It is presumed safe to stop ['mgr.y'] 2021-03-10T20:08:56.313 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:56 gibba023 bash[9844]: cluster 2021-03-10T20:08:55.719121+0000 mgr.gibba044.wflcwh (mgr.34430) 33 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:56.313 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:56 gibba023 bash[13032]: cephadm 2021-03-10T20:08:54.926967+0000 mgr.gibba044.wflcwh (mgr.34430) 30 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:08:56.314 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:56 gibba023 bash[13032]: cephadm 2021-03-10T20:08:54.932220+0000 mgr.gibba044.wflcwh (mgr.34430) 31 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:08:56.314 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:56 gibba023 bash[13032]: cephadm 2021-03-10T20:08:54.933539+0000 mgr.gibba044.wflcwh (mgr.34430) 32 : cephadm [INF] Upgrade: It is presumed safe to stop ['mgr.y'] 2021-03-10T20:08:56.314 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:56 gibba023 bash[13032]: cluster 2021-03-10T20:08:55.719121+0000 mgr.gibba044.wflcwh (mgr.34430) 33 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:56.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:56 gibba044 bash[9859]: cephadm 2021-03-10T20:08:54.926967+0000 mgr.gibba044.wflcwh (mgr.34430) 30 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:08:56.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:56 gibba044 bash[9859]: cephadm 2021-03-10T20:08:54.932220+0000 mgr.gibba044.wflcwh (mgr.34430) 31 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:08:56.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:56 gibba044 bash[9859]: cephadm 2021-03-10T20:08:54.933539+0000 mgr.gibba044.wflcwh (mgr.34430) 32 : cephadm [INF] Upgrade: It is presumed safe to stop ['mgr.y'] 2021-03-10T20:08:56.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:56 gibba044 bash[9859]: cluster 2021-03-10T20:08:55.719121+0000 mgr.gibba044.wflcwh (mgr.34430) 33 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:57.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:57 gibba023 bash[9844]: cephadm 2021-03-10T20:08:56.844078+0000 mgr.gibba044.wflcwh (mgr.34430) 34 : cephadm [INF] Upgrade: Updating mgr.y 2021-03-10T20:08:57.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:57 gibba023 bash[9844]: audit 2021-03-10T20:08:56.845121+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.y"}]: dispatch 2021-03-10T20:08:57.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:57 gibba023 bash[9844]: audit 2021-03-10T20:08:56.845124+0000 mon.b (mon.2) 97 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.y"}]: dispatch 2021-03-10T20:08:57.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:57 gibba023 bash[9844]: audit 2021-03-10T20:08:56.849885+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.y"}]': finished 2021-03-10T20:08:57.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:57 gibba023 bash[9844]: audit 2021-03-10T20:08:56.856174+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:08:57.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:57 gibba023 bash[9844]: audit 2021-03-10T20:08:56.856608+0000 mon.b (mon.2) 98 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:08:57.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:57 gibba023 bash[9844]: audit 2021-03-10T20:08:56.858064+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T20:08:57.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:57 gibba023 bash[9844]: audit 2021-03-10T20:08:56.858866+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:08:57.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:57 gibba023 bash[9844]: cephadm 2021-03-10T20:08:56.859407+0000 mgr.gibba044.wflcwh (mgr.34430) 35 : cephadm [INF] Deploying daemon mgr.y on gibba023 2021-03-10T20:08:57.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:57 gibba023 bash[9844]: audit 2021-03-10T20:08:56.859650+0000 mon.b (mon.2) 101 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T20:08:57.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:57 gibba023 bash[13032]: cephadm 2021-03-10T20:08:56.844078+0000 mgr.gibba044.wflcwh (mgr.34430) 34 : cephadm [INF] Upgrade: Updating mgr.y 2021-03-10T20:08:57.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:57 gibba023 bash[13032]: audit 2021-03-10T20:08:56.845121+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.y"}]: dispatch 2021-03-10T20:08:57.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:57 gibba023 bash[13032]: audit 2021-03-10T20:08:56.845124+0000 mon.b (mon.2) 97 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.y"}]: dispatch 2021-03-10T20:08:57.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:57 gibba023 bash[13032]: audit 2021-03-10T20:08:56.849885+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.y"}]': finished 2021-03-10T20:08:57.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:57 gibba023 bash[13032]: audit 2021-03-10T20:08:56.856174+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:08:57.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:57 gibba023 bash[13032]: audit 2021-03-10T20:08:56.856608+0000 mon.b (mon.2) 98 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:08:57.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:57 gibba023 bash[13032]: audit 2021-03-10T20:08:56.858064+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T20:08:57.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:57 gibba023 bash[13032]: audit 2021-03-10T20:08:56.858866+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:08:57.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:57 gibba023 bash[13032]: cephadm 2021-03-10T20:08:56.859407+0000 mgr.gibba044.wflcwh (mgr.34430) 35 : cephadm [INF] Deploying daemon mgr.y on gibba023 2021-03-10T20:08:57.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:57 gibba023 bash[13032]: audit 2021-03-10T20:08:56.859650+0000 mon.b (mon.2) 101 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T20:08:57.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:57 gibba044 bash[9859]: cephadm 2021-03-10T20:08:56.844078+0000 mgr.gibba044.wflcwh (mgr.34430) 34 : cephadm [INF] Upgrade: Updating mgr.y 2021-03-10T20:08:57.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:57 gibba044 bash[9859]: audit 2021-03-10T20:08:56.845121+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.y"}]: dispatch 2021-03-10T20:08:57.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:57 gibba044 bash[9859]: audit 2021-03-10T20:08:56.845124+0000 mon.b (mon.2) 97 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.y"}]: dispatch 2021-03-10T20:08:57.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:57 gibba044 bash[9859]: audit 2021-03-10T20:08:56.849885+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr.y"}]': finished 2021-03-10T20:08:57.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:57 gibba044 bash[9859]: audit 2021-03-10T20:08:56.856174+0000 mon.a (mon.0) 675 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:08:57.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:57 gibba044 bash[9859]: audit 2021-03-10T20:08:56.856608+0000 mon.b (mon.2) 98 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:08:57.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:57 gibba044 bash[9859]: audit 2021-03-10T20:08:56.858064+0000 mon.b (mon.2) 99 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T20:08:57.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:57 gibba044 bash[9859]: audit 2021-03-10T20:08:56.858866+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:08:57.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:57 gibba044 bash[9859]: cephadm 2021-03-10T20:08:56.859407+0000 mgr.gibba044.wflcwh (mgr.34430) 35 : cephadm [INF] Deploying daemon mgr.y on gibba023 2021-03-10T20:08:57.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:57 gibba044 bash[9859]: audit 2021-03-10T20:08:56.859650+0000 mon.b (mon.2) 101 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T20:08:58.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:08:58 gibba044 bash[9859]: cluster 2021-03-10T20:08:57.720425+0000 mgr.gibba044.wflcwh (mgr.34430) 36 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:58.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:08:58 gibba023 bash[9844]: cluster 2021-03-10T20:08:57.720425+0000 mgr.gibba044.wflcwh (mgr.34430) 36 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:58.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:08:58 gibba023 bash[13032]: cluster 2021-03-10T20:08:57.720425+0000 mgr.gibba044.wflcwh (mgr.34430) 36 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:08:59.175 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 20:08:58 gibba023 systemd[1]: Stopping Ceph mgr.y for dd719b26-81da-11eb-9080-001a4aab830c... 2021-03-10T20:09:01.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:00 gibba023 bash[9844]: cluster 2021-03-10T20:08:59.721540+0000 mgr.gibba044.wflcwh (mgr.34430) 37 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:01.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:00 gibba023 bash[13032]: cluster 2021-03-10T20:08:59.721540+0000 mgr.gibba044.wflcwh (mgr.34430) 37 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:01.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:00 gibba044 bash[9859]: cluster 2021-03-10T20:08:59.721540+0000 mgr.gibba044.wflcwh (mgr.34430) 37 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:01.924 INFO:journalctl@ceph.alertmanager.a.gibba023.stdout:Mar 10 20:09:01 gibba023 bash[29415]: level=info ts=2021-03-10T20:09:01.600Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.001219426s 2021-03-10T20:09:03.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:02 gibba023 bash[9844]: cluster 2021-03-10T20:09:01.723875+0000 mgr.gibba044.wflcwh (mgr.34430) 38 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:03.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:02 gibba023 bash[13032]: cluster 2021-03-10T20:09:01.723875+0000 mgr.gibba044.wflcwh (mgr.34430) 38 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:03.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:02 gibba044 bash[9859]: cluster 2021-03-10T20:09:01.723875+0000 mgr.gibba044.wflcwh (mgr.34430) 38 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:05.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:04 gibba023 bash[9844]: cluster 2021-03-10T20:09:03.725037+0000 mgr.gibba044.wflcwh (mgr.34430) 39 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:05.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:04 gibba023 bash[13032]: cluster 2021-03-10T20:09:03.725037+0000 mgr.gibba044.wflcwh (mgr.34430) 39 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:05.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:04 gibba044 bash[9859]: cluster 2021-03-10T20:09:03.725037+0000 mgr.gibba044.wflcwh (mgr.34430) 39 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:07.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:06 gibba023 bash[9844]: cluster 2021-03-10T20:09:05.727190+0000 mgr.gibba044.wflcwh (mgr.34430) 40 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:07.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:06 gibba023 bash[13032]: cluster 2021-03-10T20:09:05.727190+0000 mgr.gibba044.wflcwh (mgr.34430) 40 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:07.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:06 gibba044 bash[9859]: cluster 2021-03-10T20:09:05.727190+0000 mgr.gibba044.wflcwh (mgr.34430) 40 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:09.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:08 gibba023 bash[9844]: cluster 2021-03-10T20:09:07.728322+0000 mgr.gibba044.wflcwh (mgr.34430) 41 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:09.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:08 gibba023 bash[13032]: cluster 2021-03-10T20:09:07.728322+0000 mgr.gibba044.wflcwh (mgr.34430) 41 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:09.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:08 gibba044 bash[9859]: cluster 2021-03-10T20:09:07.728322+0000 mgr.gibba044.wflcwh (mgr.34430) 41 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:10.052 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 20:09:09 gibba023 docker[29762]: ceph-dd719b26-81da-11eb-9080-001a4aab830c-mgr.y 2021-03-10T20:09:10.053 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 20:09:09 gibba023 systemd[1]: ceph-dd719b26-81da-11eb-9080-001a4aab830c@mgr.y.service: Main process exited, code=exited, status=137/n/a 2021-03-10T20:09:10.053 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 20:09:09 gibba023 systemd[1]: ceph-dd719b26-81da-11eb-9080-001a4aab830c@mgr.y.service: Failed with result 'exit-code'. 2021-03-10T20:09:10.053 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 20:09:09 gibba023 systemd[1]: Stopped Ceph mgr.y for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:09:10.053 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 20:09:09 gibba023 systemd[1]: Started Ceph mgr.y for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:09:11.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:10 gibba044 bash[9859]: cluster 2021-03-10T20:09:09.729397+0000 mgr.gibba044.wflcwh (mgr.34430) 42 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:11.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:10 gibba044 bash[9859]: audit 2021-03-10T20:09:09.926473+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]: dispatch 2021-03-10T20:09:11.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:10 gibba044 bash[9859]: audit 2021-03-10T20:09:09.927029+0000 mon.b (mon.2) 102 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]: dispatch 2021-03-10T20:09:11.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:10 gibba044 bash[9859]: audit 2021-03-10T20:09:09.929185+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]': finished 2021-03-10T20:09:11.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:10 gibba044 bash[9859]: audit 2021-03-10T20:09:09.931297+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:09:11.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:10 gibba044 bash[9859]: audit 2021-03-10T20:09:10.113634+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99897835, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492498Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371510476, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492604Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400136601, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:08:39.492659Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50593792, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492711Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492863Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47416606, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492977Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48611983, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493089Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33239859, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:08:39.493199Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493257Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29999759, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:08:39.493309Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493360Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:50.607552Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.493429Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T20:09:10.113043Z\"}"}]: dispatch 2021-03-10T20:09:11.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:10 gibba044 bash[9859]: audit 2021-03-10T20:09:10.113946+0000 mon.b (mon.2) 104 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99897835, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492498Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371510476, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492604Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400136601, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:08:39.492659Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50593792, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492711Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492863Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47416606, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492977Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48611983, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493089Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33239859, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:08:39.493199Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493257Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29999759, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:08:39.493309Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493360Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:50.607552Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.493429Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T20:09:10.113043Z\"}"}]: dispatch 2021-03-10T20:09:11.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:10 gibba044 bash[9859]: audit 2021-03-10T20:09:10.116838+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99897835, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492498Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371510476, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492604Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400136601, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:08:39.492659Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50593792, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492711Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492863Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47416606, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492977Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48611983, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493089Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33239859, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:08:39.493199Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493257Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29999759, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:08:39.493309Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493360Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:50.607552Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.493429Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T20:09:10.113043Z\"}"}]': finished 2021-03-10T20:09:11.424 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 20:09:11 gibba023 bash[29872]: debug 2021-03-10T20:09:11.092+0000 7f2557a75700 1 -- 172.21.2.123:0/269589098 <== mon.1 v2:172.21.2.123:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5560227f84e0 con 0x5560228e9000 2021-03-10T20:09:11.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:10 gibba023 bash[9844]: cluster 2021-03-10T20:09:09.729397+0000 mgr.gibba044.wflcwh (mgr.34430) 42 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:11.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:10 gibba023 bash[13032]: cluster 2021-03-10T20:09:09.729397+0000 mgr.gibba044.wflcwh (mgr.34430) 42 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:11.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:10 gibba023 bash[9844]: audit 2021-03-10T20:09:09.926473+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]: dispatch 2021-03-10T20:09:11.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:10 gibba023 bash[13032]: audit 2021-03-10T20:09:09.926473+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]: dispatch 2021-03-10T20:09:11.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:10 gibba023 bash[9844]: audit 2021-03-10T20:09:09.927029+0000 mon.b (mon.2) 102 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]: dispatch 2021-03-10T20:09:11.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:10 gibba023 bash[13032]: audit 2021-03-10T20:09:09.927029+0000 mon.b (mon.2) 102 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]: dispatch 2021-03-10T20:09:11.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:10 gibba023 bash[9844]: audit 2021-03-10T20:09:09.929185+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]': finished 2021-03-10T20:09:11.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:10 gibba023 bash[9844]: audit 2021-03-10T20:09:09.931297+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:09:11.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:10 gibba023 bash[13032]: audit 2021-03-10T20:09:09.929185+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94382325, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.378414Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 93920952, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379324Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49597644, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.379738Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.380503Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47133491, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381186Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48779755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.381835Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23383244, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.382467Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.383105Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]': finished 2021-03-10T20:09:11.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:10 gibba023 bash[13032]: audit 2021-03-10T20:09:09.931297+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:09:11.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:10 gibba023 bash[9844]: audit 2021-03-10T20:09:10.113634+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99897835, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492498Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371510476, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492604Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400136601, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:08:39.492659Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50593792, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492711Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492863Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47416606, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492977Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48611983, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493089Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33239859, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:08:39.493199Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493257Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29999759, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:08:39.493309Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493360Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:50.607552Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.493429Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T20:09:10.113043Z\"}"}]: dispatch 2021-03-10T20:09:11.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:10 gibba023 bash[13032]: audit 2021-03-10T20:09:10.113634+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99897835, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492498Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371510476, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492604Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400136601, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:08:39.492659Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50593792, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492711Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492863Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47416606, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492977Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48611983, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493089Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33239859, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:08:39.493199Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493257Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29999759, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:08:39.493309Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493360Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:50.607552Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.493429Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T20:09:10.113043Z\"}"}]: dispatch 2021-03-10T20:09:11.432 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:10 gibba023 bash[9844]: audit 2021-03-10T20:09:10.113946+0000 mon.b (mon.2) 104 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99897835, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492498Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371510476, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492604Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400136601, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:08:39.492659Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50593792, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492711Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492863Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47416606, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492977Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48611983, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493089Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33239859, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:08:39.493199Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493257Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29999759, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:08:39.493309Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493360Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:50.607552Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.493429Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T20:09:10.113043Z\"}"}]: dispatch 2021-03-10T20:09:11.433 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:10 gibba023 bash[9844]: audit 2021-03-10T20:09:10.116838+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99897835, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492498Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371510476, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492604Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400136601, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:08:39.492659Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50593792, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492711Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492863Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47416606, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492977Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48611983, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493089Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33239859, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:08:39.493199Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493257Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29999759, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:08:39.493309Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493360Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:50.607552Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.493429Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T20:09:10.113043Z\"}"}]': finished 2021-03-10T20:09:11.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:10 gibba023 bash[13032]: audit 2021-03-10T20:09:10.113946+0000 mon.b (mon.2) 104 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99897835, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492498Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371510476, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492604Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400136601, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:08:39.492659Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50593792, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492711Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492863Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47416606, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492977Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48611983, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493089Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33239859, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:08:39.493199Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493257Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29999759, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:08:39.493309Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493360Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:50.607552Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.493429Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T20:09:10.113043Z\"}"}]: dispatch 2021-03-10T20:09:11.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:10 gibba023 bash[13032]: audit 2021-03-10T20:09:10.116838+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99897835, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492498Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 371510476, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492604Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 400136601, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:08:39.492659Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50593792, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492711Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47238348, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492863Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47416606, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.492977Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48611983, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493089Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33239859, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:08:39.493199Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23257415, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493257Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 29999759, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:08:39.493309Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:08:39.493360Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:50.607552Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:08:39.493429Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T20:09:10.113043Z\"}"}]': finished 2021-03-10T20:09:13.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:12 gibba044 bash[9859]: cluster 2021-03-10T20:09:11.731669+0000 mgr.gibba044.wflcwh (mgr.34430) 43 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:13.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:12 gibba023 bash[9844]: cluster 2021-03-10T20:09:11.731669+0000 mgr.gibba044.wflcwh (mgr.34430) 43 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:13.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:12 gibba023 bash[13032]: cluster 2021-03-10T20:09:11.731669+0000 mgr.gibba044.wflcwh (mgr.34430) 43 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:15.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[9844]: cluster 2021-03-10T20:09:13.732611+0000 mgr.gibba044.wflcwh (mgr.34430) 44 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:15.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[13032]: cluster 2021-03-10T20:09:13.732611+0000 mgr.gibba044.wflcwh (mgr.34430) 44 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:15.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[9844]: audit 2021-03-10T20:09:14.598678+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107688755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.593929Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"513df908ba68\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 216530944, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.594419Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T20:09:09.951098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95126814, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.594744Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49230643, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.595045Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.595802Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47039119, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.596463Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48999956, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.597100Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23676846, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.597728Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"16ead90c14c6\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12761169, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.598059Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:08:50.596854Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.598107Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_daemon_update\": \"2021-03-10T20:09:14.598169Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]: dispatch 2021-03-10T20:09:15.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[13032]: audit 2021-03-10T20:09:14.598678+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107688755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.593929Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"513df908ba68\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 216530944, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.594419Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T20:09:09.951098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95126814, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.594744Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49230643, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.595045Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.595802Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47039119, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.596463Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48999956, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.597100Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23676846, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.597728Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"16ead90c14c6\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12761169, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.598059Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:08:50.596854Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.598107Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_daemon_update\": \"2021-03-10T20:09:14.598169Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]: dispatch 2021-03-10T20:09:15.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[9844]: audit 2021-03-10T20:09:14.599177+0000 mon.b (mon.2) 105 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107688755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.593929Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"513df908ba68\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 216530944, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.594419Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T20:09:09.951098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95126814, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.594744Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49230643, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.595045Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.595802Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47039119, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.596463Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48999956, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.597100Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23676846, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.597728Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"16ead90c14c6\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12761169, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.598059Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:08:50.596854Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.598107Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_daemon_update\": \"2021-03-10T20:09:14.598169Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]: dispatch 2021-03-10T20:09:15.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[13032]: audit 2021-03-10T20:09:14.599177+0000 mon.b (mon.2) 105 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107688755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.593929Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"513df908ba68\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 216530944, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.594419Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T20:09:09.951098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95126814, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.594744Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49230643, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.595045Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.595802Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47039119, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.596463Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48999956, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.597100Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23676846, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.597728Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"16ead90c14c6\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12761169, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.598059Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:08:50.596854Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.598107Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_daemon_update\": \"2021-03-10T20:09:14.598169Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]: dispatch 2021-03-10T20:09:15.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[9844]: audit 2021-03-10T20:09:14.601991+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107688755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.593929Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"513df908ba68\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 216530944, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.594419Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T20:09:09.951098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95126814, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.594744Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49230643, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.595045Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.595802Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47039119, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.596463Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48999956, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.597100Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23676846, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.597728Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"16ead90c14c6\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12761169, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.598059Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:08:50.596854Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.598107Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_daemon_update\": \"2021-03-10T20:09:14.598169Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]': finished 2021-03-10T20:09:15.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[9844]: audit 2021-03-10T20:09:14.603766+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:09:15.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[13032]: audit 2021-03-10T20:09:14.601991+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107688755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.593929Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"513df908ba68\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 216530944, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.594419Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T20:09:09.951098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95126814, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.594744Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49230643, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.595045Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.595802Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47039119, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.596463Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48999956, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.597100Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23676846, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.597728Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"16ead90c14c6\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12761169, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.598059Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:08:50.596854Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.598107Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_daemon_update\": \"2021-03-10T20:09:14.598169Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]': finished 2021-03-10T20:09:15.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[13032]: audit 2021-03-10T20:09:14.603766+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:09:15.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[9844]: audit 2021-03-10T20:09:14.604511+0000 mon.b (mon.2) 106 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:09:15.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[9844]: audit 2021-03-10T20:09:14.606039+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T20:09:15.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[9844]: audit 2021-03-10T20:09:14.612025+0000 mon.b (mon.2) 107 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:09:15.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[9844]: audit 2021-03-10T20:09:14.613036+0000 mon.b (mon.2) 108 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:09:15.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[9844]: audit 2021-03-10T20:09:14.613278+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr"}]: dispatch 2021-03-10T20:09:15.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[9844]: audit 2021-03-10T20:09:14.613965+0000 mon.b (mon.2) 109 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr"}]: dispatch 2021-03-10T20:09:15.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[9844]: audit 2021-03-10T20:09:14.616572+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr"}]': finished 2021-03-10T20:09:15.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[9844]: audit 2021-03-10T20:09:14.617768+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba044.wflcwh"}]: dispatch 2021-03-10T20:09:15.183 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[9844]: audit 2021-03-10T20:09:14.618584+0000 mon.b (mon.2) 110 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba044.wflcwh"}]: dispatch 2021-03-10T20:09:15.183 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[9844]: audit 2021-03-10T20:09:14.620595+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba044.wflcwh"}]': finished 2021-03-10T20:09:15.183 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[9844]: audit 2021-03-10T20:09:14.621904+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T20:09:15.183 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[9844]: audit 2021-03-10T20:09:14.622651+0000 mon.b (mon.2) 111 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T20:09:15.183 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[9844]: audit 2021-03-10T20:09:14.624863+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2021-03-10T20:09:15.184 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[9844]: audit 2021-03-10T20:09:14.626221+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T20:09:15.184 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[9844]: audit 2021-03-10T20:09:14.627054+0000 mon.b (mon.2) 112 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T20:09:15.184 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[9844]: audit 2021-03-10T20:09:14.629040+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2021-03-10T20:09:15.184 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[9844]: audit 2021-03-10T20:09:14.631353+0000 mon.b (mon.2) 113 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2021-03-10T20:09:15.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[13032]: audit 2021-03-10T20:09:14.604511+0000 mon.b (mon.2) 106 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:09:15.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[13032]: audit 2021-03-10T20:09:14.606039+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T20:09:15.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[13032]: audit 2021-03-10T20:09:14.612025+0000 mon.b (mon.2) 107 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:09:15.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[13032]: audit 2021-03-10T20:09:14.613036+0000 mon.b (mon.2) 108 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:09:15.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[13032]: audit 2021-03-10T20:09:14.613278+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr"}]: dispatch 2021-03-10T20:09:15.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[13032]: audit 2021-03-10T20:09:14.613965+0000 mon.b (mon.2) 109 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr"}]: dispatch 2021-03-10T20:09:15.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[13032]: audit 2021-03-10T20:09:14.616572+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr"}]': finished 2021-03-10T20:09:15.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[13032]: audit 2021-03-10T20:09:14.617768+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba044.wflcwh"}]: dispatch 2021-03-10T20:09:15.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[13032]: audit 2021-03-10T20:09:14.618584+0000 mon.b (mon.2) 110 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba044.wflcwh"}]: dispatch 2021-03-10T20:09:15.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[13032]: audit 2021-03-10T20:09:14.620595+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba044.wflcwh"}]': finished 2021-03-10T20:09:15.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[13032]: audit 2021-03-10T20:09:14.621904+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T20:09:15.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[13032]: audit 2021-03-10T20:09:14.622651+0000 mon.b (mon.2) 111 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T20:09:15.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[13032]: audit 2021-03-10T20:09:14.624863+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2021-03-10T20:09:15.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[13032]: audit 2021-03-10T20:09:14.626221+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T20:09:15.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[13032]: audit 2021-03-10T20:09:14.627054+0000 mon.b (mon.2) 112 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T20:09:15.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[13032]: audit 2021-03-10T20:09:14.629040+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2021-03-10T20:09:15.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:14 gibba023 bash[13032]: audit 2021-03-10T20:09:14.631353+0000 mon.b (mon.2) 113 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2021-03-10T20:09:15.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:14 gibba044 bash[9859]: cluster 2021-03-10T20:09:13.732611+0000 mgr.gibba044.wflcwh (mgr.34430) 44 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:15.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:14 gibba044 bash[9859]: audit 2021-03-10T20:09:14.598678+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107688755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.593929Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"513df908ba68\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 216530944, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.594419Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T20:09:09.951098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95126814, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.594744Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49230643, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.595045Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.595802Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47039119, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.596463Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48999956, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.597100Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23676846, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.597728Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"16ead90c14c6\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12761169, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.598059Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:08:50.596854Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.598107Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_daemon_update\": \"2021-03-10T20:09:14.598169Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]: dispatch 2021-03-10T20:09:15.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:14 gibba044 bash[9859]: audit 2021-03-10T20:09:14.599177+0000 mon.b (mon.2) 105 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107688755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.593929Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"513df908ba68\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 216530944, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.594419Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T20:09:09.951098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95126814, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.594744Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49230643, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.595045Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.595802Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47039119, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.596463Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48999956, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.597100Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23676846, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.597728Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"16ead90c14c6\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12761169, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.598059Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:08:50.596854Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.598107Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_daemon_update\": \"2021-03-10T20:09:14.598169Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]: dispatch 2021-03-10T20:09:15.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:14 gibba044 bash[9859]: audit 2021-03-10T20:09:14.601991+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"295953e7c788\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 107688755, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.593929Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T19:58:08.564889Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"513df908ba68\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 216530944, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.594419Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T20:09:09.951098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95126814, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.594744Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49230643, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.595045Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.595802Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47039119, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.596463Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48999956, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.597100Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23676846, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.597728Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"16ead90c14c6\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12761169, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.598059Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:08:50.596854Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.598107Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:39.723655Z\"}}, \"last_daemon_update\": \"2021-03-10T20:09:14.598169Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]': finished 2021-03-10T20:09:15.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:14 gibba044 bash[9859]: audit 2021-03-10T20:09:14.603766+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:09:15.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:14 gibba044 bash[9859]: audit 2021-03-10T20:09:14.604511+0000 mon.b (mon.2) 106 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:09:15.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:14 gibba044 bash[9859]: audit 2021-03-10T20:09:14.606039+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2021-03-10T20:09:15.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:14 gibba044 bash[9859]: audit 2021-03-10T20:09:14.612025+0000 mon.b (mon.2) 107 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:09:15.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:14 gibba044 bash[9859]: audit 2021-03-10T20:09:14.613036+0000 mon.b (mon.2) 108 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:09:15.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:14 gibba044 bash[9859]: audit 2021-03-10T20:09:14.613278+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr"}]: dispatch 2021-03-10T20:09:15.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:14 gibba044 bash[9859]: audit 2021-03-10T20:09:14.613965+0000 mon.b (mon.2) 109 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr"}]: dispatch 2021-03-10T20:09:15.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:14 gibba044 bash[9859]: audit 2021-03-10T20:09:14.616572+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mgr"}]': finished 2021-03-10T20:09:15.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:14 gibba044 bash[9859]: audit 2021-03-10T20:09:14.617768+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba044.wflcwh"}]: dispatch 2021-03-10T20:09:15.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:14 gibba044 bash[9859]: audit 2021-03-10T20:09:14.618584+0000 mon.b (mon.2) 110 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba044.wflcwh"}]: dispatch 2021-03-10T20:09:15.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:14 gibba044 bash[9859]: audit 2021-03-10T20:09:14.620595+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.gibba044.wflcwh"}]': finished 2021-03-10T20:09:15.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:14 gibba044 bash[9859]: audit 2021-03-10T20:09:14.621904+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T20:09:15.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:14 gibba044 bash[9859]: audit 2021-03-10T20:09:14.622651+0000 mon.b (mon.2) 111 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-03-10T20:09:15.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:14 gibba044 bash[9859]: audit 2021-03-10T20:09:14.624863+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2021-03-10T20:09:15.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:14 gibba044 bash[9859]: audit 2021-03-10T20:09:14.626221+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T20:09:15.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:14 gibba044 bash[9859]: audit 2021-03-10T20:09:14.627054+0000 mon.b (mon.2) 112 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-03-10T20:09:15.258 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:14 gibba044 bash[9859]: audit 2021-03-10T20:09:14.629040+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2021-03-10T20:09:15.258 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:14 gibba044 bash[9859]: audit 2021-03-10T20:09:14.631353+0000 mon.b (mon.2) 113 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2021-03-10T20:09:15.572 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:09:15.828 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:09:15.828 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (25s) 1s ago 5m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:09:15.828 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (5m) 36s ago 5m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:09:15.829 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (46s) 36s ago 9m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:09:15.829 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (63s) 36s ago 9m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:09:15.829 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (5s) 1s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:09:15.829 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (11m) 1s ago 11m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 295953e7c788 2021-03-10T20:09:15.830 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (9m) 36s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 0e96acfc200a 2021-03-10T20:09:15.830 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (9m) 1s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 c1745ed327ed 2021-03-10T20:09:15.830 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (6m) 1s ago 6m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:09:15.830 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (6m) 36s ago 6m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:09:15.831 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (9m) 1s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a8e662729287 2021-03-10T20:09:15.831 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (8m) 1s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 aba825ce9058 2021-03-10T20:09:15.831 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (8m) 1s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 0b4c19578b20 2021-03-10T20:09:15.831 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (7m) 1s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 25229602755c 2021-03-10T20:09:15.831 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (7m) 36s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a745be9e28cb 2021-03-10T20:09:15.832 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (7m) 36s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0313bf557eb 2021-03-10T20:09:15.832 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (6m) 36s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 ffa9fe94cea1 2021-03-10T20:09:15.832 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (6m) 36s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 082d0fe68f90 2021-03-10T20:09:15.833 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (5m) 36s ago 6m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:09:15.833 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 1s ago 3m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:09:15.833 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 36s ago 3m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:09:16.094 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:09:16.094 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:09:16.095 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2021-03-10T20:09:16.095 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:09:16.095 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:09:16.095 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:09:16.096 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:09:16.096 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:09:16.096 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T20:09:16.096 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:09:16.096 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:09:16.097 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:09:16.097 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 11, 2021-03-10T20:09:16.097 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:09:16.097 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:09:16.097 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:09:16.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:15 gibba023 bash[9844]: cephadm 2021-03-10T20:09:14.611440+0000 mgr.gibba044.wflcwh (mgr.34430) 45 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:09:16.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:15 gibba023 bash[9844]: cephadm 2021-03-10T20:09:14.612737+0000 mgr.gibba044.wflcwh (mgr.34430) 46 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:09:16.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:15 gibba023 bash[9844]: cephadm 2021-03-10T20:09:14.613708+0000 mgr.gibba044.wflcwh (mgr.34430) 47 : cephadm [WRN] Upgrade: 1 mgr daemon(s) are 15.2.0 != target 17.0.0-1749-gb26fc080 2021-03-10T20:09:16.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:15 gibba023 bash[9844]: cephadm 2021-03-10T20:09:14.613744+0000 mgr.gibba044.wflcwh (mgr.34430) 48 : cephadm [INF] Upgrade: Setting container_image for all mgr 2021-03-10T20:09:16.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:15 gibba023 bash[9844]: cephadm 2021-03-10T20:09:14.631051+0000 mgr.gibba044.wflcwh (mgr.34430) 49 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:09:16.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:15 gibba023 bash[9844]: cephadm 2021-03-10T20:09:14.631087+0000 mgr.gibba044.wflcwh (mgr.34430) 50 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:09:16.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:15 gibba023 bash[9844]: cephadm 2021-03-10T20:09:14.631753+0000 mgr.gibba044.wflcwh (mgr.34430) 51 : cephadm [INF] It is presumed safe to stop mon.a 2021-03-10T20:09:16.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:15 gibba023 bash[9844]: cephadm 2021-03-10T20:09:14.631788+0000 mgr.gibba044.wflcwh (mgr.34430) 52 : cephadm [INF] Upgrade: It is presumed safe to stop mon.a 2021-03-10T20:09:16.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:15 gibba023 bash[9844]: cluster 2021-03-10T20:09:14.988984+0000 mon.a (mon.0) 692 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T20:09:16.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:15 gibba023 bash[9844]: cluster 2021-03-10T20:09:14.989081+0000 mon.a (mon.0) 693 : cluster [DBG] Standby manager daemon y started 2021-03-10T20:09:16.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:15 gibba023 bash[9844]: audit 2021-03-10T20:09:14.989850+0000 mon.c (mon.1) 28 : audit [DBG] from='mgr.? 172.21.2.123:0/3599362729' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:09:16.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:15 gibba023 bash[9844]: audit 2021-03-10T20:09:14.990976+0000 mon.c (mon.1) 29 : audit [DBG] from='mgr.? 172.21.2.123:0/3599362729' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:09:16.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:15 gibba023 bash[13032]: cephadm 2021-03-10T20:09:14.611440+0000 mgr.gibba044.wflcwh (mgr.34430) 45 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:09:16.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:15 gibba023 bash[13032]: cephadm 2021-03-10T20:09:14.612737+0000 mgr.gibba044.wflcwh (mgr.34430) 46 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:09:16.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:15 gibba023 bash[13032]: cephadm 2021-03-10T20:09:14.613708+0000 mgr.gibba044.wflcwh (mgr.34430) 47 : cephadm [WRN] Upgrade: 1 mgr daemon(s) are 15.2.0 != target 17.0.0-1749-gb26fc080 2021-03-10T20:09:16.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:15 gibba023 bash[13032]: cephadm 2021-03-10T20:09:14.613744+0000 mgr.gibba044.wflcwh (mgr.34430) 48 : cephadm [INF] Upgrade: Setting container_image for all mgr 2021-03-10T20:09:16.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:15 gibba023 bash[13032]: cephadm 2021-03-10T20:09:14.631051+0000 mgr.gibba044.wflcwh (mgr.34430) 49 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:09:16.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:15 gibba023 bash[13032]: cephadm 2021-03-10T20:09:14.631087+0000 mgr.gibba044.wflcwh (mgr.34430) 50 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:09:16.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:15 gibba023 bash[13032]: cephadm 2021-03-10T20:09:14.631753+0000 mgr.gibba044.wflcwh (mgr.34430) 51 : cephadm [INF] It is presumed safe to stop mon.a 2021-03-10T20:09:16.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:15 gibba023 bash[13032]: cephadm 2021-03-10T20:09:14.631788+0000 mgr.gibba044.wflcwh (mgr.34430) 52 : cephadm [INF] Upgrade: It is presumed safe to stop mon.a 2021-03-10T20:09:16.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:15 gibba023 bash[13032]: cluster 2021-03-10T20:09:14.988984+0000 mon.a (mon.0) 692 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T20:09:16.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:15 gibba023 bash[13032]: cluster 2021-03-10T20:09:14.989081+0000 mon.a (mon.0) 693 : cluster [DBG] Standby manager daemon y started 2021-03-10T20:09:16.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:15 gibba023 bash[13032]: audit 2021-03-10T20:09:14.989850+0000 mon.c (mon.1) 28 : audit [DBG] from='mgr.? 172.21.2.123:0/3599362729' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:09:16.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:15 gibba023 bash[13032]: audit 2021-03-10T20:09:14.990976+0000 mon.c (mon.1) 29 : audit [DBG] from='mgr.? 172.21.2.123:0/3599362729' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:09:16.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:15 gibba044 bash[9859]: cephadm 2021-03-10T20:09:14.611440+0000 mgr.gibba044.wflcwh (mgr.34430) 45 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:09:16.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:15 gibba044 bash[9859]: cephadm 2021-03-10T20:09:14.612737+0000 mgr.gibba044.wflcwh (mgr.34430) 46 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:09:16.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:15 gibba044 bash[9859]: cephadm 2021-03-10T20:09:14.613708+0000 mgr.gibba044.wflcwh (mgr.34430) 47 : cephadm [WRN] Upgrade: 1 mgr daemon(s) are 15.2.0 != target 17.0.0-1749-gb26fc080 2021-03-10T20:09:16.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:15 gibba044 bash[9859]: cephadm 2021-03-10T20:09:14.613744+0000 mgr.gibba044.wflcwh (mgr.34430) 48 : cephadm [INF] Upgrade: Setting container_image for all mgr 2021-03-10T20:09:16.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:15 gibba044 bash[9859]: cephadm 2021-03-10T20:09:14.631051+0000 mgr.gibba044.wflcwh (mgr.34430) 49 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:09:16.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:15 gibba044 bash[9859]: cephadm 2021-03-10T20:09:14.631087+0000 mgr.gibba044.wflcwh (mgr.34430) 50 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:09:16.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:15 gibba044 bash[9859]: cephadm 2021-03-10T20:09:14.631753+0000 mgr.gibba044.wflcwh (mgr.34430) 51 : cephadm [INF] It is presumed safe to stop mon.a 2021-03-10T20:09:16.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:15 gibba044 bash[9859]: cephadm 2021-03-10T20:09:14.631788+0000 mgr.gibba044.wflcwh (mgr.34430) 52 : cephadm [INF] Upgrade: It is presumed safe to stop mon.a 2021-03-10T20:09:16.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:15 gibba044 bash[9859]: cluster 2021-03-10T20:09:14.988984+0000 mon.a (mon.0) 692 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T20:09:16.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:15 gibba044 bash[9859]: cluster 2021-03-10T20:09:14.989081+0000 mon.a (mon.0) 693 : cluster [DBG] Standby manager daemon y started 2021-03-10T20:09:16.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:15 gibba044 bash[9859]: audit 2021-03-10T20:09:14.989850+0000 mon.c (mon.1) 28 : audit [DBG] from='mgr.? 172.21.2.123:0/3599362729' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:09:16.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:15 gibba044 bash[9859]: audit 2021-03-10T20:09:14.990976+0000 mon.c (mon.1) 29 : audit [DBG] from='mgr.? 172.21.2.123:0/3599362729' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:09:17.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:16 gibba044 bash[9859]: audit 2021-03-10T20:09:15.564173+0000 mgr.gibba044.wflcwh (mgr.34430) 53 : audit [DBG] from='client.14715 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:09:17.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:16 gibba044 bash[9859]: cluster 2021-03-10T20:09:15.734619+0000 mgr.gibba044.wflcwh (mgr.34430) 54 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:17.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:16 gibba044 bash[9859]: audit 2021-03-10T20:09:15.790055+0000 mgr.gibba044.wflcwh (mgr.34430) 55 : audit [DBG] from='client.24631 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:09:17.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:16 gibba044 bash[9859]: cluster 2021-03-10T20:09:15.952175+0000 mon.a (mon.0) 694 : cluster [DBG] mgrmap e21: gibba044.wflcwh(active, since 41s), standbys: y, x 2021-03-10T20:09:17.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:16 gibba044 bash[9859]: audit 2021-03-10T20:09:16.094039+0000 mon.c (mon.1) 30 : audit [DBG] from='client.? 172.21.2.123:0/1068569872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:09:17.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:16 gibba044 bash[9859]: audit 2021-03-10T20:09:16.782857+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.a"}]: dispatch 2021-03-10T20:09:17.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:16 gibba044 bash[9859]: audit 2021-03-10T20:09:16.782895+0000 mon.b (mon.2) 114 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.a"}]: dispatch 2021-03-10T20:09:17.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:16 gibba044 bash[9859]: audit 2021-03-10T20:09:16.787454+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.a"}]': finished 2021-03-10T20:09:17.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:16 gibba044 bash[9859]: audit 2021-03-10T20:09:16.794289+0000 mon.b (mon.2) 115 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:09:17.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:16 gibba044 bash[9859]: audit 2021-03-10T20:09:16.795230+0000 mon.b (mon.2) 116 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:09:17.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:16 gibba044 bash[9859]: audit 2021-03-10T20:09:16.795921+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:09:17.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:16 gibba044 bash[9859]: audit 2021-03-10T20:09:16.796867+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T20:09:17.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:16 gibba023 bash[9844]: audit 2021-03-10T20:09:15.564173+0000 mgr.gibba044.wflcwh (mgr.34430) 53 : audit [DBG] from='client.14715 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:09:17.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:16 gibba023 bash[9844]: cluster 2021-03-10T20:09:15.734619+0000 mgr.gibba044.wflcwh (mgr.34430) 54 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:17.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:16 gibba023 bash[9844]: audit 2021-03-10T20:09:15.790055+0000 mgr.gibba044.wflcwh (mgr.34430) 55 : audit [DBG] from='client.24631 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:09:17.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:16 gibba023 bash[9844]: cluster 2021-03-10T20:09:15.952175+0000 mon.a (mon.0) 694 : cluster [DBG] mgrmap e21: gibba044.wflcwh(active, since 41s), standbys: y, x 2021-03-10T20:09:17.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:16 gibba023 bash[9844]: audit 2021-03-10T20:09:16.094039+0000 mon.c (mon.1) 30 : audit [DBG] from='client.? 172.21.2.123:0/1068569872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:09:17.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:16 gibba023 bash[9844]: audit 2021-03-10T20:09:16.782857+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.a"}]: dispatch 2021-03-10T20:09:17.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:16 gibba023 bash[9844]: audit 2021-03-10T20:09:16.782895+0000 mon.b (mon.2) 114 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.a"}]: dispatch 2021-03-10T20:09:17.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:16 gibba023 bash[9844]: audit 2021-03-10T20:09:16.787454+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.a"}]': finished 2021-03-10T20:09:17.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:16 gibba023 bash[9844]: audit 2021-03-10T20:09:16.794289+0000 mon.b (mon.2) 115 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:09:17.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:16 gibba023 bash[9844]: audit 2021-03-10T20:09:16.795230+0000 mon.b (mon.2) 116 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:09:17.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:16 gibba023 bash[9844]: audit 2021-03-10T20:09:16.795921+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:09:17.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:16 gibba023 bash[9844]: audit 2021-03-10T20:09:16.796867+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T20:09:17.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:16 gibba023 bash[13032]: audit 2021-03-10T20:09:15.564173+0000 mgr.gibba044.wflcwh (mgr.34430) 53 : audit [DBG] from='client.14715 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:09:17.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:16 gibba023 bash[13032]: cluster 2021-03-10T20:09:15.734619+0000 mgr.gibba044.wflcwh (mgr.34430) 54 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:17.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:16 gibba023 bash[13032]: audit 2021-03-10T20:09:15.790055+0000 mgr.gibba044.wflcwh (mgr.34430) 55 : audit [DBG] from='client.24631 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:09:17.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:16 gibba023 bash[13032]: cluster 2021-03-10T20:09:15.952175+0000 mon.a (mon.0) 694 : cluster [DBG] mgrmap e21: gibba044.wflcwh(active, since 41s), standbys: y, x 2021-03-10T20:09:17.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:16 gibba023 bash[13032]: audit 2021-03-10T20:09:16.094039+0000 mon.c (mon.1) 30 : audit [DBG] from='client.? 172.21.2.123:0/1068569872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:09:17.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:16 gibba023 bash[13032]: audit 2021-03-10T20:09:16.782857+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.a"}]: dispatch 2021-03-10T20:09:17.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:16 gibba023 bash[13032]: audit 2021-03-10T20:09:16.782895+0000 mon.b (mon.2) 114 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.a"}]: dispatch 2021-03-10T20:09:17.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:16 gibba023 bash[13032]: audit 2021-03-10T20:09:16.787454+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34430 ' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.a"}]': finished 2021-03-10T20:09:17.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:16 gibba023 bash[13032]: audit 2021-03-10T20:09:16.794289+0000 mon.b (mon.2) 115 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:09:17.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:16 gibba023 bash[13032]: audit 2021-03-10T20:09:16.795230+0000 mon.b (mon.2) 116 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:09:17.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:16 gibba023 bash[13032]: audit 2021-03-10T20:09:16.795921+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:09:17.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:16 gibba023 bash[13032]: audit 2021-03-10T20:09:16.796867+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T20:09:18.048 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:17 gibba023 bash[9844]: cephadm 2021-03-10T20:09:16.781880+0000 mgr.gibba044.wflcwh (mgr.34430) 56 : cephadm [INF] Upgrade: Updating mon.a 2021-03-10T20:09:18.048 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:17 gibba023 bash[9844]: cephadm 2021-03-10T20:09:16.796556+0000 mgr.gibba044.wflcwh (mgr.34430) 57 : cephadm [INF] Deploying daemon mon.a on gibba023 2021-03-10T20:09:18.048 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:18 gibba023 bash[13032]: cephadm 2021-03-10T20:09:16.781880+0000 mgr.gibba044.wflcwh (mgr.34430) 56 : cephadm [INF] Upgrade: Updating mon.a 2021-03-10T20:09:18.049 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:18 gibba023 bash[13032]: cephadm 2021-03-10T20:09:16.796556+0000 mgr.gibba044.wflcwh (mgr.34430) 57 : cephadm [INF] Deploying daemon mon.a on gibba023 2021-03-10T20:09:18.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:17 gibba044 bash[9859]: cephadm 2021-03-10T20:09:16.781880+0000 mgr.gibba044.wflcwh (mgr.34430) 56 : cephadm [INF] Upgrade: Updating mon.a 2021-03-10T20:09:18.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:17 gibba044 bash[9859]: cephadm 2021-03-10T20:09:16.796556+0000 mgr.gibba044.wflcwh (mgr.34430) 57 : cephadm [INF] Deploying daemon mon.a on gibba023 2021-03-10T20:09:18.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:18 gibba023 systemd[1]: Stopping Ceph mon.a for dd719b26-81da-11eb-9080-001a4aab830c... 2021-03-10T20:09:18.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:18 gibba023 bash[9844]: debug 2021-03-10T20:09:18.804+0000 7f596d693700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T20:09:18.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:18 gibba023 bash[9844]: debug 2021-03-10T20:09:18.804+0000 7f596d693700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2021-03-10T20:09:20.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:19 gibba023 docker[30764]: ceph-dd719b26-81da-11eb-9080-001a4aab830c-mon.a 2021-03-10T20:09:20.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:19 gibba023 systemd[1]: ceph-dd719b26-81da-11eb-9080-001a4aab830c@mon.a.service: Succeeded. 2021-03-10T20:09:20.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:19 gibba023 systemd[1]: Stopped Ceph mon.a for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:09:20.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:19 gibba023 systemd[1]: Started Ceph mon.a for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:09:21.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.872+0000 7fa81203c700 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T20:09:21.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.872+0000 7fa81203c700 0 ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev), process ceph-mon, pid 6 2021-03-10T20:09:21.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.872+0000 7fa81203c700 0 pidfile_write: ignore empty --pid-file 2021-03-10T20:09:21.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 0 load: jerasure load: lrc load: isa 2021-03-10T20:09:21.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: RocksDB version: 6.8.1 2021-03-10T20:09:21.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T20:09:21.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Compile date Mar 9 2021 2021-03-10T20:09:21.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: DB SUMMARY 2021-03-10T20:09:21.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: CURRENT file: CURRENT 2021-03-10T20:09:21.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: IDENTITY file: IDENTITY 2021-03-10T20:09:21.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: MANIFEST file: MANIFEST-000008 size: 883 Bytes 2021-03-10T20:09:21.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 2, files: 000026.sst 000027.sst 2021-03-10T20:09:21.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000024.log size: 14656130 ; 2021-03-10T20:09:21.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.error_if_exists: 0 2021-03-10T20:09:21.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.create_if_missing: 0 2021-03-10T20:09:21.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T20:09:21.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.env: 0x55a282d7a1c0 2021-03-10T20:09:21.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.fs: Posix File System 2021-03-10T20:09:21.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.info_log: 0x55a2852191e0 2021-03-10T20:09:21.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T20:09:21.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.statistics: (nil) 2021-03-10T20:09:21.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.use_fsync: 0 2021-03-10T20:09:21.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T20:09:21.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T20:09:21.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T20:09:21.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T20:09:21.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T20:09:21.184 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T20:09:21.185 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T20:09:21.185 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T20:09:21.185 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T20:09:21.186 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T20:09:21.186 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T20:09:21.186 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.db_log_dir: 2021-03-10T20:09:21.186 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-03-10T20:09:21.187 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T20:09:21.187 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T20:09:21.187 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T20:09:21.187 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T20:09:21.188 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T20:09:21.188 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-03-10T20:09:21.188 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T20:09:21.188 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T20:09:21.189 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T20:09:21.189 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T20:09:21.189 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.write_buffer_manager: 0x55a28526dc50 2021-03-10T20:09:21.189 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T20:09:21.190 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T20:09:21.190 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T20:09:21.190 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T20:09:21.190 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T20:09:21.191 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T20:09:21.191 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T20:09:21.191 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T20:09:21.191 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T20:09:21.192 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.unordered_write: 0 2021-03-10T20:09:21.192 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T20:09:21.192 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T20:09:21.192 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T20:09:21.193 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T20:09:21.193 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.row_cache: None 2021-03-10T20:09:21.193 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.wal_filter: None 2021-03-10T20:09:21.193 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T20:09:21.194 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T20:09:21.194 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T20:09:21.194 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.two_write_queues: 0 2021-03-10T20:09:21.194 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T20:09:21.195 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.atomic_flush: 0 2021-03-10T20:09:21.195 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T20:09:21.195 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-03-10T20:09:21.195 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-03-10T20:09:21.195 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.log_readahead_size: 0 2021-03-10T20:09:21.196 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-03-10T20:09:21.196 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T20:09:21.196 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T20:09:21.196 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T20:09:21.197 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T20:09:21.197 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T20:09:21.197 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T20:09:21.197 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T20:09:21.198 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T20:09:21.198 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T20:09:21.198 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T20:09:21.198 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.max_open_files: -1 2021-03-10T20:09:21.199 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T20:09:21.199 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T20:09:21.199 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-03-10T20:09:21.199 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T20:09:21.200 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Compression algorithms supported: 2021-03-10T20:09:21.200 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T20:09:21.200 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: kZSTD supported: 0 2021-03-10T20:09:21.200 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: kXpressCompression supported: 0 2021-03-10T20:09:21.201 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T20:09:21.201 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T20:09:21.201 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T20:09:21.201 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: kZlibCompression supported: 1 2021-03-10T20:09:21.201 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T20:09:21.202 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T20:09:21.202 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000008 2021-03-10T20:09:21.202 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-03-10T20:09:21.202 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T20:09:21.203 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.merge_operator: 2021-03-10T20:09:21.203 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.compaction_filter: None 2021-03-10T20:09:21.203 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T20:09:21.203 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T20:09:21.204 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T20:09:21.204 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a2851bc230) 2021-03-10T20:09:21.204 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: cache_index_and_filter_blocks: 1 2021-03-10T20:09:21.204 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: cache_index_and_filter_blocks_with_high_priority: 0 2021-03-10T20:09:21.204 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T20:09:21.205 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: pin_top_level_index_and_filter: 1 2021-03-10T20:09:21.205 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: index_type: 0 2021-03-10T20:09:21.205 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: data_block_index_type: 0 2021-03-10T20:09:21.205 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: index_shortening: 1 2021-03-10T20:09:21.206 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: data_block_hash_table_util_ratio: 0.750000 2021-03-10T20:09:21.206 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: hash_index_allow_collision: 1 2021-03-10T20:09:21.206 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: checksum: 1 2021-03-10T20:09:21.206 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: no_block_cache: 0 2021-03-10T20:09:21.207 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: block_cache: 0x55a2851f4510 2021-03-10T20:09:21.207 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: block_cache_name: BinnedLRUCache 2021-03-10T20:09:21.207 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: block_cache_options: 2021-03-10T20:09:21.207 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: capacity : 536870912 2021-03-10T20:09:21.208 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: num_shard_bits : 4 2021-03-10T20:09:21.208 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: strict_capacity_limit : 0 2021-03-10T20:09:21.208 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: high_pri_pool_ratio: 0.000 2021-03-10T20:09:21.208 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: block_cache_compressed: (nil) 2021-03-10T20:09:21.208 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: persistent_cache: (nil) 2021-03-10T20:09:21.209 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: block_size: 4096 2021-03-10T20:09:21.209 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: block_size_deviation: 10 2021-03-10T20:09:21.209 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: block_restart_interval: 16 2021-03-10T20:09:21.209 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: index_block_restart_interval: 1 2021-03-10T20:09:21.210 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: metadata_block_size: 4096 2021-03-10T20:09:21.210 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: partition_filters: 0 2021-03-10T20:09:21.210 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: use_delta_encoding: 1 2021-03-10T20:09:21.210 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T20:09:21.211 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: whole_key_filtering: 1 2021-03-10T20:09:21.211 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: verify_compression: 0 2021-03-10T20:09:21.211 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: read_amp_bytes_per_bit: 0 2021-03-10T20:09:21.211 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: format_version: 2 2021-03-10T20:09:21.212 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: enable_index_compression: 1 2021-03-10T20:09:21.212 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: block_align: 0 2021-03-10T20:09:21.212 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T20:09:21.213 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T20:09:21.213 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.compression: NoCompression 2021-03-10T20:09:21.213 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T20:09:21.214 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T20:09:21.214 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T20:09:21.214 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.num_levels: 7 2021-03-10T20:09:21.214 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T20:09:21.215 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T20:09:21.215 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-03-10T20:09:21.215 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T20:09:21.215 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T20:09:21.216 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T20:09:21.216 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T20:09:21.216 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T20:09:21.217 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T20:09:21.217 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T20:09:21.217 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T20:09:21.217 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T20:09:21.218 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T20:09:21.218 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T20:09:21.218 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T20:09:21.218 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T20:09:21.219 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T20:09:21.219 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T20:09:21.219 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T20:09:21.219 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T20:09:21.220 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T20:09:21.220 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T20:09:21.220 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T20:09:21.220 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T20:09:21.221 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T20:09:21.221 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T20:09:21.221 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T20:09:21.222 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T20:09:21.222 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T20:09:21.222 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T20:09:21.222 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T20:09:21.223 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T20:09:21.223 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T20:09:21.223 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T20:09:21.223 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T20:09:21.224 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T20:09:21.224 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T20:09:21.224 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T20:09:21.224 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T20:09:21.224 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T20:09:21.225 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T20:09:21.225 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T20:09:21.225 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T20:09:21.226 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T20:09:21.226 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T20:09:21.226 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T20:09:21.227 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T20:09:21.227 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.table_properties_collectors: 2021-03-10T20:09:21.227 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T20:09:21.227 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T20:09:21.228 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T20:09:21.228 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T20:09:21.228 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T20:09:21.228 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.bloom_locality: 0 2021-03-10T20:09:21.229 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T20:09:21.229 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T20:09:21.229 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T20:09:21.229 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T20:09:21.230 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T20:09:21.230 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.ttl: 2592000 2021-03-10T20:09:21.230 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-03-10T20:09:21.230 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000008 succeeded,manifest_file_number is 8, next_file_number is 29, last_sequence is 8741, log_number is 24,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T20:09:21.231 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 24 2021-03-10T20:09:21.231 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615406960880056, "job": 1, "event": "recovery_started", "log_files": [24]} 2021-03-10T20:09:21.231 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.876+0000 7fa81203c700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #24 mode 2 2021-03-10T20:09:21.231 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.884+0000 7fa81203c700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-03-10T20:09:21.232 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.896+0000 7fa81203c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615406960899206, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 29, "file_size": 14563042, "table_properties": {"data_size": 14556718, "index_size": 4796, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 709, "raw_key_size": 5770, "raw_average_key_size": 23, "raw_value_size": 14549254, "raw_average_value_size": 59384, "num_data_blocks": 149, "num_entries": 245, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1615406960, "oldest_key_time": 3, "file_creation_time": 0}} 2021-03-10T20:09:21.232 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.896+0000 7fa81203c700 4 rocksdb: [version_set.cc:3826] Creating manifest 30 2021-03-10T20:09:21.232 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.896+0000 7fa81203c700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615406960900154, "job": 1, "event": "recovery_finished"} 2021-03-10T20:09:21.233 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.896+0000 7fa81203c700 4 rocksdb: DB pointer 0x55a2852b9800 2021-03-10T20:09:21.233 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.896+0000 7fa7f8e4f700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-03-10T20:09:21.233 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.896+0000 7fa7f8e4f700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-03-10T20:09:21.233 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: ** DB Stats ** 2021-03-10T20:09:21.234 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T20:09:21.234 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T20:09:21.234 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T20:09:21.234 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T20:09:21.235 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T20:09:21.235 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T20:09:21.235 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T20:09:21.235 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: ** Compaction Stats [default] ** 2021-03-10T20:09:21.236 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:09:21.236 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:09:21.236 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: L0 1/0 13.89 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1109.6 0.01 0.00 1 0.013 0 0 2021-03-10T20:09:21.236 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: L6 2/0 69.36 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T20:09:21.237 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: Sum 3/0 83.25 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1109.6 0.01 0.00 1 0.013 0 0 2021-03-10T20:09:21.237 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1109.6 0.01 0.00 1 0.013 0 0 2021-03-10T20:09:21.237 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: ** Compaction Stats [default] ** 2021-03-10T20:09:21.237 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:09:21.238 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:09:21.238 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1109.6 0.01 0.00 1 0.013 0 0 2021-03-10T20:09:21.238 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T20:09:21.238 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: Flush(GB): cumulative 0.014, interval 0.014 2021-03-10T20:09:21.239 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T20:09:21.239 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T20:09:21.239 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T20:09:21.239 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T20:09:21.240 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: Cumulative compaction: 0.01 GB write, 625.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:09:21.240 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: Interval compaction: 0.01 GB write, 625.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:09:21.240 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T20:09:21.240 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T20:09:21.241 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: ** Compaction Stats [default] ** 2021-03-10T20:09:21.241 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:09:21.241 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:09:21.241 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: L0 1/0 13.89 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1109.6 0.01 0.00 1 0.013 0 0 2021-03-10T20:09:21.242 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: L6 2/0 69.36 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T20:09:21.242 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: Sum 3/0 83.25 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1109.6 0.01 0.00 1 0.013 0 0 2021-03-10T20:09:21.242 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T20:09:21.243 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: ** Compaction Stats [default] ** 2021-03-10T20:09:21.243 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:09:21.243 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:09:21.243 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1109.6 0.01 0.00 1 0.013 0 0 2021-03-10T20:09:21.244 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T20:09:21.244 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: Flush(GB): cumulative 0.014, interval 0.000 2021-03-10T20:09:21.244 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T20:09:21.244 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T20:09:21.245 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T20:09:21.245 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T20:09:21.245 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: Cumulative compaction: 0.01 GB write, 624.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:09:21.245 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:09:21.246 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T20:09:21.246 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T20:09:21.246 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.896+0000 7fa81203c700 0 starting mon.a rank 0 at public addrs [v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0] at bind addrs [v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid dd719b26-81da-11eb-9080-001a4aab830c 2021-03-10T20:09:21.246 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.900+0000 7fa81203c700 1 mon.a@-1(???) e3 preinit fsid dd719b26-81da-11eb-9080-001a4aab830c 2021-03-10T20:09:21.247 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.900+0000 7fa81203c700 0 mon.a@-1(???).mds e1 new map 2021-03-10T20:09:21.247 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.900+0000 7fa81203c700 0 mon.a@-1(???).mds e1 print_map 2021-03-10T20:09:21.247 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: e1 2021-03-10T20:09:21.247 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: enable_multiple, ever_enabled_multiple: 0,0 2021-03-10T20:09:21.248 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-03-10T20:09:21.248 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: legacy client fscid: -1 2021-03-10T20:09:21.248 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: 2021-03-10T20:09:21.249 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: No filesystems configured 2021-03-10T20:09:21.249 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.900+0000 7fa81203c700 0 mon.a@-1(???).osd e61 crush map has features 3314933000852226048, adjusting msgr requires 2021-03-10T20:09:21.249 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.900+0000 7fa81203c700 0 mon.a@-1(???).osd e61 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T20:09:21.249 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.900+0000 7fa81203c700 0 mon.a@-1(???).osd e61 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T20:09:21.250 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.900+0000 7fa81203c700 0 mon.a@-1(???).osd e61 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T20:09:21.250 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: cephadm 2021-03-10T20:09:16.781880+0000 mgr.gibba044.wflcwh (mgr.34430) 56 : cephadm [INF] Upgrade: Updating mon.a 2021-03-10T20:09:21.250 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: cephadm 2021-03-10T20:09:16.796556+0000 mgr.gibba044.wflcwh (mgr.34430) 57 : cephadm [INF] Deploying daemon mon.a on gibba023 2021-03-10T20:09:21.251 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.900+0000 7fa81203c700 1 mon.a@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2021-03-10T20:09:21.251 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.900+0000 7fa81203c700 20 expand_channel_meta expand map: {default=false} 2021-03-10T20:09:21.251 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.900+0000 7fa81203c700 20 expand_channel_meta from 'false' to 'false' 2021-03-10T20:09:21.251 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.900+0000 7fa81203c700 20 expand_channel_meta expanded map: {default=false} 2021-03-10T20:09:21.252 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.900+0000 7fa81203c700 20 expand_channel_meta expand map: {default=info} 2021-03-10T20:09:21.252 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.900+0000 7fa81203c700 20 expand_channel_meta from 'info' to 'info' 2021-03-10T20:09:21.252 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.900+0000 7fa81203c700 20 expand_channel_meta expanded map: {default=info} 2021-03-10T20:09:21.252 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.900+0000 7fa81203c700 20 expand_channel_meta expand map: {default=daemon} 2021-03-10T20:09:21.253 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.900+0000 7fa81203c700 20 expand_channel_meta from 'daemon' to 'daemon' 2021-03-10T20:09:21.253 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.900+0000 7fa81203c700 20 expand_channel_meta expanded map: {default=daemon} 2021-03-10T20:09:21.253 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.900+0000 7fa81203c700 20 expand_channel_meta expand map: {default=debug} 2021-03-10T20:09:21.253 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.900+0000 7fa81203c700 20 expand_channel_meta from 'debug' to 'debug' 2021-03-10T20:09:21.254 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:20 gibba023 bash[30844]: debug 2021-03-10T20:09:20.900+0000 7fa81203c700 20 expand_channel_meta expanded map: {default=debug} 2021-03-10T20:09:22.674 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[29872]: ignoring --setuser ceph since I am not root 2021-03-10T20:09:22.675 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[29872]: ignoring --setgroup ceph since I am not root 2021-03-10T20:09:22.675 INFO:journalctl@ceph.mgr.y.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[29872]: debug 2021-03-10T20:09:22.384+0000 7f1c9961a700 1 -- 172.21.2.123:0/1135090080 <== mon.0 v2:172.21.2.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561d42ce84e0 con 0x561d42dd8800 2021-03-10T20:09:22.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[13032]: cluster 2021-03-10T20:09:19.736669+0000 mgr.gibba044.wflcwh (mgr.34430) 59 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:22.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[13032]: audit 2021-03-10T20:09:19.885525+0000 mon.b (mon.2) 119 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"513df908ba68\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 216530944, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.594419Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T20:09:09.951098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95126814, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.594744Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49230643, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.595045Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.595802Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47039119, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.596463Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48999956, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.597100Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23676846, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.597728Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"16ead90c14c6\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12761169, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:09:14.598059Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:08:50.596854Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.598107Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:09:16.796490Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]: dispatch 2021-03-10T20:09:22.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[13032]: cluster 2021-03-10T20:09:21.738676+0000 mgr.gibba044.wflcwh (mgr.34430) 60 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:22.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[13032]: cluster 2021-03-10T20:09:22.314527+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2021-03-10T20:09:22.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[13032]: cluster 2021-03-10T20:09:22.337449+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T20:09:22.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[13032]: cluster 2021-03-10T20:09:22.347408+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0],b=[v2:172.21.2.144:3300/0,v1:172.21.2.144:6789/0],c=[v2:172.21.2.123:3301/0,v1:172.21.2.123:6790/0]} 2021-03-10T20:09:22.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[13032]: cluster 2021-03-10T20:09:22.347430+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-03-10T20:09:22.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[13032]: cluster 2021-03-10T20:09:22.347444+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-03-10T20:09:22.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[13032]: cluster 2021-03-10T20:09:22.348398+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e21: gibba044.wflcwh(active, since 48s), standbys: y, x 2021-03-10T20:09:22.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[13032]: cluster 2021-03-10T20:09:22.360384+0000 mon.a (mon.0) 7 : cluster [DBG] mgrmap e22: gibba044.wflcwh(active, since 48s), standbys: y, x 2021-03-10T20:09:22.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[13032]: cluster 2021-03-10T20:09:22.360997+0000 mon.a (mon.0) 8 : cluster [ERR] Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:22.686 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[13032]: cluster 2021-03-10T20:09:22.361012+0000 mon.a (mon.0) 9 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:09:22.686 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[13032]: cluster 2021-03-10T20:09:22.361019+0000 mon.a (mon.0) 10 : cluster [ERR] daemon rgw.r.z.gibba023.rsfdop on gibba023 is in error state 2021-03-10T20:09:22.687 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[13032]: cluster 2021-03-10T20:09:22.361025+0000 mon.a (mon.0) 11 : cluster [ERR] daemon rgw.r.z.gibba044.rblqpl on gibba044 is in error state 2021-03-10T20:09:22.688 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[13032]: cluster 2021-03-10T20:09:22.361031+0000 mon.a (mon.0) 12 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:22.688 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[13032]: cluster 2021-03-10T20:09:22.361036+0000 mon.a (mon.0) 13 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:22.689 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[13032]: audit 2021-03-10T20:09:22.364842+0000 mon.a (mon.0) 14 : audit [INF] from='mgr.34430 ' entity='' 2021-03-10T20:09:22.691 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[30844]: debug 2021-03-10T20:09:22.356+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:22.691 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[30844]: debug 2021-03-10T20:09:22.356+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:09:22.691 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[30844]: debug 2021-03-10T20:09:22.356+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba023.rsfdop on gibba023 is in error state 2021-03-10T20:09:22.691 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[30844]: debug 2021-03-10T20:09:22.356+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba044.rblqpl on gibba044 is in error state 2021-03-10T20:09:22.692 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[30844]: debug 2021-03-10T20:09:22.356+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:22.692 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[30844]: debug 2021-03-10T20:09:22.356+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:22.692 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[30844]: cluster 2021-03-10T20:09:19.736669+0000 mgr.gibba044.wflcwh (mgr.34430) 59 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:22.692 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[30844]: audit 2021-03-10T20:09:19.885525+0000 mon.b (mon.2) 119 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"513df908ba68\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 216530944, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.594419Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T20:09:09.951098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95126814, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.594744Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49230643, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.595045Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.595802Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47039119, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.596463Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48999956, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.597100Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23676846, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.597728Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"16ead90c14c6\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12761169, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:09:14.598059Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:08:50.596854Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.598107Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:09:16.796490Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]: dispatch 2021-03-10T20:09:22.693 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[30844]: cluster 2021-03-10T20:09:21.738676+0000 mgr.gibba044.wflcwh (mgr.34430) 60 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:22.693 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[30844]: cluster 2021-03-10T20:09:22.314527+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2021-03-10T20:09:22.693 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[30844]: cluster 2021-03-10T20:09:22.337449+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T20:09:22.694 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[30844]: cluster 2021-03-10T20:09:22.347408+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0],b=[v2:172.21.2.144:3300/0,v1:172.21.2.144:6789/0],c=[v2:172.21.2.123:3301/0,v1:172.21.2.123:6790/0]} 2021-03-10T20:09:22.694 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[30844]: cluster 2021-03-10T20:09:22.347430+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-03-10T20:09:22.694 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[30844]: cluster 2021-03-10T20:09:22.347444+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-03-10T20:09:22.695 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[30844]: cluster 2021-03-10T20:09:22.348398+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e21: gibba044.wflcwh(active, since 48s), standbys: y, x 2021-03-10T20:09:22.695 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[30844]: cluster 2021-03-10T20:09:22.360384+0000 mon.a (mon.0) 7 : cluster [DBG] mgrmap e22: gibba044.wflcwh(active, since 48s), standbys: y, x 2021-03-10T20:09:22.695 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[30844]: cluster 2021-03-10T20:09:22.360997+0000 mon.a (mon.0) 8 : cluster [ERR] Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:22.695 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[30844]: cluster 2021-03-10T20:09:22.361012+0000 mon.a (mon.0) 9 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:09:22.696 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[30844]: cluster 2021-03-10T20:09:22.361019+0000 mon.a (mon.0) 10 : cluster [ERR] daemon rgw.r.z.gibba023.rsfdop on gibba023 is in error state 2021-03-10T20:09:22.696 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[30844]: cluster 2021-03-10T20:09:22.361025+0000 mon.a (mon.0) 11 : cluster [ERR] daemon rgw.r.z.gibba044.rblqpl on gibba044 is in error state 2021-03-10T20:09:22.696 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[30844]: cluster 2021-03-10T20:09:22.361031+0000 mon.a (mon.0) 12 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:22.696 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[30844]: cluster 2021-03-10T20:09:22.361036+0000 mon.a (mon.0) 13 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:22.697 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:22 gibba023 bash[30844]: audit 2021-03-10T20:09:22.364842+0000 mon.a (mon.0) 14 : audit [INF] from='mgr.34430 ' entity='' 2021-03-10T20:09:22.750 INFO:journalctl@ceph.mgr.x.gibba044.stdout:Mar 10 20:09:22 gibba044 bash[22100]: ignoring --setuser ceph since I am not root 2021-03-10T20:09:22.750 INFO:journalctl@ceph.mgr.x.gibba044.stdout:Mar 10 20:09:22 gibba044 bash[22100]: ignoring --setgroup ceph since I am not root 2021-03-10T20:09:22.751 INFO:journalctl@ceph.mgr.x.gibba044.stdout:Mar 10 20:09:22 gibba044 bash[22100]: debug 2021-03-10T20:09:22.387+0000 7f052590a700 1 -- 172.21.2.144:0/1196684182 <== mon.0 v2:172.21.2.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ef670564e0 con 0x55ef67146c00 2021-03-10T20:09:22.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:22 gibba044 bash[9859]: cluster 2021-03-10T20:09:19.736669+0000 mgr.gibba044.wflcwh (mgr.34430) 59 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:22.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:22 gibba044 bash[9859]: audit 2021-03-10T20:09:19.885525+0000 mon.b (mon.2) 119 : audit [INF] from='mgr.34430 172.21.2.144:0/3694980680' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"513df908ba68\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 216530944, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.594419Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T20:09:09.951098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 95126814, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.594744Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49230643, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.595045Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49304043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.595802Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47039119, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.596463Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48999956, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.597100Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23676846, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.597728Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"16ead90c14c6\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 12761169, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:09:14.598059Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:08:50.596854Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:14.598107Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:09:16.796490Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\"}"}]: dispatch 2021-03-10T20:09:22.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:22 gibba044 bash[9859]: cluster 2021-03-10T20:09:21.738676+0000 mgr.gibba044.wflcwh (mgr.34430) 60 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:22.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:22 gibba044 bash[9859]: cluster 2021-03-10T20:09:22.314527+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2021-03-10T20:09:22.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:22 gibba044 bash[9859]: cluster 2021-03-10T20:09:22.337449+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T20:09:22.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:22 gibba044 bash[9859]: cluster 2021-03-10T20:09:22.347408+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0],b=[v2:172.21.2.144:3300/0,v1:172.21.2.144:6789/0],c=[v2:172.21.2.123:3301/0,v1:172.21.2.123:6790/0]} 2021-03-10T20:09:22.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:22 gibba044 bash[9859]: cluster 2021-03-10T20:09:22.347430+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-03-10T20:09:22.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:22 gibba044 bash[9859]: cluster 2021-03-10T20:09:22.347444+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-03-10T20:09:22.758 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:22 gibba044 bash[9859]: cluster 2021-03-10T20:09:22.348398+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e21: gibba044.wflcwh(active, since 48s), standbys: y, x 2021-03-10T20:09:22.758 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:22 gibba044 bash[9859]: cluster 2021-03-10T20:09:22.360384+0000 mon.a (mon.0) 7 : cluster [DBG] mgrmap e22: gibba044.wflcwh(active, since 48s), standbys: y, x 2021-03-10T20:09:22.758 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:22 gibba044 bash[9859]: cluster 2021-03-10T20:09:22.360997+0000 mon.a (mon.0) 8 : cluster [ERR] Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:22.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:22 gibba044 bash[9859]: cluster 2021-03-10T20:09:22.361012+0000 mon.a (mon.0) 9 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:09:22.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:22 gibba044 bash[9859]: cluster 2021-03-10T20:09:22.361019+0000 mon.a (mon.0) 10 : cluster [ERR] daemon rgw.r.z.gibba023.rsfdop on gibba023 is in error state 2021-03-10T20:09:22.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:22 gibba044 bash[9859]: cluster 2021-03-10T20:09:22.361025+0000 mon.a (mon.0) 11 : cluster [ERR] daemon rgw.r.z.gibba044.rblqpl on gibba044 is in error state 2021-03-10T20:09:22.760 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:22 gibba044 bash[9859]: cluster 2021-03-10T20:09:22.361031+0000 mon.a (mon.0) 12 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:22.760 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:22 gibba044 bash[9859]: cluster 2021-03-10T20:09:22.361036+0000 mon.a (mon.0) 13 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:22.760 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:22 gibba044 bash[9859]: audit 2021-03-10T20:09:22.364842+0000 mon.a (mon.0) 14 : audit [INF] from='mgr.34430 ' entity='' 2021-03-10T20:09:27.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:26 gibba023 bash[30844]: cluster 2021-03-10T20:09:26.163769+0000 mon.a (mon.0) 15 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T20:09:27.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:26 gibba023 bash[30844]: cluster 2021-03-10T20:09:26.163873+0000 mon.a (mon.0) 16 : cluster [DBG] Standby manager daemon y started 2021-03-10T20:09:27.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:26 gibba023 bash[30844]: audit 2021-03-10T20:09:26.164827+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.? 172.21.2.123:0/2758885577' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:09:27.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:26 gibba023 bash[30844]: audit 2021-03-10T20:09:26.165718+0000 mon.c (mon.1) 32 : audit [DBG] from='mgr.? 172.21.2.123:0/2758885577' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:09:27.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:26 gibba023 bash[30844]: cluster 2021-03-10T20:09:26.221264+0000 mon.a (mon.0) 17 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T20:09:27.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:26 gibba023 bash[30844]: cluster 2021-03-10T20:09:26.221312+0000 mon.a (mon.0) 18 : cluster [DBG] Standby manager daemon x started 2021-03-10T20:09:27.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:26 gibba023 bash[30844]: audit 2021-03-10T20:09:26.221596+0000 mon.c (mon.1) 33 : audit [DBG] from='mgr.? 172.21.2.144:0/2898580150' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:09:27.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:26 gibba023 bash[30844]: audit 2021-03-10T20:09:26.222495+0000 mon.c (mon.1) 34 : audit [DBG] from='mgr.? 172.21.2.144:0/2898580150' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:09:27.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:26 gibba023 bash[30844]: cluster 2021-03-10T20:09:26.232840+0000 mon.a (mon.0) 19 : cluster [INF] Active manager daemon gibba044.wflcwh restarted 2021-03-10T20:09:27.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:26 gibba023 bash[30844]: cluster 2021-03-10T20:09:26.234116+0000 mon.a (mon.0) 20 : cluster [INF] Activating manager daemon gibba044.wflcwh 2021-03-10T20:09:27.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:26 gibba023 bash[30844]: cluster 2021-03-10T20:09:26.242163+0000 mon.a (mon.0) 21 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T20:09:27.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:26 gibba023 bash[13032]: cluster 2021-03-10T20:09:26.163769+0000 mon.a (mon.0) 15 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T20:09:27.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:26 gibba023 bash[13032]: cluster 2021-03-10T20:09:26.163873+0000 mon.a (mon.0) 16 : cluster [DBG] Standby manager daemon y started 2021-03-10T20:09:27.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:26 gibba023 bash[13032]: audit 2021-03-10T20:09:26.164827+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.? 172.21.2.123:0/2758885577' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:09:27.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:26 gibba023 bash[13032]: audit 2021-03-10T20:09:26.165718+0000 mon.c (mon.1) 32 : audit [DBG] from='mgr.? 172.21.2.123:0/2758885577' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:09:27.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:26 gibba023 bash[13032]: cluster 2021-03-10T20:09:26.221264+0000 mon.a (mon.0) 17 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T20:09:27.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:26 gibba023 bash[13032]: cluster 2021-03-10T20:09:26.221312+0000 mon.a (mon.0) 18 : cluster [DBG] Standby manager daemon x started 2021-03-10T20:09:27.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:26 gibba023 bash[13032]: audit 2021-03-10T20:09:26.221596+0000 mon.c (mon.1) 33 : audit [DBG] from='mgr.? 172.21.2.144:0/2898580150' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:09:27.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:26 gibba023 bash[13032]: audit 2021-03-10T20:09:26.222495+0000 mon.c (mon.1) 34 : audit [DBG] from='mgr.? 172.21.2.144:0/2898580150' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:09:27.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:26 gibba023 bash[13032]: cluster 2021-03-10T20:09:26.232840+0000 mon.a (mon.0) 19 : cluster [INF] Active manager daemon gibba044.wflcwh restarted 2021-03-10T20:09:27.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:26 gibba023 bash[13032]: cluster 2021-03-10T20:09:26.234116+0000 mon.a (mon.0) 20 : cluster [INF] Activating manager daemon gibba044.wflcwh 2021-03-10T20:09:27.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:26 gibba023 bash[13032]: cluster 2021-03-10T20:09:26.242163+0000 mon.a (mon.0) 21 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T20:09:27.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:26 gibba044 bash[9859]: cluster 2021-03-10T20:09:26.163769+0000 mon.a (mon.0) 15 : cluster [DBG] Standby manager daemon y restarted 2021-03-10T20:09:27.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:26 gibba044 bash[9859]: cluster 2021-03-10T20:09:26.163873+0000 mon.a (mon.0) 16 : cluster [DBG] Standby manager daemon y started 2021-03-10T20:09:27.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:26 gibba044 bash[9859]: audit 2021-03-10T20:09:26.164827+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.? 172.21.2.123:0/2758885577' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:09:27.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:26 gibba044 bash[9859]: audit 2021-03-10T20:09:26.165718+0000 mon.c (mon.1) 32 : audit [DBG] from='mgr.? 172.21.2.123:0/2758885577' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:09:27.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:26 gibba044 bash[9859]: cluster 2021-03-10T20:09:26.221264+0000 mon.a (mon.0) 17 : cluster [DBG] Standby manager daemon x restarted 2021-03-10T20:09:27.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:26 gibba044 bash[9859]: cluster 2021-03-10T20:09:26.221312+0000 mon.a (mon.0) 18 : cluster [DBG] Standby manager daemon x started 2021-03-10T20:09:27.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:26 gibba044 bash[9859]: audit 2021-03-10T20:09:26.221596+0000 mon.c (mon.1) 33 : audit [DBG] from='mgr.? 172.21.2.144:0/2898580150' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:09:27.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:26 gibba044 bash[9859]: audit 2021-03-10T20:09:26.222495+0000 mon.c (mon.1) 34 : audit [DBG] from='mgr.? 172.21.2.144:0/2898580150' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:09:27.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:26 gibba044 bash[9859]: cluster 2021-03-10T20:09:26.232840+0000 mon.a (mon.0) 19 : cluster [INF] Active manager daemon gibba044.wflcwh restarted 2021-03-10T20:09:27.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:26 gibba044 bash[9859]: cluster 2021-03-10T20:09:26.234116+0000 mon.a (mon.0) 20 : cluster [INF] Activating manager daemon gibba044.wflcwh 2021-03-10T20:09:27.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:26 gibba044 bash[9859]: cluster 2021-03-10T20:09:26.242163+0000 mon.a (mon.0) 21 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T20:09:28.218 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: cluster 2021-03-10T20:09:26.927696+0000 mon.a (mon.0) 22 : cluster [DBG] mgrmap e23: gibba044.wflcwh(active, starting, since 0.693768s), standbys: y, x 2021-03-10T20:09:28.218 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.933474+0000 mon.b (mon.2) 120 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr metadata", "who": "gibba044.wflcwh", "id": "gibba044.wflcwh"}]: dispatch 2021-03-10T20:09:28.219 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.933728+0000 mon.b (mon.2) 121 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T20:09:28.219 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.933994+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T20:09:28.219 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.934190+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:09:28.219 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.934344+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:09:28.219 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.934503+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:09:28.220 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.934625+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:09:28.220 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.934762+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:09:28.220 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.934869+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:09:28.220 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.934972+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:09:28.221 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.935079+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:09:28.221 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.935379+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T20:09:28.221 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.935573+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T20:09:28.221 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.935958+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T20:09:28.222 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.936698+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T20:09:28.222 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.937339+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T20:09:28.222 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.937679+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T20:09:28.222 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.937996+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba023"}]: dispatch 2021-03-10T20:09:28.222 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.938287+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba044"}]: dispatch 2021-03-10T20:09:28.223 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.938528+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T20:09:28.223 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.938755+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2021-03-10T20:09:28.224 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.939078+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T20:09:28.224 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.939284+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T20:09:28.224 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.939542+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T20:09:28.224 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.939908+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T20:09:28.225 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.940310+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T20:09:28.225 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.940703+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T20:09:28.225 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.941070+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T20:09:28.225 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.941366+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T20:09:28.225 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.941580+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T20:09:28.226 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.941755+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T20:09:28.226 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.941970+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:09:28.226 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.942148+0000 mon.b (mon.2) 152 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:09:28.227 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.942367+0000 mon.b (mon.2) 153 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T20:09:28.227 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.942514+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T20:09:28.227 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.942701+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T20:09:28.227 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:26.942846+0000 mon.b (mon.2) 156 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T20:09:28.228 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: cluster 2021-03-10T20:09:26.944065+0000 mon.a (mon.0) 23 : cluster [INF] Manager daemon gibba044.wflcwh is now available 2021-03-10T20:09:28.228 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:27.062486+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.34466 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:09:28.228 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:27.062568+0000 mon.b (mon.2) 157 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:09:28.228 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:27.069429+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.34466 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:09:28.229 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:27.070262+0000 mon.b (mon.2) 158 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:09:28.229 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:27.195597+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:09:28.229 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:27 gibba044 bash[9859]: audit 2021-03-10T20:09:27.238526+0000 mon.b (mon.2) 160 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:09:28.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: cluster 2021-03-10T20:09:26.927696+0000 mon.a (mon.0) 22 : cluster [DBG] mgrmap e23: gibba044.wflcwh(active, starting, since 0.693768s), standbys: y, x 2021-03-10T20:09:28.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.933474+0000 mon.b (mon.2) 120 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr metadata", "who": "gibba044.wflcwh", "id": "gibba044.wflcwh"}]: dispatch 2021-03-10T20:09:28.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.933728+0000 mon.b (mon.2) 121 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T20:09:28.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.933994+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T20:09:28.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.934190+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:09:28.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.934344+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:09:28.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.934503+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:09:28.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.934625+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:09:28.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.934762+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:09:28.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.934869+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:09:28.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.934972+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:09:28.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.935079+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:09:28.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.935379+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T20:09:28.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.935573+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T20:09:28.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.935958+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T20:09:28.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.936698+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T20:09:28.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.937339+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T20:09:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: cluster 2021-03-10T20:09:26.927696+0000 mon.a (mon.0) 22 : cluster [DBG] mgrmap e23: gibba044.wflcwh(active, starting, since 0.693768s), standbys: y, x 2021-03-10T20:09:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.933474+0000 mon.b (mon.2) 120 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr metadata", "who": "gibba044.wflcwh", "id": "gibba044.wflcwh"}]: dispatch 2021-03-10T20:09:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.933728+0000 mon.b (mon.2) 121 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-03-10T20:09:28.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.933994+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-03-10T20:09:28.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.934190+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:09:28.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.934344+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:09:28.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.934503+0000 mon.b (mon.2) 125 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:09:28.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.934625+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:09:28.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.934762+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:09:28.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.934869+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:09:28.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.934972+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:09:28.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.935079+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:09:28.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.935379+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-03-10T20:09:28.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.935573+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-03-10T20:09:28.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.935958+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-03-10T20:09:28.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.936698+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-03-10T20:09:28.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.937339+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2021-03-10T20:09:28.436 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.937679+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T20:09:28.436 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.937996+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba023"}]: dispatch 2021-03-10T20:09:28.436 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.938287+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba044"}]: dispatch 2021-03-10T20:09:28.437 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.938528+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T20:09:28.437 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.938755+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2021-03-10T20:09:28.437 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.939078+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T20:09:28.437 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.939284+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T20:09:28.438 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.939542+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T20:09:28.438 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.939908+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T20:09:28.438 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.940310+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T20:09:28.438 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.940703+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T20:09:28.439 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.941070+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T20:09:28.439 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.941366+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T20:09:28.439 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.941580+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T20:09:28.439 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.941755+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T20:09:28.440 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.941970+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:09:28.440 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.937679+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2021-03-10T20:09:28.440 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.937996+0000 mon.b (mon.2) 137 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba023"}]: dispatch 2021-03-10T20:09:28.441 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.938287+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba044"}]: dispatch 2021-03-10T20:09:28.441 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.938528+0000 mon.b (mon.2) 139 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-03-10T20:09:28.441 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.938755+0000 mon.b (mon.2) 140 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2021-03-10T20:09:28.441 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.939078+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2021-03-10T20:09:28.442 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.939284+0000 mon.b (mon.2) 142 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2021-03-10T20:09:28.442 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.939542+0000 mon.b (mon.2) 143 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2021-03-10T20:09:28.442 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.939908+0000 mon.b (mon.2) 144 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2021-03-10T20:09:28.442 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.940310+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2021-03-10T20:09:28.443 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.940703+0000 mon.b (mon.2) 146 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2021-03-10T20:09:28.443 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.941070+0000 mon.b (mon.2) 147 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-03-10T20:09:28.443 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.941366+0000 mon.b (mon.2) 148 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-03-10T20:09:28.443 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.941580+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2021-03-10T20:09:28.444 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.941755+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2021-03-10T20:09:28.444 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.941970+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-03-10T20:09:28.444 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.942148+0000 mon.b (mon.2) 152 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:09:28.445 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.942367+0000 mon.b (mon.2) 153 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T20:09:28.445 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.942514+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T20:09:28.445 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.942701+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T20:09:28.445 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:26.942846+0000 mon.b (mon.2) 156 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T20:09:28.446 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: cluster 2021-03-10T20:09:26.944065+0000 mon.a (mon.0) 23 : cluster [INF] Manager daemon gibba044.wflcwh is now available 2021-03-10T20:09:28.446 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:27.062486+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.34466 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:09:28.446 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:27.062568+0000 mon.b (mon.2) 157 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:09:28.446 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:27.069429+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.34466 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:09:28.447 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:27.070262+0000 mon.b (mon.2) 158 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:09:28.447 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:27.195597+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:09:28.447 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[30844]: audit 2021-03-10T20:09:27.238526+0000 mon.b (mon.2) 160 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:09:28.448 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.942148+0000 mon.b (mon.2) 152 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-03-10T20:09:28.448 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.942367+0000 mon.b (mon.2) 153 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-03-10T20:09:28.448 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.942514+0000 mon.b (mon.2) 154 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2021-03-10T20:09:28.449 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.942701+0000 mon.b (mon.2) 155 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-03-10T20:09:28.449 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:26.942846+0000 mon.b (mon.2) 156 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-03-10T20:09:28.449 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: cluster 2021-03-10T20:09:26.944065+0000 mon.a (mon.0) 23 : cluster [INF] Manager daemon gibba044.wflcwh is now available 2021-03-10T20:09:28.449 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:27.062486+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.34466 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:09:28.450 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:27.062568+0000 mon.b (mon.2) 157 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:09:28.450 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:27.069429+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.34466 ' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:09:28.450 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:27.070262+0000 mon.b (mon.2) 158 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:09:28.450 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:27.195597+0000 mon.b (mon.2) 159 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:09:28.451 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:27 gibba023 bash[13032]: audit 2021-03-10T20:09:27.238526+0000 mon.b (mon.2) 160 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:09:29.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:28 gibba044 bash[9859]: cluster 2021-03-10T20:09:27.940607+0000 mon.a (mon.0) 26 : cluster [DBG] mgrmap e24: gibba044.wflcwh(active, since 1.70667s), standbys: y, x 2021-03-10T20:09:29.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:28 gibba044 bash[9859]: cluster 2021-03-10T20:09:27.947682+0000 mgr.gibba044.wflcwh (mgr.34466) 1 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:29.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:28 gibba044 bash[9859]: cluster 2021-03-10T20:09:28.217815+0000 mgr.gibba044.wflcwh (mgr.34466) 2 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba044.wflcwh: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:29.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:28 gibba023 bash[30844]: cluster 2021-03-10T20:09:27.940607+0000 mon.a (mon.0) 26 : cluster [DBG] mgrmap e24: gibba044.wflcwh(active, since 1.70667s), standbys: y, x 2021-03-10T20:09:29.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:28 gibba023 bash[30844]: cluster 2021-03-10T20:09:27.947682+0000 mgr.gibba044.wflcwh (mgr.34466) 1 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:29.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:28 gibba023 bash[30844]: cluster 2021-03-10T20:09:28.217815+0000 mgr.gibba044.wflcwh (mgr.34466) 2 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba044.wflcwh: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:29.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:28 gibba023 bash[13032]: cluster 2021-03-10T20:09:27.940607+0000 mon.a (mon.0) 26 : cluster [DBG] mgrmap e24: gibba044.wflcwh(active, since 1.70667s), standbys: y, x 2021-03-10T20:09:29.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:28 gibba023 bash[13032]: cluster 2021-03-10T20:09:27.947682+0000 mgr.gibba044.wflcwh (mgr.34466) 1 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:29.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:28 gibba023 bash[13032]: cluster 2021-03-10T20:09:28.217815+0000 mgr.gibba044.wflcwh (mgr.34466) 2 : cluster [ERR] Unhandled exception from module 'dashboard' while running on mgr.gibba044.wflcwh: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:30.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:29 gibba044 bash[9859]: cluster 2021-03-10T20:09:28.935768+0000 mgr.gibba044.wflcwh (mgr.34466) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:30.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:29 gibba044 bash[9859]: cluster 2021-03-10T20:09:28.946215+0000 mon.a (mon.0) 27 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 2 failed cephadm daemon(s)) 2021-03-10T20:09:30.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:29 gibba044 bash[9859]: cluster 2021-03-10T20:09:28.959112+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e25: gibba044.wflcwh(active, since 2s), standbys: y, x 2021-03-10T20:09:30.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:29 gibba023 bash[30844]: cluster 2021-03-10T20:09:28.935768+0000 mgr.gibba044.wflcwh (mgr.34466) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:30.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:29 gibba023 bash[30844]: cluster 2021-03-10T20:09:28.946215+0000 mon.a (mon.0) 27 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 2 failed cephadm daemon(s)) 2021-03-10T20:09:30.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:29 gibba023 bash[30844]: cluster 2021-03-10T20:09:28.959112+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e25: gibba044.wflcwh(active, since 2s), standbys: y, x 2021-03-10T20:09:30.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:29 gibba023 bash[13032]: cluster 2021-03-10T20:09:28.935768+0000 mgr.gibba044.wflcwh (mgr.34466) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:30.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:29 gibba023 bash[13032]: cluster 2021-03-10T20:09:28.946215+0000 mon.a (mon.0) 27 : cluster [INF] Health check cleared: CEPHADM_FAILED_DAEMON (was: 2 failed cephadm daemon(s)) 2021-03-10T20:09:30.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:29 gibba023 bash[13032]: cluster 2021-03-10T20:09:28.959112+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e25: gibba044.wflcwh(active, since 2s), standbys: y, x 2021-03-10T20:09:32.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[30844]: audit 2021-03-10T20:09:30.932670+0000 mon.b (mon.2) 161 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"ab5236b7dab5\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 37528535, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.923303Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T20:09:19.909294Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"513df908ba68\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372873625, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.923917Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T20:09:09.951098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99205775, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.924259Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50216304, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.924567Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50216304, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.925322Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47269806, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.926016Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49681530, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.926676Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23876075, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.927336Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"16ead90c14c6\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13086228, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.927694Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:08:50.596854Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.928005Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:09:16.796490Z\"}}, \"last_daemon_update\": \"2021-03-10T20:09:30.928460Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:09:32.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[30844]: audit 2021-03-10T20:09:30.937533+0000 mon.a (mon.0) 29 : audit [INF] from='mgr.34466 ' entity='mgr.gibba044.wflcwh' 2021-03-10T20:09:32.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[30844]: cephadm 2021-03-10T20:09:30.944775+0000 mgr.gibba044.wflcwh (mgr.34466) 5 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:09:32.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[13032]: audit 2021-03-10T20:09:30.932670+0000 mon.b (mon.2) 161 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"ab5236b7dab5\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 37528535, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.923303Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T20:09:19.909294Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"513df908ba68\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372873625, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.923917Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T20:09:09.951098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99205775, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.924259Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50216304, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.924567Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50216304, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.925322Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47269806, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.926016Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49681530, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.926676Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23876075, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.927336Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"16ead90c14c6\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13086228, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.927694Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:08:50.596854Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.928005Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:09:16.796490Z\"}}, \"last_daemon_update\": \"2021-03-10T20:09:30.928460Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:09:32.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[13032]: audit 2021-03-10T20:09:30.937533+0000 mon.a (mon.0) 29 : audit [INF] from='mgr.34466 ' entity='mgr.gibba044.wflcwh' 2021-03-10T20:09:32.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[13032]: cephadm 2021-03-10T20:09:30.944775+0000 mgr.gibba044.wflcwh (mgr.34466) 5 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:09:32.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[30844]: audit 2021-03-10T20:09:31.038181+0000 mon.b (mon.2) 162 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108213043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.036180Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373397913, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.036291Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403177472, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.036352Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50740592, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.036411Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48140124, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.036575Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47961866, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.036705Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49618616, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.036830Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33355202, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.036955Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23582474, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.037017Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30314332, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.037073Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.037128Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:50.607552Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:09:31.037203Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T20:09:10.113043Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:09:32.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[30844]: audit 2021-03-10T20:09:31.041737+0000 mon.a (mon.0) 30 : audit [INF] from='mgr.34466 ' entity='mgr.gibba044.wflcwh' 2021-03-10T20:09:32.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[30844]: cephadm 2021-03-10T20:09:31.043829+0000 mgr.gibba044.wflcwh (mgr.34466) 6 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:09:32.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[30844]: cluster 2021-03-10T20:09:31.230119+0000 mgr.gibba044.wflcwh (mgr.34466) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:32.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[30844]: audit 2021-03-10T20:09:31.230537+0000 mon.b (mon.2) 163 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:09:32.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[30844]: audit 2021-03-10T20:09:31.233229+0000 mon.a (mon.0) 31 : audit [INF] from='mgr.34466 ' entity='mgr.gibba044.wflcwh' 2021-03-10T20:09:32.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[30844]: cephadm 2021-03-10T20:09:31.238991+0000 mgr.gibba044.wflcwh (mgr.34466) 8 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:09:32.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[30844]: audit 2021-03-10T20:09:31.239567+0000 mon.b (mon.2) 164 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:09:32.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[30844]: cephadm 2021-03-10T20:09:31.240571+0000 mgr.gibba044.wflcwh (mgr.34466) 9 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:09:32.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[13032]: audit 2021-03-10T20:09:31.038181+0000 mon.b (mon.2) 162 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108213043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.036180Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373397913, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.036291Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403177472, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.036352Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50740592, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.036411Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48140124, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.036575Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47961866, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.036705Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49618616, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.036830Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33355202, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.036955Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23582474, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.037017Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30314332, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.037073Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.037128Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:50.607552Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:09:31.037203Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T20:09:10.113043Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:09:32.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[13032]: audit 2021-03-10T20:09:31.041737+0000 mon.a (mon.0) 30 : audit [INF] from='mgr.34466 ' entity='mgr.gibba044.wflcwh' 2021-03-10T20:09:32.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[13032]: cephadm 2021-03-10T20:09:31.043829+0000 mgr.gibba044.wflcwh (mgr.34466) 6 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:09:32.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[13032]: cluster 2021-03-10T20:09:31.230119+0000 mgr.gibba044.wflcwh (mgr.34466) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:32.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[13032]: audit 2021-03-10T20:09:31.230537+0000 mon.b (mon.2) 163 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:09:32.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[13032]: audit 2021-03-10T20:09:31.233229+0000 mon.a (mon.0) 31 : audit [INF] from='mgr.34466 ' entity='mgr.gibba044.wflcwh' 2021-03-10T20:09:32.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[13032]: cephadm 2021-03-10T20:09:31.238991+0000 mgr.gibba044.wflcwh (mgr.34466) 8 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:09:32.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[13032]: audit 2021-03-10T20:09:31.239567+0000 mon.b (mon.2) 164 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:09:32.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[13032]: cephadm 2021-03-10T20:09:31.240571+0000 mgr.gibba044.wflcwh (mgr.34466) 9 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:09:32.183 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[30844]: audit 2021-03-10T20:09:31.240850+0000 mon.b (mon.2) 165 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:09:32.184 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[30844]: cephadm 2021-03-10T20:09:31.241518+0000 mgr.gibba044.wflcwh (mgr.34466) 10 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:09:32.184 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[30844]: cephadm 2021-03-10T20:09:31.241556+0000 mgr.gibba044.wflcwh (mgr.34466) 11 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:09:32.184 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[30844]: audit 2021-03-10T20:09:31.241819+0000 mon.b (mon.2) 166 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2021-03-10T20:09:32.184 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[30844]: cephadm 2021-03-10T20:09:31.242461+0000 mgr.gibba044.wflcwh (mgr.34466) 12 : cephadm [INF] It is presumed safe to stop mon.c 2021-03-10T20:09:32.185 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[30844]: cephadm 2021-03-10T20:09:31.242513+0000 mgr.gibba044.wflcwh (mgr.34466) 13 : cephadm [INF] Upgrade: It is presumed safe to stop mon.c 2021-03-10T20:09:32.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[13032]: audit 2021-03-10T20:09:31.240850+0000 mon.b (mon.2) 165 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:09:32.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[13032]: cephadm 2021-03-10T20:09:31.241518+0000 mgr.gibba044.wflcwh (mgr.34466) 10 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:09:32.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[13032]: cephadm 2021-03-10T20:09:31.241556+0000 mgr.gibba044.wflcwh (mgr.34466) 11 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:09:32.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[13032]: audit 2021-03-10T20:09:31.241819+0000 mon.b (mon.2) 166 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2021-03-10T20:09:32.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[13032]: cephadm 2021-03-10T20:09:31.242461+0000 mgr.gibba044.wflcwh (mgr.34466) 12 : cephadm [INF] It is presumed safe to stop mon.c 2021-03-10T20:09:32.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:31 gibba023 bash[13032]: cephadm 2021-03-10T20:09:31.242513+0000 mgr.gibba044.wflcwh (mgr.34466) 13 : cephadm [INF] Upgrade: It is presumed safe to stop mon.c 2021-03-10T20:09:32.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:31 gibba044 bash[9859]: audit 2021-03-10T20:09:30.932670+0000 mon.b (mon.2) 161 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"ab5236b7dab5\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 37528535, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.923303Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T20:09:19.909294Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"513df908ba68\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372873625, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.923917Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T20:09:09.951098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"c1745ed327ed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 99205775, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.924259Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T19:59:18.312130Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50216304, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.924567Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50216304, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.925322Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47269806, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.926016Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49681530, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.926676Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23876075, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.927336Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"16ead90c14c6\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13086228, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.927694Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:08:50.596854Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.928005Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:41.812094Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:09:16.796490Z\"}}, \"last_daemon_update\": \"2021-03-10T20:09:30.928460Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:09:32.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:31 gibba044 bash[9859]: audit 2021-03-10T20:09:30.937533+0000 mon.a (mon.0) 29 : audit [INF] from='mgr.34466 ' entity='mgr.gibba044.wflcwh' 2021-03-10T20:09:32.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:31 gibba044 bash[9859]: cephadm 2021-03-10T20:09:30.944775+0000 mgr.gibba044.wflcwh (mgr.34466) 5 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:09:32.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:31 gibba044 bash[9859]: audit 2021-03-10T20:09:31.038181+0000 mon.b (mon.2) 162 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba044","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"0e96acfc200a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 108213043, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.036180Z\", \"created\": \"2021-03-10T19:59:31.557503Z\", \"started\": \"2021-03-10T19:59:31.580699Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"hostname\": \"gibba044\", \"container_id\": \"90ed8e18c7f4\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373397913, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.036291Z\", \"created\": \"2021-03-10T19:59:48.153504Z\", \"started\": \"2021-03-10T20:08:11.961006Z\"}, \"mgr.gibba044.wflcwh\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"gibba044.wflcwh\", \"hostname\": \"gibba044\", \"container_id\": \"8f2a6baeb229\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 403177472, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.036352Z\", \"created\": \"2021-03-10T19:59:50.485504Z\", \"started\": \"2021-03-10T20:08:29.136885Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"hostname\": \"gibba044\", \"container_id\": \"a745be9e28cb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50740592, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.036411Z\", \"created\": \"2021-03-10T20:01:39.757721Z\", \"started\": \"2021-03-10T20:01:42.851748Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"hostname\": \"gibba044\", \"container_id\": \"d0313bf557eb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48140124, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.036575Z\", \"created\": \"2021-03-10T20:02:01.645721Z\", \"started\": \"2021-03-10T20:02:04.782354Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"hostname\": \"gibba044\", \"container_id\": \"ffa9fe94cea1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47961866, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.036705Z\", \"created\": \"2021-03-10T20:02:24.101721Z\", \"started\": \"2021-03-10T20:02:27.476972Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"hostname\": \"gibba044\", \"container_id\": \"082d0fe68f90\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49618616, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.036830Z\", \"created\": \"2021-03-10T20:02:46.941722Z\", \"started\": \"2021-03-10T20:02:50.129668Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"c7fd441724c1\", \"container_image_id\": \"a618f5685492e55adfb68a25b09f1d644d9123f204602f8617d7f2c13ec27d5e\", \"container_image_name\": \"prom/prometheus:latest\", \"container_image_digests\": [\"prom/prometheus@sha256:fd8b3c4c7ced91cbe96aa8a8dd4d02aa5aff7aefdaf0e579486127745c758c27\"], \"memory_usage\": 33355202, \"version\": \"2.25.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.036955Z\", \"created\": \"2021-03-10T20:03:07.141722Z\", \"started\": \"2021-03-10T20:03:47.780812Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"hostname\": \"gibba044\", \"container_id\": \"c8ae65356dfd\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23582474, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.037017Z\", \"created\": \"2021-03-10T20:03:08.333722Z\", \"started\": \"2021-03-10T20:03:10.325445Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"hostname\": \"gibba044\", \"container_id\": \"d690033c2b45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"ceph/ceph-grafana:latest\", \"container_image_digests\": [\"ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30314332, \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.037073Z\", \"created\": \"2021-03-10T20:03:32.209722Z\", \"started\": \"2021-03-10T20:03:32.232820Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba044.rblqpl\", \"hostname\": \"gibba044\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:31.037128Z\", \"created\": \"2021-03-10T20:05:21.045724Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"b833ae5d-df2b-4716-9b7c-1daad27d8d5a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"0zRMsJ-JNO3-s3mM-2dI7-ESCq-3sUS-1fvhcz\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"457d92b3-5bf6-4787-9c6d-a62b863cd4a8\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9fZf2-K6Ls-ewDY-hUkc-e2dM-bLmU-ypkMOc\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"5087ad12-b460-4867-b004-2f5082257775\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"gSRcrC-nfLZ-6Ryl-GCnz-0UNw-XeGY-GXaRwC\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"f824eb9a-50e5-46f0-a070-ab633188e079\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"f9CPDd-R4iu-f8zs-OIH1-mOps-C2aV-2lS71L\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400FA375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I8K38NF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:50.607552Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2021-03-10T20:07:59.114763Z\"}, \"mgr.gibba044.wflcwh\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:16.310353Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:38.064064Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:59.830497Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:22.400688Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2021-03-10T20:02:45.161195Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2021-03-10T20:03:40.513659Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:07.944288Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2021-03-10T20:03:20.773786Z\"}, \"rgw.r.z.gibba044.rblqpl\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:19.112088Z\"}}, \"last_daemon_update\": \"2021-03-10T20:09:31.037203Z\", \"last_device_update\": \"2021-03-10T20:02:54.556329Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.144\"], \"172.21.15.254\": [\"172.21.2.144\"]}, \"last_host_check\": \"2021-03-10T20:09:10.113043Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:09:32.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:31 gibba044 bash[9859]: audit 2021-03-10T20:09:31.041737+0000 mon.a (mon.0) 30 : audit [INF] from='mgr.34466 ' entity='mgr.gibba044.wflcwh' 2021-03-10T20:09:32.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:31 gibba044 bash[9859]: cephadm 2021-03-10T20:09:31.043829+0000 mgr.gibba044.wflcwh (mgr.34466) 6 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:09:32.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:31 gibba044 bash[9859]: cluster 2021-03-10T20:09:31.230119+0000 mgr.gibba044.wflcwh (mgr.34466) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.4 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:32.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:31 gibba044 bash[9859]: audit 2021-03-10T20:09:31.230537+0000 mon.b (mon.2) 163 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:09:32.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:31 gibba044 bash[9859]: audit 2021-03-10T20:09:31.233229+0000 mon.a (mon.0) 31 : audit [INF] from='mgr.34466 ' entity='mgr.gibba044.wflcwh' 2021-03-10T20:09:32.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:31 gibba044 bash[9859]: cephadm 2021-03-10T20:09:31.238991+0000 mgr.gibba044.wflcwh (mgr.34466) 8 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:09:32.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:31 gibba044 bash[9859]: audit 2021-03-10T20:09:31.239567+0000 mon.b (mon.2) 164 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:09:32.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:31 gibba044 bash[9859]: cephadm 2021-03-10T20:09:31.240571+0000 mgr.gibba044.wflcwh (mgr.34466) 9 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:09:32.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:31 gibba044 bash[9859]: audit 2021-03-10T20:09:31.240850+0000 mon.b (mon.2) 165 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:09:32.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:31 gibba044 bash[9859]: cephadm 2021-03-10T20:09:31.241518+0000 mgr.gibba044.wflcwh (mgr.34466) 10 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:09:32.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:31 gibba044 bash[9859]: cephadm 2021-03-10T20:09:31.241556+0000 mgr.gibba044.wflcwh (mgr.34466) 11 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:09:32.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:31 gibba044 bash[9859]: audit 2021-03-10T20:09:31.241819+0000 mon.b (mon.2) 166 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2021-03-10T20:09:32.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:31 gibba044 bash[9859]: cephadm 2021-03-10T20:09:31.242461+0000 mgr.gibba044.wflcwh (mgr.34466) 12 : cephadm [INF] It is presumed safe to stop mon.c 2021-03-10T20:09:32.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:31 gibba044 bash[9859]: cephadm 2021-03-10T20:09:31.242513+0000 mgr.gibba044.wflcwh (mgr.34466) 13 : cephadm [INF] Upgrade: It is presumed safe to stop mon.c 2021-03-10T20:09:33.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:32 gibba023 bash[30844]: cluster 2021-03-10T20:09:31.935889+0000 mon.a (mon.0) 32 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T20:09:33.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:32 gibba023 bash[13032]: cluster 2021-03-10T20:09:31.935889+0000 mon.a (mon.0) 32 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T20:09:33.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:32 gibba044 bash[9859]: cluster 2021-03-10T20:09:31.935889+0000 mon.a (mon.0) 32 : cluster [WRN] Health check failed: 2 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2021-03-10T20:09:34.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:33 gibba023 bash[30844]: cluster 2021-03-10T20:09:33.232136+0000 mgr.gibba044.wflcwh (mgr.34466) 14 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:34.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:33 gibba023 bash[30844]: cephadm 2021-03-10T20:09:33.384513+0000 mgr.gibba044.wflcwh (mgr.34466) 15 : cephadm [INF] Upgrade: Updating mon.c 2021-03-10T20:09:34.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:33 gibba023 bash[30844]: audit 2021-03-10T20:09:33.385625+0000 mon.b (mon.2) 167 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.c"}]: dispatch 2021-03-10T20:09:34.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:33 gibba023 bash[30844]: audit 2021-03-10T20:09:33.389747+0000 mon.a (mon.0) 33 : audit [INF] from='mgr.34466 ' entity='mgr.gibba044.wflcwh' 2021-03-10T20:09:34.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:33 gibba023 bash[30844]: audit 2021-03-10T20:09:33.397222+0000 mon.b (mon.2) 168 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:09:34.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:33 gibba023 bash[30844]: audit 2021-03-10T20:09:33.398028+0000 mon.b (mon.2) 169 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:09:34.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:33 gibba023 bash[30844]: audit 2021-03-10T20:09:33.398745+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:09:34.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:33 gibba023 bash[30844]: audit 2021-03-10T20:09:33.399566+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T20:09:34.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:33 gibba023 bash[13032]: cluster 2021-03-10T20:09:33.232136+0000 mgr.gibba044.wflcwh (mgr.34466) 14 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:34.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:33 gibba023 bash[13032]: cephadm 2021-03-10T20:09:33.384513+0000 mgr.gibba044.wflcwh (mgr.34466) 15 : cephadm [INF] Upgrade: Updating mon.c 2021-03-10T20:09:34.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:33 gibba023 bash[13032]: audit 2021-03-10T20:09:33.385625+0000 mon.b (mon.2) 167 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.c"}]: dispatch 2021-03-10T20:09:34.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:33 gibba023 bash[13032]: audit 2021-03-10T20:09:33.389747+0000 mon.a (mon.0) 33 : audit [INF] from='mgr.34466 ' entity='mgr.gibba044.wflcwh' 2021-03-10T20:09:34.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:33 gibba023 bash[13032]: audit 2021-03-10T20:09:33.397222+0000 mon.b (mon.2) 168 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:09:34.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:33 gibba023 bash[13032]: audit 2021-03-10T20:09:33.398028+0000 mon.b (mon.2) 169 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:09:34.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:33 gibba023 bash[13032]: audit 2021-03-10T20:09:33.398745+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:09:34.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:33 gibba023 bash[13032]: audit 2021-03-10T20:09:33.399566+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T20:09:34.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:33 gibba044 bash[9859]: cluster 2021-03-10T20:09:33.232136+0000 mgr.gibba044.wflcwh (mgr.34466) 14 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:34.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:33 gibba044 bash[9859]: cephadm 2021-03-10T20:09:33.384513+0000 mgr.gibba044.wflcwh (mgr.34466) 15 : cephadm [INF] Upgrade: Updating mon.c 2021-03-10T20:09:34.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:33 gibba044 bash[9859]: audit 2021-03-10T20:09:33.385625+0000 mon.b (mon.2) 167 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.c"}]: dispatch 2021-03-10T20:09:34.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:33 gibba044 bash[9859]: audit 2021-03-10T20:09:33.389747+0000 mon.a (mon.0) 33 : audit [INF] from='mgr.34466 ' entity='mgr.gibba044.wflcwh' 2021-03-10T20:09:34.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:33 gibba044 bash[9859]: audit 2021-03-10T20:09:33.397222+0000 mon.b (mon.2) 168 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:09:34.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:33 gibba044 bash[9859]: audit 2021-03-10T20:09:33.398028+0000 mon.b (mon.2) 169 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:09:34.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:33 gibba044 bash[9859]: audit 2021-03-10T20:09:33.398745+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:09:34.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:33 gibba044 bash[9859]: audit 2021-03-10T20:09:33.399566+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T20:09:35.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:34 gibba044 bash[9859]: cephadm 2021-03-10T20:09:33.399328+0000 mgr.gibba044.wflcwh (mgr.34466) 16 : cephadm [INF] Deploying daemon mon.c on gibba023 2021-03-10T20:09:35.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:34 gibba023 bash[30844]: cephadm 2021-03-10T20:09:33.399328+0000 mgr.gibba044.wflcwh (mgr.34466) 16 : cephadm [INF] Deploying daemon mon.c on gibba023 2021-03-10T20:09:35.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:34 gibba023 bash[13032]: cephadm 2021-03-10T20:09:33.399328+0000 mgr.gibba044.wflcwh (mgr.34466) 16 : cephadm [INF] Deploying daemon mon.c on gibba023 2021-03-10T20:09:35.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:35 gibba023 systemd[1]: Stopping Ceph mon.c for dd719b26-81da-11eb-9080-001a4aab830c... 2021-03-10T20:09:35.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:35 gibba023 bash[13032]: debug 2021-03-10T20:09:35.665+0000 7fbf081fe700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T20:09:35.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:35 gibba023 bash[13032]: debug 2021-03-10T20:09:35.665+0000 7fbf081fe700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2021-03-10T20:09:36.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:36 gibba023 docker[31727]: ceph-dd719b26-81da-11eb-9080-001a4aab830c-mon.c 2021-03-10T20:09:36.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:36 gibba023 systemd[1]: ceph-dd719b26-81da-11eb-9080-001a4aab830c@mon.c.service: Succeeded. 2021-03-10T20:09:36.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:36 gibba023 systemd[1]: Stopped Ceph mon.c for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:09:36.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:36 gibba023 systemd[1]: Started Ceph mon.c for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:09:38.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.893+0000 7f4f80479700 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T20:09:38.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.893+0000 7f4f80479700 0 ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev), process ceph-mon, pid 6 2021-03-10T20:09:38.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.893+0000 7f4f80479700 0 pidfile_write: ignore empty --pid-file 2021-03-10T20:09:38.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.897+0000 7f4f80479700 0 load: jerasure load: lrc load: isa 2021-03-10T20:09:38.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: RocksDB version: 6.8.1 2021-03-10T20:09:38.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T20:09:38.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Compile date Mar 9 2021 2021-03-10T20:09:38.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: DB SUMMARY 2021-03-10T20:09:38.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: CURRENT file: CURRENT 2021-03-10T20:09:38.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: IDENTITY file: IDENTITY 2021-03-10T20:09:38.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 765 Bytes 2021-03-10T20:09:38.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 2, files: 000022.sst 000023.sst 2021-03-10T20:09:38.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000020.log size: 26068183 ; 2021-03-10T20:09:38.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.error_if_exists: 0 2021-03-10T20:09:38.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.create_if_missing: 0 2021-03-10T20:09:38.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T20:09:38.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.env: 0x5631cd1d01c0 2021-03-10T20:09:38.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.fs: Posix File System 2021-03-10T20:09:38.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.info_log: 0x5631cddc11e0 2021-03-10T20:09:38.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T20:09:38.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.statistics: (nil) 2021-03-10T20:09:38.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.use_fsync: 0 2021-03-10T20:09:38.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T20:09:38.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T20:09:38.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T20:09:38.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T20:09:38.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T20:09:38.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T20:09:38.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T20:09:38.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T20:09:38.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T20:09:38.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T20:09:38.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T20:09:38.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.db_log_dir: 2021-03-10T20:09:38.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2021-03-10T20:09:38.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T20:09:38.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T20:09:38.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T20:09:38.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T20:09:38.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T20:09:38.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-03-10T20:09:38.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T20:09:38.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T20:09:38.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T20:09:38.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T20:09:38.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.write_buffer_manager: 0x5631cde15c50 2021-03-10T20:09:38.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T20:09:38.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T20:09:38.189 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T20:09:38.189 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T20:09:38.189 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T20:09:38.189 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T20:09:38.190 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T20:09:38.190 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T20:09:38.190 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T20:09:38.191 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.unordered_write: 0 2021-03-10T20:09:38.191 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T20:09:38.191 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T20:09:38.191 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T20:09:38.191 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T20:09:38.192 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.row_cache: None 2021-03-10T20:09:38.192 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.wal_filter: None 2021-03-10T20:09:38.192 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T20:09:38.192 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T20:09:38.192 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T20:09:38.193 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.two_write_queues: 0 2021-03-10T20:09:38.193 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T20:09:38.193 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.atomic_flush: 0 2021-03-10T20:09:38.193 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T20:09:38.194 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-03-10T20:09:38.194 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-03-10T20:09:38.194 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.log_readahead_size: 0 2021-03-10T20:09:38.194 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-03-10T20:09:38.194 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T20:09:38.195 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T20:09:38.195 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T20:09:38.195 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T20:09:38.195 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T20:09:38.196 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T20:09:38.196 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T20:09:38.196 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T20:09:38.196 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T20:09:38.196 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T20:09:38.197 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.max_open_files: -1 2021-03-10T20:09:38.197 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T20:09:38.197 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T20:09:38.197 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-03-10T20:09:38.198 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T20:09:38.198 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Compression algorithms supported: 2021-03-10T20:09:38.198 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T20:09:38.198 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: kZSTD supported: 0 2021-03-10T20:09:38.198 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: kXpressCompression supported: 0 2021-03-10T20:09:38.199 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T20:09:38.199 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T20:09:38.199 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T20:09:38.199 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: kZlibCompression supported: 1 2021-03-10T20:09:38.199 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T20:09:38.200 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T20:09:38.200 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2021-03-10T20:09:38.200 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-03-10T20:09:38.200 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T20:09:38.200 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.merge_operator: 2021-03-10T20:09:38.201 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.compaction_filter: None 2021-03-10T20:09:38.201 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T20:09:38.201 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T20:09:38.201 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T20:09:38.202 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5631cdd64230) 2021-03-10T20:09:38.202 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: cache_index_and_filter_blocks: 1 2021-03-10T20:09:38.202 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: cache_index_and_filter_blocks_with_high_priority: 0 2021-03-10T20:09:38.202 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T20:09:38.202 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: pin_top_level_index_and_filter: 1 2021-03-10T20:09:38.203 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: index_type: 0 2021-03-10T20:09:38.203 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: data_block_index_type: 0 2021-03-10T20:09:38.203 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: index_shortening: 1 2021-03-10T20:09:38.203 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: data_block_hash_table_util_ratio: 0.750000 2021-03-10T20:09:38.203 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: hash_index_allow_collision: 1 2021-03-10T20:09:38.204 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: checksum: 1 2021-03-10T20:09:38.204 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: no_block_cache: 0 2021-03-10T20:09:38.204 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: block_cache: 0x5631cdd9c510 2021-03-10T20:09:38.204 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: block_cache_name: BinnedLRUCache 2021-03-10T20:09:38.205 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: block_cache_options: 2021-03-10T20:09:38.205 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: capacity : 536870912 2021-03-10T20:09:38.205 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: num_shard_bits : 4 2021-03-10T20:09:38.205 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: strict_capacity_limit : 0 2021-03-10T20:09:38.205 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: high_pri_pool_ratio: 0.000 2021-03-10T20:09:38.206 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: block_cache_compressed: (nil) 2021-03-10T20:09:38.206 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: persistent_cache: (nil) 2021-03-10T20:09:38.206 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: block_size: 4096 2021-03-10T20:09:38.206 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: block_size_deviation: 10 2021-03-10T20:09:38.207 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: block_restart_interval: 16 2021-03-10T20:09:38.207 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: index_block_restart_interval: 1 2021-03-10T20:09:38.207 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: metadata_block_size: 4096 2021-03-10T20:09:38.207 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: partition_filters: 0 2021-03-10T20:09:38.207 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: use_delta_encoding: 1 2021-03-10T20:09:38.208 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T20:09:38.208 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: whole_key_filtering: 1 2021-03-10T20:09:38.208 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: verify_compression: 0 2021-03-10T20:09:38.208 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: read_amp_bytes_per_bit: 0 2021-03-10T20:09:38.208 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: format_version: 2 2021-03-10T20:09:38.209 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: enable_index_compression: 1 2021-03-10T20:09:38.209 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: block_align: 0 2021-03-10T20:09:38.209 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T20:09:38.209 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T20:09:38.209 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.compression: NoCompression 2021-03-10T20:09:38.210 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T20:09:38.210 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T20:09:38.210 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T20:09:38.210 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.num_levels: 7 2021-03-10T20:09:38.211 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T20:09:38.211 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T20:09:38.211 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-03-10T20:09:38.211 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T20:09:38.212 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T20:09:38.212 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T20:09:38.212 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T20:09:38.212 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T20:09:38.213 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T20:09:38.213 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T20:09:38.213 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T20:09:38.213 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T20:09:38.214 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T20:09:38.214 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T20:09:38.214 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T20:09:38.214 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T20:09:38.214 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T20:09:38.215 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T20:09:38.215 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T20:09:38.215 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T20:09:38.215 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T20:09:38.215 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T20:09:38.216 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T20:09:38.216 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T20:09:38.216 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T20:09:38.216 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T20:09:38.216 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T20:09:38.217 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T20:09:38.217 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T20:09:38.217 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T20:09:38.217 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T20:09:38.218 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T20:09:38.218 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T20:09:38.218 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T20:09:38.218 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T20:09:38.218 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T20:09:38.219 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T20:09:38.219 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T20:09:38.219 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T20:09:38.219 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T20:09:38.219 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T20:09:38.220 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T20:09:38.220 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T20:09:38.220 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T20:09:38.220 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T20:09:38.221 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T20:09:38.221 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T20:09:38.221 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.table_properties_collectors: 2021-03-10T20:09:38.221 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T20:09:38.221 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T20:09:38.222 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T20:09:38.222 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T20:09:38.222 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T20:09:38.222 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.bloom_locality: 0 2021-03-10T20:09:38.222 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T20:09:38.223 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T20:09:38.223 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T20:09:38.223 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T20:09:38.223 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T20:09:38.223 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.ttl: 2592000 2021-03-10T20:09:38.224 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-03-10T20:09:38.224 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 25, last_sequence is 9268, log_number is 20,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T20:09:38.224 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 20 2021-03-10T20:09:38.224 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615406977902970, "job": 1, "event": "recovery_started", "log_files": [20]} 2021-03-10T20:09:38.225 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.901+0000 7f4f80479700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #20 mode 2 2021-03-10T20:09:38.225 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.913+0000 7f4f80479700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-03-10T20:09:38.225 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.929+0000 7f4f80479700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615406977931363, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 25, "file_size": 17180835, "table_properties": {"data_size": 17172914, "index_size": 6265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 837, "raw_key_size": 7279, "raw_average_key_size": 22, "raw_value_size": 17163257, "raw_average_value_size": 53468, "num_data_blocks": 196, "num_entries": 321, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1615406977, "oldest_key_time": 3, "file_creation_time": 0}} 2021-03-10T20:09:38.225 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.929+0000 7f4f80479700 4 rocksdb: [version_set.cc:3826] Creating manifest 26 2021-03-10T20:09:38.225 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.929+0000 7f4f80479700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615406977932372, "job": 1, "event": "recovery_finished"} 2021-03-10T20:09:38.226 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.933+0000 7f4f80479700 4 rocksdb: DB pointer 0x5631cde61800 2021-03-10T20:09:38.226 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.933+0000 7f4f6728c700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-03-10T20:09:38.226 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.933+0000 7f4f6728c700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-03-10T20:09:38.226 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: ** DB Stats ** 2021-03-10T20:09:38.227 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T20:09:38.227 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T20:09:38.227 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T20:09:38.227 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T20:09:38.227 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T20:09:38.228 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T20:09:38.228 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T20:09:38.228 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: ** Compaction Stats [default] ** 2021-03-10T20:09:38.228 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:09:38.228 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:09:38.229 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: L0 1/0 16.38 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1121.6 0.01 0.00 1 0.015 0 0 2021-03-10T20:09:38.229 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: L6 2/0 69.36 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T20:09:38.229 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: Sum 3/0 85.75 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1121.6 0.01 0.00 1 0.015 0 0 2021-03-10T20:09:38.229 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1121.6 0.01 0.00 1 0.015 0 0 2021-03-10T20:09:38.230 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: ** Compaction Stats [default] ** 2021-03-10T20:09:38.230 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:09:38.230 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:09:38.230 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1121.6 0.01 0.00 1 0.015 0 0 2021-03-10T20:09:38.230 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T20:09:38.231 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: Flush(GB): cumulative 0.016, interval 0.016 2021-03-10T20:09:38.231 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T20:09:38.231 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T20:09:38.231 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T20:09:38.231 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T20:09:38.232 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: Cumulative compaction: 0.02 GB write, 511.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:09:38.232 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: Interval compaction: 0.02 GB write, 511.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:09:38.232 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T20:09:38.232 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T20:09:38.232 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: ** Compaction Stats [default] ** 2021-03-10T20:09:38.233 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:09:38.233 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:09:38.233 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: L0 1/0 16.38 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1121.6 0.01 0.00 1 0.015 0 0 2021-03-10T20:09:38.233 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: L6 2/0 69.36 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T20:09:38.234 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: Sum 3/0 85.75 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1121.6 0.01 0.00 1 0.015 0 0 2021-03-10T20:09:38.234 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T20:09:38.234 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: ** Compaction Stats [default] ** 2021-03-10T20:09:38.234 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:09:38.234 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:09:38.235 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1121.6 0.01 0.00 1 0.015 0 0 2021-03-10T20:09:38.235 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T20:09:38.235 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: Flush(GB): cumulative 0.016, interval 0.000 2021-03-10T20:09:38.235 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T20:09:38.235 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T20:09:38.236 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T20:09:38.236 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T20:09:38.236 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: Cumulative compaction: 0.02 GB write, 510.94 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:09:38.236 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:09:38.237 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T20:09:38.237 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T20:09:38.237 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.933+0000 7f4f80479700 0 starting mon.c rank 1 at public addrs [v2:172.21.2.123:3301/0,v1:172.21.2.123:6790/0] at bind addrs [v2:172.21.2.123:3301/0,v1:172.21.2.123:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid dd719b26-81da-11eb-9080-001a4aab830c 2021-03-10T20:09:38.237 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.933+0000 7f4f80479700 1 mon.c@-1(???) e3 preinit fsid dd719b26-81da-11eb-9080-001a4aab830c 2021-03-10T20:09:38.237 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.933+0000 7f4f80479700 0 mon.c@-1(???).mds e1 new map 2021-03-10T20:09:38.238 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.933+0000 7f4f80479700 0 mon.c@-1(???).mds e1 print_map 2021-03-10T20:09:38.238 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: e1 2021-03-10T20:09:38.238 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: enable_multiple, ever_enabled_multiple: 0,0 2021-03-10T20:09:38.238 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-03-10T20:09:38.238 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: legacy client fscid: -1 2021-03-10T20:09:38.239 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: 2021-03-10T20:09:38.239 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: No filesystems configured 2021-03-10T20:09:38.239 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.933+0000 7f4f80479700 0 mon.c@-1(???).osd e62 crush map has features 3314933000852226048, adjusting msgr requires 2021-03-10T20:09:38.239 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.933+0000 7f4f80479700 0 mon.c@-1(???).osd e62 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T20:09:38.240 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.933+0000 7f4f80479700 0 mon.c@-1(???).osd e62 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T20:09:38.240 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.933+0000 7f4f80479700 0 mon.c@-1(???).osd e62 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T20:09:38.240 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: cephadm 2021-03-10T20:09:33.399328+0000 mgr.gibba044.wflcwh (mgr.34466) 16 : cephadm [INF] Deploying daemon mon.c on gibba023 2021-03-10T20:09:38.240 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:37 gibba023 bash[31815]: debug 2021-03-10T20:09:37.933+0000 7f4f80479700 1 mon.c@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2021-03-10T20:09:39.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:38 gibba023 bash[30844]: debug 2021-03-10T20:09:38.925+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:39.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:38 gibba023 bash[30844]: debug 2021-03-10T20:09:38.925+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:09:39.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:38 gibba023 bash[30844]: debug 2021-03-10T20:09:38.925+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba023.rsfdop on gibba023 is in error state 2021-03-10T20:09:39.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:38 gibba023 bash[30844]: debug 2021-03-10T20:09:38.925+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba044.rblqpl on gibba044 is in error state 2021-03-10T20:09:39.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:38 gibba023 bash[30844]: debug 2021-03-10T20:09:38.925+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:39.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:38 gibba023 bash[30844]: debug 2021-03-10T20:09:38.925+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:40.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:39 gibba044 bash[9859]: audit 2021-03-10T20:09:36.793723+0000 mon.b (mon.2) 172 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"ab5236b7dab5\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 37528535, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.923303Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T20:09:19.909294Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"513df908ba68\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372873625, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.923917Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T20:09:09.951098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50216304, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.924567Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50216304, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.925322Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47269806, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.926016Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49681530, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.926676Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23876075, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.927336Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"16ead90c14c6\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13086228, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:09:30.927694Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:08:50.596854Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.928005Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:09:33.399256Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:09:16.796490Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:09:40.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:39 gibba044 bash[9859]: cluster 2021-03-10T20:09:37.234460+0000 mgr.gibba044.wflcwh (mgr.34466) 18 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:40.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:39 gibba044 bash[9859]: cluster 2021-03-10T20:09:38.145844+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-03-10T20:09:40.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:39 gibba044 bash[9859]: cluster 2021-03-10T20:09:38.912864+0000 mon.a (mon.0) 34 : cluster [INF] mon.a calling monitor election 2021-03-10T20:09:40.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:39 gibba044 bash[9859]: cluster 2021-03-10T20:09:38.915570+0000 mon.a (mon.0) 35 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T20:09:40.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:39 gibba044 bash[9859]: cluster 2021-03-10T20:09:38.921158+0000 mon.a (mon.0) 36 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0],b=[v2:172.21.2.144:3300/0,v1:172.21.2.144:6789/0],c=[v2:172.21.2.123:3301/0,v1:172.21.2.123:6790/0]} 2021-03-10T20:09:40.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:39 gibba044 bash[9859]: cluster 2021-03-10T20:09:38.921206+0000 mon.a (mon.0) 37 : cluster [DBG] fsmap 2021-03-10T20:09:40.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:39 gibba044 bash[9859]: cluster 2021-03-10T20:09:38.921234+0000 mon.a (mon.0) 38 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T20:09:40.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:39 gibba044 bash[9859]: cluster 2021-03-10T20:09:38.921606+0000 mon.a (mon.0) 39 : cluster [DBG] mgrmap e25: gibba044.wflcwh(active, since 12s), standbys: y, x 2021-03-10T20:09:40.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:39 gibba044 bash[9859]: cluster 2021-03-10T20:09:38.926527+0000 mon.a (mon.0) 40 : cluster [ERR] Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:40.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:39 gibba044 bash[9859]: cluster 2021-03-10T20:09:38.926561+0000 mon.a (mon.0) 41 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:09:40.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:39 gibba044 bash[9859]: cluster 2021-03-10T20:09:38.926573+0000 mon.a (mon.0) 42 : cluster [ERR] daemon rgw.r.z.gibba023.rsfdop on gibba023 is in error state 2021-03-10T20:09:40.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:39 gibba044 bash[9859]: cluster 2021-03-10T20:09:38.926586+0000 mon.a (mon.0) 43 : cluster [ERR] daemon rgw.r.z.gibba044.rblqpl on gibba044 is in error state 2021-03-10T20:09:40.258 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:39 gibba044 bash[9859]: cluster 2021-03-10T20:09:38.926599+0000 mon.a (mon.0) 44 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:40.259 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:39 gibba044 bash[9859]: cluster 2021-03-10T20:09:38.926613+0000 mon.a (mon.0) 45 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:40.266 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:39 gibba044 bash[9859]: audit 2021-03-10T20:09:38.930848+0000 mon.a (mon.0) 46 : audit [INF] from='mgr.34466 ' entity='' 2021-03-10T20:09:40.267 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:39 gibba044 bash[9859]: audit 2021-03-10T20:09:38.934046+0000 mon.b (mon.2) 173 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:09:40.267 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:39 gibba044 bash[9859]: cluster 2021-03-10T20:09:39.236408+0000 mgr.gibba044.wflcwh (mgr.34466) 19 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:40.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[30844]: audit 2021-03-10T20:09:36.793723+0000 mon.b (mon.2) 172 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"ab5236b7dab5\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 37528535, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.923303Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T20:09:19.909294Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"513df908ba68\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372873625, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.923917Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T20:09:09.951098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50216304, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.924567Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50216304, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.925322Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47269806, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.926016Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49681530, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.926676Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23876075, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.927336Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"16ead90c14c6\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13086228, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:09:30.927694Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:08:50.596854Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.928005Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:09:33.399256Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:09:16.796490Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:09:40.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[30844]: cluster 2021-03-10T20:09:37.234460+0000 mgr.gibba044.wflcwh (mgr.34466) 18 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:40.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[30844]: cluster 2021-03-10T20:09:38.145844+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-03-10T20:09:40.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[30844]: cluster 2021-03-10T20:09:38.912864+0000 mon.a (mon.0) 34 : cluster [INF] mon.a calling monitor election 2021-03-10T20:09:40.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[30844]: cluster 2021-03-10T20:09:38.915570+0000 mon.a (mon.0) 35 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T20:09:40.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[30844]: cluster 2021-03-10T20:09:38.921158+0000 mon.a (mon.0) 36 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0],b=[v2:172.21.2.144:3300/0,v1:172.21.2.144:6789/0],c=[v2:172.21.2.123:3301/0,v1:172.21.2.123:6790/0]} 2021-03-10T20:09:40.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[30844]: cluster 2021-03-10T20:09:38.921206+0000 mon.a (mon.0) 37 : cluster [DBG] fsmap 2021-03-10T20:09:40.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[30844]: cluster 2021-03-10T20:09:38.921234+0000 mon.a (mon.0) 38 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T20:09:40.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[30844]: cluster 2021-03-10T20:09:38.921606+0000 mon.a (mon.0) 39 : cluster [DBG] mgrmap e25: gibba044.wflcwh(active, since 12s), standbys: y, x 2021-03-10T20:09:40.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[30844]: cluster 2021-03-10T20:09:38.926527+0000 mon.a (mon.0) 40 : cluster [ERR] Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:40.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[30844]: cluster 2021-03-10T20:09:38.926561+0000 mon.a (mon.0) 41 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:09:40.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[30844]: cluster 2021-03-10T20:09:38.926573+0000 mon.a (mon.0) 42 : cluster [ERR] daemon rgw.r.z.gibba023.rsfdop on gibba023 is in error state 2021-03-10T20:09:40.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[31815]: audit 2021-03-10T20:09:36.793723+0000 mon.b (mon.2) 172 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"ab5236b7dab5\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 37528535, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.923303Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T20:09:19.909294Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"513df908ba68\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 372873625, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.923917Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T20:09:09.951098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"status\": 1, \"status_desc\": \"starting\", \"is_active\": false}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50216304, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.924567Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50216304, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.925322Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47269806, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.926016Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49681530, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.926676Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23876075, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.927336Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"16ead90c14c6\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13086228, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2021-03-10T20:09:30.927694Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:08:50.596854Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:30.928005Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:09:33.399256Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:09:16.796490Z\"}}, \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:09:40.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[31815]: cluster 2021-03-10T20:09:37.234460+0000 mgr.gibba044.wflcwh (mgr.34466) 18 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:40.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[31815]: cluster 2021-03-10T20:09:38.145844+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-03-10T20:09:40.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[31815]: cluster 2021-03-10T20:09:38.912864+0000 mon.a (mon.0) 34 : cluster [INF] mon.a calling monitor election 2021-03-10T20:09:40.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[31815]: cluster 2021-03-10T20:09:38.915570+0000 mon.a (mon.0) 35 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T20:09:40.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[31815]: cluster 2021-03-10T20:09:38.921158+0000 mon.a (mon.0) 36 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0],b=[v2:172.21.2.144:3300/0,v1:172.21.2.144:6789/0],c=[v2:172.21.2.123:3301/0,v1:172.21.2.123:6790/0]} 2021-03-10T20:09:40.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[31815]: cluster 2021-03-10T20:09:38.921206+0000 mon.a (mon.0) 37 : cluster [DBG] fsmap 2021-03-10T20:09:40.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[31815]: cluster 2021-03-10T20:09:38.921234+0000 mon.a (mon.0) 38 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T20:09:40.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[31815]: cluster 2021-03-10T20:09:38.921606+0000 mon.a (mon.0) 39 : cluster [DBG] mgrmap e25: gibba044.wflcwh(active, since 12s), standbys: y, x 2021-03-10T20:09:40.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[31815]: cluster 2021-03-10T20:09:38.926527+0000 mon.a (mon.0) 40 : cluster [ERR] Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:40.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[31815]: cluster 2021-03-10T20:09:38.926561+0000 mon.a (mon.0) 41 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:09:40.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[31815]: cluster 2021-03-10T20:09:38.926573+0000 mon.a (mon.0) 42 : cluster [ERR] daemon rgw.r.z.gibba023.rsfdop on gibba023 is in error state 2021-03-10T20:09:40.432 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[30844]: cluster 2021-03-10T20:09:38.926586+0000 mon.a (mon.0) 43 : cluster [ERR] daemon rgw.r.z.gibba044.rblqpl on gibba044 is in error state 2021-03-10T20:09:40.433 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[30844]: cluster 2021-03-10T20:09:38.926599+0000 mon.a (mon.0) 44 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:40.433 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[30844]: cluster 2021-03-10T20:09:38.926613+0000 mon.a (mon.0) 45 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:40.434 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[30844]: audit 2021-03-10T20:09:38.930848+0000 mon.a (mon.0) 46 : audit [INF] from='mgr.34466 ' entity='' 2021-03-10T20:09:40.434 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[30844]: audit 2021-03-10T20:09:38.934046+0000 mon.b (mon.2) 173 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:09:40.434 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[30844]: cluster 2021-03-10T20:09:39.236408+0000 mgr.gibba044.wflcwh (mgr.34466) 19 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:40.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[31815]: cluster 2021-03-10T20:09:38.926586+0000 mon.a (mon.0) 43 : cluster [ERR] daemon rgw.r.z.gibba044.rblqpl on gibba044 is in error state 2021-03-10T20:09:40.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[31815]: cluster 2021-03-10T20:09:38.926599+0000 mon.a (mon.0) 44 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:40.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[31815]: cluster 2021-03-10T20:09:38.926613+0000 mon.a (mon.0) 45 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:40.436 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[31815]: audit 2021-03-10T20:09:38.930848+0000 mon.a (mon.0) 46 : audit [INF] from='mgr.34466 ' entity='' 2021-03-10T20:09:40.436 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[31815]: audit 2021-03-10T20:09:38.934046+0000 mon.b (mon.2) 173 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:09:40.436 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:39 gibba023 bash[31815]: cluster 2021-03-10T20:09:39.236408+0000 mgr.gibba044.wflcwh (mgr.34466) 19 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:42.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:41 gibba023 bash[30844]: cluster 2021-03-10T20:09:41.237346+0000 mgr.gibba044.wflcwh (mgr.34466) 20 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:42.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:41 gibba023 bash[31815]: cluster 2021-03-10T20:09:41.237346+0000 mgr.gibba044.wflcwh (mgr.34466) 20 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:42.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:41 gibba044 bash[9859]: cluster 2021-03-10T20:09:41.237346+0000 mgr.gibba044.wflcwh (mgr.34466) 20 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:43.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:42 gibba044 bash[9859]: audit 2021-03-10T20:09:42.668400+0000 mon.b (mon.2) 174 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"ab5236b7dab5\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 43400560, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.663101Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T20:09:19.909294Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"513df908ba68\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373502771, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.663598Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T20:09:09.951098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"b1667336db24\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 44805652, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.663969Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T20:09:36.816708Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50384076, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.664275Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50142904, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.664987Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47343206, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.665642Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49838817, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.666276Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23949475, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.666908Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"16ead90c14c6\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13201571, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.667238Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:08:50.596854Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.667399Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:09:33.399256Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:09:16.796490Z\"}}, \"last_daemon_update\": \"2021-03-10T20:09:42.667479Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:09:43.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:42 gibba044 bash[9859]: audit 2021-03-10T20:09:42.672500+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.34466 ' entity='mgr.gibba044.wflcwh' 2021-03-10T20:09:43.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:42 gibba044 bash[9859]: audit 2021-03-10T20:09:42.675889+0000 mon.b (mon.2) 175 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:09:43.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:42 gibba044 bash[9859]: audit 2021-03-10T20:09:42.677692+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.34466 ' entity='mgr.gibba044.wflcwh' 2021-03-10T20:09:43.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:42 gibba044 bash[9859]: audit 2021-03-10T20:09:42.684837+0000 mon.b (mon.2) 176 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:09:43.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:42 gibba044 bash[9859]: audit 2021-03-10T20:09:42.686088+0000 mon.b (mon.2) 177 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:09:43.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:42 gibba044 bash[9859]: audit 2021-03-10T20:09:42.687191+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2021-03-10T20:09:43.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:42 gibba023 bash[30844]: audit 2021-03-10T20:09:42.668400+0000 mon.b (mon.2) 174 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"ab5236b7dab5\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 43400560, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.663101Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T20:09:19.909294Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"513df908ba68\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373502771, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.663598Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T20:09:09.951098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"b1667336db24\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 44805652, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.663969Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T20:09:36.816708Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50384076, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.664275Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50142904, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.664987Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47343206, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.665642Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49838817, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.666276Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23949475, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.666908Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"16ead90c14c6\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13201571, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.667238Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:08:50.596854Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.667399Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:09:33.399256Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:09:16.796490Z\"}}, \"last_daemon_update\": \"2021-03-10T20:09:42.667479Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:09:43.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:42 gibba023 bash[30844]: audit 2021-03-10T20:09:42.672500+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.34466 ' entity='mgr.gibba044.wflcwh' 2021-03-10T20:09:43.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:42 gibba023 bash[30844]: audit 2021-03-10T20:09:42.675889+0000 mon.b (mon.2) 175 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:09:43.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:42 gibba023 bash[30844]: audit 2021-03-10T20:09:42.677692+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.34466 ' entity='mgr.gibba044.wflcwh' 2021-03-10T20:09:43.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:42 gibba023 bash[30844]: audit 2021-03-10T20:09:42.684837+0000 mon.b (mon.2) 176 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:09:43.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:42 gibba023 bash[30844]: audit 2021-03-10T20:09:42.686088+0000 mon.b (mon.2) 177 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:09:43.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:42 gibba023 bash[30844]: audit 2021-03-10T20:09:42.687191+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2021-03-10T20:09:43.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:42 gibba023 bash[31815]: audit 2021-03-10T20:09:42.668400+0000 mon.b (mon.2) 174 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.gibba023","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"ab5236b7dab5\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 43400560, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.663101Z\", \"created\": \"2021-03-10T19:58:02.889146Z\", \"started\": \"2021-03-10T20:09:19.909294Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"hostname\": \"gibba023\", \"container_id\": \"513df908ba68\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 373502771, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.663598Z\", \"created\": \"2021-03-10T19:58:10.609146Z\", \"started\": \"2021-03-10T20:09:09.951098Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"hostname\": \"gibba023\", \"container_id\": \"b1667336db24\", \"container_image_id\": \"d4615e7085da621d1ad059caeee4303a51b89331a28166bbd090a93d091f1a14\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54\"], \"memory_usage\": 44805652, \"version\": \"17.0.0-1749-gb26fc080\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.663969Z\", \"created\": \"2021-03-10T19:59:18.289146Z\", \"started\": \"2021-03-10T20:09:36.816708Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"hostname\": \"gibba023\", \"container_id\": \"a8e662729287\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50384076, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.664275Z\", \"created\": \"2021-03-10T20:00:07.565145Z\", \"started\": \"2021-03-10T20:00:11.808125Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"hostname\": \"gibba023\", \"container_id\": \"aba825ce9058\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 50142904, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.664987Z\", \"created\": \"2021-03-10T20:00:31.149145Z\", \"started\": \"2021-03-10T20:00:34.745419Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"hostname\": \"gibba023\", \"container_id\": \"0b4c19578b20\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47343206, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.665642Z\", \"created\": \"2021-03-10T20:00:55.158947Z\", \"started\": \"2021-03-10T20:00:58.791505Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"hostname\": \"gibba023\", \"container_id\": \"25229602755c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 49838817, \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"osdspec_affinity\": \"\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.666276Z\", \"created\": \"2021-03-10T20:01:19.922947Z\", \"started\": \"2021-03-10T20:01:23.320992Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"251ac7cf8b4d\", \"container_image_id\": \"c19ae228f0699185488b6a1c0debb9c6b79672181356ad455c9a7924a41a01bb\", \"container_image_name\": \"prom/node-exporter\", \"container_image_digests\": [\"prom/node-exporter@sha256:22fbde17ab647ddf89841e5e464464eece111402b7d599882c2a3393bc0d2810\"], \"memory_usage\": 23949475, \"version\": \"1.1.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.666908Z\", \"created\": \"2021-03-10T20:03:08.746947Z\", \"started\": \"2021-03-10T20:03:11.078015Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"hostname\": \"gibba023\", \"container_id\": \"16ead90c14c6\", \"container_image_id\": \"c876f5897d7b07a19836227e26de9053c4ae14c114e43635df6fdb4a4b251ba6\", \"container_image_name\": \"prom/alertmanager\", \"container_image_digests\": [\"prom/alertmanager@sha256:24a5204b418e8fa0214cfb628486749003b039c279c56b5bddb5b10cd100d926\"], \"memory_usage\": 13201571, \"version\": \"0.21.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.667238Z\", \"created\": \"2021-03-10T20:03:18.574947Z\", \"started\": \"2021-03-10T20:08:50.596854Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.gibba023.rsfdop\", \"hostname\": \"gibba023\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"status\": -1, \"status_desc\": \"error\", \"is_active\": false, \"last_refresh\": \"2021-03-10T20:09:42.667399Z\", \"created\": \"2021-03-10T20:05:24.438946Z\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEL1K375GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 375083606016.0, \"human_readable_size\": \"349.32 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"6613b193-a360-4fc9-a240-11ac052531a2\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"veyxdi-DdUh-ehTz-VIVw-xGEQ-rw34-IXAPn2\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"a0f4e49d-c3f2-4689-a636-aeba722b895a\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"xsPcUN-xmBm-cwFZ-IxV3-mS7a-8JEc-j5WTHQ\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"95b1ac45-85e8-43cd-9a54-ac01a8971dd4\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"E6oilD-rMyv-I223-yvrK-8slY-iUcq-QIhsM8\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"44017fc6-e3eb-486e-b88f-073ab24f2838\", \"cluster_fsid\": \"dd719b26-81da-11eb-9080-001a4aab830c\", \"block_uuid\": \"ocCYij-Q0pn-qPMZ-xP7x-AcgR-fSeu-Rf9EET\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEL1K375GA_PHKM913400CL375A\", \"lsm_data\": {}}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"TOSHIBA MG04ACA1\", \"rev\": \"FJ5A\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"TOSHIBA_MG04ACA100N_Y9I6K2JYF6XF\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2021-03-10T20:09:33.399256Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2021-03-10T20:08:56.859351Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:05.609710Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:29.301214Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2021-03-10T20:00:53.346973Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2021-03-10T20:01:18.030537Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:03:08.360535Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.gibba044.wflcwh\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2021-03-10T20:08:43.698386Z\"}, \"rgw.r.z.gibba023.rsfdop\": {\"deps\": [], \"last_config\": \"2021-03-10T20:05:21.068542Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2021-03-10T20:09:16.796490Z\"}}, \"last_daemon_update\": \"2021-03-10T20:09:42.667479Z\", \"last_device_update\": \"2021-03-10T20:01:26.426201Z\", \"networks\": {\"172.17.0.0/16\": [\"172.17.0.1\"], \"172.21.0.0/20\": [\"172.21.2.123\"], \"172.21.15.254\": [\"172.21.2.123\"]}, \"last_host_check\": \"2021-03-10T20:08:35.797632Z\", \"scheduled_daemon_actions\": {}}"}]: dispatch 2021-03-10T20:09:43.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:42 gibba023 bash[31815]: audit 2021-03-10T20:09:42.672500+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.34466 ' entity='mgr.gibba044.wflcwh' 2021-03-10T20:09:43.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:42 gibba023 bash[31815]: audit 2021-03-10T20:09:42.675889+0000 mon.b (mon.2) 175 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2021-03-10T20:09:43.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:42 gibba023 bash[31815]: audit 2021-03-10T20:09:42.677692+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.34466 ' entity='mgr.gibba044.wflcwh' 2021-03-10T20:09:43.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:42 gibba023 bash[31815]: audit 2021-03-10T20:09:42.684837+0000 mon.b (mon.2) 176 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:09:43.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:42 gibba023 bash[31815]: audit 2021-03-10T20:09:42.686088+0000 mon.b (mon.2) 177 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:09:43.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:42 gibba023 bash[31815]: audit 2021-03-10T20:09:42.687191+0000 mon.b (mon.2) 178 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2021-03-10T20:09:44.219 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:43 gibba044 bash[9859]: cephadm 2021-03-10T20:09:42.684158+0000 mgr.gibba044.wflcwh (mgr.34466) 21 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:09:44.220 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:43 gibba044 bash[9859]: cephadm 2021-03-10T20:09:42.685812+0000 mgr.gibba044.wflcwh (mgr.34466) 22 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:09:44.220 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:43 gibba044 bash[9859]: cephadm 2021-03-10T20:09:42.686823+0000 mgr.gibba044.wflcwh (mgr.34466) 23 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:09:44.220 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:43 gibba044 bash[9859]: cephadm 2021-03-10T20:09:42.686873+0000 mgr.gibba044.wflcwh (mgr.34466) 24 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:09:44.221 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:43 gibba044 bash[9859]: cephadm 2021-03-10T20:09:42.687922+0000 mgr.gibba044.wflcwh (mgr.34466) 25 : cephadm [INF] It is presumed safe to stop mon.b 2021-03-10T20:09:44.221 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:43 gibba044 bash[9859]: cephadm 2021-03-10T20:09:42.687972+0000 mgr.gibba044.wflcwh (mgr.34466) 26 : cephadm [INF] Upgrade: It is presumed safe to stop mon.b 2021-03-10T20:09:44.221 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:43 gibba044 bash[9859]: cluster 2021-03-10T20:09:43.239387+0000 mgr.gibba044.wflcwh (mgr.34466) 27 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:44.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:43 gibba023 bash[30844]: cephadm 2021-03-10T20:09:42.684158+0000 mgr.gibba044.wflcwh (mgr.34466) 21 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:09:44.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:43 gibba023 bash[30844]: cephadm 2021-03-10T20:09:42.685812+0000 mgr.gibba044.wflcwh (mgr.34466) 22 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:09:44.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:43 gibba023 bash[30844]: cephadm 2021-03-10T20:09:42.686823+0000 mgr.gibba044.wflcwh (mgr.34466) 23 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:09:44.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:43 gibba023 bash[30844]: cephadm 2021-03-10T20:09:42.686873+0000 mgr.gibba044.wflcwh (mgr.34466) 24 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:09:44.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:43 gibba023 bash[30844]: cephadm 2021-03-10T20:09:42.687922+0000 mgr.gibba044.wflcwh (mgr.34466) 25 : cephadm [INF] It is presumed safe to stop mon.b 2021-03-10T20:09:44.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:43 gibba023 bash[30844]: cephadm 2021-03-10T20:09:42.687972+0000 mgr.gibba044.wflcwh (mgr.34466) 26 : cephadm [INF] Upgrade: It is presumed safe to stop mon.b 2021-03-10T20:09:44.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:43 gibba023 bash[30844]: cluster 2021-03-10T20:09:43.239387+0000 mgr.gibba044.wflcwh (mgr.34466) 27 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:44.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:43 gibba023 bash[31815]: cephadm 2021-03-10T20:09:42.684158+0000 mgr.gibba044.wflcwh (mgr.34466) 21 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:09:44.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:43 gibba023 bash[31815]: cephadm 2021-03-10T20:09:42.685812+0000 mgr.gibba044.wflcwh (mgr.34466) 22 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:09:44.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:43 gibba023 bash[31815]: cephadm 2021-03-10T20:09:42.686823+0000 mgr.gibba044.wflcwh (mgr.34466) 23 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:09:44.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:43 gibba023 bash[31815]: cephadm 2021-03-10T20:09:42.686873+0000 mgr.gibba044.wflcwh (mgr.34466) 24 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:09:44.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:43 gibba023 bash[31815]: cephadm 2021-03-10T20:09:42.687922+0000 mgr.gibba044.wflcwh (mgr.34466) 25 : cephadm [INF] It is presumed safe to stop mon.b 2021-03-10T20:09:44.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:43 gibba023 bash[31815]: cephadm 2021-03-10T20:09:42.687972+0000 mgr.gibba044.wflcwh (mgr.34466) 26 : cephadm [INF] Upgrade: It is presumed safe to stop mon.b 2021-03-10T20:09:44.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:43 gibba023 bash[31815]: cluster 2021-03-10T20:09:43.239387+0000 mgr.gibba044.wflcwh (mgr.34466) 27 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:45.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:44 gibba044 bash[9859]: audit 2021-03-10T20:09:44.690615+0000 mon.b (mon.2) 179 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.b"}]: dispatch 2021-03-10T20:09:45.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:44 gibba044 bash[9859]: audit 2021-03-10T20:09:44.699974+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.34466 ' entity='mgr.gibba044.wflcwh' 2021-03-10T20:09:45.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:44 gibba044 bash[9859]: audit 2021-03-10T20:09:44.702555+0000 mon.b (mon.2) 180 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:09:45.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:44 gibba044 bash[9859]: audit 2021-03-10T20:09:44.703393+0000 mon.b (mon.2) 181 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:09:45.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:44 gibba044 bash[9859]: audit 2021-03-10T20:09:44.704092+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:09:45.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:44 gibba044 bash[9859]: audit 2021-03-10T20:09:44.705066+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T20:09:45.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:44 gibba023 bash[30844]: audit 2021-03-10T20:09:44.690615+0000 mon.b (mon.2) 179 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.b"}]: dispatch 2021-03-10T20:09:45.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:44 gibba023 bash[30844]: audit 2021-03-10T20:09:44.699974+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.34466 ' entity='mgr.gibba044.wflcwh' 2021-03-10T20:09:45.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:44 gibba023 bash[30844]: audit 2021-03-10T20:09:44.702555+0000 mon.b (mon.2) 180 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:09:45.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:44 gibba023 bash[30844]: audit 2021-03-10T20:09:44.703393+0000 mon.b (mon.2) 181 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:09:45.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:44 gibba023 bash[30844]: audit 2021-03-10T20:09:44.704092+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:09:45.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:44 gibba023 bash[30844]: audit 2021-03-10T20:09:44.705066+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T20:09:45.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:44 gibba023 bash[31815]: audit 2021-03-10T20:09:44.690615+0000 mon.b (mon.2) 179 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a", "who": "mon.b"}]: dispatch 2021-03-10T20:09:45.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:44 gibba023 bash[31815]: audit 2021-03-10T20:09:44.699974+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.34466 ' entity='mgr.gibba044.wflcwh' 2021-03-10T20:09:45.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:44 gibba023 bash[31815]: audit 2021-03-10T20:09:44.702555+0000 mon.b (mon.2) 180 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:09:45.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:44 gibba023 bash[31815]: audit 2021-03-10T20:09:44.703393+0000 mon.b (mon.2) 181 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:09:45.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:44 gibba023 bash[31815]: audit 2021-03-10T20:09:44.704092+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:09:45.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:44 gibba023 bash[31815]: audit 2021-03-10T20:09:44.705066+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T20:09:46.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:45 gibba044 bash[9859]: cephadm 2021-03-10T20:09:44.690261+0000 mgr.gibba044.wflcwh (mgr.34466) 28 : cephadm [INF] Upgrade: Updating mon.b 2021-03-10T20:09:46.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:45 gibba044 bash[9859]: cephadm 2021-03-10T20:09:44.704768+0000 mgr.gibba044.wflcwh (mgr.34466) 29 : cephadm [INF] Deploying daemon mon.b on gibba044 2021-03-10T20:09:46.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:45 gibba044 bash[9859]: cluster 2021-03-10T20:09:45.239785+0000 mgr.gibba044.wflcwh (mgr.34466) 30 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:46.341 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:09:46.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:45 gibba023 bash[30844]: cephadm 2021-03-10T20:09:44.690261+0000 mgr.gibba044.wflcwh (mgr.34466) 28 : cephadm [INF] Upgrade: Updating mon.b 2021-03-10T20:09:46.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:45 gibba023 bash[30844]: cephadm 2021-03-10T20:09:44.704768+0000 mgr.gibba044.wflcwh (mgr.34466) 29 : cephadm [INF] Deploying daemon mon.b on gibba044 2021-03-10T20:09:46.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:45 gibba023 bash[30844]: cluster 2021-03-10T20:09:45.239785+0000 mgr.gibba044.wflcwh (mgr.34466) 30 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:46.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:45 gibba023 bash[31815]: cephadm 2021-03-10T20:09:44.690261+0000 mgr.gibba044.wflcwh (mgr.34466) 28 : cephadm [INF] Upgrade: Updating mon.b 2021-03-10T20:09:46.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:45 gibba023 bash[31815]: cephadm 2021-03-10T20:09:44.704768+0000 mgr.gibba044.wflcwh (mgr.34466) 29 : cephadm [INF] Deploying daemon mon.b on gibba044 2021-03-10T20:09:46.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:45 gibba023 bash[31815]: cluster 2021-03-10T20:09:45.239785+0000 mgr.gibba044.wflcwh (mgr.34466) 30 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:46.565 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:09:46.565 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (55s) 3s ago 6m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:09:46.565 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (6m) 15s ago 6m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:09:46.566 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (77s) 15s ago 9m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:09:46.566 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (94s) 15s ago 9m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:09:46.566 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (36s) 3s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:09:46.566 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (26s) 3s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:09:46.567 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (10m) 15s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 0e96acfc200a 2021-03-10T20:09:46.567 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (9s) 3s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:09:46.567 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (6m) 3s ago 6m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:09:46.567 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (6m) 15s ago 6m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:09:46.568 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (9m) 3s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a8e662729287 2021-03-10T20:09:46.568 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (9m) 3s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 aba825ce9058 2021-03-10T20:09:46.568 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (8m) 3s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 0b4c19578b20 2021-03-10T20:09:46.568 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (8m) 3s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 25229602755c 2021-03-10T20:09:46.568 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (8m) 15s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a745be9e28cb 2021-03-10T20:09:46.569 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (7m) 15s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0313bf557eb 2021-03-10T20:09:46.569 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (7m) 15s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 ffa9fe94cea1 2021-03-10T20:09:46.569 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (6m) 15s ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 082d0fe68f90 2021-03-10T20:09:46.569 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (5m) 15s ago 6m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:09:46.570 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 3s ago 4m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:09:46.570 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 15s ago 4m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:09:46.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:46 gibba044 systemd[1]: Stopping Ceph mon.b for dd719b26-81da-11eb-9080-001a4aab830c... 2021-03-10T20:09:46.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:46 gibba044 bash[9859]: debug 2021-03-10T20:09:46.691+0000 7f4a7c7ae700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T20:09:46.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:46 gibba044 bash[9859]: debug 2021-03-10T20:09:46.691+0000 7f4a7c7ae700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2021-03-10T20:09:46.816 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:09:46.816 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:09:46.817 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2021-03-10T20:09:46.817 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 2 2021-03-10T20:09:46.817 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:09:46.817 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:09:46.818 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:09:46.818 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:09:46.818 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:09:46.818 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T20:09:46.818 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:09:46.819 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:09:46.819 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:09:46.819 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 9, 2021-03-10T20:09:46.819 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 5 2021-03-10T20:09:46.820 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:09:46.820 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:09:47.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:47 gibba044 docker[25389]: ceph-dd719b26-81da-11eb-9080-001a4aab830c-mon.b 2021-03-10T20:09:47.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:47 gibba044 systemd[1]: ceph-dd719b26-81da-11eb-9080-001a4aab830c@mon.b.service: Succeeded. 2021-03-10T20:09:47.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:47 gibba044 systemd[1]: Stopped Ceph mon.b for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:09:47.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:47 gibba044 systemd[1]: Started Ceph mon.b for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:09:48.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.539+0000 7f7f14d97700 0 set uid:gid to 167:167 (ceph:ceph) 2021-03-10T20:09:48.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.539+0000 7f7f14d97700 0 ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev), process ceph-mon, pid 6 2021-03-10T20:09:48.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.539+0000 7f7f14d97700 0 pidfile_write: ignore empty --pid-file 2021-03-10T20:09:48.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 0 load: jerasure load: lrc load: isa 2021-03-10T20:09:48.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: RocksDB version: 6.8.1 2021-03-10T20:09:48.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-03-10T20:09:48.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Compile date Mar 9 2021 2021-03-10T20:09:48.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: DB SUMMARY 2021-03-10T20:09:48.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: CURRENT file: CURRENT 2021-03-10T20:09:48.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: IDENTITY file: IDENTITY 2021-03-10T20:09:48.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 765 Bytes 2021-03-10T20:09:48.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 2, files: 000022.sst 000023.sst 2021-03-10T20:09:48.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000020.log size: 27611042 ; 2021-03-10T20:09:48.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.error_if_exists: 0 2021-03-10T20:09:48.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.create_if_missing: 0 2021-03-10T20:09:48.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.paranoid_checks: 1 2021-03-10T20:09:48.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.env: 0x55d8f79041c0 2021-03-10T20:09:48.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.fs: Posix File System 2021-03-10T20:09:48.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.info_log: 0x55d8f88051e0 2021-03-10T20:09:48.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.max_file_opening_threads: 16 2021-03-10T20:09:48.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.statistics: (nil) 2021-03-10T20:09:48.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.use_fsync: 0 2021-03-10T20:09:48.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.max_log_file_size: 0 2021-03-10T20:09:48.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-03-10T20:09:48.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-03-10T20:09:48.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.keep_log_file_num: 1000 2021-03-10T20:09:48.758 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.recycle_log_file_num: 0 2021-03-10T20:09:48.761 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.allow_fallocate: 1 2021-03-10T20:09:48.761 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.allow_mmap_reads: 0 2021-03-10T20:09:48.761 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.allow_mmap_writes: 0 2021-03-10T20:09:48.761 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.use_direct_reads: 0 2021-03-10T20:09:48.762 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-03-10T20:09:48.762 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.create_missing_column_families: 0 2021-03-10T20:09:48.762 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.db_log_dir: 2021-03-10T20:09:48.762 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2021-03-10T20:09:48.763 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-03-10T20:09:48.763 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.max_subcompactions: 1 2021-03-10T20:09:48.763 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.max_background_flushes: -1 2021-03-10T20:09:48.763 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-03-10T20:09:48.763 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-03-10T20:09:48.764 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-03-10T20:09:48.764 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-03-10T20:09:48.764 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-03-10T20:09:48.764 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.advise_random_on_open: 1 2021-03-10T20:09:48.765 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.db_write_buffer_size: 0 2021-03-10T20:09:48.765 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.write_buffer_manager: 0x55d8f8859c50 2021-03-10T20:09:48.765 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-03-10T20:09:48.765 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-03-10T20:09:48.765 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-03-10T20:09:48.766 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-03-10T20:09:48.766 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.rate_limiter: (nil) 2021-03-10T20:09:48.766 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-03-10T20:09:48.766 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.wal_recovery_mode: 2 2021-03-10T20:09:48.767 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.enable_thread_tracking: 0 2021-03-10T20:09:48.767 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.enable_pipelined_write: 0 2021-03-10T20:09:48.767 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.unordered_write: 0 2021-03-10T20:09:48.767 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-03-10T20:09:48.767 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-03-10T20:09:48.768 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-03-10T20:09:48.768 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-03-10T20:09:48.768 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.row_cache: None 2021-03-10T20:09:48.768 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.wal_filter: None 2021-03-10T20:09:48.769 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-03-10T20:09:48.769 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.allow_ingest_behind: 0 2021-03-10T20:09:48.769 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.preserve_deletes: 0 2021-03-10T20:09:48.771 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.two_write_queues: 0 2021-03-10T20:09:48.771 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.manual_wal_flush: 0 2021-03-10T20:09:48.772 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.atomic_flush: 0 2021-03-10T20:09:48.772 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-03-10T20:09:48.772 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-03-10T20:09:48.773 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-03-10T20:09:48.773 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.log_readahead_size: 0 2021-03-10T20:09:48.773 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-03-10T20:09:48.773 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.max_background_jobs: 2 2021-03-10T20:09:48.774 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.max_background_compactions: -1 2021-03-10T20:09:48.774 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-03-10T20:09:48.774 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-03-10T20:09:48.774 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-03-10T20:09:48.775 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.max_total_wal_size: 0 2021-03-10T20:09:48.775 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-03-10T20:09:48.775 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-03-10T20:09:48.775 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-03-10T20:09:48.776 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-03-10T20:09:48.776 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.max_open_files: -1 2021-03-10T20:09:48.776 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.bytes_per_sync: 0 2021-03-10T20:09:48.776 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-03-10T20:09:48.776 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-03-10T20:09:48.777 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.compaction_readahead_size: 0 2021-03-10T20:09:48.777 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Compression algorithms supported: 2021-03-10T20:09:48.777 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-03-10T20:09:48.777 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: kZSTD supported: 0 2021-03-10T20:09:48.778 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: kXpressCompression supported: 0 2021-03-10T20:09:48.778 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: kLZ4HCCompression supported: 1 2021-03-10T20:09:48.778 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: kLZ4Compression supported: 1 2021-03-10T20:09:48.778 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: kBZip2Compression supported: 0 2021-03-10T20:09:48.779 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: kZlibCompression supported: 1 2021-03-10T20:09:48.779 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: kSnappyCompression supported: 1 2021-03-10T20:09:48.779 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-03-10T20:09:48.779 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2021-03-10T20:09:48.779 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-03-10T20:09:48.780 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-03-10T20:09:48.780 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.merge_operator: 2021-03-10T20:09:48.780 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.compaction_filter: None 2021-03-10T20:09:48.780 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.compaction_filter_factory: None 2021-03-10T20:09:48.781 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-03-10T20:09:48.781 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-03-10T20:09:48.781 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d8f87a8230) 2021-03-10T20:09:48.781 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: cache_index_and_filter_blocks: 1 2021-03-10T20:09:48.781 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: cache_index_and_filter_blocks_with_high_priority: 0 2021-03-10T20:09:48.782 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-03-10T20:09:48.782 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: pin_top_level_index_and_filter: 1 2021-03-10T20:09:48.783 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: index_type: 0 2021-03-10T20:09:48.783 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: data_block_index_type: 0 2021-03-10T20:09:48.783 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: index_shortening: 1 2021-03-10T20:09:48.783 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: data_block_hash_table_util_ratio: 0.750000 2021-03-10T20:09:48.784 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: hash_index_allow_collision: 1 2021-03-10T20:09:48.784 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: checksum: 1 2021-03-10T20:09:48.784 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: no_block_cache: 0 2021-03-10T20:09:48.784 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: block_cache: 0x55d8f87e0510 2021-03-10T20:09:48.785 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: block_cache_name: BinnedLRUCache 2021-03-10T20:09:48.785 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: block_cache_options: 2021-03-10T20:09:48.785 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: capacity : 536870912 2021-03-10T20:09:48.785 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: num_shard_bits : 4 2021-03-10T20:09:48.785 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: strict_capacity_limit : 0 2021-03-10T20:09:48.786 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: high_pri_pool_ratio: 0.000 2021-03-10T20:09:48.786 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: block_cache_compressed: (nil) 2021-03-10T20:09:48.786 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: persistent_cache: (nil) 2021-03-10T20:09:48.786 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: block_size: 4096 2021-03-10T20:09:48.787 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: block_size_deviation: 10 2021-03-10T20:09:48.787 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: block_restart_interval: 16 2021-03-10T20:09:48.787 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: index_block_restart_interval: 1 2021-03-10T20:09:48.787 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: metadata_block_size: 4096 2021-03-10T20:09:48.787 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: partition_filters: 0 2021-03-10T20:09:48.788 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: use_delta_encoding: 1 2021-03-10T20:09:48.788 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: filter_policy: rocksdb.BuiltinBloomFilter 2021-03-10T20:09:48.788 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: whole_key_filtering: 1 2021-03-10T20:09:48.788 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: verify_compression: 0 2021-03-10T20:09:48.788 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: read_amp_bytes_per_bit: 0 2021-03-10T20:09:48.789 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: format_version: 2 2021-03-10T20:09:48.789 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: enable_index_compression: 1 2021-03-10T20:09:48.789 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: block_align: 0 2021-03-10T20:09:48.789 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.write_buffer_size: 33554432 2021-03-10T20:09:48.790 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.max_write_buffer_number: 2 2021-03-10T20:09:48.790 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.compression: NoCompression 2021-03-10T20:09:48.790 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.bottommost_compression: Disabled 2021-03-10T20:09:48.790 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.prefix_extractor: nullptr 2021-03-10T20:09:48.790 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-03-10T20:09:48.791 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.num_levels: 7 2021-03-10T20:09:48.791 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-03-10T20:09:48.791 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-03-10T20:09:48.791 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-03-10T20:09:48.792 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-03-10T20:09:48.792 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-03-10T20:09:48.792 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-03-10T20:09:48.793 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-03-10T20:09:48.793 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-03-10T20:09:48.793 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-03-10T20:09:48.793 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-03-10T20:09:48.794 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.compression_opts.level: 32767 2021-03-10T20:09:48.794 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.compression_opts.strategy: 0 2021-03-10T20:09:48.794 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-03-10T20:09:48.794 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-03-10T20:09:48.795 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.compression_opts.enabled: false 2021-03-10T20:09:48.795 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-03-10T20:09:48.795 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-03-10T20:09:48.795 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-03-10T20:09:48.795 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.target_file_size_base: 67108864 2021-03-10T20:09:48.796 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-03-10T20:09:48.797 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-03-10T20:09:48.797 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-03-10T20:09:48.797 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-03-10T20:09:48.798 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-03-10T20:09:48.798 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-03-10T20:09:48.798 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-03-10T20:09:48.798 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-03-10T20:09:48.799 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-03-10T20:09:48.799 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-03-10T20:09:48.799 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-03-10T20:09:48.799 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-03-10T20:09:48.800 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-03-10T20:09:48.800 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.arena_block_size: 4194304 2021-03-10T20:09:48.800 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-03-10T20:09:48.800 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-03-10T20:09:48.801 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-03-10T20:09:48.801 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.disable_auto_compactions: 0 2021-03-10T20:09:48.801 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-03-10T20:09:48.801 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-03-10T20:09:48.801 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-03-10T20:09:48.802 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-03-10T20:09:48.802 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-03-10T20:09:48.802 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-03-10T20:09:48.803 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-03-10T20:09:48.803 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-03-10T20:09:48.803 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-03-10T20:09:48.803 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-03-10T20:09:48.803 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.table_properties_collectors: 2021-03-10T20:09:48.804 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.inplace_update_support: 0 2021-03-10T20:09:48.804 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-03-10T20:09:48.804 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-03-10T20:09:48.804 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-03-10T20:09:48.805 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-03-10T20:09:48.805 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.bloom_locality: 0 2021-03-10T20:09:48.806 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.max_successive_merges: 0 2021-03-10T20:09:48.807 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-03-10T20:09:48.807 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.paranoid_file_checks: 0 2021-03-10T20:09:48.808 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.force_consistency_checks: 0 2021-03-10T20:09:48.808 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.report_bg_io_stats: 0 2021-03-10T20:09:48.809 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.ttl: 2592000 2021-03-10T20:09:48.809 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-03-10T20:09:48.809 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 25, last_sequence is 9159, log_number is 20,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-03-10T20:09:48.810 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 20 2021-03-10T20:09:48.810 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615406988549712, "job": 1, "event": "recovery_started", "log_files": [20]} 2021-03-10T20:09:48.810 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.543+0000 7f7f14d97700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #20 mode 2 2021-03-10T20:09:48.810 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.555+0000 7f7f14d97700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-03-10T20:09:48.811 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.571+0000 7f7f14d97700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615406988576383, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 25, "file_size": 18183757, "table_properties": {"data_size": 18174888, "index_size": 7085, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 965, "raw_key_size": 8138, "raw_average_key_size": 22, "raw_value_size": 18164016, "raw_average_value_size": 49901, "num_data_blocks": 222, "num_entries": 364, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1615406988, "oldest_key_time": 3, "file_creation_time": 0}} 2021-03-10T20:09:48.811 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.571+0000 7f7f14d97700 4 rocksdb: [version_set.cc:3826] Creating manifest 26 2021-03-10T20:09:48.811 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.571+0000 7f7f14d97700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1615406988577343, "job": 1, "event": "recovery_finished"} 2021-03-10T20:09:48.811 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.571+0000 7f7f14d97700 4 rocksdb: DB pointer 0x55d8f88a5800 2021-03-10T20:09:48.812 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.571+0000 7f7efbbaa700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-03-10T20:09:48.812 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.571+0000 7f7efbbaa700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-03-10T20:09:48.812 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: ** DB Stats ** 2021-03-10T20:09:48.812 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T20:09:48.813 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-03-10T20:09:48.813 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-03-10T20:09:48.815 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T20:09:48.815 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-03-10T20:09:48.816 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-03-10T20:09:48.816 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-03-10T20:09:48.816 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: ** Compaction Stats [default] ** 2021-03-10T20:09:48.816 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:09:48.816 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:09:48.817 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: L0 1/0 17.34 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1209.0 0.01 0.00 1 0.014 0 0 2021-03-10T20:09:48.817 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: L6 2/0 69.36 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T20:09:48.817 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: Sum 3/0 86.71 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1209.0 0.01 0.00 1 0.014 0 0 2021-03-10T20:09:48.817 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1209.0 0.01 0.00 1 0.014 0 0 2021-03-10T20:09:48.818 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: ** Compaction Stats [default] ** 2021-03-10T20:09:48.818 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:09:48.818 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:09:48.818 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1209.0 0.01 0.00 1 0.014 0 0 2021-03-10T20:09:48.818 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T20:09:48.819 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: Flush(GB): cumulative 0.017, interval 0.017 2021-03-10T20:09:48.819 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T20:09:48.819 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T20:09:48.819 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T20:09:48.820 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T20:09:48.820 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: Cumulative compaction: 0.02 GB write, 576.82 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:09:48.820 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: Interval compaction: 0.02 GB write, 576.82 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:09:48.820 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T20:09:48.820 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T20:09:48.821 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: ** Compaction Stats [default] ** 2021-03-10T20:09:48.821 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:09:48.821 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:09:48.821 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: L0 1/0 17.34 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1209.0 0.01 0.00 1 0.014 0 0 2021-03-10T20:09:48.821 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: L6 2/0 69.36 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T20:09:48.822 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: Sum 3/0 86.71 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1209.0 0.01 0.00 1 0.014 0 0 2021-03-10T20:09:48.822 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-03-10T20:09:48.822 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: ** Compaction Stats [default] ** 2021-03-10T20:09:48.822 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-03-10T20:09:48.823 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-03-10T20:09:48.823 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1209.0 0.01 0.00 1 0.014 0 0 2021-03-10T20:09:48.823 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: Uptime(secs): 0.0 total, 0.0 interval 2021-03-10T20:09:48.823 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: Flush(GB): cumulative 0.017, interval 0.000 2021-03-10T20:09:48.823 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: AddFile(GB): cumulative 0.000, interval 0.000 2021-03-10T20:09:48.824 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: AddFile(Total Files): cumulative 0, interval 0 2021-03-10T20:09:48.824 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: AddFile(L0 Files): cumulative 0, interval 0 2021-03-10T20:09:48.824 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: AddFile(Keys): cumulative 0, interval 0 2021-03-10T20:09:48.824 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: Cumulative compaction: 0.02 GB write, 576.34 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:09:48.825 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-03-10T20:09:48.825 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-03-10T20:09:48.825 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: ** File Read Latency Histogram By Level [default] ** 2021-03-10T20:09:48.825 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.575+0000 7f7f14d97700 0 starting mon.b rank 2 at public addrs [v2:172.21.2.144:3300/0,v1:172.21.2.144:6789/0] at bind addrs [v2:172.21.2.144:3300/0,v1:172.21.2.144:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid dd719b26-81da-11eb-9080-001a4aab830c 2021-03-10T20:09:48.825 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.575+0000 7f7f14d97700 1 mon.b@-1(???) e3 preinit fsid dd719b26-81da-11eb-9080-001a4aab830c 2021-03-10T20:09:48.826 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.575+0000 7f7f14d97700 0 mon.b@-1(???).mds e1 new map 2021-03-10T20:09:48.826 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.575+0000 7f7f14d97700 0 mon.b@-1(???).mds e1 print_map 2021-03-10T20:09:48.826 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: e1 2021-03-10T20:09:48.826 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: enable_multiple, ever_enabled_multiple: 0,0 2021-03-10T20:09:48.827 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-03-10T20:09:48.827 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: legacy client fscid: -1 2021-03-10T20:09:48.827 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: 2021-03-10T20:09:48.827 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: No filesystems configured 2021-03-10T20:09:48.827 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.575+0000 7f7f14d97700 0 mon.b@-1(???).osd e62 crush map has features 3314933000852226048, adjusting msgr requires 2021-03-10T20:09:48.828 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.575+0000 7f7f14d97700 0 mon.b@-1(???).osd e62 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T20:09:48.828 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.575+0000 7f7f14d97700 0 mon.b@-1(???).osd e62 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T20:09:48.828 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.575+0000 7f7f14d97700 0 mon.b@-1(???).osd e62 crush map has features 288514051259236352, adjusting msgr requires 2021-03-10T20:09:48.828 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: cephadm 2021-03-10T20:09:44.690261+0000 mgr.gibba044.wflcwh (mgr.34466) 28 : cephadm [INF] Upgrade: Updating mon.b 2021-03-10T20:09:48.828 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: cephadm 2021-03-10T20:09:44.704768+0000 mgr.gibba044.wflcwh (mgr.34466) 29 : cephadm [INF] Deploying daemon mon.b on gibba044 2021-03-10T20:09:48.829 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: cluster 2021-03-10T20:09:45.239785+0000 mgr.gibba044.wflcwh (mgr.34466) 30 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:48.829 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:48 gibba044 bash[25485]: debug 2021-03-10T20:09:48.575+0000 7f7f14d97700 1 mon.b@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2021-03-10T20:09:50.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:50 gibba023 bash[31815]: audit 2021-03-10T20:09:46.331526+0000 mgr.gibba044.wflcwh (mgr.34466) 31 : audit [DBG] from='client.44124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:09:50.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:50 gibba023 bash[31815]: audit 2021-03-10T20:09:46.557925+0000 mgr.gibba044.wflcwh (mgr.34466) 32 : audit [DBG] from='client.54109 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:09:50.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:50 gibba023 bash[31815]: audit 2021-03-10T20:09:46.816202+0000 mon.a (mon.0) 50 : audit [DBG] from='client.? 172.21.2.123:0/2416184056' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:09:50.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:50 gibba023 bash[30844]: audit 2021-03-10T20:09:46.331526+0000 mgr.gibba044.wflcwh (mgr.34466) 31 : audit [DBG] from='client.44124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:09:50.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:50 gibba023 bash[30844]: audit 2021-03-10T20:09:46.557925+0000 mgr.gibba044.wflcwh (mgr.34466) 32 : audit [DBG] from='client.54109 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:09:50.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:50 gibba023 bash[30844]: audit 2021-03-10T20:09:46.816202+0000 mon.a (mon.0) 50 : audit [DBG] from='client.? 172.21.2.123:0/2416184056' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:09:50.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:50 gibba023 bash[30844]: debug 2021-03-10T20:09:50.009+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:50.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:50 gibba023 bash[30844]: debug 2021-03-10T20:09:50.009+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:09:50.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:50 gibba023 bash[30844]: debug 2021-03-10T20:09:50.009+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba023.rsfdop on gibba023 is in error state 2021-03-10T20:09:50.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:50 gibba023 bash[30844]: debug 2021-03-10T20:09:50.009+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba044.rblqpl on gibba044 is in error state 2021-03-10T20:09:50.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:50 gibba023 bash[30844]: debug 2021-03-10T20:09:50.009+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:50.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:50 gibba023 bash[30844]: debug 2021-03-10T20:09:50.009+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:50.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:50 gibba044 bash[25485]: audit 2021-03-10T20:09:46.331526+0000 mgr.gibba044.wflcwh (mgr.34466) 31 : audit [DBG] from='client.44124 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:09:50.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:50 gibba044 bash[25485]: audit 2021-03-10T20:09:46.557925+0000 mgr.gibba044.wflcwh (mgr.34466) 32 : audit [DBG] from='client.54109 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:09:50.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:50 gibba044 bash[25485]: audit 2021-03-10T20:09:46.816202+0000 mon.a (mon.0) 50 : audit [DBG] from='client.? 172.21.2.123:0/2416184056' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:09:55.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: debug 2021-03-10T20:09:55.025+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',); 1/3 mons down, quorum a,c 2021-03-10T20:09:55.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: debug 2021-03-10T20:09:55.025+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:09:55.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: debug 2021-03-10T20:09:55.025+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba023.rsfdop on gibba023 is in error state 2021-03-10T20:09:55.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: debug 2021-03-10T20:09:55.025+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba044.rblqpl on gibba044 is in error state 2021-03-10T20:09:55.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: debug 2021-03-10T20:09:55.025+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:55.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: debug 2021-03-10T20:09:55.025+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:55.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: debug 2021-03-10T20:09:55.025+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2021-03-10T20:09:55.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: debug 2021-03-10T20:09:55.025+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : mon.b (rank 2) addr [v2:172.21.2.144:3300/0,v1:172.21.2.144:6789/0] is down (out of quorum) 2021-03-10T20:09:55.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: cluster 2021-03-10T20:09:50.013177+0000 mon.a (mon.0) 57 : cluster [ERR] Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:55.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: cluster 2021-03-10T20:09:50.013186+0000 mon.a (mon.0) 58 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:09:55.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: cluster 2021-03-10T20:09:50.013193+0000 mon.a (mon.0) 59 : cluster [ERR] daemon rgw.r.z.gibba023.rsfdop on gibba023 is in error state 2021-03-10T20:09:55.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: cluster 2021-03-10T20:09:50.013199+0000 mon.a (mon.0) 60 : cluster [ERR] daemon rgw.r.z.gibba044.rblqpl on gibba044 is in error state 2021-03-10T20:09:55.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: cluster 2021-03-10T20:09:50.013207+0000 mon.a (mon.0) 61 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:55.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: cluster 2021-03-10T20:09:50.013213+0000 mon.a (mon.0) 62 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:55.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: cluster 2021-03-10T20:09:50.013615+0000 mon.a (mon.0) 63 : cluster [INF] mon.a calling monitor election 2021-03-10T20:09:55.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: cluster 2021-03-10T20:09:50.013628+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-03-10T20:09:55.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: cluster 2021-03-10T20:09:51.244036+0000 mgr.gibba044.wflcwh (mgr.34466) 35 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:55.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: cluster 2021-03-10T20:09:53.246172+0000 mgr.gibba044.wflcwh (mgr.34466) 36 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:55.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: cluster 2021-03-10T20:09:55.015480+0000 mon.a (mon.0) 64 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-03-10T20:09:55.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: cluster 2021-03-10T20:09:55.024517+0000 mon.a (mon.0) 65 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0],b=[v2:172.21.2.144:3300/0,v1:172.21.2.144:6789/0],c=[v2:172.21.2.123:3301/0,v1:172.21.2.123:6790/0]} 2021-03-10T20:09:55.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: cluster 2021-03-10T20:09:55.024647+0000 mon.a (mon.0) 66 : cluster [DBG] fsmap 2021-03-10T20:09:55.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[31815]: cluster 2021-03-10T20:09:50.013177+0000 mon.a (mon.0) 57 : cluster [ERR] Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:55.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[31815]: cluster 2021-03-10T20:09:50.013186+0000 mon.a (mon.0) 58 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:09:55.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[31815]: cluster 2021-03-10T20:09:50.013193+0000 mon.a (mon.0) 59 : cluster [ERR] daemon rgw.r.z.gibba023.rsfdop on gibba023 is in error state 2021-03-10T20:09:55.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[31815]: cluster 2021-03-10T20:09:50.013199+0000 mon.a (mon.0) 60 : cluster [ERR] daemon rgw.r.z.gibba044.rblqpl on gibba044 is in error state 2021-03-10T20:09:55.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[31815]: cluster 2021-03-10T20:09:50.013207+0000 mon.a (mon.0) 61 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:55.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[31815]: cluster 2021-03-10T20:09:50.013213+0000 mon.a (mon.0) 62 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:55.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[31815]: cluster 2021-03-10T20:09:50.013615+0000 mon.a (mon.0) 63 : cluster [INF] mon.a calling monitor election 2021-03-10T20:09:55.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[31815]: cluster 2021-03-10T20:09:50.013628+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-03-10T20:09:55.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[31815]: cluster 2021-03-10T20:09:51.244036+0000 mgr.gibba044.wflcwh (mgr.34466) 35 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:55.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[31815]: cluster 2021-03-10T20:09:53.246172+0000 mgr.gibba044.wflcwh (mgr.34466) 36 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:55.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[31815]: cluster 2021-03-10T20:09:55.015480+0000 mon.a (mon.0) 64 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-03-10T20:09:55.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[31815]: cluster 2021-03-10T20:09:55.024517+0000 mon.a (mon.0) 65 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0],b=[v2:172.21.2.144:3300/0,v1:172.21.2.144:6789/0],c=[v2:172.21.2.123:3301/0,v1:172.21.2.123:6790/0]} 2021-03-10T20:09:55.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[31815]: cluster 2021-03-10T20:09:55.024647+0000 mon.a (mon.0) 66 : cluster [DBG] fsmap 2021-03-10T20:09:55.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[31815]: cluster 2021-03-10T20:09:55.024705+0000 mon.a (mon.0) 67 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T20:09:55.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[31815]: cluster 2021-03-10T20:09:55.024978+0000 mon.a (mon.0) 68 : cluster [DBG] mgrmap e25: gibba044.wflcwh(active, since 28s), standbys: y, x 2021-03-10T20:09:55.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[31815]: cluster 2021-03-10T20:09:55.025106+0000 mon.a (mon.0) 69 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2021-03-10T20:09:55.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[31815]: cluster 2021-03-10T20:09:55.028601+0000 mon.a (mon.0) 70 : cluster [ERR] Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',); 1/3 mons down, quorum a,c 2021-03-10T20:09:55.436 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[31815]: cluster 2021-03-10T20:09:55.028610+0000 mon.a (mon.0) 71 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:09:55.436 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[31815]: cluster 2021-03-10T20:09:55.028616+0000 mon.a (mon.0) 72 : cluster [ERR] daemon rgw.r.z.gibba023.rsfdop on gibba023 is in error state 2021-03-10T20:09:55.436 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[31815]: cluster 2021-03-10T20:09:55.028620+0000 mon.a (mon.0) 73 : cluster [ERR] daemon rgw.r.z.gibba044.rblqpl on gibba044 is in error state 2021-03-10T20:09:55.437 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[31815]: cluster 2021-03-10T20:09:55.028624+0000 mon.a (mon.0) 74 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:55.437 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[31815]: cluster 2021-03-10T20:09:55.028647+0000 mon.a (mon.0) 75 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:55.437 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[31815]: cluster 2021-03-10T20:09:55.028669+0000 mon.a (mon.0) 76 : cluster [ERR] [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2021-03-10T20:09:55.438 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[31815]: cluster 2021-03-10T20:09:55.028678+0000 mon.a (mon.0) 77 : cluster [ERR] mon.b (rank 2) addr [v2:172.21.2.144:3300/0,v1:172.21.2.144:6789/0] is down (out of quorum) 2021-03-10T20:09:55.438 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[31815]: audit 2021-03-10T20:09:55.031338+0000 mon.a (mon.0) 78 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:09:55.438 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[31815]: audit 2021-03-10T20:09:55.038228+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:09:55.439 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: cluster 2021-03-10T20:09:55.024705+0000 mon.a (mon.0) 67 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T20:09:55.439 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: cluster 2021-03-10T20:09:55.024978+0000 mon.a (mon.0) 68 : cluster [DBG] mgrmap e25: gibba044.wflcwh(active, since 28s), standbys: y, x 2021-03-10T20:09:55.440 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: cluster 2021-03-10T20:09:55.025106+0000 mon.a (mon.0) 69 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2021-03-10T20:09:55.440 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: cluster 2021-03-10T20:09:55.028601+0000 mon.a (mon.0) 70 : cluster [ERR] Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',); 1/3 mons down, quorum a,c 2021-03-10T20:09:55.441 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: cluster 2021-03-10T20:09:55.028610+0000 mon.a (mon.0) 71 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:09:55.441 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: cluster 2021-03-10T20:09:55.028616+0000 mon.a (mon.0) 72 : cluster [ERR] daemon rgw.r.z.gibba023.rsfdop on gibba023 is in error state 2021-03-10T20:09:55.441 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: cluster 2021-03-10T20:09:55.028620+0000 mon.a (mon.0) 73 : cluster [ERR] daemon rgw.r.z.gibba044.rblqpl on gibba044 is in error state 2021-03-10T20:09:55.442 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: cluster 2021-03-10T20:09:55.028624+0000 mon.a (mon.0) 74 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:55.442 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: cluster 2021-03-10T20:09:55.028647+0000 mon.a (mon.0) 75 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:55.443 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: cluster 2021-03-10T20:09:55.028669+0000 mon.a (mon.0) 76 : cluster [ERR] [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2021-03-10T20:09:55.443 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: cluster 2021-03-10T20:09:55.028678+0000 mon.a (mon.0) 77 : cluster [ERR] mon.b (rank 2) addr [v2:172.21.2.144:3300/0,v1:172.21.2.144:6789/0] is down (out of quorum) 2021-03-10T20:09:55.444 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: audit 2021-03-10T20:09:55.031338+0000 mon.a (mon.0) 78 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:09:55.444 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:55 gibba023 bash[30844]: audit 2021-03-10T20:09:55.038228+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:09:56.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:56 gibba023 bash[30844]: cluster 2021-03-10T20:09:55.246761+0000 mgr.gibba044.wflcwh (mgr.34466) 37 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:56.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:56 gibba023 bash[31815]: cluster 2021-03-10T20:09:55.246761+0000 mgr.gibba044.wflcwh (mgr.34466) 37 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:57.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:57 gibba023 bash[30844]: debug 2021-03-10T20:09:57.665+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:57.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:57 gibba023 bash[30844]: debug 2021-03-10T20:09:57.665+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:09:57.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:57 gibba023 bash[30844]: debug 2021-03-10T20:09:57.665+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba023.rsfdop on gibba023 is in error state 2021-03-10T20:09:57.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:57 gibba023 bash[30844]: debug 2021-03-10T20:09:57.665+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : daemon rgw.r.z.gibba044.rblqpl on gibba044 is in error state 2021-03-10T20:09:57.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:57 gibba023 bash[30844]: debug 2021-03-10T20:09:57.665+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:57.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:57 gibba023 bash[30844]: debug 2021-03-10T20:09:57.665+0000 7fa7f9e51700 -1 log_channel(cluster) log [ERR] : Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:58.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:57 gibba044 bash[25485]: cluster 2021-03-10T20:09:55.246761+0000 mgr.gibba044.wflcwh (mgr.34466) 37 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:09:58.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[30844]: cluster 2021-03-10T20:09:50.015695+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-03-10T20:09:58.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[30844]: cluster 2021-03-10T20:09:57.627139+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2021-03-10T20:09:58.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[30844]: cluster 2021-03-10T20:09:57.627247+0000 mon.a (mon.0) 80 : cluster [INF] mon.a calling monitor election 2021-03-10T20:09:58.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[30844]: cluster 2021-03-10T20:09:57.651990+0000 mon.a (mon.0) 81 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T20:09:58.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[30844]: cluster 2021-03-10T20:09:57.661007+0000 mon.a (mon.0) 82 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0],b=[v2:172.21.2.144:3300/0,v1:172.21.2.144:6789/0],c=[v2:172.21.2.123:3301/0,v1:172.21.2.123:6790/0]} 2021-03-10T20:09:58.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[30844]: cluster 2021-03-10T20:09:57.661033+0000 mon.a (mon.0) 83 : cluster [DBG] fsmap 2021-03-10T20:09:58.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[30844]: cluster 2021-03-10T20:09:57.661045+0000 mon.a (mon.0) 84 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T20:09:58.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[30844]: cluster 2021-03-10T20:09:57.661329+0000 mon.a (mon.0) 85 : cluster [DBG] mgrmap e25: gibba044.wflcwh(active, since 31s), standbys: y, x 2021-03-10T20:09:58.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[30844]: cluster 2021-03-10T20:09:57.661418+0000 mon.a (mon.0) 86 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2021-03-10T20:09:58.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[30844]: cluster 2021-03-10T20:09:57.667303+0000 mon.a (mon.0) 87 : cluster [ERR] Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:58.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[30844]: cluster 2021-03-10T20:09:57.667314+0000 mon.a (mon.0) 88 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:09:58.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[30844]: cluster 2021-03-10T20:09:57.667319+0000 mon.a (mon.0) 89 : cluster [ERR] daemon rgw.r.z.gibba023.rsfdop on gibba023 is in error state 2021-03-10T20:09:58.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[30844]: cluster 2021-03-10T20:09:57.667323+0000 mon.a (mon.0) 90 : cluster [ERR] daemon rgw.r.z.gibba044.rblqpl on gibba044 is in error state 2021-03-10T20:09:58.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[30844]: cluster 2021-03-10T20:09:57.667327+0000 mon.a (mon.0) 91 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:58.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[30844]: cluster 2021-03-10T20:09:57.667332+0000 mon.a (mon.0) 92 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:58.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[31815]: cluster 2021-03-10T20:09:50.015695+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-03-10T20:09:58.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[31815]: cluster 2021-03-10T20:09:57.627139+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2021-03-10T20:09:58.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[31815]: cluster 2021-03-10T20:09:57.627247+0000 mon.a (mon.0) 80 : cluster [INF] mon.a calling monitor election 2021-03-10T20:09:58.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[31815]: cluster 2021-03-10T20:09:57.651990+0000 mon.a (mon.0) 81 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T20:09:58.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[31815]: cluster 2021-03-10T20:09:57.661007+0000 mon.a (mon.0) 82 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0],b=[v2:172.21.2.144:3300/0,v1:172.21.2.144:6789/0],c=[v2:172.21.2.123:3301/0,v1:172.21.2.123:6790/0]} 2021-03-10T20:09:58.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[31815]: cluster 2021-03-10T20:09:57.661033+0000 mon.a (mon.0) 83 : cluster [DBG] fsmap 2021-03-10T20:09:58.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[31815]: cluster 2021-03-10T20:09:57.661045+0000 mon.a (mon.0) 84 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T20:09:58.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[31815]: cluster 2021-03-10T20:09:57.661329+0000 mon.a (mon.0) 85 : cluster [DBG] mgrmap e25: gibba044.wflcwh(active, since 31s), standbys: y, x 2021-03-10T20:09:58.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[31815]: cluster 2021-03-10T20:09:57.661418+0000 mon.a (mon.0) 86 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2021-03-10T20:09:58.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[31815]: cluster 2021-03-10T20:09:57.667303+0000 mon.a (mon.0) 87 : cluster [ERR] Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:58.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[31815]: cluster 2021-03-10T20:09:57.667314+0000 mon.a (mon.0) 88 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:09:58.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[31815]: cluster 2021-03-10T20:09:57.667319+0000 mon.a (mon.0) 89 : cluster [ERR] daemon rgw.r.z.gibba023.rsfdop on gibba023 is in error state 2021-03-10T20:09:58.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[31815]: cluster 2021-03-10T20:09:57.667323+0000 mon.a (mon.0) 90 : cluster [ERR] daemon rgw.r.z.gibba044.rblqpl on gibba044 is in error state 2021-03-10T20:09:58.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[31815]: cluster 2021-03-10T20:09:57.667327+0000 mon.a (mon.0) 91 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:58.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:58 gibba023 bash[31815]: cluster 2021-03-10T20:09:57.667332+0000 mon.a (mon.0) 92 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:58.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:58 gibba044 bash[25485]: cluster 2021-03-10T20:09:50.015695+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-03-10T20:09:58.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:58 gibba044 bash[25485]: cluster 2021-03-10T20:09:57.627139+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2021-03-10T20:09:58.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:58 gibba044 bash[25485]: cluster 2021-03-10T20:09:57.627247+0000 mon.a (mon.0) 80 : cluster [INF] mon.a calling monitor election 2021-03-10T20:09:58.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:58 gibba044 bash[25485]: cluster 2021-03-10T20:09:57.651990+0000 mon.a (mon.0) 81 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-03-10T20:09:58.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:58 gibba044 bash[25485]: cluster 2021-03-10T20:09:57.661007+0000 mon.a (mon.0) 82 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.2.123:3300/0,v1:172.21.2.123:6789/0],b=[v2:172.21.2.144:3300/0,v1:172.21.2.144:6789/0],c=[v2:172.21.2.123:3301/0,v1:172.21.2.123:6790/0]} 2021-03-10T20:09:58.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:58 gibba044 bash[25485]: cluster 2021-03-10T20:09:57.661033+0000 mon.a (mon.0) 83 : cluster [DBG] fsmap 2021-03-10T20:09:58.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:58 gibba044 bash[25485]: cluster 2021-03-10T20:09:57.661045+0000 mon.a (mon.0) 84 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-03-10T20:09:58.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:58 gibba044 bash[25485]: cluster 2021-03-10T20:09:57.661329+0000 mon.a (mon.0) 85 : cluster [DBG] mgrmap e25: gibba044.wflcwh(active, since 31s), standbys: y, x 2021-03-10T20:09:58.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:58 gibba044 bash[25485]: cluster 2021-03-10T20:09:57.661418+0000 mon.a (mon.0) 86 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2021-03-10T20:09:58.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:58 gibba044 bash[25485]: cluster 2021-03-10T20:09:57.667303+0000 mon.a (mon.0) 87 : cluster [ERR] Health detail: HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:58.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:58 gibba044 bash[25485]: cluster 2021-03-10T20:09:57.667314+0000 mon.a (mon.0) 88 : cluster [ERR] [WRN] CEPHADM_FAILED_DAEMON: 2 failed cephadm daemon(s) 2021-03-10T20:09:58.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:58 gibba044 bash[25485]: cluster 2021-03-10T20:09:57.667319+0000 mon.a (mon.0) 89 : cluster [ERR] daemon rgw.r.z.gibba023.rsfdop on gibba023 is in error state 2021-03-10T20:09:58.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:58 gibba044 bash[25485]: cluster 2021-03-10T20:09:57.667323+0000 mon.a (mon.0) 90 : cluster [ERR] daemon rgw.r.z.gibba044.rblqpl on gibba044 is in error state 2021-03-10T20:09:58.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:58 gibba044 bash[25485]: cluster 2021-03-10T20:09:57.667327+0000 mon.a (mon.0) 91 : cluster [ERR] [ERR] MGR_MODULE_ERROR: Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:09:58.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:58 gibba044 bash[25485]: cluster 2021-03-10T20:09:57.667332+0000 mon.a (mon.0) 92 : cluster [ERR] Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:10:00.153 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:59 gibba023 bash[30844]: audit 2021-03-10T20:09:58.835641+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:00.153 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:59 gibba023 bash[30844]: audit 2021-03-10T20:09:58.839531+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:00.154 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:59 gibba023 bash[30844]: audit 2021-03-10T20:09:58.842534+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:10:00.154 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:59 gibba023 bash[30844]: cephadm 2021-03-10T20:09:58.843451+0000 mgr.gibba044.wflcwh (mgr.34466) 39 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-03-10T20:10:00.154 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:59 gibba023 bash[30844]: audit 2021-03-10T20:09:58.843638+0000 mon.a (mon.0) 96 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:10:00.154 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:59 gibba023 bash[30844]: audit 2021-03-10T20:09:58.844913+0000 mon.a (mon.0) 97 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:00.155 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:59 gibba023 bash[30844]: audit 2021-03-10T20:09:58.846074+0000 mon.a (mon.0) 98 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T20:10:00.155 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:59 gibba023 bash[30844]: cephadm 2021-03-10T20:09:58.846998+0000 mgr.gibba044.wflcwh (mgr.34466) 40 : cephadm [INF] Reconfiguring daemon mon.a on gibba023 2021-03-10T20:10:00.155 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:09:59 gibba023 bash[30844]: cluster 2021-03-10T20:09:59.249532+0000 mgr.gibba044.wflcwh (mgr.34466) 41 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:00.155 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:00 gibba023 bash[30844]: debug 2021-03-10T20:09:59.997+0000 7fa7fde59700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:10:00.156 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:59 gibba023 bash[31815]: audit 2021-03-10T20:09:58.835641+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:00.156 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:59 gibba023 bash[31815]: audit 2021-03-10T20:09:58.839531+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:00.156 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:59 gibba023 bash[31815]: audit 2021-03-10T20:09:58.842534+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:10:00.156 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:59 gibba023 bash[31815]: cephadm 2021-03-10T20:09:58.843451+0000 mgr.gibba044.wflcwh (mgr.34466) 39 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-03-10T20:10:00.157 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:59 gibba023 bash[31815]: audit 2021-03-10T20:09:58.843638+0000 mon.a (mon.0) 96 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:10:00.157 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:59 gibba023 bash[31815]: audit 2021-03-10T20:09:58.844913+0000 mon.a (mon.0) 97 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:00.157 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:59 gibba023 bash[31815]: audit 2021-03-10T20:09:58.846074+0000 mon.a (mon.0) 98 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T20:10:00.157 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:59 gibba023 bash[31815]: cephadm 2021-03-10T20:09:58.846998+0000 mgr.gibba044.wflcwh (mgr.34466) 40 : cephadm [INF] Reconfiguring daemon mon.a on gibba023 2021-03-10T20:10:00.158 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:09:59 gibba023 bash[31815]: cluster 2021-03-10T20:09:59.249532+0000 mgr.gibba044.wflcwh (mgr.34466) 41 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:00.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:59 gibba044 bash[25485]: audit 2021-03-10T20:09:58.835641+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:00.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:59 gibba044 bash[25485]: audit 2021-03-10T20:09:58.839531+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:00.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:59 gibba044 bash[25485]: audit 2021-03-10T20:09:58.842534+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:10:00.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:59 gibba044 bash[25485]: cephadm 2021-03-10T20:09:58.843451+0000 mgr.gibba044.wflcwh (mgr.34466) 39 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-03-10T20:10:00.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:59 gibba044 bash[25485]: audit 2021-03-10T20:09:58.843638+0000 mon.a (mon.0) 96 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:10:00.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:59 gibba044 bash[25485]: audit 2021-03-10T20:09:58.844913+0000 mon.a (mon.0) 97 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:00.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:59 gibba044 bash[25485]: audit 2021-03-10T20:09:58.846074+0000 mon.a (mon.0) 98 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2021-03-10T20:10:00.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:59 gibba044 bash[25485]: cephadm 2021-03-10T20:09:58.846998+0000 mgr.gibba044.wflcwh (mgr.34466) 40 : cephadm [INF] Reconfiguring daemon mon.a on gibba023 2021-03-10T20:10:00.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:09:59 gibba044 bash[25485]: cluster 2021-03-10T20:09:59.249532+0000 mgr.gibba044.wflcwh (mgr.34466) 41 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:01.116 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:00 gibba023 bash[30844]: cluster 2021-03-10T20:10:00.000164+0000 mon.a (mon.0) 99 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:10:01.117 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:00 gibba023 bash[31815]: cluster 2021-03-10T20:10:00.000164+0000 mon.a (mon.0) 99 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:10:01.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:00 gibba044 bash[25485]: cluster 2021-03-10T20:10:00.000164+0000 mon.a (mon.0) 99 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:10:02.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:01 gibba044 bash[25485]: audit 2021-03-10T20:10:00.927515+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:02.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:01 gibba044 bash[25485]: audit 2021-03-10T20:10:00.930015+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:10:02.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:01 gibba044 bash[25485]: cephadm 2021-03-10T20:10:00.930719+0000 mgr.gibba044.wflcwh (mgr.34466) 42 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-03-10T20:10:02.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:01 gibba044 bash[25485]: audit 2021-03-10T20:10:00.932359+0000 mon.a (mon.0) 102 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T20:10:02.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:01 gibba044 bash[25485]: audit 2021-03-10T20:10:00.935008+0000 mon.a (mon.0) 103 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:02.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:01 gibba044 bash[25485]: audit 2021-03-10T20:10:00.938446+0000 mon.a (mon.0) 104 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T20:10:02.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:01 gibba044 bash[25485]: cephadm 2021-03-10T20:10:00.938697+0000 mgr.gibba044.wflcwh (mgr.34466) 43 : cephadm [INF] Reconfiguring daemon mgr.y on gibba023 2021-03-10T20:10:02.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:01 gibba044 bash[25485]: cluster 2021-03-10T20:10:01.250763+0000 mgr.gibba044.wflcwh (mgr.34466) 44 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:02.307 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:01 gibba023 bash[30844]: audit 2021-03-10T20:10:00.927515+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:02.307 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:01 gibba023 bash[30844]: audit 2021-03-10T20:10:00.930015+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:10:02.307 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:01 gibba023 bash[30844]: cephadm 2021-03-10T20:10:00.930719+0000 mgr.gibba044.wflcwh (mgr.34466) 42 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-03-10T20:10:02.308 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:01 gibba023 bash[30844]: audit 2021-03-10T20:10:00.932359+0000 mon.a (mon.0) 102 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T20:10:02.308 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:01 gibba023 bash[30844]: audit 2021-03-10T20:10:00.935008+0000 mon.a (mon.0) 103 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:02.308 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:01 gibba023 bash[30844]: audit 2021-03-10T20:10:00.938446+0000 mon.a (mon.0) 104 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T20:10:02.308 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:01 gibba023 bash[30844]: cephadm 2021-03-10T20:10:00.938697+0000 mgr.gibba044.wflcwh (mgr.34466) 43 : cephadm [INF] Reconfiguring daemon mgr.y on gibba023 2021-03-10T20:10:02.309 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:01 gibba023 bash[30844]: cluster 2021-03-10T20:10:01.250763+0000 mgr.gibba044.wflcwh (mgr.34466) 44 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:02.309 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:01 gibba023 bash[31815]: audit 2021-03-10T20:10:00.927515+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:02.309 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:01 gibba023 bash[31815]: audit 2021-03-10T20:10:00.930015+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:10:02.310 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:01 gibba023 bash[31815]: cephadm 2021-03-10T20:10:00.930719+0000 mgr.gibba044.wflcwh (mgr.34466) 42 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-03-10T20:10:02.310 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:01 gibba023 bash[31815]: audit 2021-03-10T20:10:00.932359+0000 mon.a (mon.0) 102 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T20:10:02.310 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:01 gibba023 bash[31815]: audit 2021-03-10T20:10:00.935008+0000 mon.a (mon.0) 103 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:02.310 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:01 gibba023 bash[31815]: audit 2021-03-10T20:10:00.938446+0000 mon.a (mon.0) 104 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2021-03-10T20:10:02.311 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:01 gibba023 bash[31815]: cephadm 2021-03-10T20:10:00.938697+0000 mgr.gibba044.wflcwh (mgr.34466) 43 : cephadm [INF] Reconfiguring daemon mgr.y on gibba023 2021-03-10T20:10:02.311 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:01 gibba023 bash[31815]: cluster 2021-03-10T20:10:01.250763+0000 mgr.gibba044.wflcwh (mgr.34466) 44 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:04.108 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:03 gibba023 bash[30844]: audit 2021-03-10T20:10:02.855904+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:04.108 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:03 gibba023 bash[30844]: audit 2021-03-10T20:10:02.858677+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:10:04.108 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:03 gibba023 bash[30844]: cephadm 2021-03-10T20:10:02.859359+0000 mgr.gibba044.wflcwh (mgr.34466) 45 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T20:10:04.109 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:03 gibba023 bash[30844]: audit 2021-03-10T20:10:02.861110+0000 mon.a (mon.0) 107 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:10:04.109 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:03 gibba023 bash[30844]: audit 2021-03-10T20:10:02.862267+0000 mon.a (mon.0) 108 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:04.109 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:03 gibba023 bash[30844]: audit 2021-03-10T20:10:02.863931+0000 mon.a (mon.0) 109 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T20:10:04.109 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:03 gibba023 bash[30844]: cephadm 2021-03-10T20:10:02.864811+0000 mgr.gibba044.wflcwh (mgr.34466) 46 : cephadm [INF] Reconfiguring daemon mon.c on gibba023 2021-03-10T20:10:04.110 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:03 gibba023 bash[30844]: cluster 2021-03-10T20:10:03.252879+0000 mgr.gibba044.wflcwh (mgr.34466) 47 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:04.110 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:03 gibba023 bash[31815]: audit 2021-03-10T20:10:02.855904+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:04.110 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:03 gibba023 bash[31815]: audit 2021-03-10T20:10:02.858677+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:10:04.111 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:03 gibba023 bash[31815]: cephadm 2021-03-10T20:10:02.859359+0000 mgr.gibba044.wflcwh (mgr.34466) 45 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T20:10:04.111 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:03 gibba023 bash[31815]: audit 2021-03-10T20:10:02.861110+0000 mon.a (mon.0) 107 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:10:04.111 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:03 gibba023 bash[31815]: audit 2021-03-10T20:10:02.862267+0000 mon.a (mon.0) 108 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:04.111 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:03 gibba023 bash[31815]: audit 2021-03-10T20:10:02.863931+0000 mon.a (mon.0) 109 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T20:10:04.112 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:03 gibba023 bash[31815]: cephadm 2021-03-10T20:10:02.864811+0000 mgr.gibba044.wflcwh (mgr.34466) 46 : cephadm [INF] Reconfiguring daemon mon.c on gibba023 2021-03-10T20:10:04.113 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:03 gibba023 bash[31815]: cluster 2021-03-10T20:10:03.252879+0000 mgr.gibba044.wflcwh (mgr.34466) 47 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:04.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:03 gibba044 bash[25485]: audit 2021-03-10T20:10:02.855904+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:04.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:03 gibba044 bash[25485]: audit 2021-03-10T20:10:02.858677+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:10:04.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:03 gibba044 bash[25485]: cephadm 2021-03-10T20:10:02.859359+0000 mgr.gibba044.wflcwh (mgr.34466) 45 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-03-10T20:10:04.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:03 gibba044 bash[25485]: audit 2021-03-10T20:10:02.861110+0000 mon.a (mon.0) 107 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:10:04.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:03 gibba044 bash[25485]: audit 2021-03-10T20:10:02.862267+0000 mon.a (mon.0) 108 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:04.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:03 gibba044 bash[25485]: audit 2021-03-10T20:10:02.863931+0000 mon.a (mon.0) 109 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2021-03-10T20:10:04.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:03 gibba044 bash[25485]: cephadm 2021-03-10T20:10:02.864811+0000 mgr.gibba044.wflcwh (mgr.34466) 46 : cephadm [INF] Reconfiguring daemon mon.c on gibba023 2021-03-10T20:10:04.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:03 gibba044 bash[25485]: cluster 2021-03-10T20:10:03.252879+0000 mgr.gibba044.wflcwh (mgr.34466) 47 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:05.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:05 gibba023 bash[30844]: audit 2021-03-10T20:10:04.650735+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:05.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:05 gibba023 bash[30844]: cephadm 2021-03-10T20:10:04.654113+0000 mgr.gibba044.wflcwh (mgr.34466) 48 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2021-03-10T20:10:05.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:05 gibba023 bash[30844]: audit 2021-03-10T20:10:04.656117+0000 mon.a (mon.0) 111 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T20:10:05.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:05 gibba023 bash[30844]: cephadm 2021-03-10T20:10:04.656385+0000 mgr.gibba044.wflcwh (mgr.34466) 49 : cephadm [INF] Reconfiguring daemon osd.0 on gibba023 2021-03-10T20:10:05.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:05 gibba023 bash[30844]: cluster 2021-03-10T20:10:05.253778+0000 mgr.gibba044.wflcwh (mgr.34466) 50 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:05.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:05 gibba023 bash[31815]: audit 2021-03-10T20:10:04.650735+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:05.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:05 gibba023 bash[31815]: cephadm 2021-03-10T20:10:04.654113+0000 mgr.gibba044.wflcwh (mgr.34466) 48 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2021-03-10T20:10:05.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:05 gibba023 bash[31815]: audit 2021-03-10T20:10:04.656117+0000 mon.a (mon.0) 111 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T20:10:05.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:05 gibba023 bash[31815]: cephadm 2021-03-10T20:10:04.656385+0000 mgr.gibba044.wflcwh (mgr.34466) 49 : cephadm [INF] Reconfiguring daemon osd.0 on gibba023 2021-03-10T20:10:05.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:05 gibba023 bash[31815]: cluster 2021-03-10T20:10:05.253778+0000 mgr.gibba044.wflcwh (mgr.34466) 50 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:06.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:05 gibba044 bash[25485]: audit 2021-03-10T20:10:04.650735+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:06.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:05 gibba044 bash[25485]: cephadm 2021-03-10T20:10:04.654113+0000 mgr.gibba044.wflcwh (mgr.34466) 48 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2021-03-10T20:10:06.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:05 gibba044 bash[25485]: audit 2021-03-10T20:10:04.656117+0000 mon.a (mon.0) 111 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T20:10:06.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:05 gibba044 bash[25485]: cephadm 2021-03-10T20:10:04.656385+0000 mgr.gibba044.wflcwh (mgr.34466) 49 : cephadm [INF] Reconfiguring daemon osd.0 on gibba023 2021-03-10T20:10:06.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:05 gibba044 bash[25485]: cluster 2021-03-10T20:10:05.253778+0000 mgr.gibba044.wflcwh (mgr.34466) 50 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:08.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:07 gibba044 bash[25485]: audit 2021-03-10T20:10:06.683123+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:08.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:07 gibba044 bash[25485]: cephadm 2021-03-10T20:10:06.686790+0000 mgr.gibba044.wflcwh (mgr.34466) 51 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2021-03-10T20:10:08.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:07 gibba044 bash[25485]: audit 2021-03-10T20:10:06.688642+0000 mon.a (mon.0) 113 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T20:10:08.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:07 gibba044 bash[25485]: cephadm 2021-03-10T20:10:06.689053+0000 mgr.gibba044.wflcwh (mgr.34466) 52 : cephadm [INF] Reconfiguring daemon osd.1 on gibba023 2021-03-10T20:10:08.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:07 gibba044 bash[25485]: cluster 2021-03-10T20:10:07.254811+0000 mgr.gibba044.wflcwh (mgr.34466) 53 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:08.016 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:07 gibba023 bash[30844]: audit 2021-03-10T20:10:06.683123+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:08.016 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:07 gibba023 bash[30844]: cephadm 2021-03-10T20:10:06.686790+0000 mgr.gibba044.wflcwh (mgr.34466) 51 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2021-03-10T20:10:08.016 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:07 gibba023 bash[30844]: audit 2021-03-10T20:10:06.688642+0000 mon.a (mon.0) 113 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T20:10:08.016 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:07 gibba023 bash[30844]: cephadm 2021-03-10T20:10:06.689053+0000 mgr.gibba044.wflcwh (mgr.34466) 52 : cephadm [INF] Reconfiguring daemon osd.1 on gibba023 2021-03-10T20:10:08.017 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:07 gibba023 bash[30844]: cluster 2021-03-10T20:10:07.254811+0000 mgr.gibba044.wflcwh (mgr.34466) 53 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:08.017 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:07 gibba023 bash[31815]: audit 2021-03-10T20:10:06.683123+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:08.017 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:07 gibba023 bash[31815]: cephadm 2021-03-10T20:10:06.686790+0000 mgr.gibba044.wflcwh (mgr.34466) 51 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2021-03-10T20:10:08.018 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:07 gibba023 bash[31815]: audit 2021-03-10T20:10:06.688642+0000 mon.a (mon.0) 113 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T20:10:08.018 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:07 gibba023 bash[31815]: cephadm 2021-03-10T20:10:06.689053+0000 mgr.gibba044.wflcwh (mgr.34466) 52 : cephadm [INF] Reconfiguring daemon osd.1 on gibba023 2021-03-10T20:10:08.018 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:07 gibba023 bash[31815]: cluster 2021-03-10T20:10:07.254811+0000 mgr.gibba044.wflcwh (mgr.34466) 53 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:09.899 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:09 gibba023 bash[30844]: audit 2021-03-10T20:10:08.592749+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:09.899 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:09 gibba023 bash[30844]: cephadm 2021-03-10T20:10:08.596410+0000 mgr.gibba044.wflcwh (mgr.34466) 54 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2021-03-10T20:10:09.899 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:09 gibba023 bash[30844]: audit 2021-03-10T20:10:08.598357+0000 mon.a (mon.0) 115 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T20:10:09.900 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:09 gibba023 bash[30844]: cephadm 2021-03-10T20:10:08.598657+0000 mgr.gibba044.wflcwh (mgr.34466) 55 : cephadm [INF] Reconfiguring daemon osd.2 on gibba023 2021-03-10T20:10:09.900 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:09 gibba023 bash[30844]: cluster 2021-03-10T20:10:09.257020+0000 mgr.gibba044.wflcwh (mgr.34466) 56 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:09.900 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:09 gibba023 bash[31815]: audit 2021-03-10T20:10:08.592749+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:09.901 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:09 gibba023 bash[31815]: cephadm 2021-03-10T20:10:08.596410+0000 mgr.gibba044.wflcwh (mgr.34466) 54 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2021-03-10T20:10:09.901 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:09 gibba023 bash[31815]: audit 2021-03-10T20:10:08.598357+0000 mon.a (mon.0) 115 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T20:10:09.901 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:09 gibba023 bash[31815]: cephadm 2021-03-10T20:10:08.598657+0000 mgr.gibba044.wflcwh (mgr.34466) 55 : cephadm [INF] Reconfiguring daemon osd.2 on gibba023 2021-03-10T20:10:09.901 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:09 gibba023 bash[31815]: cluster 2021-03-10T20:10:09.257020+0000 mgr.gibba044.wflcwh (mgr.34466) 56 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:10.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:09 gibba044 bash[25485]: audit 2021-03-10T20:10:08.592749+0000 mon.a (mon.0) 114 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:10.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:09 gibba044 bash[25485]: cephadm 2021-03-10T20:10:08.596410+0000 mgr.gibba044.wflcwh (mgr.34466) 54 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2021-03-10T20:10:10.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:09 gibba044 bash[25485]: audit 2021-03-10T20:10:08.598357+0000 mon.a (mon.0) 115 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T20:10:10.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:09 gibba044 bash[25485]: cephadm 2021-03-10T20:10:08.598657+0000 mgr.gibba044.wflcwh (mgr.34466) 55 : cephadm [INF] Reconfiguring daemon osd.2 on gibba023 2021-03-10T20:10:10.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:09 gibba044 bash[25485]: cluster 2021-03-10T20:10:09.257020+0000 mgr.gibba044.wflcwh (mgr.34466) 56 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:11.739 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:11 gibba023 bash[30844]: audit 2021-03-10T20:10:10.452384+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:11.740 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:11 gibba023 bash[30844]: cephadm 2021-03-10T20:10:10.456068+0000 mgr.gibba044.wflcwh (mgr.34466) 57 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2021-03-10T20:10:11.740 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:11 gibba023 bash[30844]: audit 2021-03-10T20:10:10.457932+0000 mon.a (mon.0) 117 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T20:10:11.740 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:11 gibba023 bash[30844]: cephadm 2021-03-10T20:10:10.458306+0000 mgr.gibba044.wflcwh (mgr.34466) 58 : cephadm [INF] Reconfiguring daemon osd.3 on gibba023 2021-03-10T20:10:11.740 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:11 gibba023 bash[30844]: cluster 2021-03-10T20:10:11.258186+0000 mgr.gibba044.wflcwh (mgr.34466) 59 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:11.741 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:11 gibba023 bash[31815]: audit 2021-03-10T20:10:10.452384+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:11.741 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:11 gibba023 bash[31815]: cephadm 2021-03-10T20:10:10.456068+0000 mgr.gibba044.wflcwh (mgr.34466) 57 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2021-03-10T20:10:11.741 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:11 gibba023 bash[31815]: audit 2021-03-10T20:10:10.457932+0000 mon.a (mon.0) 117 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T20:10:11.742 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:11 gibba023 bash[31815]: cephadm 2021-03-10T20:10:10.458306+0000 mgr.gibba044.wflcwh (mgr.34466) 58 : cephadm [INF] Reconfiguring daemon osd.3 on gibba023 2021-03-10T20:10:11.742 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:11 gibba023 bash[31815]: cluster 2021-03-10T20:10:11.258186+0000 mgr.gibba044.wflcwh (mgr.34466) 59 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:11.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:11 gibba044 bash[25485]: audit 2021-03-10T20:10:10.452384+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:11.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:11 gibba044 bash[25485]: cephadm 2021-03-10T20:10:10.456068+0000 mgr.gibba044.wflcwh (mgr.34466) 57 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2021-03-10T20:10:11.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:11 gibba044 bash[25485]: audit 2021-03-10T20:10:10.457932+0000 mon.a (mon.0) 117 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T20:10:11.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:11 gibba044 bash[25485]: cephadm 2021-03-10T20:10:10.458306+0000 mgr.gibba044.wflcwh (mgr.34466) 58 : cephadm [INF] Reconfiguring daemon osd.3 on gibba023 2021-03-10T20:10:11.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:11 gibba044 bash[25485]: cluster 2021-03-10T20:10:11.258186+0000 mgr.gibba044.wflcwh (mgr.34466) 59 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:13.713 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:13 gibba023 bash[30844]: audit 2021-03-10T20:10:12.429341+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:13.714 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:13 gibba023 bash[30844]: audit 2021-03-10T20:10:12.433942+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba023.rsfdop", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T20:10:13.714 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:13 gibba023 bash[30844]: cephadm 2021-03-10T20:10:12.434598+0000 mgr.gibba044.wflcwh (mgr.34466) 60 : cephadm [INF] Reconfiguring rgw.r.z.gibba023.rsfdop (monmap changed)... 2021-03-10T20:10:13.714 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:13 gibba023 bash[30844]: audit 2021-03-10T20:10:12.435241+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.gibba023.rsfdop"}]: dispatch 2021-03-10T20:10:13.714 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:13 gibba023 bash[30844]: audit 2021-03-10T20:10:12.436614+0000 mon.a (mon.0) 121 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:13.715 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:13 gibba023 bash[30844]: audit 2021-03-10T20:10:12.437873+0000 mon.a (mon.0) 122 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "client.rgw.r.z.gibba023.rsfdop","key": "container_image"}]: dispatch 2021-03-10T20:10:13.715 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:13 gibba023 bash[30844]: cephadm 2021-03-10T20:10:12.438855+0000 mgr.gibba044.wflcwh (mgr.34466) 61 : cephadm [INF] Reconfiguring daemon rgw.r.z.gibba023.rsfdop on gibba023 2021-03-10T20:10:13.715 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:13 gibba023 bash[30844]: cluster 2021-03-10T20:10:13.260311+0000 mgr.gibba044.wflcwh (mgr.34466) 62 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:13.716 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:13 gibba023 bash[31815]: audit 2021-03-10T20:10:12.429341+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:13.716 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:13 gibba023 bash[31815]: audit 2021-03-10T20:10:12.433942+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba023.rsfdop", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T20:10:13.716 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:13 gibba023 bash[31815]: cephadm 2021-03-10T20:10:12.434598+0000 mgr.gibba044.wflcwh (mgr.34466) 60 : cephadm [INF] Reconfiguring rgw.r.z.gibba023.rsfdop (monmap changed)... 2021-03-10T20:10:13.717 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:13 gibba023 bash[31815]: audit 2021-03-10T20:10:12.435241+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.gibba023.rsfdop"}]: dispatch 2021-03-10T20:10:13.717 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:13 gibba023 bash[31815]: audit 2021-03-10T20:10:12.436614+0000 mon.a (mon.0) 121 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:13.717 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:13 gibba023 bash[31815]: audit 2021-03-10T20:10:12.437873+0000 mon.a (mon.0) 122 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "client.rgw.r.z.gibba023.rsfdop","key": "container_image"}]: dispatch 2021-03-10T20:10:13.717 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:13 gibba023 bash[31815]: cephadm 2021-03-10T20:10:12.438855+0000 mgr.gibba044.wflcwh (mgr.34466) 61 : cephadm [INF] Reconfiguring daemon rgw.r.z.gibba023.rsfdop on gibba023 2021-03-10T20:10:13.718 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:13 gibba023 bash[31815]: cluster 2021-03-10T20:10:13.260311+0000 mgr.gibba044.wflcwh (mgr.34466) 62 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:13.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:13 gibba044 bash[25485]: audit 2021-03-10T20:10:12.429341+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:13.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:13 gibba044 bash[25485]: audit 2021-03-10T20:10:12.433942+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba023.rsfdop", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T20:10:13.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:13 gibba044 bash[25485]: cephadm 2021-03-10T20:10:12.434598+0000 mgr.gibba044.wflcwh (mgr.34466) 60 : cephadm [INF] Reconfiguring rgw.r.z.gibba023.rsfdop (monmap changed)... 2021-03-10T20:10:13.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:13 gibba044 bash[25485]: audit 2021-03-10T20:10:12.435241+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.gibba023.rsfdop"}]: dispatch 2021-03-10T20:10:13.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:13 gibba044 bash[25485]: audit 2021-03-10T20:10:12.436614+0000 mon.a (mon.0) 121 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:13.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:13 gibba044 bash[25485]: audit 2021-03-10T20:10:12.437873+0000 mon.a (mon.0) 122 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "client.rgw.r.z.gibba023.rsfdop","key": "container_image"}]: dispatch 2021-03-10T20:10:13.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:13 gibba044 bash[25485]: cephadm 2021-03-10T20:10:12.438855+0000 mgr.gibba044.wflcwh (mgr.34466) 61 : cephadm [INF] Reconfiguring daemon rgw.r.z.gibba023.rsfdop on gibba023 2021-03-10T20:10:13.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:13 gibba044 bash[25485]: cluster 2021-03-10T20:10:13.260311+0000 mgr.gibba044.wflcwh (mgr.34466) 62 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:15.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:15 gibba023 bash[30844]: audit 2021-03-10T20:10:14.392102+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:15.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:15 gibba023 bash[30844]: audit 2021-03-10T20:10:14.394720+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:10:15.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:15 gibba023 bash[30844]: cephadm 2021-03-10T20:10:14.395544+0000 mgr.gibba044.wflcwh (mgr.34466) 63 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T20:10:15.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:15 gibba023 bash[30844]: audit 2021-03-10T20:10:14.396947+0000 mon.a (mon.0) 125 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:10:15.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:15 gibba023 bash[30844]: audit 2021-03-10T20:10:14.398586+0000 mon.a (mon.0) 126 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:15.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:15 gibba023 bash[30844]: audit 2021-03-10T20:10:14.400101+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T20:10:15.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:15 gibba023 bash[30844]: cephadm 2021-03-10T20:10:14.401223+0000 mgr.gibba044.wflcwh (mgr.34466) 64 : cephadm [INF] Reconfiguring daemon mon.b on gibba044 2021-03-10T20:10:15.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:15 gibba023 bash[31815]: audit 2021-03-10T20:10:14.392102+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:15.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:15 gibba023 bash[31815]: audit 2021-03-10T20:10:14.394720+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:10:15.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:15 gibba023 bash[31815]: cephadm 2021-03-10T20:10:14.395544+0000 mgr.gibba044.wflcwh (mgr.34466) 63 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T20:10:15.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:15 gibba023 bash[31815]: audit 2021-03-10T20:10:14.396947+0000 mon.a (mon.0) 125 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:10:15.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:15 gibba023 bash[31815]: audit 2021-03-10T20:10:14.398586+0000 mon.a (mon.0) 126 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:15.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:15 gibba023 bash[31815]: audit 2021-03-10T20:10:14.400101+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T20:10:15.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:15 gibba023 bash[31815]: cephadm 2021-03-10T20:10:14.401223+0000 mgr.gibba044.wflcwh (mgr.34466) 64 : cephadm [INF] Reconfiguring daemon mon.b on gibba044 2021-03-10T20:10:15.694 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:15 gibba044 bash[25485]: audit 2021-03-10T20:10:14.392102+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:15.695 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:15 gibba044 bash[25485]: audit 2021-03-10T20:10:14.394720+0000 mon.a (mon.0) 124 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-03-10T20:10:15.695 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:15 gibba044 bash[25485]: cephadm 2021-03-10T20:10:14.395544+0000 mgr.gibba044.wflcwh (mgr.34466) 63 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-03-10T20:10:15.695 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:15 gibba044 bash[25485]: audit 2021-03-10T20:10:14.396947+0000 mon.a (mon.0) 125 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-03-10T20:10:15.696 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:15 gibba044 bash[25485]: audit 2021-03-10T20:10:14.398586+0000 mon.a (mon.0) 126 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:15.696 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:15 gibba044 bash[25485]: audit 2021-03-10T20:10:14.400101+0000 mon.a (mon.0) 127 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2021-03-10T20:10:15.696 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:15 gibba044 bash[25485]: cephadm 2021-03-10T20:10:14.401223+0000 mgr.gibba044.wflcwh (mgr.34466) 64 : cephadm [INF] Reconfiguring daemon mon.b on gibba044 2021-03-10T20:10:16.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:16 gibba023 bash[30844]: cluster 2021-03-10T20:10:15.261210+0000 mgr.gibba044.wflcwh (mgr.34466) 65 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:16.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:16 gibba023 bash[30844]: audit 2021-03-10T20:10:16.158982+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:16.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:16 gibba023 bash[30844]: audit 2021-03-10T20:10:16.160386+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:10:16.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:16 gibba023 bash[30844]: audit 2021-03-10T20:10:16.161699+0000 mon.a (mon.0) 130 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T20:10:16.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:16 gibba023 bash[30844]: audit 2021-03-10T20:10:16.163091+0000 mon.a (mon.0) 131 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:16.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:16 gibba023 bash[30844]: audit 2021-03-10T20:10:16.164954+0000 mon.a (mon.0) 132 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2021-03-10T20:10:16.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:16 gibba023 bash[31815]: cluster 2021-03-10T20:10:15.261210+0000 mgr.gibba044.wflcwh (mgr.34466) 65 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:16.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:16 gibba023 bash[31815]: audit 2021-03-10T20:10:16.158982+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:16.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:16 gibba023 bash[31815]: audit 2021-03-10T20:10:16.160386+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:10:16.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:16 gibba023 bash[31815]: audit 2021-03-10T20:10:16.161699+0000 mon.a (mon.0) 130 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T20:10:16.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:16 gibba023 bash[31815]: audit 2021-03-10T20:10:16.163091+0000 mon.a (mon.0) 131 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:16.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:16 gibba023 bash[31815]: audit 2021-03-10T20:10:16.164954+0000 mon.a (mon.0) 132 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2021-03-10T20:10:16.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:16 gibba044 bash[25485]: cluster 2021-03-10T20:10:15.261210+0000 mgr.gibba044.wflcwh (mgr.34466) 65 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:16.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:16 gibba044 bash[25485]: audit 2021-03-10T20:10:16.158982+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:16.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:16 gibba044 bash[25485]: audit 2021-03-10T20:10:16.160386+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:10:16.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:16 gibba044 bash[25485]: audit 2021-03-10T20:10:16.161699+0000 mon.a (mon.0) 130 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T20:10:16.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:16 gibba044 bash[25485]: audit 2021-03-10T20:10:16.163091+0000 mon.a (mon.0) 131 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:16.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:16 gibba044 bash[25485]: audit 2021-03-10T20:10:16.164954+0000 mon.a (mon.0) 132 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2021-03-10T20:10:17.067 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:10:17.303 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:10:17.303 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (86s) 34s ago 6m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:10:17.303 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (6m) 18s ago 6m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:10:17.304 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (108s) 18s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:10:17.304 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (2m) 18s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:10:17.304 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (67s) 34s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:10:17.304 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (57s) 34s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:10:17.305 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (29s) 18s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:10:17.305 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (40s) 34s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:10:17.305 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (7m) 34s ago 7m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:10:17.305 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (7m) 18s ago 7m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:10:17.306 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (10m) 34s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a8e662729287 2021-03-10T20:10:17.306 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (9m) 34s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 aba825ce9058 2021-03-10T20:10:17.306 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (9m) 34s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 0b4c19578b20 2021-03-10T20:10:17.306 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (8m) 34s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 25229602755c 2021-03-10T20:10:17.307 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (8m) 18s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a745be9e28cb 2021-03-10T20:10:17.307 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (8m) 18s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0313bf557eb 2021-03-10T20:10:17.307 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (7m) 18s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 ffa9fe94cea1 2021-03-10T20:10:17.307 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (7m) 18s ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 082d0fe68f90 2021-03-10T20:10:17.308 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (6m) 18s ago 7m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:10:17.308 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 34s ago 4m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:10:17.308 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 18s ago 4m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:10:17.556 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:10:17.556 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:10:17.556 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:10:17.556 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:10:17.557 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:10:17.557 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:10:17.557 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:10:17.557 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:10:17.558 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2021-03-10T20:10:17.558 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:10:17.558 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:10:17.558 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:10:17.559 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8, 2021-03-10T20:10:17.559 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 6 2021-03-10T20:10:17.559 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:10:17.559 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:10:17.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:17 gibba023 bash[30844]: cephadm 2021-03-10T20:10:16.161400+0000 mgr.gibba044.wflcwh (mgr.34466) 66 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2021-03-10T20:10:17.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:17 gibba023 bash[30844]: cephadm 2021-03-10T20:10:16.165775+0000 mgr.gibba044.wflcwh (mgr.34466) 67 : cephadm [INF] Reconfiguring daemon mgr.x on gibba044 2021-03-10T20:10:17.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:17 gibba023 bash[31815]: cephadm 2021-03-10T20:10:16.161400+0000 mgr.gibba044.wflcwh (mgr.34466) 66 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2021-03-10T20:10:17.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:17 gibba023 bash[31815]: cephadm 2021-03-10T20:10:16.165775+0000 mgr.gibba044.wflcwh (mgr.34466) 67 : cephadm [INF] Reconfiguring daemon mgr.x on gibba044 2021-03-10T20:10:17.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:17 gibba044 bash[25485]: cephadm 2021-03-10T20:10:16.161400+0000 mgr.gibba044.wflcwh (mgr.34466) 66 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2021-03-10T20:10:17.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:17 gibba044 bash[25485]: cephadm 2021-03-10T20:10:16.165775+0000 mgr.gibba044.wflcwh (mgr.34466) 67 : cephadm [INF] Reconfiguring daemon mgr.x on gibba044 2021-03-10T20:10:18.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:18 gibba023 bash[30844]: audit 2021-03-10T20:10:17.060834+0000 mgr.gibba044.wflcwh (mgr.34466) 68 : audit [DBG] from='client.54121 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:10:18.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:18 gibba023 bash[30844]: cluster 2021-03-10T20:10:17.262318+0000 mgr.gibba044.wflcwh (mgr.34466) 69 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:18.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:18 gibba023 bash[30844]: audit 2021-03-10T20:10:17.287728+0000 mgr.gibba044.wflcwh (mgr.34466) 70 : audit [DBG] from='client.44148 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:10:18.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:18 gibba023 bash[30844]: audit 2021-03-10T20:10:17.555875+0000 mon.c (mon.1) 4 : audit [DBG] from='client.? 172.21.2.123:0/1032978568' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:18.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:18 gibba023 bash[30844]: audit 2021-03-10T20:10:17.928593+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:18.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:18 gibba023 bash[30844]: audit 2021-03-10T20:10:17.929734+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba044.wflcwh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:10:18.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:18 gibba023 bash[30844]: cephadm 2021-03-10T20:10:17.930878+0000 mgr.gibba044.wflcwh (mgr.34466) 71 : cephadm [INF] Reconfiguring mgr.gibba044.wflcwh (monmap changed)... 2021-03-10T20:10:18.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:18 gibba023 bash[30844]: audit 2021-03-10T20:10:17.931152+0000 mon.a (mon.0) 135 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T20:10:18.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:18 gibba023 bash[30844]: audit 2021-03-10T20:10:17.932762+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:18.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:18 gibba023 bash[30844]: audit 2021-03-10T20:10:17.934442+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mgr.gibba044.wflcwh","key": "container_image"}]: dispatch 2021-03-10T20:10:18.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:18 gibba023 bash[30844]: cephadm 2021-03-10T20:10:17.935343+0000 mgr.gibba044.wflcwh (mgr.34466) 72 : cephadm [INF] Reconfiguring daemon mgr.gibba044.wflcwh on gibba044 2021-03-10T20:10:18.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:18 gibba023 bash[31815]: audit 2021-03-10T20:10:17.060834+0000 mgr.gibba044.wflcwh (mgr.34466) 68 : audit [DBG] from='client.54121 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:10:18.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:18 gibba023 bash[31815]: cluster 2021-03-10T20:10:17.262318+0000 mgr.gibba044.wflcwh (mgr.34466) 69 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:18.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:18 gibba023 bash[31815]: audit 2021-03-10T20:10:17.287728+0000 mgr.gibba044.wflcwh (mgr.34466) 70 : audit [DBG] from='client.44148 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:10:18.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:18 gibba023 bash[31815]: audit 2021-03-10T20:10:17.555875+0000 mon.c (mon.1) 4 : audit [DBG] from='client.? 172.21.2.123:0/1032978568' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:18.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:18 gibba023 bash[31815]: audit 2021-03-10T20:10:17.928593+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:18.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:18 gibba023 bash[31815]: audit 2021-03-10T20:10:17.929734+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba044.wflcwh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:10:18.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:18 gibba023 bash[31815]: cephadm 2021-03-10T20:10:17.930878+0000 mgr.gibba044.wflcwh (mgr.34466) 71 : cephadm [INF] Reconfiguring mgr.gibba044.wflcwh (monmap changed)... 2021-03-10T20:10:18.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:18 gibba023 bash[31815]: audit 2021-03-10T20:10:17.931152+0000 mon.a (mon.0) 135 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T20:10:18.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:18 gibba023 bash[31815]: audit 2021-03-10T20:10:17.932762+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:18.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:18 gibba023 bash[31815]: audit 2021-03-10T20:10:17.934442+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mgr.gibba044.wflcwh","key": "container_image"}]: dispatch 2021-03-10T20:10:18.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:18 gibba023 bash[31815]: cephadm 2021-03-10T20:10:17.935343+0000 mgr.gibba044.wflcwh (mgr.34466) 72 : cephadm [INF] Reconfiguring daemon mgr.gibba044.wflcwh on gibba044 2021-03-10T20:10:18.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:18 gibba044 bash[25485]: audit 2021-03-10T20:10:17.060834+0000 mgr.gibba044.wflcwh (mgr.34466) 68 : audit [DBG] from='client.54121 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:10:18.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:18 gibba044 bash[25485]: cluster 2021-03-10T20:10:17.262318+0000 mgr.gibba044.wflcwh (mgr.34466) 69 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:18.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:18 gibba044 bash[25485]: audit 2021-03-10T20:10:17.287728+0000 mgr.gibba044.wflcwh (mgr.34466) 70 : audit [DBG] from='client.44148 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:10:18.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:18 gibba044 bash[25485]: audit 2021-03-10T20:10:17.555875+0000 mon.c (mon.1) 4 : audit [DBG] from='client.? 172.21.2.123:0/1032978568' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:18.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:18 gibba044 bash[25485]: audit 2021-03-10T20:10:17.928593+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:18.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:18 gibba044 bash[25485]: audit 2021-03-10T20:10:17.929734+0000 mon.a (mon.0) 134 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.gibba044.wflcwh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-03-10T20:10:18.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:18 gibba044 bash[25485]: cephadm 2021-03-10T20:10:17.930878+0000 mgr.gibba044.wflcwh (mgr.34466) 71 : cephadm [INF] Reconfiguring mgr.gibba044.wflcwh (monmap changed)... 2021-03-10T20:10:18.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:18 gibba044 bash[25485]: audit 2021-03-10T20:10:17.931152+0000 mon.a (mon.0) 135 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "mgr services"}]: dispatch 2021-03-10T20:10:18.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:18 gibba044 bash[25485]: audit 2021-03-10T20:10:17.932762+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:18.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:18 gibba044 bash[25485]: audit 2021-03-10T20:10:17.934442+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mgr.gibba044.wflcwh","key": "container_image"}]: dispatch 2021-03-10T20:10:18.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:18 gibba044 bash[25485]: cephadm 2021-03-10T20:10:17.935343+0000 mgr.gibba044.wflcwh (mgr.34466) 72 : cephadm [INF] Reconfiguring daemon mgr.gibba044.wflcwh on gibba044 2021-03-10T20:10:19.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:19 gibba044 bash[25485]: cluster 2021-03-10T20:10:19.264365+0000 mgr.gibba044.wflcwh (mgr.34466) 73 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:19.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:19 gibba023 bash[30844]: cluster 2021-03-10T20:10:19.264365+0000 mgr.gibba044.wflcwh (mgr.34466) 73 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:19.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:19 gibba023 bash[31815]: cluster 2021-03-10T20:10:19.264365+0000 mgr.gibba044.wflcwh (mgr.34466) 73 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:21.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:20 gibba044 bash[25485]: audit 2021-03-10T20:10:19.679733+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:21.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:20 gibba044 bash[25485]: audit 2021-03-10T20:10:19.681416+0000 mon.a (mon.0) 139 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T20:10:21.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:20 gibba044 bash[25485]: cephadm 2021-03-10T20:10:19.682075+0000 mgr.gibba044.wflcwh (mgr.34466) 74 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2021-03-10T20:10:21.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:20 gibba044 bash[25485]: cephadm 2021-03-10T20:10:19.682532+0000 mgr.gibba044.wflcwh (mgr.34466) 75 : cephadm [INF] Reconfiguring daemon osd.4 on gibba044 2021-03-10T20:10:21.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:20 gibba023 bash[30844]: audit 2021-03-10T20:10:19.679733+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:21.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:20 gibba023 bash[30844]: audit 2021-03-10T20:10:19.681416+0000 mon.a (mon.0) 139 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T20:10:21.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:20 gibba023 bash[30844]: cephadm 2021-03-10T20:10:19.682075+0000 mgr.gibba044.wflcwh (mgr.34466) 74 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2021-03-10T20:10:21.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:20 gibba023 bash[30844]: cephadm 2021-03-10T20:10:19.682532+0000 mgr.gibba044.wflcwh (mgr.34466) 75 : cephadm [INF] Reconfiguring daemon osd.4 on gibba044 2021-03-10T20:10:21.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:20 gibba023 bash[31815]: audit 2021-03-10T20:10:19.679733+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:21.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:20 gibba023 bash[31815]: audit 2021-03-10T20:10:19.681416+0000 mon.a (mon.0) 139 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T20:10:21.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:20 gibba023 bash[31815]: cephadm 2021-03-10T20:10:19.682075+0000 mgr.gibba044.wflcwh (mgr.34466) 74 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2021-03-10T20:10:21.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:20 gibba023 bash[31815]: cephadm 2021-03-10T20:10:19.682532+0000 mgr.gibba044.wflcwh (mgr.34466) 75 : cephadm [INF] Reconfiguring daemon osd.4 on gibba044 2021-03-10T20:10:22.586 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:22 gibba044 bash[25485]: cluster 2021-03-10T20:10:21.265247+0000 mgr.gibba044.wflcwh (mgr.34466) 76 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:22.587 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:22 gibba044 bash[25485]: audit 2021-03-10T20:10:21.346138+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:22.587 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:22 gibba044 bash[25485]: audit 2021-03-10T20:10:21.348271+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T20:10:22.587 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:22 gibba044 bash[25485]: cephadm 2021-03-10T20:10:21.348506+0000 mgr.gibba044.wflcwh (mgr.34466) 77 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2021-03-10T20:10:22.587 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:22 gibba044 bash[25485]: cephadm 2021-03-10T20:10:21.348979+0000 mgr.gibba044.wflcwh (mgr.34466) 78 : cephadm [INF] Reconfiguring daemon osd.5 on gibba044 2021-03-10T20:10:22.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:22 gibba023 bash[30844]: cluster 2021-03-10T20:10:21.265247+0000 mgr.gibba044.wflcwh (mgr.34466) 76 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:22.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:22 gibba023 bash[30844]: audit 2021-03-10T20:10:21.346138+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:22.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:22 gibba023 bash[30844]: audit 2021-03-10T20:10:21.348271+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T20:10:22.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:22 gibba023 bash[30844]: cephadm 2021-03-10T20:10:21.348506+0000 mgr.gibba044.wflcwh (mgr.34466) 77 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2021-03-10T20:10:22.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:22 gibba023 bash[30844]: cephadm 2021-03-10T20:10:21.348979+0000 mgr.gibba044.wflcwh (mgr.34466) 78 : cephadm [INF] Reconfiguring daemon osd.5 on gibba044 2021-03-10T20:10:22.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:22 gibba023 bash[31815]: cluster 2021-03-10T20:10:21.265247+0000 mgr.gibba044.wflcwh (mgr.34466) 76 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:22.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:22 gibba023 bash[31815]: audit 2021-03-10T20:10:21.346138+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:22.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:22 gibba023 bash[31815]: audit 2021-03-10T20:10:21.348271+0000 mon.a (mon.0) 141 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T20:10:22.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:22 gibba023 bash[31815]: cephadm 2021-03-10T20:10:21.348506+0000 mgr.gibba044.wflcwh (mgr.34466) 77 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2021-03-10T20:10:22.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:22 gibba023 bash[31815]: cephadm 2021-03-10T20:10:21.348979+0000 mgr.gibba044.wflcwh (mgr.34466) 78 : cephadm [INF] Reconfiguring daemon osd.5 on gibba044 2021-03-10T20:10:24.319 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:24 gibba044 bash[25485]: audit 2021-03-10T20:10:23.045734+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:24.320 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:24 gibba044 bash[25485]: audit 2021-03-10T20:10:23.047441+0000 mon.a (mon.0) 143 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T20:10:24.320 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:24 gibba044 bash[25485]: cephadm 2021-03-10T20:10:23.048075+0000 mgr.gibba044.wflcwh (mgr.34466) 79 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2021-03-10T20:10:24.320 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:24 gibba044 bash[25485]: cephadm 2021-03-10T20:10:23.048601+0000 mgr.gibba044.wflcwh (mgr.34466) 80 : cephadm [INF] Reconfiguring daemon osd.6 on gibba044 2021-03-10T20:10:24.321 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:24 gibba044 bash[25485]: cluster 2021-03-10T20:10:23.266152+0000 mgr.gibba044.wflcwh (mgr.34466) 81 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:24.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:24 gibba023 bash[30844]: audit 2021-03-10T20:10:23.045734+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:24.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:24 gibba023 bash[30844]: audit 2021-03-10T20:10:23.047441+0000 mon.a (mon.0) 143 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T20:10:24.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:24 gibba023 bash[30844]: cephadm 2021-03-10T20:10:23.048075+0000 mgr.gibba044.wflcwh (mgr.34466) 79 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2021-03-10T20:10:24.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:24 gibba023 bash[30844]: cephadm 2021-03-10T20:10:23.048601+0000 mgr.gibba044.wflcwh (mgr.34466) 80 : cephadm [INF] Reconfiguring daemon osd.6 on gibba044 2021-03-10T20:10:24.432 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:24 gibba023 bash[30844]: cluster 2021-03-10T20:10:23.266152+0000 mgr.gibba044.wflcwh (mgr.34466) 81 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:24.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:24 gibba023 bash[31815]: audit 2021-03-10T20:10:23.045734+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:24.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:24 gibba023 bash[31815]: audit 2021-03-10T20:10:23.047441+0000 mon.a (mon.0) 143 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T20:10:24.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:24 gibba023 bash[31815]: cephadm 2021-03-10T20:10:23.048075+0000 mgr.gibba044.wflcwh (mgr.34466) 79 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2021-03-10T20:10:24.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:24 gibba023 bash[31815]: cephadm 2021-03-10T20:10:23.048601+0000 mgr.gibba044.wflcwh (mgr.34466) 80 : cephadm [INF] Reconfiguring daemon osd.6 on gibba044 2021-03-10T20:10:24.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:24 gibba023 bash[31815]: cluster 2021-03-10T20:10:23.266152+0000 mgr.gibba044.wflcwh (mgr.34466) 81 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:26.144 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:25 gibba044 bash[25485]: audit 2021-03-10T20:10:24.812391+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:26.145 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:25 gibba044 bash[25485]: cephadm 2021-03-10T20:10:24.815584+0000 mgr.gibba044.wflcwh (mgr.34466) 82 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2021-03-10T20:10:26.145 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:25 gibba044 bash[25485]: audit 2021-03-10T20:10:24.816498+0000 mon.a (mon.0) 145 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T20:10:26.145 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:25 gibba044 bash[25485]: cephadm 2021-03-10T20:10:24.817168+0000 mgr.gibba044.wflcwh (mgr.34466) 83 : cephadm [INF] Reconfiguring daemon osd.7 on gibba044 2021-03-10T20:10:26.145 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:25 gibba044 bash[25485]: cluster 2021-03-10T20:10:25.267091+0000 mgr.gibba044.wflcwh (mgr.34466) 84 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:26.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:25 gibba023 bash[30844]: audit 2021-03-10T20:10:24.812391+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:26.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:25 gibba023 bash[30844]: cephadm 2021-03-10T20:10:24.815584+0000 mgr.gibba044.wflcwh (mgr.34466) 82 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2021-03-10T20:10:26.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:25 gibba023 bash[30844]: audit 2021-03-10T20:10:24.816498+0000 mon.a (mon.0) 145 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T20:10:26.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:25 gibba023 bash[30844]: cephadm 2021-03-10T20:10:24.817168+0000 mgr.gibba044.wflcwh (mgr.34466) 83 : cephadm [INF] Reconfiguring daemon osd.7 on gibba044 2021-03-10T20:10:26.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:25 gibba023 bash[30844]: cluster 2021-03-10T20:10:25.267091+0000 mgr.gibba044.wflcwh (mgr.34466) 84 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:26.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:25 gibba023 bash[31815]: audit 2021-03-10T20:10:24.812391+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:26.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:25 gibba023 bash[31815]: cephadm 2021-03-10T20:10:24.815584+0000 mgr.gibba044.wflcwh (mgr.34466) 82 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2021-03-10T20:10:26.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:25 gibba023 bash[31815]: audit 2021-03-10T20:10:24.816498+0000 mon.a (mon.0) 145 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T20:10:26.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:25 gibba023 bash[31815]: cephadm 2021-03-10T20:10:24.817168+0000 mgr.gibba044.wflcwh (mgr.34466) 83 : cephadm [INF] Reconfiguring daemon osd.7 on gibba044 2021-03-10T20:10:26.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:25 gibba023 bash[31815]: cluster 2021-03-10T20:10:25.267091+0000 mgr.gibba044.wflcwh (mgr.34466) 84 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:27.896 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:27 gibba044 bash[25485]: audit 2021-03-10T20:10:26.593902+0000 mon.a (mon.0) 146 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:27.896 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:27 gibba044 bash[25485]: audit 2021-03-10T20:10:26.595548+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba044.rblqpl", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T20:10:27.896 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:27 gibba044 bash[25485]: cephadm 2021-03-10T20:10:26.596761+0000 mgr.gibba044.wflcwh (mgr.34466) 85 : cephadm [INF] Reconfiguring rgw.r.z.gibba044.rblqpl (monmap changed)... 2021-03-10T20:10:27.897 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:27 gibba044 bash[25485]: audit 2021-03-10T20:10:26.597483+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.gibba044.rblqpl"}]: dispatch 2021-03-10T20:10:27.897 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:27 gibba044 bash[25485]: audit 2021-03-10T20:10:26.598588+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:27.897 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:27 gibba044 bash[25485]: audit 2021-03-10T20:10:26.600657+0000 mon.a (mon.0) 150 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "client.rgw.r.z.gibba044.rblqpl","key": "container_image"}]: dispatch 2021-03-10T20:10:27.897 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:27 gibba044 bash[25485]: cephadm 2021-03-10T20:10:26.601514+0000 mgr.gibba044.wflcwh (mgr.34466) 86 : cephadm [INF] Reconfiguring daemon rgw.r.z.gibba044.rblqpl on gibba044 2021-03-10T20:10:27.898 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:27 gibba044 bash[25485]: audit 2021-03-10T20:10:26.948511+0000 mon.a (mon.0) 151 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:10:27.898 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:27 gibba044 bash[25485]: audit 2021-03-10T20:10:26.949270+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:10:27.898 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:27 gibba044 bash[25485]: audit 2021-03-10T20:10:26.949971+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:10:27.898 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:27 gibba044 bash[25485]: audit 2021-03-10T20:10:26.950667+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:10:27.898 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:27 gibba044 bash[25485]: audit 2021-03-10T20:10:27.066914+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:10:27.899 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:27 gibba044 bash[25485]: audit 2021-03-10T20:10:27.072728+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:10:27.899 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:27 gibba044 bash[25485]: cluster 2021-03-10T20:10:27.268149+0000 mgr.gibba044.wflcwh (mgr.34466) 87 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:27.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:27 gibba023 bash[30844]: audit 2021-03-10T20:10:26.593902+0000 mon.a (mon.0) 146 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:27.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:27 gibba023 bash[30844]: audit 2021-03-10T20:10:26.595548+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba044.rblqpl", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T20:10:27.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:27 gibba023 bash[30844]: cephadm 2021-03-10T20:10:26.596761+0000 mgr.gibba044.wflcwh (mgr.34466) 85 : cephadm [INF] Reconfiguring rgw.r.z.gibba044.rblqpl (monmap changed)... 2021-03-10T20:10:27.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:27 gibba023 bash[30844]: audit 2021-03-10T20:10:26.597483+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.gibba044.rblqpl"}]: dispatch 2021-03-10T20:10:27.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:27 gibba023 bash[30844]: audit 2021-03-10T20:10:26.598588+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:27.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:27 gibba023 bash[30844]: audit 2021-03-10T20:10:26.600657+0000 mon.a (mon.0) 150 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "client.rgw.r.z.gibba044.rblqpl","key": "container_image"}]: dispatch 2021-03-10T20:10:27.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:27 gibba023 bash[30844]: cephadm 2021-03-10T20:10:26.601514+0000 mgr.gibba044.wflcwh (mgr.34466) 86 : cephadm [INF] Reconfiguring daemon rgw.r.z.gibba044.rblqpl on gibba044 2021-03-10T20:10:27.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:27 gibba023 bash[30844]: audit 2021-03-10T20:10:26.948511+0000 mon.a (mon.0) 151 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:10:27.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:27 gibba023 bash[30844]: audit 2021-03-10T20:10:26.949270+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:10:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:27 gibba023 bash[30844]: audit 2021-03-10T20:10:26.949971+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:10:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:27 gibba023 bash[30844]: audit 2021-03-10T20:10:26.950667+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:10:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:27 gibba023 bash[30844]: audit 2021-03-10T20:10:27.066914+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:10:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:27 gibba023 bash[30844]: audit 2021-03-10T20:10:27.072728+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:10:27.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:27 gibba023 bash[30844]: cluster 2021-03-10T20:10:27.268149+0000 mgr.gibba044.wflcwh (mgr.34466) 87 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:27.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:27 gibba023 bash[31815]: audit 2021-03-10T20:10:26.593902+0000 mon.a (mon.0) 146 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:27.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:27 gibba023 bash[31815]: audit 2021-03-10T20:10:26.595548+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.gibba044.rblqpl", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-03-10T20:10:27.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:27 gibba023 bash[31815]: cephadm 2021-03-10T20:10:26.596761+0000 mgr.gibba044.wflcwh (mgr.34466) 85 : cephadm [INF] Reconfiguring rgw.r.z.gibba044.rblqpl (monmap changed)... 2021-03-10T20:10:27.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:27 gibba023 bash[31815]: audit 2021-03-10T20:10:26.597483+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.gibba044.rblqpl"}]: dispatch 2021-03-10T20:10:27.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:27 gibba023 bash[31815]: audit 2021-03-10T20:10:26.598588+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-03-10T20:10:27.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:27 gibba023 bash[31815]: audit 2021-03-10T20:10:26.600657+0000 mon.a (mon.0) 150 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "client.rgw.r.z.gibba044.rblqpl","key": "container_image"}]: dispatch 2021-03-10T20:10:27.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:27 gibba023 bash[31815]: cephadm 2021-03-10T20:10:26.601514+0000 mgr.gibba044.wflcwh (mgr.34466) 86 : cephadm [INF] Reconfiguring daemon rgw.r.z.gibba044.rblqpl on gibba044 2021-03-10T20:10:27.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:27 gibba023 bash[31815]: audit 2021-03-10T20:10:26.948511+0000 mon.a (mon.0) 151 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:10:27.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:27 gibba023 bash[31815]: audit 2021-03-10T20:10:26.949270+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:10:27.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:27 gibba023 bash[31815]: audit 2021-03-10T20:10:26.949971+0000 mon.a (mon.0) 153 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:10:27.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:27 gibba023 bash[31815]: audit 2021-03-10T20:10:26.950667+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:10:27.936 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:27 gibba023 bash[31815]: audit 2021-03-10T20:10:27.066914+0000 mon.a (mon.0) 155 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:10:27.936 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:27 gibba023 bash[31815]: audit 2021-03-10T20:10:27.072728+0000 mon.a (mon.0) 156 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:10:27.937 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:27 gibba023 bash[31815]: cluster 2021-03-10T20:10:27.268149+0000 mgr.gibba044.wflcwh (mgr.34466) 87 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:29.646 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[30844]: audit 2021-03-10T20:10:28.338800+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:29.647 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[30844]: audit 2021-03-10T20:10:28.340401+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:10:29.648 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[30844]: cephadm 2021-03-10T20:10:28.341075+0000 mgr.gibba044.wflcwh (mgr.34466) 88 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:10:29.649 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[30844]: audit 2021-03-10T20:10:28.342192+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:29.650 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[30844]: cephadm 2021-03-10T20:10:28.343079+0000 mgr.gibba044.wflcwh (mgr.34466) 89 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:10:29.650 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[30844]: audit 2021-03-10T20:10:28.344064+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:29.651 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[30844]: cephadm 2021-03-10T20:10:28.344901+0000 mgr.gibba044.wflcwh (mgr.34466) 90 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:10:29.651 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[30844]: cephadm 2021-03-10T20:10:28.344948+0000 mgr.gibba044.wflcwh (mgr.34466) 91 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:10:29.651 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[30844]: cephadm 2021-03-10T20:10:28.346807+0000 mgr.gibba044.wflcwh (mgr.34466) 92 : cephadm [INF] Upgrade: Setting container_image for all mon 2021-03-10T20:10:29.651 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[30844]: audit 2021-03-10T20:10:28.349206+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:29.651 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[30844]: audit 2021-03-10T20:10:28.350503+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-03-10T20:10:29.652 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[30844]: audit 2021-03-10T20:10:28.353463+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2021-03-10T20:10:29.652 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[30844]: audit 2021-03-10T20:10:28.354507+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-03-10T20:10:29.652 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[30844]: audit 2021-03-10T20:10:28.358230+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2021-03-10T20:10:29.652 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[30844]: audit 2021-03-10T20:10:28.359217+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-03-10T20:10:29.653 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[30844]: audit 2021-03-10T20:10:28.362947+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2021-03-10T20:10:29.653 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[30844]: audit 2021-03-10T20:10:28.364284+0000 mon.a (mon.0) 168 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:29.653 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[30844]: cephadm 2021-03-10T20:10:28.365353+0000 mgr.gibba044.wflcwh (mgr.34466) 93 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:10:29.654 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[31815]: audit 2021-03-10T20:10:28.338800+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:29.654 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[31815]: audit 2021-03-10T20:10:28.340401+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:10:29.654 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[31815]: cephadm 2021-03-10T20:10:28.341075+0000 mgr.gibba044.wflcwh (mgr.34466) 88 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:10:29.654 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[31815]: audit 2021-03-10T20:10:28.342192+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:29.655 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[31815]: cephadm 2021-03-10T20:10:28.343079+0000 mgr.gibba044.wflcwh (mgr.34466) 89 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:10:29.655 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[31815]: audit 2021-03-10T20:10:28.344064+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:29.655 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[31815]: cephadm 2021-03-10T20:10:28.344901+0000 mgr.gibba044.wflcwh (mgr.34466) 90 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:10:29.655 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[31815]: cephadm 2021-03-10T20:10:28.344948+0000 mgr.gibba044.wflcwh (mgr.34466) 91 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:10:29.656 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[31815]: cephadm 2021-03-10T20:10:28.346807+0000 mgr.gibba044.wflcwh (mgr.34466) 92 : cephadm [INF] Upgrade: Setting container_image for all mon 2021-03-10T20:10:29.656 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[31815]: audit 2021-03-10T20:10:28.349206+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:29.656 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[31815]: audit 2021-03-10T20:10:28.350503+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-03-10T20:10:29.656 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[31815]: audit 2021-03-10T20:10:28.353463+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2021-03-10T20:10:29.657 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[31815]: audit 2021-03-10T20:10:28.354507+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-03-10T20:10:29.657 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[31815]: audit 2021-03-10T20:10:28.358230+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2021-03-10T20:10:29.657 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[31815]: audit 2021-03-10T20:10:28.359217+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-03-10T20:10:29.657 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[31815]: audit 2021-03-10T20:10:28.362947+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2021-03-10T20:10:29.657 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[31815]: audit 2021-03-10T20:10:28.364284+0000 mon.a (mon.0) 168 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:29.658 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[31815]: cephadm 2021-03-10T20:10:28.365353+0000 mgr.gibba044.wflcwh (mgr.34466) 93 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:10:29.658 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[31815]: cephadm 2021-03-10T20:10:28.365425+0000 mgr.gibba044.wflcwh (mgr.34466) 94 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:10:29.658 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[31815]: cephadm 2021-03-10T20:10:28.367015+0000 mgr.gibba044.wflcwh (mgr.34466) 95 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:10:29.658 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[31815]: audit 2021-03-10T20:10:28.369356+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:29.659 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[31815]: audit 2021-03-10T20:10:28.370980+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T20:10:29.659 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[31815]: cephadm 2021-03-10T20:10:28.371724+0000 mgr.gibba044.wflcwh (mgr.34466) 96 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:10:29.659 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[31815]: cephadm 2021-03-10T20:10:28.371804+0000 mgr.gibba044.wflcwh (mgr.34466) 97 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:10:29.659 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[31815]: audit 2021-03-10T20:10:28.372799+0000 mgr.gibba044.wflcwh (mgr.34466) 98 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T20:10:29.659 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[31815]: cephadm 2021-03-10T20:10:28.374597+0000 mgr.gibba044.wflcwh (mgr.34466) 99 : cephadm [INF] Upgrade: osd.0 is safe to restart 2021-03-10T20:10:29.660 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[30844]: cephadm 2021-03-10T20:10:28.365425+0000 mgr.gibba044.wflcwh (mgr.34466) 94 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:10:29.660 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[30844]: cephadm 2021-03-10T20:10:28.367015+0000 mgr.gibba044.wflcwh (mgr.34466) 95 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:10:29.660 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[30844]: audit 2021-03-10T20:10:28.369356+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:29.660 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[30844]: audit 2021-03-10T20:10:28.370980+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T20:10:29.661 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[30844]: cephadm 2021-03-10T20:10:28.371724+0000 mgr.gibba044.wflcwh (mgr.34466) 96 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:10:29.661 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[30844]: cephadm 2021-03-10T20:10:28.371804+0000 mgr.gibba044.wflcwh (mgr.34466) 97 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:10:29.661 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[30844]: audit 2021-03-10T20:10:28.372799+0000 mgr.gibba044.wflcwh (mgr.34466) 98 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T20:10:29.661 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:29 gibba023 bash[30844]: cephadm 2021-03-10T20:10:28.374597+0000 mgr.gibba044.wflcwh (mgr.34466) 99 : cephadm [INF] Upgrade: osd.0 is safe to restart 2021-03-10T20:10:29.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:29 gibba044 bash[25485]: audit 2021-03-10T20:10:28.338800+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:29.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:29 gibba044 bash[25485]: audit 2021-03-10T20:10:28.340401+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:10:29.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:29 gibba044 bash[25485]: cephadm 2021-03-10T20:10:28.341075+0000 mgr.gibba044.wflcwh (mgr.34466) 88 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:10:29.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:29 gibba044 bash[25485]: audit 2021-03-10T20:10:28.342192+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:29.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:29 gibba044 bash[25485]: cephadm 2021-03-10T20:10:28.343079+0000 mgr.gibba044.wflcwh (mgr.34466) 89 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:10:29.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:29 gibba044 bash[25485]: audit 2021-03-10T20:10:28.344064+0000 mon.a (mon.0) 160 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:29.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:29 gibba044 bash[25485]: cephadm 2021-03-10T20:10:28.344901+0000 mgr.gibba044.wflcwh (mgr.34466) 90 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:10:29.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:29 gibba044 bash[25485]: cephadm 2021-03-10T20:10:28.344948+0000 mgr.gibba044.wflcwh (mgr.34466) 91 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:10:29.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:29 gibba044 bash[25485]: cephadm 2021-03-10T20:10:28.346807+0000 mgr.gibba044.wflcwh (mgr.34466) 92 : cephadm [INF] Upgrade: Setting container_image for all mon 2021-03-10T20:10:29.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:29 gibba044 bash[25485]: audit 2021-03-10T20:10:28.349206+0000 mon.a (mon.0) 161 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:29.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:29 gibba044 bash[25485]: audit 2021-03-10T20:10:28.350503+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-03-10T20:10:29.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:29 gibba044 bash[25485]: audit 2021-03-10T20:10:28.353463+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2021-03-10T20:10:29.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:29 gibba044 bash[25485]: audit 2021-03-10T20:10:28.354507+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-03-10T20:10:29.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:29 gibba044 bash[25485]: audit 2021-03-10T20:10:28.358230+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2021-03-10T20:10:29.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:29 gibba044 bash[25485]: audit 2021-03-10T20:10:28.359217+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-03-10T20:10:29.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:29 gibba044 bash[25485]: audit 2021-03-10T20:10:28.362947+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2021-03-10T20:10:29.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:29 gibba044 bash[25485]: audit 2021-03-10T20:10:28.364284+0000 mon.a (mon.0) 168 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:29.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:29 gibba044 bash[25485]: cephadm 2021-03-10T20:10:28.365353+0000 mgr.gibba044.wflcwh (mgr.34466) 93 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:10:29.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:29 gibba044 bash[25485]: cephadm 2021-03-10T20:10:28.365425+0000 mgr.gibba044.wflcwh (mgr.34466) 94 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:10:29.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:29 gibba044 bash[25485]: cephadm 2021-03-10T20:10:28.367015+0000 mgr.gibba044.wflcwh (mgr.34466) 95 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:10:29.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:29 gibba044 bash[25485]: audit 2021-03-10T20:10:28.369356+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:29.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:29 gibba044 bash[25485]: audit 2021-03-10T20:10:28.370980+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T20:10:29.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:29 gibba044 bash[25485]: cephadm 2021-03-10T20:10:28.371724+0000 mgr.gibba044.wflcwh (mgr.34466) 96 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:10:29.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:29 gibba044 bash[25485]: cephadm 2021-03-10T20:10:28.371804+0000 mgr.gibba044.wflcwh (mgr.34466) 97 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:10:29.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:29 gibba044 bash[25485]: audit 2021-03-10T20:10:28.372799+0000 mgr.gibba044.wflcwh (mgr.34466) 98 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-03-10T20:10:29.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:29 gibba044 bash[25485]: cephadm 2021-03-10T20:10:28.374597+0000 mgr.gibba044.wflcwh (mgr.34466) 99 : cephadm [INF] Upgrade: osd.0 is safe to restart 2021-03-10T20:10:30.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:30 gibba023 bash[30844]: cluster 2021-03-10T20:10:29.270131+0000 mgr.gibba044.wflcwh (mgr.34466) 100 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:30.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:30 gibba023 bash[31815]: cluster 2021-03-10T20:10:29.270131+0000 mgr.gibba044.wflcwh (mgr.34466) 100 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:30.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:30 gibba044 bash[25485]: cluster 2021-03-10T20:10:29.270131+0000 mgr.gibba044.wflcwh (mgr.34466) 100 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:31.647 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:31 gibba023 bash[30844]: cephadm 2021-03-10T20:10:30.387850+0000 mgr.gibba044.wflcwh (mgr.34466) 101 : cephadm [INF] Upgrade: Updating osd.0 2021-03-10T20:10:31.647 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:31 gibba023 bash[30844]: audit 2021-03-10T20:10:30.392029+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:31.648 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:31 gibba023 bash[30844]: audit 2021-03-10T20:10:30.397135+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T20:10:31.648 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:31 gibba023 bash[30844]: cephadm 2021-03-10T20:10:30.397667+0000 mgr.gibba044.wflcwh (mgr.34466) 102 : cephadm [INF] Deploying daemon osd.0 on gibba023 2021-03-10T20:10:31.648 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:31 gibba023 bash[31815]: cephadm 2021-03-10T20:10:30.387850+0000 mgr.gibba044.wflcwh (mgr.34466) 101 : cephadm [INF] Upgrade: Updating osd.0 2021-03-10T20:10:31.649 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:31 gibba023 bash[31815]: audit 2021-03-10T20:10:30.392029+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:31.649 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:31 gibba023 bash[31815]: audit 2021-03-10T20:10:30.397135+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T20:10:31.649 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:31 gibba023 bash[31815]: cephadm 2021-03-10T20:10:30.397667+0000 mgr.gibba044.wflcwh (mgr.34466) 102 : cephadm [INF] Deploying daemon osd.0 on gibba023 2021-03-10T20:10:31.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:31 gibba044 bash[25485]: cephadm 2021-03-10T20:10:30.387850+0000 mgr.gibba044.wflcwh (mgr.34466) 101 : cephadm [INF] Upgrade: Updating osd.0 2021-03-10T20:10:31.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:31 gibba044 bash[25485]: audit 2021-03-10T20:10:30.392029+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:31.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:31 gibba044 bash[25485]: audit 2021-03-10T20:10:30.397135+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2021-03-10T20:10:31.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:31 gibba044 bash[25485]: cephadm 2021-03-10T20:10:30.397667+0000 mgr.gibba044.wflcwh (mgr.34466) 102 : cephadm [INF] Deploying daemon osd.0 on gibba023 2021-03-10T20:10:32.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:32 gibba023 bash[30844]: cluster 2021-03-10T20:10:31.271174+0000 mgr.gibba044.wflcwh (mgr.34466) 103 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:32.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:32 gibba023 bash[31815]: cluster 2021-03-10T20:10:31.271174+0000 mgr.gibba044.wflcwh (mgr.34466) 103 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:32.682 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:10:32 gibba023 systemd[1]: Stopping Ceph osd.0 for dd719b26-81da-11eb-9080-001a4aab830c... 2021-03-10T20:10:32.682 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:10:32 gibba023 bash[15000]: debug 2021-03-10T20:10:32.569+0000 7f8e61b0a700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T20:10:32.682 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:10:32 gibba023 bash[15000]: debug 2021-03-10T20:10:32.569+0000 7f8e61b0a700 -1 osd.0 62 *** Got signal Terminated *** 2021-03-10T20:10:32.682 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:10:32 gibba023 bash[15000]: debug 2021-03-10T20:10:32.569+0000 7f8e61b0a700 -1 osd.0 62 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T20:10:32.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:32 gibba044 bash[25485]: cluster 2021-03-10T20:10:31.271174+0000 mgr.gibba044.wflcwh (mgr.34466) 103 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:33.674 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:10:33 gibba023 docker[33332]: ceph-dd719b26-81da-11eb-9080-001a4aab830c-osd.0 2021-03-10T20:10:33.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:32.663878+0000 mon.a (mon.0) 173 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:10:33.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:32.663912+0000 mon.a (mon.0) 174 : cluster [INF] osd.0 failed (root=default,host=gibba023) (connection refused reported by osd.6) 2021-03-10T20:10:33.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:32.664025+0000 mon.a (mon.0) 175 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:10:33.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:32.664121+0000 mon.a (mon.0) 176 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:10:33.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:32.664206+0000 mon.a (mon.0) 177 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:10:33.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:32.664283+0000 mon.a (mon.0) 178 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:10:33.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:32.664355+0000 mon.a (mon.0) 179 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:10:33.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:32.664421+0000 mon.a (mon.0) 180 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:10:33.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:32.664475+0000 mon.a (mon.0) 181 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:10:33.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:32.805621+0000 mon.a (mon.0) 182 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:10:33.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:32.864273+0000 mon.a (mon.0) 183 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T20:10:33.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:32.864702+0000 mon.a (mon.0) 184 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:10:33.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:32.865209+0000 mon.a (mon.0) 185 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T20:10:33.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:32.865536+0000 mon.a (mon.0) 186 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:10:33.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:32.866114+0000 mon.a (mon.0) 187 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:10:33.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:32.866521+0000 mon.a (mon.0) 188 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:10:33.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:32.866972+0000 mon.a (mon.0) 189 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:10:33.681 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:32.867151+0000 mon.a (mon.0) 190 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:10:33.681 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:32.867609+0000 mon.a (mon.0) 191 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:10:33.681 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:32.867915+0000 mon.a (mon.0) 192 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:10:33.681 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:32.868468+0000 mon.a (mon.0) 193 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:10:33.682 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:32.868770+0000 mon.a (mon.0) 194 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:10:33.682 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:32.869426+0000 mon.a (mon.0) 195 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:10:33.682 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:32.869823+0000 mon.a (mon.0) 196 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:10:33.682 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:32.896061+0000 mon.a (mon.0) 197 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:10:33.683 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:32.896749+0000 mon.a (mon.0) 198 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T20:10:33.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:32.663878+0000 mon.a (mon.0) 173 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:10:33.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:32.663912+0000 mon.a (mon.0) 174 : cluster [INF] osd.0 failed (root=default,host=gibba023) (connection refused reported by osd.6) 2021-03-10T20:10:33.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:32.664025+0000 mon.a (mon.0) 175 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:10:33.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:32.664121+0000 mon.a (mon.0) 176 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:10:33.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:32.664206+0000 mon.a (mon.0) 177 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:10:33.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:32.664283+0000 mon.a (mon.0) 178 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:10:33.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:32.664355+0000 mon.a (mon.0) 179 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:10:33.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:32.664421+0000 mon.a (mon.0) 180 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:10:33.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:32.664475+0000 mon.a (mon.0) 181 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:10:33.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:32.805621+0000 mon.a (mon.0) 182 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:10:33.686 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:32.864273+0000 mon.a (mon.0) 183 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T20:10:33.687 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:32.864702+0000 mon.a (mon.0) 184 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:10:33.687 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:32.865209+0000 mon.a (mon.0) 185 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T20:10:33.688 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:32.865536+0000 mon.a (mon.0) 186 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:10:33.688 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:32.866114+0000 mon.a (mon.0) 187 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:10:33.688 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:32.866521+0000 mon.a (mon.0) 188 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:10:33.688 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:32.866972+0000 mon.a (mon.0) 189 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:10:33.689 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:32.867151+0000 mon.a (mon.0) 190 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:10:33.689 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:32.867609+0000 mon.a (mon.0) 191 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:10:33.689 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:32.867915+0000 mon.a (mon.0) 192 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:10:33.689 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:32.868468+0000 mon.a (mon.0) 193 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:10:33.690 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:32.868770+0000 mon.a (mon.0) 194 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:10:33.690 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:32.869426+0000 mon.a (mon.0) 195 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:10:33.690 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:32.869823+0000 mon.a (mon.0) 196 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:10:33.690 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:32.896061+0000 mon.a (mon.0) 197 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:10:33.691 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:32.896749+0000 mon.a (mon.0) 198 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T20:10:33.691 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:32.897729+0000 mon.a (mon.0) 199 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:10:33.691 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:32.898076+0000 mon.a (mon.0) 200 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:10:33.692 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:33.006310+0000 mon.a (mon.0) 201 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:10:33.692 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:33.058098+0000 mon.a (mon.0) 202 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:10:33.692 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:33.059562+0000 mon.a (mon.0) 203 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:10:33.692 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:33.095921+0000 mon.a (mon.0) 204 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:10:33.693 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:33.098114+0000 mon.a (mon.0) 205 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:10:33.693 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:33.260200+0000 mon.a (mon.0) 206 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:10:33.693 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:33.261032+0000 mon.a (mon.0) 207 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:10:33.694 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:33.263493+0000 mon.a (mon.0) 208 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:10:33.694 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:33.263967+0000 mon.a (mon.0) 209 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:10:33.694 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:33.264274+0000 mon.a (mon.0) 210 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:10:33.694 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:33.264611+0000 mon.a (mon.0) 211 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T20:10:33.695 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:33.264942+0000 mon.a (mon.0) 212 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:10:33.695 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:33.265321+0000 mon.a (mon.0) 213 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:10:33.695 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:33.265829+0000 mon.a (mon.0) 214 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:10:33.695 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:33.266160+0000 mon.a (mon.0) 215 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:10:33.696 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:33.266537+0000 mon.a (mon.0) 216 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T20:10:33.696 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:33.266854+0000 mon.a (mon.0) 217 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:10:33.696 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:33.267189+0000 mon.a (mon.0) 218 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:10:33.696 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:33.267613+0000 mon.a (mon.0) 219 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:10:33.697 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:33.268020+0000 mon.a (mon.0) 220 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:10:33.697 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[30844]: cluster 2021-03-10T20:10:33.268466+0000 mon.a (mon.0) 221 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:10:33.697 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:32.897729+0000 mon.a (mon.0) 199 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:10:33.697 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:32.898076+0000 mon.a (mon.0) 200 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:10:33.698 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:33.006310+0000 mon.a (mon.0) 201 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:10:33.698 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:33.058098+0000 mon.a (mon.0) 202 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:10:33.698 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:33.059562+0000 mon.a (mon.0) 203 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:10:33.698 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:33.095921+0000 mon.a (mon.0) 204 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:10:33.699 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:33.098114+0000 mon.a (mon.0) 205 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:10:33.699 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:33.260200+0000 mon.a (mon.0) 206 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:10:33.699 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:33.261032+0000 mon.a (mon.0) 207 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:10:33.700 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:33.263493+0000 mon.a (mon.0) 208 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:10:33.700 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:33.263967+0000 mon.a (mon.0) 209 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:10:33.700 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:33.264274+0000 mon.a (mon.0) 210 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:10:33.700 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:33.264611+0000 mon.a (mon.0) 211 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T20:10:33.700 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:33.264942+0000 mon.a (mon.0) 212 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:10:33.701 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:33.265321+0000 mon.a (mon.0) 213 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:10:33.701 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:33.265829+0000 mon.a (mon.0) 214 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:10:33.701 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:33.266160+0000 mon.a (mon.0) 215 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:10:33.701 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:33.266537+0000 mon.a (mon.0) 216 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T20:10:33.702 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:33.266854+0000 mon.a (mon.0) 217 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:10:33.702 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:33.267189+0000 mon.a (mon.0) 218 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:10:33.702 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:33.267613+0000 mon.a (mon.0) 219 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:10:33.702 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:33.268020+0000 mon.a (mon.0) 220 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:10:33.703 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:33 gibba023 bash[31815]: cluster 2021-03-10T20:10:33.268466+0000 mon.a (mon.0) 221 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:10:33.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:32.663878+0000 mon.a (mon.0) 173 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:10:33.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:32.663912+0000 mon.a (mon.0) 174 : cluster [INF] osd.0 failed (root=default,host=gibba023) (connection refused reported by osd.6) 2021-03-10T20:10:33.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:32.664025+0000 mon.a (mon.0) 175 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:10:33.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:32.664121+0000 mon.a (mon.0) 176 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:10:33.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:32.664206+0000 mon.a (mon.0) 177 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:10:33.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:32.664283+0000 mon.a (mon.0) 178 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:10:33.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:32.664355+0000 mon.a (mon.0) 179 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:10:33.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:32.664421+0000 mon.a (mon.0) 180 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:10:33.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:32.664475+0000 mon.a (mon.0) 181 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:10:33.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:32.805621+0000 mon.a (mon.0) 182 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:10:33.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:32.864273+0000 mon.a (mon.0) 183 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T20:10:33.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:32.864702+0000 mon.a (mon.0) 184 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:10:33.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:32.865209+0000 mon.a (mon.0) 185 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T20:10:33.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:32.865536+0000 mon.a (mon.0) 186 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:10:33.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:32.866114+0000 mon.a (mon.0) 187 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:10:33.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:32.866521+0000 mon.a (mon.0) 188 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:10:33.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:32.866972+0000 mon.a (mon.0) 189 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:10:33.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:32.867151+0000 mon.a (mon.0) 190 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:10:33.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:32.867609+0000 mon.a (mon.0) 191 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:10:33.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:32.867915+0000 mon.a (mon.0) 192 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:10:33.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:32.868468+0000 mon.a (mon.0) 193 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:10:33.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:32.868770+0000 mon.a (mon.0) 194 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:10:33.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:32.869426+0000 mon.a (mon.0) 195 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:10:33.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:32.869823+0000 mon.a (mon.0) 196 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:10:33.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:32.896061+0000 mon.a (mon.0) 197 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:10:33.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:32.896749+0000 mon.a (mon.0) 198 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T20:10:33.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:32.897729+0000 mon.a (mon.0) 199 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:10:33.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:32.898076+0000 mon.a (mon.0) 200 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:10:33.758 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:33.006310+0000 mon.a (mon.0) 201 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:10:33.758 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:33.058098+0000 mon.a (mon.0) 202 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:10:33.758 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:33.059562+0000 mon.a (mon.0) 203 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:10:33.758 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:33.095921+0000 mon.a (mon.0) 204 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:10:33.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:33.098114+0000 mon.a (mon.0) 205 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:10:33.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:33.260200+0000 mon.a (mon.0) 206 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:10:33.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:33.261032+0000 mon.a (mon.0) 207 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:10:33.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:33.263493+0000 mon.a (mon.0) 208 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:10:33.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:33.263967+0000 mon.a (mon.0) 209 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-03-10T20:10:33.760 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:33.264274+0000 mon.a (mon.0) 210 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:10:33.760 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:33.264611+0000 mon.a (mon.0) 211 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T20:10:33.760 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:33.264942+0000 mon.a (mon.0) 212 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:10:33.760 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:33.265321+0000 mon.a (mon.0) 213 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:10:33.761 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:33.265829+0000 mon.a (mon.0) 214 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:10:33.761 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:33.266160+0000 mon.a (mon.0) 215 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-03-10T20:10:33.761 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:33.266537+0000 mon.a (mon.0) 216 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-03-10T20:10:33.761 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:33.266854+0000 mon.a (mon.0) 217 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-03-10T20:10:33.761 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:33.267189+0000 mon.a (mon.0) 218 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-03-10T20:10:33.762 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:33.267613+0000 mon.a (mon.0) 219 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-03-10T20:10:33.762 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:33.268020+0000 mon.a (mon.0) 220 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:10:33.762 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:33 gibba044 bash[25485]: cluster 2021-03-10T20:10:33.268466+0000 mon.a (mon.0) 221 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-03-10T20:10:34.657 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:34 gibba023 bash[30844]: cluster 2021-03-10T20:10:33.273154+0000 mgr.gibba044.wflcwh (mgr.34466) 104 : cluster [DBG] pgmap v37: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:34.657 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:34 gibba023 bash[30844]: cluster 2021-03-10T20:10:33.398070+0000 mon.a (mon.0) 222 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:10:34.658 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:34 gibba023 bash[30844]: cluster 2021-03-10T20:10:33.411187+0000 mon.a (mon.0) 223 : cluster [DBG] osdmap e63: 8 total, 7 up, 8 in 2021-03-10T20:10:34.658 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:34 gibba023 bash[30844]: audit 2021-03-10T20:10:33.411634+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T20:10:34.658 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:34 gibba023 bash[30844]: audit 2021-03-10T20:10:33.412869+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T20:10:34.658 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:34 gibba023 bash[31815]: cluster 2021-03-10T20:10:33.273154+0000 mgr.gibba044.wflcwh (mgr.34466) 104 : cluster [DBG] pgmap v37: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:34.659 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:34 gibba023 bash[31815]: cluster 2021-03-10T20:10:33.398070+0000 mon.a (mon.0) 222 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:10:34.659 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:34 gibba023 bash[31815]: cluster 2021-03-10T20:10:33.411187+0000 mon.a (mon.0) 223 : cluster [DBG] osdmap e63: 8 total, 7 up, 8 in 2021-03-10T20:10:34.659 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:34 gibba023 bash[31815]: audit 2021-03-10T20:10:33.411634+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T20:10:34.659 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:34 gibba023 bash[31815]: audit 2021-03-10T20:10:33.412869+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T20:10:34.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:34 gibba044 bash[25485]: cluster 2021-03-10T20:10:33.273154+0000 mgr.gibba044.wflcwh (mgr.34466) 104 : cluster [DBG] pgmap v37: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:34.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:34 gibba044 bash[25485]: cluster 2021-03-10T20:10:33.398070+0000 mon.a (mon.0) 222 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:10:34.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:34 gibba044 bash[25485]: cluster 2021-03-10T20:10:33.411187+0000 mon.a (mon.0) 223 : cluster [DBG] osdmap e63: 8 total, 7 up, 8 in 2021-03-10T20:10:34.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:34 gibba044 bash[25485]: audit 2021-03-10T20:10:33.411634+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-03-10T20:10:34.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:34 gibba044 bash[25485]: audit 2021-03-10T20:10:33.412869+0000 mon.a (mon.0) 225 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-03-10T20:10:35.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:35 gibba023 bash[30844]: audit 2021-03-10T20:10:34.412125+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-03-10T20:10:35.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:35 gibba023 bash[30844]: cluster 2021-03-10T20:10:34.412230+0000 mon.a (mon.0) 227 : cluster [DBG] osdmap e64: 8 total, 7 up, 8 in 2021-03-10T20:10:35.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:35 gibba023 bash[31815]: audit 2021-03-10T20:10:34.412125+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-03-10T20:10:35.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:35 gibba023 bash[31815]: cluster 2021-03-10T20:10:34.412230+0000 mon.a (mon.0) 227 : cluster [DBG] osdmap e64: 8 total, 7 up, 8 in 2021-03-10T20:10:35.676 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:10:35 gibba023 systemd[1]: ceph-dd719b26-81da-11eb-9080-001a4aab830c@osd.0.service: Succeeded. 2021-03-10T20:10:35.676 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:10:35 gibba023 systemd[1]: Stopped Ceph osd.0 for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:10:35.676 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:10:35 gibba023 systemd[1]: Started Ceph osd.0 for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:10:35.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:35 gibba044 bash[25485]: audit 2021-03-10T20:10:34.412125+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-03-10T20:10:35.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:35 gibba044 bash[25485]: cluster 2021-03-10T20:10:34.412230+0000 mon.a (mon.0) 227 : cluster [DBG] osdmap e64: 8 total, 7 up, 8 in 2021-03-10T20:10:36.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:36 gibba023 bash[30844]: cluster 2021-03-10T20:10:35.274040+0000 mgr.gibba044.wflcwh (mgr.34466) 105 : cluster [DBG] pgmap v40: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:36.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:36 gibba023 bash[30844]: audit 2021-03-10T20:10:35.477505+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:36.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:36 gibba023 bash[30844]: audit 2021-03-10T20:10:35.479336+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:10:36.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:36 gibba023 bash[31815]: cluster 2021-03-10T20:10:35.274040+0000 mgr.gibba044.wflcwh (mgr.34466) 105 : cluster [DBG] pgmap v40: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:36.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:36 gibba023 bash[31815]: audit 2021-03-10T20:10:35.477505+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:36.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:36 gibba023 bash[31815]: audit 2021-03-10T20:10:35.479336+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:10:36.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:36 gibba044 bash[25485]: cluster 2021-03-10T20:10:35.274040+0000 mgr.gibba044.wflcwh (mgr.34466) 105 : cluster [DBG] pgmap v40: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:36.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:36 gibba044 bash[25485]: audit 2021-03-10T20:10:35.477505+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:36.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:36 gibba044 bash[25485]: audit 2021-03-10T20:10:35.479336+0000 mon.a (mon.0) 229 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:10:37.175 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:10:36 gibba023 bash[33561]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-03-10T20:10:37.175 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:10:36 gibba023 bash[33561]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2021-03-10T20:10:37.175 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:10:36 gibba023 bash[33561]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2021-03-10T20:10:37.176 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:10:36 gibba023 bash[33561]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2021-03-10T20:10:37.176 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:10:36 gibba023 bash[33561]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-03-10T20:10:37.176 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:10:36 gibba023 bash[33561]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-03-10T20:10:37.176 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:10:36 gibba023 bash[33561]: --> ceph-volume lvm activate successful for osd ID: 0 2021-03-10T20:10:37.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:37 gibba023 bash[30844]: cephadm 2021-03-10T20:10:35.480896+0000 mgr.gibba044.wflcwh (mgr.34466) 106 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:10:37.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:37 gibba023 bash[30844]: cluster 2021-03-10T20:10:37.274938+0000 mgr.gibba044.wflcwh (mgr.34466) 107 : cluster [DBG] pgmap v41: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:37.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:37 gibba023 bash[31815]: cephadm 2021-03-10T20:10:35.480896+0000 mgr.gibba044.wflcwh (mgr.34466) 106 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:10:37.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:37 gibba023 bash[31815]: cluster 2021-03-10T20:10:37.274938+0000 mgr.gibba044.wflcwh (mgr.34466) 107 : cluster [DBG] pgmap v41: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:37.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:37 gibba044 bash[25485]: cephadm 2021-03-10T20:10:35.480896+0000 mgr.gibba044.wflcwh (mgr.34466) 106 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:10:37.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:37 gibba044 bash[25485]: cluster 2021-03-10T20:10:37.274938+0000 mgr.gibba044.wflcwh (mgr.34466) 107 : cluster [DBG] pgmap v41: 129 pgs: 16 stale+active+clean, 113 active+clean; 7.0 KiB data, 5.5 MiB used, 664 GiB / 672 GiB avail 2021-03-10T20:10:38.924 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:10:38 gibba023 bash[33687]: debug 2021-03-10T20:10:38.541+0000 7fd45bb6c700 1 -- 172.21.2.123:0/3277103365 <== mon.1 v2:172.21.2.123:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5643eeb3e4e0 con 0x5643eebbac00 2021-03-10T20:10:39.424 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:10:39 gibba023 bash[33687]: debug 2021-03-10T20:10:39.141+0000 7fd463601080 -1 Falling back to public interface 2021-03-10T20:10:39.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:39 gibba023 bash[30844]: cluster 2021-03-10T20:10:39.326817+0000 mon.a (mon.0) 230 : cluster [WRN] Health check failed: Degraded data redundancy: 22/195 objects degraded (11.282%), 15 pgs degraded (PG_DEGRADED) 2021-03-10T20:10:39.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:39 gibba023 bash[31815]: cluster 2021-03-10T20:10:39.326817+0000 mon.a (mon.0) 230 : cluster [WRN] Health check failed: Degraded data redundancy: 22/195 objects degraded (11.282%), 15 pgs degraded (PG_DEGRADED) 2021-03-10T20:10:39.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:39 gibba044 bash[25485]: cluster 2021-03-10T20:10:39.326817+0000 mon.a (mon.0) 230 : cluster [WRN] Health check failed: Degraded data redundancy: 22/195 objects degraded (11.282%), 15 pgs degraded (PG_DEGRADED) 2021-03-10T20:10:40.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:40 gibba023 bash[30844]: cluster 2021-03-10T20:10:39.277191+0000 mgr.gibba044.wflcwh (mgr.34466) 108 : cluster [DBG] pgmap v42: 129 pgs: 15 active+undersized+degraded, 34 active+undersized, 80 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 22/195 objects degraded (11.282%) 2021-03-10T20:10:40.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:40 gibba023 bash[30844]: audit 2021-03-10T20:10:39.384252+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:40.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:40 gibba023 bash[30844]: cephadm 2021-03-10T20:10:39.386643+0000 mgr.gibba044.wflcwh (mgr.34466) 109 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:10:40.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:40 gibba023 bash[30844]: audit 2021-03-10T20:10:39.595505+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:40.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:40 gibba023 bash[30844]: audit 2021-03-10T20:10:39.603990+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:10:40.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:40 gibba023 bash[30844]: audit 2021-03-10T20:10:39.605880+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:40.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:40 gibba023 bash[30844]: audit 2021-03-10T20:10:39.607761+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:40.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:40 gibba023 bash[30844]: audit 2021-03-10T20:10:39.609284+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:40.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:40 gibba023 bash[30844]: audit 2021-03-10T20:10:39.612285+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T20:10:40.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:40 gibba023 bash[31815]: cluster 2021-03-10T20:10:39.277191+0000 mgr.gibba044.wflcwh (mgr.34466) 108 : cluster [DBG] pgmap v42: 129 pgs: 15 active+undersized+degraded, 34 active+undersized, 80 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 22/195 objects degraded (11.282%) 2021-03-10T20:10:40.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:40 gibba023 bash[31815]: audit 2021-03-10T20:10:39.384252+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:40.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:40 gibba023 bash[31815]: cephadm 2021-03-10T20:10:39.386643+0000 mgr.gibba044.wflcwh (mgr.34466) 109 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:10:40.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:40 gibba023 bash[31815]: audit 2021-03-10T20:10:39.595505+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:40.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:40 gibba023 bash[31815]: audit 2021-03-10T20:10:39.603990+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:10:40.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:40 gibba023 bash[31815]: audit 2021-03-10T20:10:39.605880+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:40.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:40 gibba023 bash[31815]: audit 2021-03-10T20:10:39.607761+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:40.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:40 gibba023 bash[31815]: audit 2021-03-10T20:10:39.609284+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:40.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:40 gibba023 bash[31815]: audit 2021-03-10T20:10:39.612285+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T20:10:40.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:40 gibba044 bash[25485]: cluster 2021-03-10T20:10:39.277191+0000 mgr.gibba044.wflcwh (mgr.34466) 108 : cluster [DBG] pgmap v42: 129 pgs: 15 active+undersized+degraded, 34 active+undersized, 80 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 22/195 objects degraded (11.282%) 2021-03-10T20:10:40.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:40 gibba044 bash[25485]: audit 2021-03-10T20:10:39.384252+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:40.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:40 gibba044 bash[25485]: cephadm 2021-03-10T20:10:39.386643+0000 mgr.gibba044.wflcwh (mgr.34466) 109 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:10:40.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:40 gibba044 bash[25485]: audit 2021-03-10T20:10:39.595505+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:40.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:40 gibba044 bash[25485]: audit 2021-03-10T20:10:39.603990+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:10:40.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:40 gibba044 bash[25485]: audit 2021-03-10T20:10:39.605880+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:40.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:40 gibba044 bash[25485]: audit 2021-03-10T20:10:39.607761+0000 mon.a (mon.0) 235 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:40.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:40 gibba044 bash[25485]: audit 2021-03-10T20:10:39.609284+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:40.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:40 gibba044 bash[25485]: audit 2021-03-10T20:10:39.612285+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T20:10:41.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:41 gibba023 bash[30844]: cephadm 2021-03-10T20:10:39.604627+0000 mgr.gibba044.wflcwh (mgr.34466) 110 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:10:41.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:41 gibba023 bash[30844]: cephadm 2021-03-10T20:10:39.607016+0000 mgr.gibba044.wflcwh (mgr.34466) 111 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:10:41.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:41 gibba023 bash[30844]: cephadm 2021-03-10T20:10:39.608704+0000 mgr.gibba044.wflcwh (mgr.34466) 112 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:10:41.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:41 gibba023 bash[30844]: cephadm 2021-03-10T20:10:39.608744+0000 mgr.gibba044.wflcwh (mgr.34466) 113 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:10:41.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:41 gibba023 bash[30844]: cephadm 2021-03-10T20:10:39.610428+0000 mgr.gibba044.wflcwh (mgr.34466) 114 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:10:41.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:41 gibba023 bash[30844]: cephadm 2021-03-10T20:10:39.610463+0000 mgr.gibba044.wflcwh (mgr.34466) 115 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:10:41.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:41 gibba023 bash[30844]: cephadm 2021-03-10T20:10:39.611978+0000 mgr.gibba044.wflcwh (mgr.34466) 116 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:10:41.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:41 gibba023 bash[30844]: cephadm 2021-03-10T20:10:39.613234+0000 mgr.gibba044.wflcwh (mgr.34466) 117 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:10:41.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:41 gibba023 bash[30844]: cephadm 2021-03-10T20:10:39.613279+0000 mgr.gibba044.wflcwh (mgr.34466) 118 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:10:41.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:41 gibba023 bash[30844]: audit 2021-03-10T20:10:39.614149+0000 mgr.gibba044.wflcwh (mgr.34466) 119 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T20:10:41.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:41 gibba023 bash[30844]: cephadm 2021-03-10T20:10:39.615532+0000 mgr.gibba044.wflcwh (mgr.34466) 120 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2021-03-10T20:10:41.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:41 gibba023 bash[31815]: cephadm 2021-03-10T20:10:39.604627+0000 mgr.gibba044.wflcwh (mgr.34466) 110 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:10:41.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:41 gibba023 bash[31815]: cephadm 2021-03-10T20:10:39.607016+0000 mgr.gibba044.wflcwh (mgr.34466) 111 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:10:41.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:41 gibba023 bash[31815]: cephadm 2021-03-10T20:10:39.608704+0000 mgr.gibba044.wflcwh (mgr.34466) 112 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:10:41.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:41 gibba023 bash[31815]: cephadm 2021-03-10T20:10:39.608744+0000 mgr.gibba044.wflcwh (mgr.34466) 113 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:10:41.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:41 gibba023 bash[31815]: cephadm 2021-03-10T20:10:39.610428+0000 mgr.gibba044.wflcwh (mgr.34466) 114 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:10:41.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:41 gibba023 bash[31815]: cephadm 2021-03-10T20:10:39.610463+0000 mgr.gibba044.wflcwh (mgr.34466) 115 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:10:41.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:41 gibba023 bash[31815]: cephadm 2021-03-10T20:10:39.611978+0000 mgr.gibba044.wflcwh (mgr.34466) 116 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:10:41.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:41 gibba023 bash[31815]: cephadm 2021-03-10T20:10:39.613234+0000 mgr.gibba044.wflcwh (mgr.34466) 117 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:10:41.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:41 gibba023 bash[31815]: cephadm 2021-03-10T20:10:39.613279+0000 mgr.gibba044.wflcwh (mgr.34466) 118 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:10:41.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:41 gibba023 bash[31815]: audit 2021-03-10T20:10:39.614149+0000 mgr.gibba044.wflcwh (mgr.34466) 119 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T20:10:41.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:41 gibba023 bash[31815]: cephadm 2021-03-10T20:10:39.615532+0000 mgr.gibba044.wflcwh (mgr.34466) 120 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2021-03-10T20:10:41.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:41 gibba044 bash[25485]: cephadm 2021-03-10T20:10:39.604627+0000 mgr.gibba044.wflcwh (mgr.34466) 110 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:10:41.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:41 gibba044 bash[25485]: cephadm 2021-03-10T20:10:39.607016+0000 mgr.gibba044.wflcwh (mgr.34466) 111 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:10:41.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:41 gibba044 bash[25485]: cephadm 2021-03-10T20:10:39.608704+0000 mgr.gibba044.wflcwh (mgr.34466) 112 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:10:41.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:41 gibba044 bash[25485]: cephadm 2021-03-10T20:10:39.608744+0000 mgr.gibba044.wflcwh (mgr.34466) 113 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:10:41.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:41 gibba044 bash[25485]: cephadm 2021-03-10T20:10:39.610428+0000 mgr.gibba044.wflcwh (mgr.34466) 114 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:10:41.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:41 gibba044 bash[25485]: cephadm 2021-03-10T20:10:39.610463+0000 mgr.gibba044.wflcwh (mgr.34466) 115 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:10:41.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:41 gibba044 bash[25485]: cephadm 2021-03-10T20:10:39.611978+0000 mgr.gibba044.wflcwh (mgr.34466) 116 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:10:41.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:41 gibba044 bash[25485]: cephadm 2021-03-10T20:10:39.613234+0000 mgr.gibba044.wflcwh (mgr.34466) 117 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:10:41.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:41 gibba044 bash[25485]: cephadm 2021-03-10T20:10:39.613279+0000 mgr.gibba044.wflcwh (mgr.34466) 118 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:10:41.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:41 gibba044 bash[25485]: audit 2021-03-10T20:10:39.614149+0000 mgr.gibba044.wflcwh (mgr.34466) 119 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T20:10:41.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:41 gibba044 bash[25485]: cephadm 2021-03-10T20:10:39.615532+0000 mgr.gibba044.wflcwh (mgr.34466) 120 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2021-03-10T20:10:42.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:42 gibba023 bash[30844]: cluster 2021-03-10T20:10:41.278577+0000 mgr.gibba044.wflcwh (mgr.34466) 121 : cluster [DBG] pgmap v43: 129 pgs: 15 active+undersized+degraded, 34 active+undersized, 80 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 22/195 objects degraded (11.282%) 2021-03-10T20:10:42.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:42 gibba023 bash[31815]: cluster 2021-03-10T20:10:41.278577+0000 mgr.gibba044.wflcwh (mgr.34466) 121 : cluster [DBG] pgmap v43: 129 pgs: 15 active+undersized+degraded, 34 active+undersized, 80 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 22/195 objects degraded (11.282%) 2021-03-10T20:10:42.676 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:10:42 gibba023 bash[33687]: debug 2021-03-10T20:10:42.342+0000 7fd463601080 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: store not yet converted to per-pg omap 2021-03-10T20:10:42.676 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:10:42 gibba023 bash[33687]: debug 2021-03-10T20:10:42.342+0000 7fd4508ca700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T20:10:42.676 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:10:42 gibba023 bash[33687]: debug 2021-03-10T20:10:42.342+0000 7fd4508ca700 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #1:e49187f3:::INTEL_SSDPEL1K375GA_PHKM913400CL375A:head# has omap that is not per-pg or pgmeta 2021-03-10T20:10:42.676 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:10:42 gibba023 bash[33687]: debug 2021-03-10T20:10:42.478+0000 7fd463601080 -1 osd.0 62 log_to_monitors {default=true} 2021-03-10T20:10:42.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:42 gibba044 bash[25485]: cluster 2021-03-10T20:10:41.278577+0000 mgr.gibba044.wflcwh (mgr.34466) 121 : cluster [DBG] pgmap v43: 129 pgs: 15 active+undersized+degraded, 34 active+undersized, 80 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 22/195 objects degraded (11.282%) 2021-03-10T20:10:43.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:43 gibba023 bash[30844]: audit 2021-03-10T20:10:42.482544+0000 mon.c (mon.1) 5 : audit [INF] from='osd.0 [v2:172.21.2.123:6800/1381202961,v1:172.21.2.123:6801/1381202961]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T20:10:43.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:43 gibba023 bash[30844]: audit 2021-03-10T20:10:42.482897+0000 mon.a (mon.0) 238 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T20:10:43.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:43 gibba023 bash[31815]: audit 2021-03-10T20:10:42.482544+0000 mon.c (mon.1) 5 : audit [INF] from='osd.0 [v2:172.21.2.123:6800/1381202961,v1:172.21.2.123:6801/1381202961]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T20:10:43.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:43 gibba023 bash[31815]: audit 2021-03-10T20:10:42.482897+0000 mon.a (mon.0) 238 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T20:10:43.676 INFO:journalctl@ceph.osd.0.gibba023.stdout:Mar 10 20:10:43 gibba023 bash[33687]: debug 2021-03-10T20:10:43.414+0000 7fd4562e4700 -1 osd.0 62 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:10:43.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:43 gibba044 bash[25485]: audit 2021-03-10T20:10:42.482544+0000 mon.c (mon.1) 5 : audit [INF] from='osd.0 [v2:172.21.2.123:6800/1381202961,v1:172.21.2.123:6801/1381202961]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T20:10:43.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:43 gibba044 bash[25485]: audit 2021-03-10T20:10:42.482897+0000 mon.a (mon.0) 238 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-03-10T20:10:44.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:44 gibba023 bash[30844]: cluster 2021-03-10T20:10:43.279920+0000 mgr.gibba044.wflcwh (mgr.34466) 122 : cluster [DBG] pgmap v44: 129 pgs: 15 active+undersized+degraded, 34 active+undersized, 80 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 22/195 objects degraded (11.282%) 2021-03-10T20:10:44.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:44 gibba023 bash[30844]: audit 2021-03-10T20:10:43.407627+0000 mon.a (mon.0) 239 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T20:10:44.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:44 gibba023 bash[30844]: cluster 2021-03-10T20:10:43.407682+0000 mon.a (mon.0) 240 : cluster [DBG] osdmap e65: 8 total, 7 up, 8 in 2021-03-10T20:10:44.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:44 gibba023 bash[30844]: audit 2021-03-10T20:10:43.408903+0000 mon.c (mon.1) 6 : audit [INF] from='osd.0 [v2:172.21.2.123:6800/1381202961,v1:172.21.2.123:6801/1381202961]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:10:44.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:44 gibba023 bash[30844]: audit 2021-03-10T20:10:43.411222+0000 mon.a (mon.0) 241 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:10:44.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:44 gibba023 bash[31815]: cluster 2021-03-10T20:10:43.279920+0000 mgr.gibba044.wflcwh (mgr.34466) 122 : cluster [DBG] pgmap v44: 129 pgs: 15 active+undersized+degraded, 34 active+undersized, 80 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 22/195 objects degraded (11.282%) 2021-03-10T20:10:44.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:44 gibba023 bash[31815]: audit 2021-03-10T20:10:43.407627+0000 mon.a (mon.0) 239 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T20:10:44.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:44 gibba023 bash[31815]: cluster 2021-03-10T20:10:43.407682+0000 mon.a (mon.0) 240 : cluster [DBG] osdmap e65: 8 total, 7 up, 8 in 2021-03-10T20:10:44.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:44 gibba023 bash[31815]: audit 2021-03-10T20:10:43.408903+0000 mon.c (mon.1) 6 : audit [INF] from='osd.0 [v2:172.21.2.123:6800/1381202961,v1:172.21.2.123:6801/1381202961]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:10:44.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:44 gibba023 bash[31815]: audit 2021-03-10T20:10:43.411222+0000 mon.a (mon.0) 241 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:10:44.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:44 gibba044 bash[25485]: cluster 2021-03-10T20:10:43.279920+0000 mgr.gibba044.wflcwh (mgr.34466) 122 : cluster [DBG] pgmap v44: 129 pgs: 15 active+undersized+degraded, 34 active+undersized, 80 active+clean; 7.0 KiB data, 5.6 MiB used, 664 GiB / 672 GiB avail; 22/195 objects degraded (11.282%) 2021-03-10T20:10:44.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:44 gibba044 bash[25485]: audit 2021-03-10T20:10:43.407627+0000 mon.a (mon.0) 239 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-03-10T20:10:44.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:44 gibba044 bash[25485]: cluster 2021-03-10T20:10:43.407682+0000 mon.a (mon.0) 240 : cluster [DBG] osdmap e65: 8 total, 7 up, 8 in 2021-03-10T20:10:44.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:44 gibba044 bash[25485]: audit 2021-03-10T20:10:43.408903+0000 mon.c (mon.1) 6 : audit [INF] from='osd.0 [v2:172.21.2.123:6800/1381202961,v1:172.21.2.123:6801/1381202961]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:10:44.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:44 gibba044 bash[25485]: audit 2021-03-10T20:10:43.411222+0000 mon.a (mon.0) 241 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:10:45.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:45 gibba044 bash[25485]: cluster 2021-03-10T20:10:44.410980+0000 mon.a (mon.0) 242 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:10:45.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:45 gibba044 bash[25485]: cluster 2021-03-10T20:10:44.421070+0000 mon.a (mon.0) 243 : cluster [INF] osd.0 [v2:172.21.2.123:6800/1381202961,v1:172.21.2.123:6801/1381202961] boot 2021-03-10T20:10:45.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:45 gibba044 bash[25485]: cluster 2021-03-10T20:10:44.421093+0000 mon.a (mon.0) 244 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-03-10T20:10:45.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:45 gibba044 bash[25485]: audit 2021-03-10T20:10:44.421608+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:10:45.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:45 gibba044 bash[25485]: cluster 2021-03-10T20:10:45.280990+0000 mgr.gibba044.wflcwh (mgr.34466) 123 : cluster [DBG] pgmap v47: 129 pgs: 15 active+undersized+degraded, 34 active+undersized, 80 active+clean; 7.0 KiB data, 10 MiB used, 665 GiB / 672 GiB avail; 22/195 objects degraded (11.282%) 2021-03-10T20:10:45.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:45 gibba023 bash[30844]: cluster 2021-03-10T20:10:44.410980+0000 mon.a (mon.0) 242 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:10:45.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:45 gibba023 bash[30844]: cluster 2021-03-10T20:10:44.421070+0000 mon.a (mon.0) 243 : cluster [INF] osd.0 [v2:172.21.2.123:6800/1381202961,v1:172.21.2.123:6801/1381202961] boot 2021-03-10T20:10:45.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:45 gibba023 bash[30844]: cluster 2021-03-10T20:10:44.421093+0000 mon.a (mon.0) 244 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-03-10T20:10:45.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:45 gibba023 bash[30844]: audit 2021-03-10T20:10:44.421608+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:10:45.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:45 gibba023 bash[30844]: cluster 2021-03-10T20:10:45.280990+0000 mgr.gibba044.wflcwh (mgr.34466) 123 : cluster [DBG] pgmap v47: 129 pgs: 15 active+undersized+degraded, 34 active+undersized, 80 active+clean; 7.0 KiB data, 10 MiB used, 665 GiB / 672 GiB avail; 22/195 objects degraded (11.282%) 2021-03-10T20:10:45.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:45 gibba023 bash[31815]: cluster 2021-03-10T20:10:44.410980+0000 mon.a (mon.0) 242 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:10:45.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:45 gibba023 bash[31815]: cluster 2021-03-10T20:10:44.421070+0000 mon.a (mon.0) 243 : cluster [INF] osd.0 [v2:172.21.2.123:6800/1381202961,v1:172.21.2.123:6801/1381202961] boot 2021-03-10T20:10:45.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:45 gibba023 bash[31815]: cluster 2021-03-10T20:10:44.421093+0000 mon.a (mon.0) 244 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-03-10T20:10:45.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:45 gibba023 bash[31815]: audit 2021-03-10T20:10:44.421608+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-03-10T20:10:45.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:45 gibba023 bash[31815]: cluster 2021-03-10T20:10:45.280990+0000 mgr.gibba044.wflcwh (mgr.34466) 123 : cluster [DBG] pgmap v47: 129 pgs: 15 active+undersized+degraded, 34 active+undersized, 80 active+clean; 7.0 KiB data, 10 MiB used, 665 GiB / 672 GiB avail; 22/195 objects degraded (11.282%) 2021-03-10T20:10:46.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:46 gibba044 bash[25485]: cluster 2021-03-10T20:10:45.426347+0000 mon.a (mon.0) 246 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2021-03-10T20:10:46.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:46 gibba023 bash[30844]: cluster 2021-03-10T20:10:45.426347+0000 mon.a (mon.0) 246 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2021-03-10T20:10:46.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:46 gibba023 bash[31815]: cluster 2021-03-10T20:10:45.426347+0000 mon.a (mon.0) 246 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2021-03-10T20:10:47.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:47 gibba044 bash[25485]: cluster 2021-03-10T20:10:47.282415+0000 mgr.gibba044.wflcwh (mgr.34466) 124 : cluster [DBG] pgmap v49: 129 pgs: 15 active+undersized+degraded, 34 active+undersized, 80 active+clean; 7.0 KiB data, 10 MiB used, 665 GiB / 672 GiB avail; 22/195 objects degraded (11.282%) 2021-03-10T20:10:47.798 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:10:47.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:47 gibba023 bash[30844]: cluster 2021-03-10T20:10:47.282415+0000 mgr.gibba044.wflcwh (mgr.34466) 124 : cluster [DBG] pgmap v49: 129 pgs: 15 active+undersized+degraded, 34 active+undersized, 80 active+clean; 7.0 KiB data, 10 MiB used, 665 GiB / 672 GiB avail; 22/195 objects degraded (11.282%) 2021-03-10T20:10:47.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:47 gibba023 bash[31815]: cluster 2021-03-10T20:10:47.282415+0000 mgr.gibba044.wflcwh (mgr.34466) 124 : cluster [DBG] pgmap v49: 129 pgs: 15 active+undersized+degraded, 34 active+undersized, 80 active+clean; 7.0 KiB data, 10 MiB used, 665 GiB / 672 GiB avail; 22/195 objects degraded (11.282%) 2021-03-10T20:10:48.028 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:10:48.028 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (117s) 8s ago 7m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:10:48.029 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (7m) 49s ago 7m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:10:48.029 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (2m) 49s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:10:48.029 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (2m) 49s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:10:48.030 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (98s) 8s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:10:48.030 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (88s) 8s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:10:48.030 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (60s) 49s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:10:48.031 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (71s) 8s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:10:48.031 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (7m) 8s ago 7m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:10:48.031 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (7m) 49s ago 7m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:10:48.032 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (10s) 8s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:10:48.032 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (10m) 8s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 aba825ce9058 2021-03-10T20:10:48.032 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (9m) 8s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 0b4c19578b20 2021-03-10T20:10:48.033 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (9m) 8s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 25229602755c 2021-03-10T20:10:48.033 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (9m) 49s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a745be9e28cb 2021-03-10T20:10:48.034 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (8m) 49s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0313bf557eb 2021-03-10T20:10:48.034 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (8m) 49s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 ffa9fe94cea1 2021-03-10T20:10:48.034 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (7m) 49s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 082d0fe68f90 2021-03-10T20:10:48.035 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (7m) 49s ago 7m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:10:48.035 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 8s ago 5m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:10:48.035 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 49s ago 5m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:10:48.275 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:10:48.276 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:10:48.277 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:10:48.277 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:10:48.277 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:10:48.278 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:10:48.278 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:10:48.279 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:10:48.279 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 7, 2021-03-10T20:10:48.280 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 1 2021-03-10T20:10:48.280 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:10:48.280 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:10:48.281 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:10:48.281 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 7, 2021-03-10T20:10:48.282 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 7 2021-03-10T20:10:48.282 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:10:48.282 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:10:48.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:48 gibba044 bash[25485]: audit 2021-03-10T20:10:47.790791+0000 mgr.gibba044.wflcwh (mgr.34466) 125 : audit [DBG] from='client.44166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:10:48.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:48 gibba044 bash[25485]: audit 2021-03-10T20:10:48.017730+0000 mgr.gibba044.wflcwh (mgr.34466) 126 : audit [DBG] from='client.54151 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:10:48.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:48 gibba044 bash[25485]: audit 2021-03-10T20:10:48.275558+0000 mon.c (mon.1) 7 : audit [DBG] from='client.? 172.21.2.123:0/3650938730' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:48.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:48 gibba023 bash[30844]: audit 2021-03-10T20:10:47.790791+0000 mgr.gibba044.wflcwh (mgr.34466) 125 : audit [DBG] from='client.44166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:10:48.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:48 gibba023 bash[30844]: audit 2021-03-10T20:10:48.017730+0000 mgr.gibba044.wflcwh (mgr.34466) 126 : audit [DBG] from='client.54151 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:10:48.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:48 gibba023 bash[30844]: audit 2021-03-10T20:10:48.275558+0000 mon.c (mon.1) 7 : audit [DBG] from='client.? 172.21.2.123:0/3650938730' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:48.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:48 gibba023 bash[31815]: audit 2021-03-10T20:10:47.790791+0000 mgr.gibba044.wflcwh (mgr.34466) 125 : audit [DBG] from='client.44166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:10:48.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:48 gibba023 bash[31815]: audit 2021-03-10T20:10:48.017730+0000 mgr.gibba044.wflcwh (mgr.34466) 126 : audit [DBG] from='client.54151 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:10:48.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:48 gibba023 bash[31815]: audit 2021-03-10T20:10:48.275558+0000 mon.c (mon.1) 7 : audit [DBG] from='client.? 172.21.2.123:0/3650938730' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:10:49.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:49 gibba044 bash[25485]: cluster 2021-03-10T20:10:49.284573+0000 mgr.gibba044.wflcwh (mgr.34466) 127 : cluster [DBG] pgmap v50: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:10:49.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:49 gibba023 bash[30844]: cluster 2021-03-10T20:10:49.284573+0000 mgr.gibba044.wflcwh (mgr.34466) 127 : cluster [DBG] pgmap v50: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:10:49.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:49 gibba023 bash[31815]: cluster 2021-03-10T20:10:49.284573+0000 mgr.gibba044.wflcwh (mgr.34466) 127 : cluster [DBG] pgmap v50: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:10:50.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:50 gibba044 bash[25485]: cluster 2021-03-10T20:10:49.451042+0000 mon.a (mon.0) 247 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/195 objects degraded (11.282%), 15 pgs degraded) 2021-03-10T20:10:50.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:50 gibba023 bash[30844]: cluster 2021-03-10T20:10:49.451042+0000 mon.a (mon.0) 247 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/195 objects degraded (11.282%), 15 pgs degraded) 2021-03-10T20:10:50.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:50 gibba023 bash[31815]: cluster 2021-03-10T20:10:49.451042+0000 mon.a (mon.0) 247 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/195 objects degraded (11.282%), 15 pgs degraded) 2021-03-10T20:10:52.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:51 gibba044 bash[25485]: cluster 2021-03-10T20:10:51.285767+0000 mgr.gibba044.wflcwh (mgr.34466) 128 : cluster [DBG] pgmap v51: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:10:52.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:51 gibba023 bash[30844]: cluster 2021-03-10T20:10:51.285767+0000 mgr.gibba044.wflcwh (mgr.34466) 128 : cluster [DBG] pgmap v51: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:10:52.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:51 gibba023 bash[31815]: cluster 2021-03-10T20:10:51.285767+0000 mgr.gibba044.wflcwh (mgr.34466) 128 : cluster [DBG] pgmap v51: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:10:53.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:53 gibba023 bash[30844]: audit 2021-03-10T20:10:52.064286+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:53.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:53 gibba023 bash[31815]: audit 2021-03-10T20:10:52.064286+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:53.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:53 gibba044 bash[25485]: audit 2021-03-10T20:10:52.064286+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:54.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:54 gibba023 bash[30844]: cluster 2021-03-10T20:10:53.288011+0000 mgr.gibba044.wflcwh (mgr.34466) 129 : cluster [DBG] pgmap v52: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:10:54.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:54 gibba023 bash[31815]: cluster 2021-03-10T20:10:53.288011+0000 mgr.gibba044.wflcwh (mgr.34466) 129 : cluster [DBG] pgmap v52: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:10:54.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:54 gibba044 bash[25485]: cluster 2021-03-10T20:10:53.288011+0000 mgr.gibba044.wflcwh (mgr.34466) 129 : cluster [DBG] pgmap v52: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:10:55.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:55 gibba023 bash[30844]: audit 2021-03-10T20:10:54.626396+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T20:10:55.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:55 gibba023 bash[31815]: audit 2021-03-10T20:10:54.626396+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T20:10:55.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:55 gibba044 bash[25485]: audit 2021-03-10T20:10:54.626396+0000 mon.a (mon.0) 249 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T20:10:56.374 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:56 gibba023 bash[30844]: audit 2021-03-10T20:10:54.628818+0000 mgr.gibba044.wflcwh (mgr.34466) 130 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T20:10:56.374 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:56 gibba023 bash[30844]: cephadm 2021-03-10T20:10:54.633825+0000 mgr.gibba044.wflcwh (mgr.34466) 131 : cephadm [INF] Upgrade: osd.1 is safe to restart 2021-03-10T20:10:56.375 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:56 gibba023 bash[30844]: cluster 2021-03-10T20:10:55.289178+0000 mgr.gibba044.wflcwh (mgr.34466) 132 : cluster [DBG] pgmap v53: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:10:56.375 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:56 gibba023 bash[31815]: audit 2021-03-10T20:10:54.628818+0000 mgr.gibba044.wflcwh (mgr.34466) 130 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T20:10:56.375 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:56 gibba023 bash[31815]: cephadm 2021-03-10T20:10:54.633825+0000 mgr.gibba044.wflcwh (mgr.34466) 131 : cephadm [INF] Upgrade: osd.1 is safe to restart 2021-03-10T20:10:56.376 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:56 gibba023 bash[31815]: cluster 2021-03-10T20:10:55.289178+0000 mgr.gibba044.wflcwh (mgr.34466) 132 : cluster [DBG] pgmap v53: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:10:56.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:56 gibba044 bash[25485]: audit 2021-03-10T20:10:54.628818+0000 mgr.gibba044.wflcwh (mgr.34466) 130 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-03-10T20:10:56.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:56 gibba044 bash[25485]: cephadm 2021-03-10T20:10:54.633825+0000 mgr.gibba044.wflcwh (mgr.34466) 131 : cephadm [INF] Upgrade: osd.1 is safe to restart 2021-03-10T20:10:56.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:56 gibba044 bash[25485]: cluster 2021-03-10T20:10:55.289178+0000 mgr.gibba044.wflcwh (mgr.34466) 132 : cluster [DBG] pgmap v53: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:10:58.224 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:57 gibba023 bash[30844]: cephadm 2021-03-10T20:10:56.938186+0000 mgr.gibba044.wflcwh (mgr.34466) 133 : cephadm [INF] Upgrade: Updating osd.1 2021-03-10T20:10:58.225 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:57 gibba023 bash[30844]: audit 2021-03-10T20:10:56.940735+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:58.225 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:57 gibba023 bash[30844]: audit 2021-03-10T20:10:56.943272+0000 mon.a (mon.0) 251 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T20:10:58.226 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:57 gibba023 bash[30844]: cephadm 2021-03-10T20:10:56.944347+0000 mgr.gibba044.wflcwh (mgr.34466) 134 : cephadm [INF] Deploying daemon osd.1 on gibba023 2021-03-10T20:10:58.226 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:57 gibba023 bash[30844]: cluster 2021-03-10T20:10:57.290338+0000 mgr.gibba044.wflcwh (mgr.34466) 135 : cluster [DBG] pgmap v54: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:10:58.227 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:57 gibba023 bash[31815]: cephadm 2021-03-10T20:10:56.938186+0000 mgr.gibba044.wflcwh (mgr.34466) 133 : cephadm [INF] Upgrade: Updating osd.1 2021-03-10T20:10:58.228 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:57 gibba023 bash[31815]: audit 2021-03-10T20:10:56.940735+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:58.228 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:57 gibba023 bash[31815]: audit 2021-03-10T20:10:56.943272+0000 mon.a (mon.0) 251 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T20:10:58.228 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:57 gibba023 bash[31815]: cephadm 2021-03-10T20:10:56.944347+0000 mgr.gibba044.wflcwh (mgr.34466) 134 : cephadm [INF] Deploying daemon osd.1 on gibba023 2021-03-10T20:10:58.229 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:57 gibba023 bash[31815]: cluster 2021-03-10T20:10:57.290338+0000 mgr.gibba044.wflcwh (mgr.34466) 135 : cluster [DBG] pgmap v54: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:10:58.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:57 gibba044 bash[25485]: cephadm 2021-03-10T20:10:56.938186+0000 mgr.gibba044.wflcwh (mgr.34466) 133 : cephadm [INF] Upgrade: Updating osd.1 2021-03-10T20:10:58.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:57 gibba044 bash[25485]: audit 2021-03-10T20:10:56.940735+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:10:58.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:57 gibba044 bash[25485]: audit 2021-03-10T20:10:56.943272+0000 mon.a (mon.0) 251 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2021-03-10T20:10:58.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:57 gibba044 bash[25485]: cephadm 2021-03-10T20:10:56.944347+0000 mgr.gibba044.wflcwh (mgr.34466) 134 : cephadm [INF] Deploying daemon osd.1 on gibba023 2021-03-10T20:10:58.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:57 gibba044 bash[25485]: cluster 2021-03-10T20:10:57.290338+0000 mgr.gibba044.wflcwh (mgr.34466) 135 : cluster [DBG] pgmap v54: 129 pgs: 16 active+clean+wait, 113 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:10:59.130 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:10:58 gibba023 systemd[1]: Stopping Ceph osd.1 for dd719b26-81da-11eb-9080-001a4aab830c... 2021-03-10T20:10:59.131 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[16412]: debug 2021-03-10T20:10:59.006+0000 7f89ab685700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T20:10:59.131 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[16412]: debug 2021-03-10T20:10:59.006+0000 7f89ab685700 -1 osd.1 67 *** Got signal Terminated *** 2021-03-10T20:10:59.131 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[16412]: debug 2021-03-10T20:10:59.006+0000 7f89ab685700 -1 osd.1 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T20:10:59.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[30844]: cluster 2021-03-10T20:10:59.310701+0000 mon.a (mon.0) 252 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T20:10:59.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[30844]: cluster 2021-03-10T20:10:59.310802+0000 mon.a (mon.0) 253 : cluster [INF] osd.1 failed (root=default,host=gibba023) (connection refused reported by osd.3) 2021-03-10T20:10:59.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[30844]: cluster 2021-03-10T20:10:59.311329+0000 mon.a (mon.0) 254 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T20:10:59.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[30844]: cluster 2021-03-10T20:10:59.311596+0000 mon.a (mon.0) 255 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T20:10:59.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[30844]: cluster 2021-03-10T20:10:59.312063+0000 mon.a (mon.0) 256 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T20:10:59.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[30844]: cluster 2021-03-10T20:10:59.312372+0000 mon.a (mon.0) 257 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T20:10:59.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[30844]: cluster 2021-03-10T20:10:59.312790+0000 mon.a (mon.0) 258 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T20:10:59.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[30844]: cluster 2021-03-10T20:10:59.312969+0000 mon.a (mon.0) 259 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T20:10:59.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[30844]: cluster 2021-03-10T20:10:59.313360+0000 mon.a (mon.0) 260 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T20:10:59.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[30844]: cluster 2021-03-10T20:10:59.313536+0000 mon.a (mon.0) 261 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T20:10:59.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[30844]: cluster 2021-03-10T20:10:59.314086+0000 mon.a (mon.0) 262 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T20:10:59.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[30844]: cluster 2021-03-10T20:10:59.314388+0000 mon.a (mon.0) 263 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T20:10:59.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[30844]: cluster 2021-03-10T20:10:59.314933+0000 mon.a (mon.0) 264 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T20:10:59.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[30844]: cluster 2021-03-10T20:10:59.315220+0000 mon.a (mon.0) 265 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T20:10:59.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[30844]: cluster 2021-03-10T20:10:59.315760+0000 mon.a (mon.0) 266 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T20:10:59.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[31815]: cluster 2021-03-10T20:10:59.310701+0000 mon.a (mon.0) 252 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T20:10:59.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[31815]: cluster 2021-03-10T20:10:59.310802+0000 mon.a (mon.0) 253 : cluster [INF] osd.1 failed (root=default,host=gibba023) (connection refused reported by osd.3) 2021-03-10T20:10:59.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[31815]: cluster 2021-03-10T20:10:59.311329+0000 mon.a (mon.0) 254 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T20:10:59.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[31815]: cluster 2021-03-10T20:10:59.311596+0000 mon.a (mon.0) 255 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T20:10:59.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[31815]: cluster 2021-03-10T20:10:59.312063+0000 mon.a (mon.0) 256 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T20:10:59.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[31815]: cluster 2021-03-10T20:10:59.312372+0000 mon.a (mon.0) 257 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T20:10:59.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[31815]: cluster 2021-03-10T20:10:59.312790+0000 mon.a (mon.0) 258 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T20:10:59.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[31815]: cluster 2021-03-10T20:10:59.312969+0000 mon.a (mon.0) 259 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T20:10:59.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[31815]: cluster 2021-03-10T20:10:59.313360+0000 mon.a (mon.0) 260 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T20:10:59.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[31815]: cluster 2021-03-10T20:10:59.313536+0000 mon.a (mon.0) 261 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T20:10:59.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[31815]: cluster 2021-03-10T20:10:59.314086+0000 mon.a (mon.0) 262 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T20:10:59.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[31815]: cluster 2021-03-10T20:10:59.314388+0000 mon.a (mon.0) 263 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T20:10:59.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[31815]: cluster 2021-03-10T20:10:59.314933+0000 mon.a (mon.0) 264 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T20:10:59.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[31815]: cluster 2021-03-10T20:10:59.315220+0000 mon.a (mon.0) 265 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T20:10:59.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:10:59 gibba023 bash[31815]: cluster 2021-03-10T20:10:59.315760+0000 mon.a (mon.0) 266 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T20:10:59.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:59 gibba044 bash[25485]: cluster 2021-03-10T20:10:59.310701+0000 mon.a (mon.0) 252 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T20:10:59.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:59 gibba044 bash[25485]: cluster 2021-03-10T20:10:59.310802+0000 mon.a (mon.0) 253 : cluster [INF] osd.1 failed (root=default,host=gibba023) (connection refused reported by osd.3) 2021-03-10T20:10:59.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:59 gibba044 bash[25485]: cluster 2021-03-10T20:10:59.311329+0000 mon.a (mon.0) 254 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T20:10:59.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:59 gibba044 bash[25485]: cluster 2021-03-10T20:10:59.311596+0000 mon.a (mon.0) 255 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T20:10:59.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:59 gibba044 bash[25485]: cluster 2021-03-10T20:10:59.312063+0000 mon.a (mon.0) 256 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T20:10:59.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:59 gibba044 bash[25485]: cluster 2021-03-10T20:10:59.312372+0000 mon.a (mon.0) 257 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T20:10:59.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:59 gibba044 bash[25485]: cluster 2021-03-10T20:10:59.312790+0000 mon.a (mon.0) 258 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-03-10T20:10:59.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:59 gibba044 bash[25485]: cluster 2021-03-10T20:10:59.312969+0000 mon.a (mon.0) 259 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-03-10T20:10:59.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:59 gibba044 bash[25485]: cluster 2021-03-10T20:10:59.313360+0000 mon.a (mon.0) 260 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-03-10T20:10:59.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:59 gibba044 bash[25485]: cluster 2021-03-10T20:10:59.313536+0000 mon.a (mon.0) 261 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-03-10T20:10:59.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:59 gibba044 bash[25485]: cluster 2021-03-10T20:10:59.314086+0000 mon.a (mon.0) 262 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-03-10T20:10:59.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:59 gibba044 bash[25485]: cluster 2021-03-10T20:10:59.314388+0000 mon.a (mon.0) 263 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T20:10:59.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:59 gibba044 bash[25485]: cluster 2021-03-10T20:10:59.314933+0000 mon.a (mon.0) 264 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T20:10:59.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:59 gibba044 bash[25485]: cluster 2021-03-10T20:10:59.315220+0000 mon.a (mon.0) 265 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-03-10T20:10:59.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:10:59 gibba044 bash[25485]: cluster 2021-03-10T20:10:59.315760+0000 mon.a (mon.0) 266 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-03-10T20:11:00.174 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:10:59 gibba023 docker[34618]: ceph-dd719b26-81da-11eb-9080-001a4aab830c-osd.1 2021-03-10T20:11:00.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:00 gibba023 bash[30844]: cluster 2021-03-10T20:10:59.292581+0000 mgr.gibba044.wflcwh (mgr.34466) 136 : cluster [DBG] pgmap v55: 129 pgs: 2 active+clean+wait, 127 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:11:00.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:00 gibba023 bash[30844]: cluster 2021-03-10T20:10:59.361532+0000 mon.a (mon.0) 267 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:11:00.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:00 gibba023 bash[30844]: cluster 2021-03-10T20:10:59.366574+0000 mon.a (mon.0) 268 : cluster [DBG] osdmap e68: 8 total, 7 up, 8 in 2021-03-10T20:11:00.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:00 gibba023 bash[31815]: cluster 2021-03-10T20:10:59.292581+0000 mgr.gibba044.wflcwh (mgr.34466) 136 : cluster [DBG] pgmap v55: 129 pgs: 2 active+clean+wait, 127 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:11:00.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:00 gibba023 bash[31815]: cluster 2021-03-10T20:10:59.361532+0000 mon.a (mon.0) 267 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:11:00.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:00 gibba023 bash[31815]: cluster 2021-03-10T20:10:59.366574+0000 mon.a (mon.0) 268 : cluster [DBG] osdmap e68: 8 total, 7 up, 8 in 2021-03-10T20:11:00.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:00 gibba044 bash[25485]: cluster 2021-03-10T20:10:59.292581+0000 mgr.gibba044.wflcwh (mgr.34466) 136 : cluster [DBG] pgmap v55: 129 pgs: 2 active+clean+wait, 127 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:11:00.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:00 gibba044 bash[25485]: cluster 2021-03-10T20:10:59.361532+0000 mon.a (mon.0) 267 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:11:00.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:00 gibba044 bash[25485]: cluster 2021-03-10T20:10:59.366574+0000 mon.a (mon.0) 268 : cluster [DBG] osdmap e68: 8 total, 7 up, 8 in 2021-03-10T20:11:01.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:01 gibba023 bash[30844]: cluster 2021-03-10T20:11:00.374666+0000 mon.a (mon.0) 269 : cluster [DBG] osdmap e69: 8 total, 7 up, 8 in 2021-03-10T20:11:01.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:01 gibba023 bash[31815]: cluster 2021-03-10T20:11:00.374666+0000 mon.a (mon.0) 269 : cluster [DBG] osdmap e69: 8 total, 7 up, 8 in 2021-03-10T20:11:01.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:01 gibba044 bash[25485]: cluster 2021-03-10T20:11:00.374666+0000 mon.a (mon.0) 269 : cluster [DBG] osdmap e69: 8 total, 7 up, 8 in 2021-03-10T20:11:02.381 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:11:02 gibba023 systemd[1]: ceph-dd719b26-81da-11eb-9080-001a4aab830c@osd.1.service: Succeeded. 2021-03-10T20:11:02.381 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:11:02 gibba023 systemd[1]: Stopped Ceph osd.1 for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:11:02.382 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:11:02 gibba023 systemd[1]: Started Ceph osd.1 for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:11:02.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:02 gibba023 bash[30844]: cluster 2021-03-10T20:11:01.293810+0000 mgr.gibba044.wflcwh (mgr.34466) 137 : cluster [DBG] pgmap v58: 129 pgs: 18 stale+active+clean, 2 active+clean+wait, 109 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:11:02.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:02 gibba023 bash[30844]: audit 2021-03-10T20:11:02.291212+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:02.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:02 gibba023 bash[30844]: audit 2021-03-10T20:11:02.294519+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:11:02.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:02 gibba023 bash[31815]: cluster 2021-03-10T20:11:01.293810+0000 mgr.gibba044.wflcwh (mgr.34466) 137 : cluster [DBG] pgmap v58: 129 pgs: 18 stale+active+clean, 2 active+clean+wait, 109 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:11:02.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:02 gibba023 bash[31815]: audit 2021-03-10T20:11:02.291212+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:02.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:02 gibba023 bash[31815]: audit 2021-03-10T20:11:02.294519+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:11:02.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:02 gibba044 bash[25485]: cluster 2021-03-10T20:11:01.293810+0000 mgr.gibba044.wflcwh (mgr.34466) 137 : cluster [DBG] pgmap v58: 129 pgs: 18 stale+active+clean, 2 active+clean+wait, 109 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail 2021-03-10T20:11:02.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:02 gibba044 bash[25485]: audit 2021-03-10T20:11:02.291212+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:02.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:02 gibba044 bash[25485]: audit 2021-03-10T20:11:02.294519+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:11:03.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:03 gibba023 bash[30844]: cluster 2021-03-10T20:11:03.296277+0000 mgr.gibba044.wflcwh (mgr.34466) 138 : cluster [DBG] pgmap v59: 129 pgs: 1 stale+active+clean, 19 active+undersized+degraded, 2 active+clean+wait, 32 active+undersized, 75 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 28/195 objects degraded (14.359%) 2021-03-10T20:11:03.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:03 gibba023 bash[30844]: cluster 2021-03-10T20:11:03.382161+0000 mon.a (mon.0) 272 : cluster [WRN] Health check failed: Degraded data redundancy: 28/195 objects degraded (14.359%), 19 pgs degraded (PG_DEGRADED) 2021-03-10T20:11:03.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:03 gibba023 bash[31815]: cluster 2021-03-10T20:11:03.296277+0000 mgr.gibba044.wflcwh (mgr.34466) 138 : cluster [DBG] pgmap v59: 129 pgs: 1 stale+active+clean, 19 active+undersized+degraded, 2 active+clean+wait, 32 active+undersized, 75 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 28/195 objects degraded (14.359%) 2021-03-10T20:11:03.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:03 gibba023 bash[31815]: cluster 2021-03-10T20:11:03.382161+0000 mon.a (mon.0) 272 : cluster [WRN] Health check failed: Degraded data redundancy: 28/195 objects degraded (14.359%), 19 pgs degraded (PG_DEGRADED) 2021-03-10T20:11:03.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:03 gibba044 bash[25485]: cluster 2021-03-10T20:11:03.296277+0000 mgr.gibba044.wflcwh (mgr.34466) 138 : cluster [DBG] pgmap v59: 129 pgs: 1 stale+active+clean, 19 active+undersized+degraded, 2 active+clean+wait, 32 active+undersized, 75 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 28/195 objects degraded (14.359%) 2021-03-10T20:11:03.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:03 gibba044 bash[25485]: cluster 2021-03-10T20:11:03.382161+0000 mon.a (mon.0) 272 : cluster [WRN] Health check failed: Degraded data redundancy: 28/195 objects degraded (14.359%), 19 pgs degraded (PG_DEGRADED) 2021-03-10T20:11:04.174 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:11:03 gibba023 bash[34811]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-03-10T20:11:04.175 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:11:03 gibba023 bash[34811]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2021-03-10T20:11:04.175 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:11:03 gibba023 bash[34811]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2021-03-10T20:11:04.175 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:11:03 gibba023 bash[34811]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2021-03-10T20:11:04.176 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:11:03 gibba023 bash[34811]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-03-10T20:11:04.176 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:11:03 gibba023 bash[34811]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-03-10T20:11:04.176 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:11:03 gibba023 bash[34811]: --> ceph-volume lvm activate successful for osd ID: 1 2021-03-10T20:11:05.674 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:11:05 gibba023 bash[34935]: debug 2021-03-10T20:11:05.474+0000 7fa93811c700 1 -- 172.21.2.123:0/1140718098 <== mon.1 v2:172.21.2.123:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564a4ba484e0 con 0x564a4bac5000 2021-03-10T20:11:06.354 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:11:06 gibba023 bash[34935]: debug 2021-03-10T20:11:06.054+0000 7fa93fbb1080 -1 Falling back to public interface 2021-03-10T20:11:06.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:06 gibba044 bash[25485]: cluster 2021-03-10T20:11:05.297725+0000 mgr.gibba044.wflcwh (mgr.34466) 139 : cluster [DBG] pgmap v60: 129 pgs: 20 active+undersized+degraded, 36 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 29/195 objects degraded (14.872%) 2021-03-10T20:11:06.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:06 gibba044 bash[25485]: audit 2021-03-10T20:11:06.219114+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:06.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:06 gibba044 bash[25485]: audit 2021-03-10T20:11:06.222568+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:06.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:06 gibba044 bash[25485]: audit 2021-03-10T20:11:06.227025+0000 mon.a (mon.0) 275 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:06.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:06 gibba044 bash[25485]: audit 2021-03-10T20:11:06.228788+0000 mon.a (mon.0) 276 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:06.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:06 gibba044 bash[25485]: audit 2021-03-10T20:11:06.230414+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:06.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:06 gibba044 bash[25485]: audit 2021-03-10T20:11:06.231888+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:06.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:06 gibba044 bash[25485]: audit 2021-03-10T20:11:06.234925+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T20:11:06.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:06 gibba023 bash[30844]: cluster 2021-03-10T20:11:05.297725+0000 mgr.gibba044.wflcwh (mgr.34466) 139 : cluster [DBG] pgmap v60: 129 pgs: 20 active+undersized+degraded, 36 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 29/195 objects degraded (14.872%) 2021-03-10T20:11:06.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:06 gibba023 bash[30844]: audit 2021-03-10T20:11:06.219114+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:06.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:06 gibba023 bash[30844]: audit 2021-03-10T20:11:06.222568+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:06.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:06 gibba023 bash[30844]: audit 2021-03-10T20:11:06.227025+0000 mon.a (mon.0) 275 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:06.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:06 gibba023 bash[30844]: audit 2021-03-10T20:11:06.228788+0000 mon.a (mon.0) 276 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:06.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:06 gibba023 bash[30844]: audit 2021-03-10T20:11:06.230414+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:06.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:06 gibba023 bash[30844]: audit 2021-03-10T20:11:06.231888+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:06.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:06 gibba023 bash[30844]: audit 2021-03-10T20:11:06.234925+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T20:11:06.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:06 gibba023 bash[31815]: cluster 2021-03-10T20:11:05.297725+0000 mgr.gibba044.wflcwh (mgr.34466) 139 : cluster [DBG] pgmap v60: 129 pgs: 20 active+undersized+degraded, 36 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 29/195 objects degraded (14.872%) 2021-03-10T20:11:06.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:06 gibba023 bash[31815]: audit 2021-03-10T20:11:06.219114+0000 mon.a (mon.0) 273 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:06.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:06 gibba023 bash[31815]: audit 2021-03-10T20:11:06.222568+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:06.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:06 gibba023 bash[31815]: audit 2021-03-10T20:11:06.227025+0000 mon.a (mon.0) 275 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:06.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:06 gibba023 bash[31815]: audit 2021-03-10T20:11:06.228788+0000 mon.a (mon.0) 276 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:06.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:06 gibba023 bash[31815]: audit 2021-03-10T20:11:06.230414+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:06.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:06 gibba023 bash[31815]: audit 2021-03-10T20:11:06.231888+0000 mon.a (mon.0) 278 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:06.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:06 gibba023 bash[31815]: audit 2021-03-10T20:11:06.234925+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T20:11:07.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:07 gibba023 bash[30844]: cephadm 2021-03-10T20:11:06.228001+0000 mgr.gibba044.wflcwh (mgr.34466) 140 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:11:07.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:07 gibba023 bash[30844]: cephadm 2021-03-10T20:11:06.230111+0000 mgr.gibba044.wflcwh (mgr.34466) 141 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:11:07.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:07 gibba023 bash[30844]: cephadm 2021-03-10T20:11:06.231587+0000 mgr.gibba044.wflcwh (mgr.34466) 142 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:11:07.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:07 gibba023 bash[30844]: cephadm 2021-03-10T20:11:06.231730+0000 mgr.gibba044.wflcwh (mgr.34466) 143 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:11:07.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:07 gibba023 bash[30844]: cephadm 2021-03-10T20:11:06.233263+0000 mgr.gibba044.wflcwh (mgr.34466) 144 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:11:07.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:07 gibba023 bash[30844]: cephadm 2021-03-10T20:11:06.233308+0000 mgr.gibba044.wflcwh (mgr.34466) 145 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:11:07.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:07 gibba023 bash[30844]: cephadm 2021-03-10T20:11:06.234802+0000 mgr.gibba044.wflcwh (mgr.34466) 146 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:11:07.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:07 gibba023 bash[30844]: cephadm 2021-03-10T20:11:06.236058+0000 mgr.gibba044.wflcwh (mgr.34466) 147 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:11:07.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:07 gibba023 bash[30844]: cephadm 2021-03-10T20:11:06.236103+0000 mgr.gibba044.wflcwh (mgr.34466) 148 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:11:07.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:07 gibba023 bash[30844]: audit 2021-03-10T20:11:06.236945+0000 mgr.gibba044.wflcwh (mgr.34466) 149 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T20:11:07.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:07 gibba023 bash[30844]: cephadm 2021-03-10T20:11:06.238293+0000 mgr.gibba044.wflcwh (mgr.34466) 150 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2021-03-10T20:11:07.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:07 gibba023 bash[31815]: cephadm 2021-03-10T20:11:06.228001+0000 mgr.gibba044.wflcwh (mgr.34466) 140 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:11:07.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:07 gibba023 bash[31815]: cephadm 2021-03-10T20:11:06.230111+0000 mgr.gibba044.wflcwh (mgr.34466) 141 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:11:07.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:07 gibba023 bash[31815]: cephadm 2021-03-10T20:11:06.231587+0000 mgr.gibba044.wflcwh (mgr.34466) 142 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:11:07.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:07 gibba023 bash[31815]: cephadm 2021-03-10T20:11:06.231730+0000 mgr.gibba044.wflcwh (mgr.34466) 143 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:11:07.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:07 gibba023 bash[31815]: cephadm 2021-03-10T20:11:06.233263+0000 mgr.gibba044.wflcwh (mgr.34466) 144 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:11:07.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:07 gibba023 bash[31815]: cephadm 2021-03-10T20:11:06.233308+0000 mgr.gibba044.wflcwh (mgr.34466) 145 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:11:07.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:07 gibba023 bash[31815]: cephadm 2021-03-10T20:11:06.234802+0000 mgr.gibba044.wflcwh (mgr.34466) 146 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:11:07.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:07 gibba023 bash[31815]: cephadm 2021-03-10T20:11:06.236058+0000 mgr.gibba044.wflcwh (mgr.34466) 147 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:11:07.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:07 gibba023 bash[31815]: cephadm 2021-03-10T20:11:06.236103+0000 mgr.gibba044.wflcwh (mgr.34466) 148 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:11:07.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:07 gibba023 bash[31815]: audit 2021-03-10T20:11:06.236945+0000 mgr.gibba044.wflcwh (mgr.34466) 149 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T20:11:07.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:07 gibba023 bash[31815]: cephadm 2021-03-10T20:11:06.238293+0000 mgr.gibba044.wflcwh (mgr.34466) 150 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2021-03-10T20:11:07.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:07 gibba044 bash[25485]: cephadm 2021-03-10T20:11:06.228001+0000 mgr.gibba044.wflcwh (mgr.34466) 140 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:11:07.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:07 gibba044 bash[25485]: cephadm 2021-03-10T20:11:06.230111+0000 mgr.gibba044.wflcwh (mgr.34466) 141 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:11:07.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:07 gibba044 bash[25485]: cephadm 2021-03-10T20:11:06.231587+0000 mgr.gibba044.wflcwh (mgr.34466) 142 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:11:07.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:07 gibba044 bash[25485]: cephadm 2021-03-10T20:11:06.231730+0000 mgr.gibba044.wflcwh (mgr.34466) 143 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:11:07.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:07 gibba044 bash[25485]: cephadm 2021-03-10T20:11:06.233263+0000 mgr.gibba044.wflcwh (mgr.34466) 144 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:11:07.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:07 gibba044 bash[25485]: cephadm 2021-03-10T20:11:06.233308+0000 mgr.gibba044.wflcwh (mgr.34466) 145 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:11:07.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:07 gibba044 bash[25485]: cephadm 2021-03-10T20:11:06.234802+0000 mgr.gibba044.wflcwh (mgr.34466) 146 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:11:07.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:07 gibba044 bash[25485]: cephadm 2021-03-10T20:11:06.236058+0000 mgr.gibba044.wflcwh (mgr.34466) 147 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:11:07.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:07 gibba044 bash[25485]: cephadm 2021-03-10T20:11:06.236103+0000 mgr.gibba044.wflcwh (mgr.34466) 148 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:11:07.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:07 gibba044 bash[25485]: audit 2021-03-10T20:11:06.236945+0000 mgr.gibba044.wflcwh (mgr.34466) 149 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T20:11:07.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:07 gibba044 bash[25485]: cephadm 2021-03-10T20:11:06.238293+0000 mgr.gibba044.wflcwh (mgr.34466) 150 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2021-03-10T20:11:08.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:08 gibba023 bash[30844]: cluster 2021-03-10T20:11:07.299201+0000 mgr.gibba044.wflcwh (mgr.34466) 151 : cluster [DBG] pgmap v61: 129 pgs: 20 active+undersized+degraded, 36 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 29/195 objects degraded (14.872%) 2021-03-10T20:11:08.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:08 gibba023 bash[31815]: cluster 2021-03-10T20:11:07.299201+0000 mgr.gibba044.wflcwh (mgr.34466) 151 : cluster [DBG] pgmap v61: 129 pgs: 20 active+undersized+degraded, 36 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 29/195 objects degraded (14.872%) 2021-03-10T20:11:08.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:08 gibba044 bash[25485]: cluster 2021-03-10T20:11:07.299201+0000 mgr.gibba044.wflcwh (mgr.34466) 151 : cluster [DBG] pgmap v61: 129 pgs: 20 active+undersized+degraded, 36 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 29/195 objects degraded (14.872%) 2021-03-10T20:11:09.674 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:11:09 gibba023 bash[34935]: debug 2021-03-10T20:11:09.318+0000 7fa93fbb1080 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: store not yet converted to per-pg omap 2021-03-10T20:11:09.675 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:11:09 gibba023 bash[34935]: debug 2021-03-10T20:11:09.318+0000 7fa93fbb1080 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T20:11:09.675 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:11:09 gibba023 bash[34935]: debug 2021-03-10T20:11:09.450+0000 7fa93fbb1080 -1 osd.1 67 log_to_monitors {default=true} 2021-03-10T20:11:10.675 INFO:journalctl@ceph.osd.1.gibba023.stdout:Mar 10 20:11:10 gibba023 bash[34935]: debug 2021-03-10T20:11:10.390+0000 7fa92e88c700 -1 osd.1 67 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:11:10.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:10 gibba023 bash[30844]: cluster 2021-03-10T20:11:09.301542+0000 mgr.gibba044.wflcwh (mgr.34466) 152 : cluster [DBG] pgmap v62: 129 pgs: 20 active+undersized+degraded, 36 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 29/195 objects degraded (14.872%) 2021-03-10T20:11:10.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:10 gibba023 bash[30844]: audit 2021-03-10T20:11:09.457193+0000 mon.c (mon.1) 8 : audit [INF] from='osd.1 [v2:172.21.2.123:6808/1468359626,v1:172.21.2.123:6809/1468359626]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T20:11:10.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:10 gibba023 bash[30844]: audit 2021-03-10T20:11:09.457461+0000 mon.a (mon.0) 280 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T20:11:10.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:10 gibba023 bash[31815]: cluster 2021-03-10T20:11:09.301542+0000 mgr.gibba044.wflcwh (mgr.34466) 152 : cluster [DBG] pgmap v62: 129 pgs: 20 active+undersized+degraded, 36 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 29/195 objects degraded (14.872%) 2021-03-10T20:11:10.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:10 gibba023 bash[31815]: audit 2021-03-10T20:11:09.457193+0000 mon.c (mon.1) 8 : audit [INF] from='osd.1 [v2:172.21.2.123:6808/1468359626,v1:172.21.2.123:6809/1468359626]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T20:11:10.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:10 gibba023 bash[31815]: audit 2021-03-10T20:11:09.457461+0000 mon.a (mon.0) 280 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T20:11:10.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:10 gibba044 bash[25485]: cluster 2021-03-10T20:11:09.301542+0000 mgr.gibba044.wflcwh (mgr.34466) 152 : cluster [DBG] pgmap v62: 129 pgs: 20 active+undersized+degraded, 36 active+undersized, 73 active+clean; 7.0 KiB data, 11 MiB used, 665 GiB / 672 GiB avail; 29/195 objects degraded (14.872%) 2021-03-10T20:11:10.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:10 gibba044 bash[25485]: audit 2021-03-10T20:11:09.457193+0000 mon.c (mon.1) 8 : audit [INF] from='osd.1 [v2:172.21.2.123:6808/1468359626,v1:172.21.2.123:6809/1468359626]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T20:11:10.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:10 gibba044 bash[25485]: audit 2021-03-10T20:11:09.457461+0000 mon.a (mon.0) 280 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-03-10T20:11:11.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:11 gibba023 bash[30844]: audit 2021-03-10T20:11:10.385366+0000 mon.a (mon.0) 281 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T20:11:11.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:11 gibba023 bash[30844]: cluster 2021-03-10T20:11:10.385566+0000 mon.a (mon.0) 282 : cluster [DBG] osdmap e70: 8 total, 7 up, 8 in 2021-03-10T20:11:11.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:11 gibba023 bash[30844]: audit 2021-03-10T20:11:10.386862+0000 mon.c (mon.1) 9 : audit [INF] from='osd.1 [v2:172.21.2.123:6808/1468359626,v1:172.21.2.123:6809/1468359626]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:11:11.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:11 gibba023 bash[30844]: audit 2021-03-10T20:11:10.390335+0000 mon.a (mon.0) 283 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:11:11.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:11 gibba023 bash[30844]: cluster 2021-03-10T20:11:10.949783+0000 mon.a (mon.0) 284 : cluster [WRN] Health check update: Degraded data redundancy: 29/195 objects degraded (14.872%), 20 pgs degraded (PG_DEGRADED) 2021-03-10T20:11:11.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:11 gibba023 bash[31815]: audit 2021-03-10T20:11:10.385366+0000 mon.a (mon.0) 281 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T20:11:11.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:11 gibba023 bash[31815]: cluster 2021-03-10T20:11:10.385566+0000 mon.a (mon.0) 282 : cluster [DBG] osdmap e70: 8 total, 7 up, 8 in 2021-03-10T20:11:11.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:11 gibba023 bash[31815]: audit 2021-03-10T20:11:10.386862+0000 mon.c (mon.1) 9 : audit [INF] from='osd.1 [v2:172.21.2.123:6808/1468359626,v1:172.21.2.123:6809/1468359626]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:11:11.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:11 gibba023 bash[31815]: audit 2021-03-10T20:11:10.390335+0000 mon.a (mon.0) 283 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:11:11.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:11 gibba023 bash[31815]: cluster 2021-03-10T20:11:10.949783+0000 mon.a (mon.0) 284 : cluster [WRN] Health check update: Degraded data redundancy: 29/195 objects degraded (14.872%), 20 pgs degraded (PG_DEGRADED) 2021-03-10T20:11:11.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:11 gibba044 bash[25485]: audit 2021-03-10T20:11:10.385366+0000 mon.a (mon.0) 281 : audit [INF] from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-03-10T20:11:11.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:11 gibba044 bash[25485]: cluster 2021-03-10T20:11:10.385566+0000 mon.a (mon.0) 282 : cluster [DBG] osdmap e70: 8 total, 7 up, 8 in 2021-03-10T20:11:11.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:11 gibba044 bash[25485]: audit 2021-03-10T20:11:10.386862+0000 mon.c (mon.1) 9 : audit [INF] from='osd.1 [v2:172.21.2.123:6808/1468359626,v1:172.21.2.123:6809/1468359626]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:11:11.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:11 gibba044 bash[25485]: audit 2021-03-10T20:11:10.390335+0000 mon.a (mon.0) 283 : audit [INF] from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:11:11.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:11 gibba044 bash[25485]: cluster 2021-03-10T20:11:10.949783+0000 mon.a (mon.0) 284 : cluster [WRN] Health check update: Degraded data redundancy: 29/195 objects degraded (14.872%), 20 pgs degraded (PG_DEGRADED) 2021-03-10T20:11:12.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:12 gibba023 bash[30844]: cluster 2021-03-10T20:11:11.302922+0000 mgr.gibba044.wflcwh (mgr.34466) 153 : cluster [DBG] pgmap v64: 129 pgs: 20 active+undersized+degraded, 36 active+undersized, 73 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 29/195 objects degraded (14.872%) 2021-03-10T20:11:12.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:12 gibba023 bash[30844]: cluster 2021-03-10T20:11:11.390092+0000 mon.a (mon.0) 285 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:11:12.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:12 gibba023 bash[30844]: cluster 2021-03-10T20:11:11.400655+0000 mon.a (mon.0) 286 : cluster [INF] osd.1 [v2:172.21.2.123:6808/1468359626,v1:172.21.2.123:6809/1468359626] boot 2021-03-10T20:11:12.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:12 gibba023 bash[30844]: cluster 2021-03-10T20:11:11.400691+0000 mon.a (mon.0) 287 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-03-10T20:11:12.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:12 gibba023 bash[30844]: audit 2021-03-10T20:11:11.401496+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:11:12.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:12 gibba023 bash[31815]: cluster 2021-03-10T20:11:11.302922+0000 mgr.gibba044.wflcwh (mgr.34466) 153 : cluster [DBG] pgmap v64: 129 pgs: 20 active+undersized+degraded, 36 active+undersized, 73 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 29/195 objects degraded (14.872%) 2021-03-10T20:11:12.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:12 gibba023 bash[31815]: cluster 2021-03-10T20:11:11.390092+0000 mon.a (mon.0) 285 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:11:12.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:12 gibba023 bash[31815]: cluster 2021-03-10T20:11:11.400655+0000 mon.a (mon.0) 286 : cluster [INF] osd.1 [v2:172.21.2.123:6808/1468359626,v1:172.21.2.123:6809/1468359626] boot 2021-03-10T20:11:12.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:12 gibba023 bash[31815]: cluster 2021-03-10T20:11:11.400691+0000 mon.a (mon.0) 287 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-03-10T20:11:12.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:12 gibba023 bash[31815]: audit 2021-03-10T20:11:11.401496+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:11:12.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:12 gibba044 bash[25485]: cluster 2021-03-10T20:11:11.302922+0000 mgr.gibba044.wflcwh (mgr.34466) 153 : cluster [DBG] pgmap v64: 129 pgs: 20 active+undersized+degraded, 36 active+undersized, 73 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 29/195 objects degraded (14.872%) 2021-03-10T20:11:12.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:12 gibba044 bash[25485]: cluster 2021-03-10T20:11:11.390092+0000 mon.a (mon.0) 285 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:11:12.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:12 gibba044 bash[25485]: cluster 2021-03-10T20:11:11.400655+0000 mon.a (mon.0) 286 : cluster [INF] osd.1 [v2:172.21.2.123:6808/1468359626,v1:172.21.2.123:6809/1468359626] boot 2021-03-10T20:11:12.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:12 gibba044 bash[25485]: cluster 2021-03-10T20:11:11.400691+0000 mon.a (mon.0) 287 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-03-10T20:11:12.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:12 gibba044 bash[25485]: audit 2021-03-10T20:11:11.401496+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-03-10T20:11:13.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:13 gibba023 bash[30844]: cluster 2021-03-10T20:11:12.404627+0000 mon.a (mon.0) 289 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2021-03-10T20:11:13.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:13 gibba023 bash[31815]: cluster 2021-03-10T20:11:12.404627+0000 mon.a (mon.0) 289 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2021-03-10T20:11:13.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:13 gibba044 bash[25485]: cluster 2021-03-10T20:11:12.404627+0000 mon.a (mon.0) 289 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2021-03-10T20:11:14.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:14 gibba023 bash[30844]: cluster 2021-03-10T20:11:13.304942+0000 mgr.gibba044.wflcwh (mgr.34466) 154 : cluster [DBG] pgmap v67: 129 pgs: 8 active+undersized+degraded, 14 active+undersized, 107 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 13/195 objects degraded (6.667%) 2021-03-10T20:11:14.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:14 gibba023 bash[31815]: cluster 2021-03-10T20:11:13.304942+0000 mgr.gibba044.wflcwh (mgr.34466) 154 : cluster [DBG] pgmap v67: 129 pgs: 8 active+undersized+degraded, 14 active+undersized, 107 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 13/195 objects degraded (6.667%) 2021-03-10T20:11:14.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:14 gibba044 bash[25485]: cluster 2021-03-10T20:11:13.304942+0000 mgr.gibba044.wflcwh (mgr.34466) 154 : cluster [DBG] pgmap v67: 129 pgs: 8 active+undersized+degraded, 14 active+undersized, 107 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 13/195 objects degraded (6.667%) 2021-03-10T20:11:16.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:16 gibba044 bash[25485]: cluster 2021-03-10T20:11:15.306495+0000 mgr.gibba044.wflcwh (mgr.34466) 155 : cluster [DBG] pgmap v68: 129 pgs: 8 active+undersized+degraded, 10 active+undersized, 111 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 13/195 objects degraded (6.667%) 2021-03-10T20:11:16.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:16 gibba044 bash[25485]: cluster 2021-03-10T20:11:15.952387+0000 mon.a (mon.0) 290 : cluster [WRN] Health check update: Degraded data redundancy: 13/195 objects degraded (6.667%), 8 pgs degraded (PG_DEGRADED) 2021-03-10T20:11:16.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:16 gibba023 bash[30844]: cluster 2021-03-10T20:11:15.306495+0000 mgr.gibba044.wflcwh (mgr.34466) 155 : cluster [DBG] pgmap v68: 129 pgs: 8 active+undersized+degraded, 10 active+undersized, 111 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 13/195 objects degraded (6.667%) 2021-03-10T20:11:16.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:16 gibba023 bash[30844]: cluster 2021-03-10T20:11:15.952387+0000 mon.a (mon.0) 290 : cluster [WRN] Health check update: Degraded data redundancy: 13/195 objects degraded (6.667%), 8 pgs degraded (PG_DEGRADED) 2021-03-10T20:11:16.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:16 gibba023 bash[31815]: cluster 2021-03-10T20:11:15.306495+0000 mgr.gibba044.wflcwh (mgr.34466) 155 : cluster [DBG] pgmap v68: 129 pgs: 8 active+undersized+degraded, 10 active+undersized, 111 active+clean; 7.0 KiB data, 16 MiB used, 666 GiB / 672 GiB avail; 13/195 objects degraded (6.667%) 2021-03-10T20:11:16.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:16 gibba023 bash[31815]: cluster 2021-03-10T20:11:15.952387+0000 mon.a (mon.0) 290 : cluster [WRN] Health check update: Degraded data redundancy: 13/195 objects degraded (6.667%), 8 pgs degraded (PG_DEGRADED) 2021-03-10T20:11:17.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:17 gibba044 bash[25485]: cluster 2021-03-10T20:11:17.307866+0000 mgr.gibba044.wflcwh (mgr.34466) 156 : cluster [DBG] pgmap v69: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:11:17.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:17 gibba044 bash[25485]: cluster 2021-03-10T20:11:17.431735+0000 mon.a (mon.0) 291 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/195 objects degraded (6.667%), 8 pgs degraded) 2021-03-10T20:11:17.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:17 gibba023 bash[30844]: cluster 2021-03-10T20:11:17.307866+0000 mgr.gibba044.wflcwh (mgr.34466) 156 : cluster [DBG] pgmap v69: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:11:17.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:17 gibba023 bash[30844]: cluster 2021-03-10T20:11:17.431735+0000 mon.a (mon.0) 291 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/195 objects degraded (6.667%), 8 pgs degraded) 2021-03-10T20:11:17.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:17 gibba023 bash[31815]: cluster 2021-03-10T20:11:17.307866+0000 mgr.gibba044.wflcwh (mgr.34466) 156 : cluster [DBG] pgmap v69: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:11:17.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:17 gibba023 bash[31815]: cluster 2021-03-10T20:11:17.431735+0000 mon.a (mon.0) 291 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/195 objects degraded (6.667%), 8 pgs degraded) 2021-03-10T20:11:18.520 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:11:18.750 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:11:18.751 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (2m) 12s ago 8m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:11:18.751 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (7m) 79s ago 7m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:11:18.752 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (2m) 79s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:11:18.752 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (3m) 79s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:11:18.752 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (2m) 12s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:11:18.752 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (118s) 12s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:11:18.753 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (91s) 79s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:11:18.753 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (101s) 12s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:11:18.753 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (8m) 12s ago 8m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:11:18.753 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (8m) 79s ago 8m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:11:18.754 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (41s) 12s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:11:18.754 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (14s) 12s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:11:18.754 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (10m) 12s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 0b4c19578b20 2021-03-10T20:11:18.754 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (9m) 12s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 25229602755c 2021-03-10T20:11:18.755 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (9m) 79s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a745be9e28cb 2021-03-10T20:11:18.755 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (9m) 79s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0313bf557eb 2021-03-10T20:11:18.755 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (8m) 79s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 ffa9fe94cea1 2021-03-10T20:11:18.755 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (8m) 79s ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 082d0fe68f90 2021-03-10T20:11:18.755 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (7m) 79s ago 8m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:11:18.756 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 12s ago 5m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:11:18.756 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 79s ago 5m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:11:19.005 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:11:19.005 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:11:19.006 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:11:19.006 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:11:19.006 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:11:19.006 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:11:19.007 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:11:19.007 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:11:19.007 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 6, 2021-03-10T20:11:19.007 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 2 2021-03-10T20:11:19.007 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:11:19.008 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:11:19.008 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:11:19.008 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 6, 2021-03-10T20:11:19.008 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:11:19.008 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:11:19.009 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:11:19.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:19 gibba023 bash[30844]: audit 2021-03-10T20:11:19.005397+0000 mon.c (mon.1) 10 : audit [DBG] from='client.? 172.21.2.123:0/1820965749' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:19.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:19 gibba023 bash[31815]: audit 2021-03-10T20:11:19.005397+0000 mon.c (mon.1) 10 : audit [DBG] from='client.? 172.21.2.123:0/1820965749' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:19.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:19 gibba044 bash[25485]: audit 2021-03-10T20:11:19.005397+0000 mon.c (mon.1) 10 : audit [DBG] from='client.? 172.21.2.123:0/1820965749' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:20.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:20 gibba023 bash[30844]: audit 2021-03-10T20:11:18.513358+0000 mgr.gibba044.wflcwh (mgr.34466) 157 : audit [DBG] from='client.54169 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:11:20.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:20 gibba023 bash[30844]: audit 2021-03-10T20:11:18.739989+0000 mgr.gibba044.wflcwh (mgr.34466) 158 : audit [DBG] from='client.54175 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:11:20.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:20 gibba023 bash[30844]: cluster 2021-03-10T20:11:19.309645+0000 mgr.gibba044.wflcwh (mgr.34466) 159 : cluster [DBG] pgmap v70: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:11:20.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:20 gibba023 bash[31815]: audit 2021-03-10T20:11:18.513358+0000 mgr.gibba044.wflcwh (mgr.34466) 157 : audit [DBG] from='client.54169 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:11:20.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:20 gibba023 bash[31815]: audit 2021-03-10T20:11:18.739989+0000 mgr.gibba044.wflcwh (mgr.34466) 158 : audit [DBG] from='client.54175 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:11:20.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:20 gibba023 bash[31815]: cluster 2021-03-10T20:11:19.309645+0000 mgr.gibba044.wflcwh (mgr.34466) 159 : cluster [DBG] pgmap v70: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:11:20.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:20 gibba044 bash[25485]: audit 2021-03-10T20:11:18.513358+0000 mgr.gibba044.wflcwh (mgr.34466) 157 : audit [DBG] from='client.54169 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:11:20.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:20 gibba044 bash[25485]: audit 2021-03-10T20:11:18.739989+0000 mgr.gibba044.wflcwh (mgr.34466) 158 : audit [DBG] from='client.54175 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:11:20.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:20 gibba044 bash[25485]: cluster 2021-03-10T20:11:19.309645+0000 mgr.gibba044.wflcwh (mgr.34466) 159 : cluster [DBG] pgmap v70: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:11:22.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:21 gibba044 bash[25485]: audit 2021-03-10T20:11:21.253205+0000 mon.a (mon.0) 292 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T20:11:22.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:21 gibba044 bash[25485]: audit 2021-03-10T20:11:21.256069+0000 mgr.gibba044.wflcwh (mgr.34466) 160 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T20:11:22.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:21 gibba044 bash[25485]: cephadm 2021-03-10T20:11:21.260268+0000 mgr.gibba044.wflcwh (mgr.34466) 161 : cephadm [INF] Upgrade: osd.2 is safe to restart 2021-03-10T20:11:22.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:21 gibba044 bash[25485]: cluster 2021-03-10T20:11:21.310442+0000 mgr.gibba044.wflcwh (mgr.34466) 162 : cluster [DBG] pgmap v71: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:11:22.367 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:21 gibba023 bash[30844]: audit 2021-03-10T20:11:21.253205+0000 mon.a (mon.0) 292 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T20:11:22.367 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:21 gibba023 bash[30844]: audit 2021-03-10T20:11:21.256069+0000 mgr.gibba044.wflcwh (mgr.34466) 160 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T20:11:22.368 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:21 gibba023 bash[30844]: cephadm 2021-03-10T20:11:21.260268+0000 mgr.gibba044.wflcwh (mgr.34466) 161 : cephadm [INF] Upgrade: osd.2 is safe to restart 2021-03-10T20:11:22.368 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:21 gibba023 bash[30844]: cluster 2021-03-10T20:11:21.310442+0000 mgr.gibba044.wflcwh (mgr.34466) 162 : cluster [DBG] pgmap v71: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:11:22.369 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:21 gibba023 bash[31815]: audit 2021-03-10T20:11:21.253205+0000 mon.a (mon.0) 292 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T20:11:22.369 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:21 gibba023 bash[31815]: audit 2021-03-10T20:11:21.256069+0000 mgr.gibba044.wflcwh (mgr.34466) 160 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-03-10T20:11:22.369 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:21 gibba023 bash[31815]: cephadm 2021-03-10T20:11:21.260268+0000 mgr.gibba044.wflcwh (mgr.34466) 161 : cephadm [INF] Upgrade: osd.2 is safe to restart 2021-03-10T20:11:22.370 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:21 gibba023 bash[31815]: cluster 2021-03-10T20:11:21.310442+0000 mgr.gibba044.wflcwh (mgr.34466) 162 : cluster [DBG] pgmap v71: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:11:23.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:23 gibba023 bash[30844]: audit 2021-03-10T20:11:22.077672+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:23.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:23 gibba023 bash[31815]: audit 2021-03-10T20:11:22.077672+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:23.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:23 gibba044 bash[25485]: audit 2021-03-10T20:11:22.077672+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:24.649 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:24 gibba023 bash[30844]: cephadm 2021-03-10T20:11:23.245037+0000 mgr.gibba044.wflcwh (mgr.34466) 163 : cephadm [INF] Upgrade: Updating osd.2 2021-03-10T20:11:24.649 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:24 gibba023 bash[30844]: audit 2021-03-10T20:11:23.249137+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:24.650 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:24 gibba023 bash[30844]: audit 2021-03-10T20:11:23.254115+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T20:11:24.650 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:24 gibba023 bash[30844]: cephadm 2021-03-10T20:11:23.255147+0000 mgr.gibba044.wflcwh (mgr.34466) 164 : cephadm [INF] Deploying daemon osd.2 on gibba023 2021-03-10T20:11:24.650 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:24 gibba023 bash[30844]: cluster 2021-03-10T20:11:23.312089+0000 mgr.gibba044.wflcwh (mgr.34466) 165 : cluster [DBG] pgmap v72: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:11:24.650 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:24 gibba023 bash[31815]: cephadm 2021-03-10T20:11:23.245037+0000 mgr.gibba044.wflcwh (mgr.34466) 163 : cephadm [INF] Upgrade: Updating osd.2 2021-03-10T20:11:24.651 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:24 gibba023 bash[31815]: audit 2021-03-10T20:11:23.249137+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:24.651 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:24 gibba023 bash[31815]: audit 2021-03-10T20:11:23.254115+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T20:11:24.651 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:24 gibba023 bash[31815]: cephadm 2021-03-10T20:11:23.255147+0000 mgr.gibba044.wflcwh (mgr.34466) 164 : cephadm [INF] Deploying daemon osd.2 on gibba023 2021-03-10T20:11:24.651 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:24 gibba023 bash[31815]: cluster 2021-03-10T20:11:23.312089+0000 mgr.gibba044.wflcwh (mgr.34466) 165 : cluster [DBG] pgmap v72: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:11:24.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:24 gibba044 bash[25485]: cephadm 2021-03-10T20:11:23.245037+0000 mgr.gibba044.wflcwh (mgr.34466) 163 : cephadm [INF] Upgrade: Updating osd.2 2021-03-10T20:11:24.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:24 gibba044 bash[25485]: audit 2021-03-10T20:11:23.249137+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:24.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:24 gibba044 bash[25485]: audit 2021-03-10T20:11:23.254115+0000 mon.a (mon.0) 295 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2021-03-10T20:11:24.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:24 gibba044 bash[25485]: cephadm 2021-03-10T20:11:23.255147+0000 mgr.gibba044.wflcwh (mgr.34466) 164 : cephadm [INF] Deploying daemon osd.2 on gibba023 2021-03-10T20:11:24.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:24 gibba044 bash[25485]: cluster 2021-03-10T20:11:23.312089+0000 mgr.gibba044.wflcwh (mgr.34466) 165 : cluster [DBG] pgmap v72: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:11:25.425 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:11:25 gibba023 systemd[1]: Stopping Ceph osd.2 for dd719b26-81da-11eb-9080-001a4aab830c... 2021-03-10T20:11:25.425 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:11:25 gibba023 bash[17868]: debug 2021-03-10T20:11:25.386+0000 7f1e75fb4700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T20:11:25.425 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:11:25 gibba023 bash[17868]: debug 2021-03-10T20:11:25.386+0000 7f1e75fb4700 -1 osd.2 72 *** Got signal Terminated *** 2021-03-10T20:11:25.426 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:11:25 gibba023 bash[17868]: debug 2021-03-10T20:11:25.386+0000 7f1e75fb4700 -1 osd.2 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T20:11:26.424 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:11:26 gibba023 docker[35868]: ceph-dd719b26-81da-11eb-9080-001a4aab830c-osd.2 2021-03-10T20:11:26.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.313318+0000 mgr.gibba044.wflcwh (mgr.34466) 166 : cluster [DBG] pgmap v73: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:11:26.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.487948+0000 mon.a (mon.0) 296 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:11:26.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.487984+0000 mon.a (mon.0) 297 : cluster [INF] osd.2 failed (root=default,host=gibba023) (connection refused reported by osd.4) 2021-03-10T20:11:26.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.488231+0000 mon.a (mon.0) 298 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:11:26.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.488396+0000 mon.a (mon.0) 299 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:11:26.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.488499+0000 mon.a (mon.0) 300 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:11:26.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.488611+0000 mon.a (mon.0) 301 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:11:26.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.488708+0000 mon.a (mon.0) 302 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:11:26.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.488794+0000 mon.a (mon.0) 303 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:11:26.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.488904+0000 mon.a (mon.0) 304 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:11:26.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.489007+0000 mon.a (mon.0) 305 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:11:26.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.489113+0000 mon.a (mon.0) 306 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:11:26.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.489249+0000 mon.a (mon.0) 307 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:11:26.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.687674+0000 mon.a (mon.0) 308 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:11:26.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.688051+0000 mon.a (mon.0) 309 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:11:26.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.689227+0000 mon.a (mon.0) 310 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:11:26.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.689646+0000 mon.a (mon.0) 311 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:11:26.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.689832+0000 mon.a (mon.0) 312 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:11:26.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.690240+0000 mon.a (mon.0) 313 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:11:26.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.690740+0000 mon.a (mon.0) 314 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:11:26.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.690928+0000 mon.a (mon.0) 315 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:11:26.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.691317+0000 mon.a (mon.0) 316 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:11:26.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.691591+0000 mon.a (mon.0) 317 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:11:26.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.692019+0000 mon.a (mon.0) 318 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:11:26.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.692289+0000 mon.a (mon.0) 319 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:11:26.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.313318+0000 mgr.gibba044.wflcwh (mgr.34466) 166 : cluster [DBG] pgmap v73: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:11:26.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.487948+0000 mon.a (mon.0) 296 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:11:26.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.487984+0000 mon.a (mon.0) 297 : cluster [INF] osd.2 failed (root=default,host=gibba023) (connection refused reported by osd.4) 2021-03-10T20:11:26.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.488231+0000 mon.a (mon.0) 298 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:11:26.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.488396+0000 mon.a (mon.0) 299 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:11:26.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.488499+0000 mon.a (mon.0) 300 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:11:26.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.488611+0000 mon.a (mon.0) 301 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:11:26.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.488708+0000 mon.a (mon.0) 302 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:11:26.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.488794+0000 mon.a (mon.0) 303 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:11:26.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.488904+0000 mon.a (mon.0) 304 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:11:26.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.489007+0000 mon.a (mon.0) 305 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:11:26.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.489113+0000 mon.a (mon.0) 306 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:11:26.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.489249+0000 mon.a (mon.0) 307 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:11:26.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.687674+0000 mon.a (mon.0) 308 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:11:26.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.688051+0000 mon.a (mon.0) 309 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:11:26.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.689227+0000 mon.a (mon.0) 310 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:11:26.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.689646+0000 mon.a (mon.0) 311 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:11:26.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.689832+0000 mon.a (mon.0) 312 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:11:26.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.690240+0000 mon.a (mon.0) 313 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:11:26.436 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.690740+0000 mon.a (mon.0) 314 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:11:26.436 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.690928+0000 mon.a (mon.0) 315 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:11:26.436 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.691317+0000 mon.a (mon.0) 316 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:11:26.436 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.691591+0000 mon.a (mon.0) 317 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:11:26.437 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.692019+0000 mon.a (mon.0) 318 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:11:26.437 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.692289+0000 mon.a (mon.0) 319 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:11:26.437 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.692840+0000 mon.a (mon.0) 320 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T20:11:26.438 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.693120+0000 mon.a (mon.0) 321 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T20:11:26.438 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.693621+0000 mon.a (mon.0) 322 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:11:26.438 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.693894+0000 mon.a (mon.0) 323 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:11:26.438 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.694562+0000 mon.a (mon.0) 324 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:11:26.438 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.694876+0000 mon.a (mon.0) 325 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:11:26.439 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:25.695447+0000 mon.a (mon.0) 326 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:11:26.439 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:26.088691+0000 mon.a (mon.0) 327 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:11:26.439 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:26.089397+0000 mon.a (mon.0) 328 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:11:26.439 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:26.090098+0000 mon.a (mon.0) 329 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:11:26.440 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:26.090632+0000 mon.a (mon.0) 330 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:11:26.440 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:26.091017+0000 mon.a (mon.0) 331 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:11:26.440 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:26.091188+0000 mon.a (mon.0) 332 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:11:26.440 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:26.091747+0000 mon.a (mon.0) 333 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:11:26.440 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:26.091937+0000 mon.a (mon.0) 334 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:11:26.441 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:26.092324+0000 mon.a (mon.0) 335 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:11:26.441 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:26.092604+0000 mon.a (mon.0) 336 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:11:26.441 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:26.093061+0000 mon.a (mon.0) 337 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:11:26.441 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:26.093344+0000 mon.a (mon.0) 338 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T20:11:26.441 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:26.093882+0000 mon.a (mon.0) 339 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T20:11:26.442 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:26.094360+0000 mon.a (mon.0) 340 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:11:26.442 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:26.094514+0000 mon.a (mon.0) 341 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:11:26.442 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:26.094600+0000 mon.a (mon.0) 342 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:11:26.442 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:26.094650+0000 mon.a (mon.0) 343 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:11:26.443 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:26.094771+0000 mon.a (mon.0) 344 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:11:26.443 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[30844]: cluster 2021-03-10T20:11:26.094950+0000 mon.a (mon.0) 345 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:11:26.443 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.692840+0000 mon.a (mon.0) 320 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T20:11:26.443 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.693120+0000 mon.a (mon.0) 321 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T20:11:26.444 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.693621+0000 mon.a (mon.0) 322 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:11:26.444 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.693894+0000 mon.a (mon.0) 323 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:11:26.444 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.694562+0000 mon.a (mon.0) 324 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:11:26.444 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.694876+0000 mon.a (mon.0) 325 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:11:26.444 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:25.695447+0000 mon.a (mon.0) 326 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:11:26.445 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:26.088691+0000 mon.a (mon.0) 327 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:11:26.445 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:26.089397+0000 mon.a (mon.0) 328 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:11:26.445 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:26.090098+0000 mon.a (mon.0) 329 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:11:26.445 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:26.090632+0000 mon.a (mon.0) 330 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:11:26.446 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:26.091017+0000 mon.a (mon.0) 331 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:11:26.446 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:26.091188+0000 mon.a (mon.0) 332 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:11:26.446 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:26.091747+0000 mon.a (mon.0) 333 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:11:26.446 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:26.091937+0000 mon.a (mon.0) 334 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:11:26.447 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:26.092324+0000 mon.a (mon.0) 335 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:11:26.447 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:26.092604+0000 mon.a (mon.0) 336 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:11:26.447 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:26.093061+0000 mon.a (mon.0) 337 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:11:26.447 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:26.093344+0000 mon.a (mon.0) 338 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T20:11:26.447 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:26.093882+0000 mon.a (mon.0) 339 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T20:11:26.448 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:26.094360+0000 mon.a (mon.0) 340 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:11:26.448 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:26.094514+0000 mon.a (mon.0) 341 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:11:26.448 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:26.094600+0000 mon.a (mon.0) 342 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:11:26.448 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:26.094650+0000 mon.a (mon.0) 343 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:11:26.448 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:26.094771+0000 mon.a (mon.0) 344 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:11:26.449 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:26 gibba023 bash[31815]: cluster 2021-03-10T20:11:26.094950+0000 mon.a (mon.0) 345 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:11:26.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.313318+0000 mgr.gibba044.wflcwh (mgr.34466) 166 : cluster [DBG] pgmap v73: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:11:26.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.487948+0000 mon.a (mon.0) 296 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:11:26.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.487984+0000 mon.a (mon.0) 297 : cluster [INF] osd.2 failed (root=default,host=gibba023) (connection refused reported by osd.4) 2021-03-10T20:11:26.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.488231+0000 mon.a (mon.0) 298 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:11:26.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.488396+0000 mon.a (mon.0) 299 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:11:26.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.488499+0000 mon.a (mon.0) 300 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:11:26.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.488611+0000 mon.a (mon.0) 301 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:11:26.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.488708+0000 mon.a (mon.0) 302 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:11:26.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.488794+0000 mon.a (mon.0) 303 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:11:26.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.488904+0000 mon.a (mon.0) 304 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:11:26.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.489007+0000 mon.a (mon.0) 305 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:11:26.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.489113+0000 mon.a (mon.0) 306 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:11:26.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.489249+0000 mon.a (mon.0) 307 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:11:26.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.687674+0000 mon.a (mon.0) 308 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:11:26.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.688051+0000 mon.a (mon.0) 309 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:11:26.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.689227+0000 mon.a (mon.0) 310 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:11:26.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.689646+0000 mon.a (mon.0) 311 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:11:26.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.689832+0000 mon.a (mon.0) 312 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:11:26.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.690240+0000 mon.a (mon.0) 313 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:11:26.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.690740+0000 mon.a (mon.0) 314 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:11:26.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.690928+0000 mon.a (mon.0) 315 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:11:26.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.691317+0000 mon.a (mon.0) 316 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:11:26.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.691591+0000 mon.a (mon.0) 317 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:11:26.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.692019+0000 mon.a (mon.0) 318 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:11:26.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.692289+0000 mon.a (mon.0) 319 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:11:26.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.692840+0000 mon.a (mon.0) 320 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T20:11:26.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.693120+0000 mon.a (mon.0) 321 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T20:11:26.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.693621+0000 mon.a (mon.0) 322 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:11:26.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.693894+0000 mon.a (mon.0) 323 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:11:26.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.694562+0000 mon.a (mon.0) 324 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:11:26.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.694876+0000 mon.a (mon.0) 325 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:11:26.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:25.695447+0000 mon.a (mon.0) 326 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:11:26.758 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:26.088691+0000 mon.a (mon.0) 327 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:11:26.758 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:26.089397+0000 mon.a (mon.0) 328 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:11:26.758 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:26.090098+0000 mon.a (mon.0) 329 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:11:26.758 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:26.090632+0000 mon.a (mon.0) 330 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:11:26.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:26.091017+0000 mon.a (mon.0) 331 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:11:26.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:26.091188+0000 mon.a (mon.0) 332 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-03-10T20:11:26.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:26.091747+0000 mon.a (mon.0) 333 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:11:26.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:26.091937+0000 mon.a (mon.0) 334 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:11:26.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:26.092324+0000 mon.a (mon.0) 335 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-03-10T20:11:26.760 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:26.092604+0000 mon.a (mon.0) 336 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-03-10T20:11:26.760 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:26.093061+0000 mon.a (mon.0) 337 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-03-10T20:11:26.760 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:26.093344+0000 mon.a (mon.0) 338 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T20:11:26.760 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:26.093882+0000 mon.a (mon.0) 339 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-03-10T20:11:26.761 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:26.094360+0000 mon.a (mon.0) 340 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:11:26.761 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:26.094514+0000 mon.a (mon.0) 341 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:11:26.761 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:26.094600+0000 mon.a (mon.0) 342 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:11:26.761 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:26.094650+0000 mon.a (mon.0) 343 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-03-10T20:11:26.761 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:26.094771+0000 mon.a (mon.0) 344 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:11:26.762 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:26 gibba044 bash[25485]: cluster 2021-03-10T20:11:26.094950+0000 mon.a (mon.0) 345 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-03-10T20:11:27.554 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:27 gibba023 bash[30844]: cluster 2021-03-10T20:11:26.366517+0000 mon.a (mon.0) 346 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:11:27.554 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:27 gibba023 bash[30844]: cluster 2021-03-10T20:11:26.378406+0000 mon.a (mon.0) 347 : cluster [DBG] osdmap e73: 8 total, 7 up, 8 in 2021-03-10T20:11:27.555 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:27 gibba023 bash[30844]: audit 2021-03-10T20:11:26.955810+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.9", "id": [4, 2]}]: dispatch 2021-03-10T20:11:27.555 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:27 gibba023 bash[30844]: audit 2021-03-10T20:11:26.956620+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.c", "id": [0, 2]}]: dispatch 2021-03-10T20:11:27.555 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:27 gibba023 bash[30844]: audit 2021-03-10T20:11:26.957365+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.d", "id": [7, 6]}]: dispatch 2021-03-10T20:11:27.555 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:27 gibba023 bash[30844]: audit 2021-03-10T20:11:26.958033+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.f", "id": [4, 3, 5, 2]}]: dispatch 2021-03-10T20:11:27.556 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:27 gibba023 bash[30844]: audit 2021-03-10T20:11:26.958791+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.11", "id": [7, 3]}]: dispatch 2021-03-10T20:11:27.556 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:27 gibba023 bash[30844]: audit 2021-03-10T20:11:26.959460+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.17", "id": [1, 2]}]: dispatch 2021-03-10T20:11:27.556 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:27 gibba023 bash[30844]: audit 2021-03-10T20:11:26.960106+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.19", "id": [5, 2]}]: dispatch 2021-03-10T20:11:27.556 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:27 gibba023 bash[30844]: audit 2021-03-10T20:11:26.960764+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:11:27.557 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:27 gibba023 bash[30844]: audit 2021-03-10T20:11:26.961431+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1f", "id": [4, 2]}]: dispatch 2021-03-10T20:11:27.557 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:27 gibba023 bash[30844]: audit 2021-03-10T20:11:27.070761+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:11:27.557 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:27 gibba023 bash[30844]: audit 2021-03-10T20:11:27.075672+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:11:27.557 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:27 gibba023 bash[30844]: cluster 2021-03-10T20:11:27.374481+0000 mon.a (mon.0) 359 : cluster [DBG] osdmap e74: 8 total, 7 up, 8 in 2021-03-10T20:11:27.558 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:27 gibba023 bash[31815]: cluster 2021-03-10T20:11:26.366517+0000 mon.a (mon.0) 346 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:11:27.558 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:27 gibba023 bash[31815]: cluster 2021-03-10T20:11:26.378406+0000 mon.a (mon.0) 347 : cluster [DBG] osdmap e73: 8 total, 7 up, 8 in 2021-03-10T20:11:27.558 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:27 gibba023 bash[31815]: audit 2021-03-10T20:11:26.955810+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.9", "id": [4, 2]}]: dispatch 2021-03-10T20:11:27.558 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:27 gibba023 bash[31815]: audit 2021-03-10T20:11:26.956620+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.c", "id": [0, 2]}]: dispatch 2021-03-10T20:11:27.559 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:27 gibba023 bash[31815]: audit 2021-03-10T20:11:26.957365+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.d", "id": [7, 6]}]: dispatch 2021-03-10T20:11:27.559 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:27 gibba023 bash[31815]: audit 2021-03-10T20:11:26.958033+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.f", "id": [4, 3, 5, 2]}]: dispatch 2021-03-10T20:11:27.559 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:27 gibba023 bash[31815]: audit 2021-03-10T20:11:26.958791+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.11", "id": [7, 3]}]: dispatch 2021-03-10T20:11:27.559 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:27 gibba023 bash[31815]: audit 2021-03-10T20:11:26.959460+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.17", "id": [1, 2]}]: dispatch 2021-03-10T20:11:27.559 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:27 gibba023 bash[31815]: audit 2021-03-10T20:11:26.960106+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.19", "id": [5, 2]}]: dispatch 2021-03-10T20:11:27.560 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:27 gibba023 bash[31815]: audit 2021-03-10T20:11:26.960764+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:11:27.560 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:27 gibba023 bash[31815]: audit 2021-03-10T20:11:26.961431+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1f", "id": [4, 2]}]: dispatch 2021-03-10T20:11:27.560 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:27 gibba023 bash[31815]: audit 2021-03-10T20:11:27.070761+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:11:27.560 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:27 gibba023 bash[31815]: audit 2021-03-10T20:11:27.075672+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:11:27.561 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:27 gibba023 bash[31815]: cluster 2021-03-10T20:11:27.374481+0000 mon.a (mon.0) 359 : cluster [DBG] osdmap e74: 8 total, 7 up, 8 in 2021-03-10T20:11:27.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:27 gibba044 bash[25485]: cluster 2021-03-10T20:11:26.366517+0000 mon.a (mon.0) 346 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:11:27.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:27 gibba044 bash[25485]: cluster 2021-03-10T20:11:26.378406+0000 mon.a (mon.0) 347 : cluster [DBG] osdmap e73: 8 total, 7 up, 8 in 2021-03-10T20:11:27.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:27 gibba044 bash[25485]: audit 2021-03-10T20:11:26.955810+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.9", "id": [4, 2]}]: dispatch 2021-03-10T20:11:27.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:27 gibba044 bash[25485]: audit 2021-03-10T20:11:26.956620+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.c", "id": [0, 2]}]: dispatch 2021-03-10T20:11:27.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:27 gibba044 bash[25485]: audit 2021-03-10T20:11:26.957365+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.d", "id": [7, 6]}]: dispatch 2021-03-10T20:11:27.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:27 gibba044 bash[25485]: audit 2021-03-10T20:11:26.958033+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.f", "id": [4, 3, 5, 2]}]: dispatch 2021-03-10T20:11:27.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:27 gibba044 bash[25485]: audit 2021-03-10T20:11:26.958791+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.11", "id": [7, 3]}]: dispatch 2021-03-10T20:11:27.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:27 gibba044 bash[25485]: audit 2021-03-10T20:11:26.959460+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.17", "id": [1, 2]}]: dispatch 2021-03-10T20:11:27.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:27 gibba044 bash[25485]: audit 2021-03-10T20:11:26.960106+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.19", "id": [5, 2]}]: dispatch 2021-03-10T20:11:27.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:27 gibba044 bash[25485]: audit 2021-03-10T20:11:26.960764+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:11:27.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:27 gibba044 bash[25485]: audit 2021-03-10T20:11:26.961431+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.1f", "id": [4, 2]}]: dispatch 2021-03-10T20:11:27.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:27 gibba044 bash[25485]: audit 2021-03-10T20:11:27.070761+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:11:27.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:27 gibba044 bash[25485]: audit 2021-03-10T20:11:27.075672+0000 mon.a (mon.0) 358 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:11:27.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:27 gibba044 bash[25485]: cluster 2021-03-10T20:11:27.374481+0000 mon.a (mon.0) 359 : cluster [DBG] osdmap e74: 8 total, 7 up, 8 in 2021-03-10T20:11:28.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:28 gibba023 bash[30844]: cluster 2021-03-10T20:11:27.314516+0000 mgr.gibba044.wflcwh (mgr.34466) 167 : cluster [DBG] pgmap v75: 129 pgs: 10 stale+active+clean, 119 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:11:28.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:28 gibba023 bash[30844]: audit 2021-03-10T20:11:28.359371+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:28.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:28 gibba023 bash[30844]: audit 2021-03-10T20:11:28.362382+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:11:28.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:28 gibba023 bash[31815]: cluster 2021-03-10T20:11:27.314516+0000 mgr.gibba044.wflcwh (mgr.34466) 167 : cluster [DBG] pgmap v75: 129 pgs: 10 stale+active+clean, 119 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:11:28.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:28 gibba023 bash[31815]: audit 2021-03-10T20:11:28.359371+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:28.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:28 gibba023 bash[31815]: audit 2021-03-10T20:11:28.362382+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:11:28.677 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:11:28 gibba023 systemd[1]: ceph-dd719b26-81da-11eb-9080-001a4aab830c@osd.2.service: Succeeded. 2021-03-10T20:11:28.677 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:11:28 gibba023 systemd[1]: Stopped Ceph osd.2 for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:11:28.677 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:11:28 gibba023 systemd[1]: Started Ceph osd.2 for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:11:28.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:28 gibba044 bash[25485]: cluster 2021-03-10T20:11:27.314516+0000 mgr.gibba044.wflcwh (mgr.34466) 167 : cluster [DBG] pgmap v75: 129 pgs: 10 stale+active+clean, 119 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail 2021-03-10T20:11:28.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:28 gibba044 bash[25485]: audit 2021-03-10T20:11:28.359371+0000 mon.a (mon.0) 360 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:28.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:28 gibba044 bash[25485]: audit 2021-03-10T20:11:28.362382+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:11:29.608 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:29 gibba023 bash[30844]: cluster 2021-03-10T20:11:29.316711+0000 mgr.gibba044.wflcwh (mgr.34466) 168 : cluster [DBG] pgmap v77: 129 pgs: 7 active+undersized+degraded, 2 stale+active+clean, 19 active+undersized, 101 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 8/195 objects degraded (4.103%) 2021-03-10T20:11:29.758 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:29 gibba023 bash[30844]: cluster 2021-03-10T20:11:29.387264+0000 mon.a (mon.0) 362 : cluster [WRN] Health check failed: Degraded data redundancy: 8/195 objects degraded (4.103%), 7 pgs degraded (PG_DEGRADED) 2021-03-10T20:11:29.758 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:29 gibba023 bash[31815]: cluster 2021-03-10T20:11:29.316711+0000 mgr.gibba044.wflcwh (mgr.34466) 168 : cluster [DBG] pgmap v77: 129 pgs: 7 active+undersized+degraded, 2 stale+active+clean, 19 active+undersized, 101 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 8/195 objects degraded (4.103%) 2021-03-10T20:11:29.759 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:29 gibba023 bash[31815]: cluster 2021-03-10T20:11:29.387264+0000 mon.a (mon.0) 362 : cluster [WRN] Health check failed: Degraded data redundancy: 8/195 objects degraded (4.103%), 7 pgs degraded (PG_DEGRADED) 2021-03-10T20:11:29.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:29 gibba044 bash[25485]: cluster 2021-03-10T20:11:29.316711+0000 mgr.gibba044.wflcwh (mgr.34466) 168 : cluster [DBG] pgmap v77: 129 pgs: 7 active+undersized+degraded, 2 stale+active+clean, 19 active+undersized, 101 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 8/195 objects degraded (4.103%) 2021-03-10T20:11:29.760 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:29 gibba044 bash[25485]: cluster 2021-03-10T20:11:29.387264+0000 mon.a (mon.0) 362 : cluster [WRN] Health check failed: Degraded data redundancy: 8/195 objects degraded (4.103%), 7 pgs degraded (PG_DEGRADED) 2021-03-10T20:11:29.967 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:11:29 gibba023 bash[36046]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-03-10T20:11:29.967 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:11:29 gibba023 bash[36046]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2021-03-10T20:11:29.967 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:11:29 gibba023 bash[36046]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2021-03-10T20:11:29.968 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:11:29 gibba023 bash[36046]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2021-03-10T20:11:29.968 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:11:29 gibba023 bash[36046]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-03-10T20:11:29.968 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:11:29 gibba023 bash[36046]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-03-10T20:11:29.968 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:11:29 gibba023 bash[36046]: --> ceph-volume lvm activate successful for osd ID: 2 2021-03-10T20:11:31.424 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:11:31 gibba023 bash[36171]: debug 2021-03-10T20:11:31.222+0000 7fa327796700 1 -- 172.21.2.123:0/2244339759 <== mon.0 v2:172.21.2.123:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55dbb91da4e0 con 0x55dbb9256c00 2021-03-10T20:11:32.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:31 gibba023 bash[30844]: cluster 2021-03-10T20:11:31.318052+0000 mgr.gibba044.wflcwh (mgr.34466) 169 : cluster [DBG] pgmap v78: 129 pgs: 9 active+undersized+degraded, 23 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 14/195 objects degraded (7.179%) 2021-03-10T20:11:32.175 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:11:31 gibba023 bash[36171]: debug 2021-03-10T20:11:31.806+0000 7fa32f22b080 -1 Falling back to public interface 2021-03-10T20:11:32.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:31 gibba023 bash[31815]: cluster 2021-03-10T20:11:31.318052+0000 mgr.gibba044.wflcwh (mgr.34466) 169 : cluster [DBG] pgmap v78: 129 pgs: 9 active+undersized+degraded, 23 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 14/195 objects degraded (7.179%) 2021-03-10T20:11:32.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:31 gibba044 bash[25485]: cluster 2021-03-10T20:11:31.318052+0000 mgr.gibba044.wflcwh (mgr.34466) 169 : cluster [DBG] pgmap v78: 129 pgs: 9 active+undersized+degraded, 23 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 14/195 objects degraded (7.179%) 2021-03-10T20:11:33.097 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:33 gibba044 bash[25485]: audit 2021-03-10T20:11:32.087972+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:33.097 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:33 gibba044 bash[25485]: audit 2021-03-10T20:11:32.091539+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:33.097 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:33 gibba044 bash[25485]: audit 2021-03-10T20:11:32.095636+0000 mon.a (mon.0) 365 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:33.098 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:33 gibba044 bash[25485]: cephadm 2021-03-10T20:11:32.096993+0000 mgr.gibba044.wflcwh (mgr.34466) 170 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:11:33.098 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:33 gibba044 bash[25485]: audit 2021-03-10T20:11:32.097262+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:33.098 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:33 gibba044 bash[25485]: audit 2021-03-10T20:11:32.098650+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:33.098 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:33 gibba044 bash[25485]: cephadm 2021-03-10T20:11:32.098822+0000 mgr.gibba044.wflcwh (mgr.34466) 171 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:11:33.099 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:33 gibba044 bash[25485]: audit 2021-03-10T20:11:32.100165+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:33.099 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:33 gibba044 bash[25485]: cephadm 2021-03-10T20:11:32.100228+0000 mgr.gibba044.wflcwh (mgr.34466) 172 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:11:33.099 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:33 gibba044 bash[25485]: cephadm 2021-03-10T20:11:32.100265+0000 mgr.gibba044.wflcwh (mgr.34466) 173 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:11:33.099 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:33 gibba044 bash[25485]: cephadm 2021-03-10T20:11:32.101654+0000 mgr.gibba044.wflcwh (mgr.34466) 174 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:11:33.099 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:33 gibba044 bash[25485]: cephadm 2021-03-10T20:11:32.101691+0000 mgr.gibba044.wflcwh (mgr.34466) 175 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:11:33.100 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:33 gibba044 bash[25485]: audit 2021-03-10T20:11:32.103109+0000 mon.a (mon.0) 369 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T20:11:33.100 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:33 gibba044 bash[25485]: cephadm 2021-03-10T20:11:32.103165+0000 mgr.gibba044.wflcwh (mgr.34466) 176 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:11:33.100 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:33 gibba044 bash[25485]: cephadm 2021-03-10T20:11:32.104501+0000 mgr.gibba044.wflcwh (mgr.34466) 177 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:11:33.100 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:33 gibba044 bash[25485]: cephadm 2021-03-10T20:11:32.104537+0000 mgr.gibba044.wflcwh (mgr.34466) 178 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:11:33.101 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:33 gibba044 bash[25485]: audit 2021-03-10T20:11:32.105311+0000 mgr.gibba044.wflcwh (mgr.34466) 179 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T20:11:33.101 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:33 gibba044 bash[25485]: cephadm 2021-03-10T20:11:32.106516+0000 mgr.gibba044.wflcwh (mgr.34466) 180 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2021-03-10T20:11:33.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[30844]: audit 2021-03-10T20:11:32.087972+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:33.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[30844]: audit 2021-03-10T20:11:32.091539+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:33.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[30844]: audit 2021-03-10T20:11:32.095636+0000 mon.a (mon.0) 365 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:33.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[30844]: cephadm 2021-03-10T20:11:32.096993+0000 mgr.gibba044.wflcwh (mgr.34466) 170 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:11:33.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[30844]: audit 2021-03-10T20:11:32.097262+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:33.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[30844]: audit 2021-03-10T20:11:32.098650+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:33.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[30844]: cephadm 2021-03-10T20:11:32.098822+0000 mgr.gibba044.wflcwh (mgr.34466) 171 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:11:33.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[30844]: audit 2021-03-10T20:11:32.100165+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:33.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[30844]: cephadm 2021-03-10T20:11:32.100228+0000 mgr.gibba044.wflcwh (mgr.34466) 172 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:11:33.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[30844]: cephadm 2021-03-10T20:11:32.100265+0000 mgr.gibba044.wflcwh (mgr.34466) 173 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:11:33.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[30844]: cephadm 2021-03-10T20:11:32.101654+0000 mgr.gibba044.wflcwh (mgr.34466) 174 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:11:33.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[30844]: cephadm 2021-03-10T20:11:32.101691+0000 mgr.gibba044.wflcwh (mgr.34466) 175 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:11:33.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[30844]: audit 2021-03-10T20:11:32.103109+0000 mon.a (mon.0) 369 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T20:11:33.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[30844]: cephadm 2021-03-10T20:11:32.103165+0000 mgr.gibba044.wflcwh (mgr.34466) 176 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:11:33.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[30844]: cephadm 2021-03-10T20:11:32.104501+0000 mgr.gibba044.wflcwh (mgr.34466) 177 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:11:33.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[30844]: cephadm 2021-03-10T20:11:32.104537+0000 mgr.gibba044.wflcwh (mgr.34466) 178 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:11:33.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[30844]: audit 2021-03-10T20:11:32.105311+0000 mgr.gibba044.wflcwh (mgr.34466) 179 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T20:11:33.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[30844]: cephadm 2021-03-10T20:11:32.106516+0000 mgr.gibba044.wflcwh (mgr.34466) 180 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2021-03-10T20:11:33.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[31815]: audit 2021-03-10T20:11:32.087972+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:33.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[31815]: audit 2021-03-10T20:11:32.091539+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:33.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[31815]: audit 2021-03-10T20:11:32.095636+0000 mon.a (mon.0) 365 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:33.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[31815]: cephadm 2021-03-10T20:11:32.096993+0000 mgr.gibba044.wflcwh (mgr.34466) 170 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:11:33.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[31815]: audit 2021-03-10T20:11:32.097262+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:33.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[31815]: audit 2021-03-10T20:11:32.098650+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:33.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[31815]: cephadm 2021-03-10T20:11:32.098822+0000 mgr.gibba044.wflcwh (mgr.34466) 171 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:11:33.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[31815]: audit 2021-03-10T20:11:32.100165+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:33.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[31815]: cephadm 2021-03-10T20:11:32.100228+0000 mgr.gibba044.wflcwh (mgr.34466) 172 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:11:33.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[31815]: cephadm 2021-03-10T20:11:32.100265+0000 mgr.gibba044.wflcwh (mgr.34466) 173 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:11:33.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[31815]: cephadm 2021-03-10T20:11:32.101654+0000 mgr.gibba044.wflcwh (mgr.34466) 174 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:11:33.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[31815]: cephadm 2021-03-10T20:11:32.101691+0000 mgr.gibba044.wflcwh (mgr.34466) 175 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:11:33.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[31815]: audit 2021-03-10T20:11:32.103109+0000 mon.a (mon.0) 369 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T20:11:33.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[31815]: cephadm 2021-03-10T20:11:32.103165+0000 mgr.gibba044.wflcwh (mgr.34466) 176 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:11:33.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[31815]: cephadm 2021-03-10T20:11:32.104501+0000 mgr.gibba044.wflcwh (mgr.34466) 177 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:11:33.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[31815]: cephadm 2021-03-10T20:11:32.104537+0000 mgr.gibba044.wflcwh (mgr.34466) 178 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:11:33.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[31815]: audit 2021-03-10T20:11:32.105311+0000 mgr.gibba044.wflcwh (mgr.34466) 179 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T20:11:33.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:33 gibba023 bash[31815]: cephadm 2021-03-10T20:11:32.106516+0000 mgr.gibba044.wflcwh (mgr.34466) 180 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2021-03-10T20:11:34.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:34 gibba023 bash[30844]: cluster 2021-03-10T20:11:33.320082+0000 mgr.gibba044.wflcwh (mgr.34466) 181 : cluster [DBG] pgmap v79: 129 pgs: 9 active+undersized+degraded, 23 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 14/195 objects degraded (7.179%) 2021-03-10T20:11:34.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:34 gibba023 bash[31815]: cluster 2021-03-10T20:11:33.320082+0000 mgr.gibba044.wflcwh (mgr.34466) 181 : cluster [DBG] pgmap v79: 129 pgs: 9 active+undersized+degraded, 23 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 14/195 objects degraded (7.179%) 2021-03-10T20:11:34.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:34 gibba044 bash[25485]: cluster 2021-03-10T20:11:33.320082+0000 mgr.gibba044.wflcwh (mgr.34466) 181 : cluster [DBG] pgmap v79: 129 pgs: 9 active+undersized+degraded, 23 active+undersized, 97 active+clean; 7.0 KiB data, 17 MiB used, 666 GiB / 672 GiB avail; 14/195 objects degraded (7.179%) 2021-03-10T20:11:35.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:35 gibba023 bash[30844]: audit 2021-03-10T20:11:35.220730+0000 mon.c (mon.1) 11 : audit [INF] from='osd.2 [v2:172.21.2.123:6816/2439205807,v1:172.21.2.123:6817/2439205807]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T20:11:35.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:35 gibba023 bash[30844]: audit 2021-03-10T20:11:35.221036+0000 mon.a (mon.0) 370 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T20:11:35.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:35 gibba023 bash[31815]: audit 2021-03-10T20:11:35.220730+0000 mon.c (mon.1) 11 : audit [INF] from='osd.2 [v2:172.21.2.123:6816/2439205807,v1:172.21.2.123:6817/2439205807]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T20:11:35.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:35 gibba023 bash[31815]: audit 2021-03-10T20:11:35.221036+0000 mon.a (mon.0) 370 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T20:11:35.425 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:11:35 gibba023 bash[36171]: debug 2021-03-10T20:11:35.090+0000 7fa32f22b080 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: store not yet converted to per-pg omap 2021-03-10T20:11:35.426 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:11:35 gibba023 bash[36171]: debug 2021-03-10T20:11:35.090+0000 7fa32f22b080 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T20:11:35.426 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:11:35 gibba023 bash[36171]: debug 2021-03-10T20:11:35.210+0000 7fa32f22b080 -1 osd.2 72 log_to_monitors {default=true} 2021-03-10T20:11:35.426 INFO:journalctl@ceph.osd.2.gibba023.stdout:Mar 10 20:11:35 gibba023 bash[36171]: debug 2021-03-10T20:11:35.286+0000 7fa321f0e700 -1 osd.2 72 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:11:35.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:35 gibba044 bash[25485]: audit 2021-03-10T20:11:35.220730+0000 mon.c (mon.1) 11 : audit [INF] from='osd.2 [v2:172.21.2.123:6816/2439205807,v1:172.21.2.123:6817/2439205807]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T20:11:35.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:35 gibba044 bash[25485]: audit 2021-03-10T20:11:35.221036+0000 mon.a (mon.0) 370 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-03-10T20:11:36.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:36 gibba023 bash[30844]: audit 2021-03-10T20:11:35.276464+0000 mon.a (mon.0) 371 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T20:11:36.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:36 gibba023 bash[30844]: cluster 2021-03-10T20:11:35.276543+0000 mon.a (mon.0) 372 : cluster [DBG] osdmap e75: 8 total, 7 up, 8 in 2021-03-10T20:11:36.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:36 gibba023 bash[30844]: audit 2021-03-10T20:11:35.277673+0000 mon.c (mon.1) 12 : audit [INF] from='osd.2 [v2:172.21.2.123:6816/2439205807,v1:172.21.2.123:6817/2439205807]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:11:36.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:36 gibba023 bash[30844]: audit 2021-03-10T20:11:35.285282+0000 mon.a (mon.0) 373 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:11:36.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:36 gibba023 bash[30844]: cluster 2021-03-10T20:11:35.320696+0000 mgr.gibba044.wflcwh (mgr.34466) 182 : cluster [DBG] pgmap v81: 129 pgs: 9 active+undersized+degraded, 23 active+undersized, 97 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 14/195 objects degraded (7.179%) 2021-03-10T20:11:36.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:36 gibba023 bash[30844]: cluster 2021-03-10T20:11:35.962326+0000 mon.a (mon.0) 374 : cluster [WRN] Health check update: Degraded data redundancy: 14/195 objects degraded (7.179%), 9 pgs degraded (PG_DEGRADED) 2021-03-10T20:11:36.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:36 gibba023 bash[31815]: audit 2021-03-10T20:11:35.276464+0000 mon.a (mon.0) 371 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T20:11:36.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:36 gibba023 bash[31815]: cluster 2021-03-10T20:11:35.276543+0000 mon.a (mon.0) 372 : cluster [DBG] osdmap e75: 8 total, 7 up, 8 in 2021-03-10T20:11:36.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:36 gibba023 bash[31815]: audit 2021-03-10T20:11:35.277673+0000 mon.c (mon.1) 12 : audit [INF] from='osd.2 [v2:172.21.2.123:6816/2439205807,v1:172.21.2.123:6817/2439205807]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:11:36.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:36 gibba023 bash[31815]: audit 2021-03-10T20:11:35.285282+0000 mon.a (mon.0) 373 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:11:36.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:36 gibba023 bash[31815]: cluster 2021-03-10T20:11:35.320696+0000 mgr.gibba044.wflcwh (mgr.34466) 182 : cluster [DBG] pgmap v81: 129 pgs: 9 active+undersized+degraded, 23 active+undersized, 97 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 14/195 objects degraded (7.179%) 2021-03-10T20:11:36.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:36 gibba023 bash[31815]: cluster 2021-03-10T20:11:35.962326+0000 mon.a (mon.0) 374 : cluster [WRN] Health check update: Degraded data redundancy: 14/195 objects degraded (7.179%), 9 pgs degraded (PG_DEGRADED) 2021-03-10T20:11:36.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:36 gibba044 bash[25485]: audit 2021-03-10T20:11:35.276464+0000 mon.a (mon.0) 371 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-03-10T20:11:36.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:36 gibba044 bash[25485]: cluster 2021-03-10T20:11:35.276543+0000 mon.a (mon.0) 372 : cluster [DBG] osdmap e75: 8 total, 7 up, 8 in 2021-03-10T20:11:36.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:36 gibba044 bash[25485]: audit 2021-03-10T20:11:35.277673+0000 mon.c (mon.1) 12 : audit [INF] from='osd.2 [v2:172.21.2.123:6816/2439205807,v1:172.21.2.123:6817/2439205807]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:11:36.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:36 gibba044 bash[25485]: audit 2021-03-10T20:11:35.285282+0000 mon.a (mon.0) 373 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:11:36.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:36 gibba044 bash[25485]: cluster 2021-03-10T20:11:35.320696+0000 mgr.gibba044.wflcwh (mgr.34466) 182 : cluster [DBG] pgmap v81: 129 pgs: 9 active+undersized+degraded, 23 active+undersized, 97 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 14/195 objects degraded (7.179%) 2021-03-10T20:11:36.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:36 gibba044 bash[25485]: cluster 2021-03-10T20:11:35.962326+0000 mon.a (mon.0) 374 : cluster [WRN] Health check update: Degraded data redundancy: 14/195 objects degraded (7.179%), 9 pgs degraded (PG_DEGRADED) 2021-03-10T20:11:37.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:37 gibba023 bash[30844]: cluster 2021-03-10T20:11:36.284098+0000 mon.a (mon.0) 375 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:11:37.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:37 gibba023 bash[30844]: cluster 2021-03-10T20:11:36.297695+0000 mon.a (mon.0) 376 : cluster [INF] osd.2 [v2:172.21.2.123:6816/2439205807,v1:172.21.2.123:6817/2439205807] boot 2021-03-10T20:11:37.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:37 gibba023 bash[30844]: cluster 2021-03-10T20:11:36.297785+0000 mon.a (mon.0) 377 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-03-10T20:11:37.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:37 gibba023 bash[30844]: audit 2021-03-10T20:11:36.298077+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:11:37.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:37 gibba023 bash[31815]: cluster 2021-03-10T20:11:36.284098+0000 mon.a (mon.0) 375 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:11:37.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:37 gibba023 bash[31815]: cluster 2021-03-10T20:11:36.297695+0000 mon.a (mon.0) 376 : cluster [INF] osd.2 [v2:172.21.2.123:6816/2439205807,v1:172.21.2.123:6817/2439205807] boot 2021-03-10T20:11:37.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:37 gibba023 bash[31815]: cluster 2021-03-10T20:11:36.297785+0000 mon.a (mon.0) 377 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-03-10T20:11:37.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:37 gibba023 bash[31815]: audit 2021-03-10T20:11:36.298077+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:11:37.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:37 gibba044 bash[25485]: cluster 2021-03-10T20:11:36.284098+0000 mon.a (mon.0) 375 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:11:37.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:37 gibba044 bash[25485]: cluster 2021-03-10T20:11:36.297695+0000 mon.a (mon.0) 376 : cluster [INF] osd.2 [v2:172.21.2.123:6816/2439205807,v1:172.21.2.123:6817/2439205807] boot 2021-03-10T20:11:37.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:37 gibba044 bash[25485]: cluster 2021-03-10T20:11:36.297785+0000 mon.a (mon.0) 377 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-03-10T20:11:37.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:37 gibba044 bash[25485]: audit 2021-03-10T20:11:36.298077+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-03-10T20:11:38.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:38 gibba023 bash[30844]: cluster 2021-03-10T20:11:37.307405+0000 mon.a (mon.0) 379 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2021-03-10T20:11:38.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:38 gibba023 bash[30844]: cluster 2021-03-10T20:11:37.321030+0000 mgr.gibba044.wflcwh (mgr.34466) 183 : cluster [DBG] pgmap v84: 129 pgs: 9 active+undersized+degraded, 23 active+undersized, 97 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 14/195 objects degraded (7.179%) 2021-03-10T20:11:38.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:38 gibba023 bash[31815]: cluster 2021-03-10T20:11:37.307405+0000 mon.a (mon.0) 379 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2021-03-10T20:11:38.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:38 gibba023 bash[31815]: cluster 2021-03-10T20:11:37.321030+0000 mgr.gibba044.wflcwh (mgr.34466) 183 : cluster [DBG] pgmap v84: 129 pgs: 9 active+undersized+degraded, 23 active+undersized, 97 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 14/195 objects degraded (7.179%) 2021-03-10T20:11:38.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:38 gibba044 bash[25485]: cluster 2021-03-10T20:11:37.307405+0000 mon.a (mon.0) 379 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2021-03-10T20:11:38.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:38 gibba044 bash[25485]: cluster 2021-03-10T20:11:37.321030+0000 mgr.gibba044.wflcwh (mgr.34466) 183 : cluster [DBG] pgmap v84: 129 pgs: 9 active+undersized+degraded, 23 active+undersized, 97 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 14/195 objects degraded (7.179%) 2021-03-10T20:11:40.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:40 gibba023 bash[30844]: cluster 2021-03-10T20:11:39.322842+0000 mgr.gibba044.wflcwh (mgr.34466) 184 : cluster [DBG] pgmap v85: 129 pgs: 3 active+undersized+degraded, 11 active+undersized, 115 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 7/195 objects degraded (3.590%) 2021-03-10T20:11:40.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:40 gibba023 bash[31815]: cluster 2021-03-10T20:11:39.322842+0000 mgr.gibba044.wflcwh (mgr.34466) 184 : cluster [DBG] pgmap v85: 129 pgs: 3 active+undersized+degraded, 11 active+undersized, 115 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 7/195 objects degraded (3.590%) 2021-03-10T20:11:40.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:40 gibba044 bash[25485]: cluster 2021-03-10T20:11:39.322842+0000 mgr.gibba044.wflcwh (mgr.34466) 184 : cluster [DBG] pgmap v85: 129 pgs: 3 active+undersized+degraded, 11 active+undersized, 115 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail; 7/195 objects degraded (3.590%) 2021-03-10T20:11:41.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:41 gibba023 bash[30844]: cluster 2021-03-10T20:11:40.963729+0000 mon.a (mon.0) 380 : cluster [WRN] Health check update: Degraded data redundancy: 7/195 objects degraded (3.590%), 3 pgs degraded (PG_DEGRADED) 2021-03-10T20:11:41.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:41 gibba023 bash[31815]: cluster 2021-03-10T20:11:40.963729+0000 mon.a (mon.0) 380 : cluster [WRN] Health check update: Degraded data redundancy: 7/195 objects degraded (3.590%), 3 pgs degraded (PG_DEGRADED) 2021-03-10T20:11:41.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:41 gibba044 bash[25485]: cluster 2021-03-10T20:11:40.963729+0000 mon.a (mon.0) 380 : cluster [WRN] Health check update: Degraded data redundancy: 7/195 objects degraded (3.590%), 3 pgs degraded (PG_DEGRADED) 2021-03-10T20:11:42.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:42 gibba023 bash[30844]: cluster 2021-03-10T20:11:41.324276+0000 mgr.gibba044.wflcwh (mgr.34466) 185 : cluster [DBG] pgmap v86: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:11:42.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:42 gibba023 bash[30844]: cluster 2021-03-10T20:11:41.968778+0000 mon.a (mon.0) 381 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/195 objects degraded (3.590%), 3 pgs degraded) 2021-03-10T20:11:42.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:42 gibba023 bash[30844]: audit 2021-03-10T20:11:42.092718+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:42.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:42 gibba023 bash[31815]: cluster 2021-03-10T20:11:41.324276+0000 mgr.gibba044.wflcwh (mgr.34466) 185 : cluster [DBG] pgmap v86: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:11:42.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:42 gibba023 bash[31815]: cluster 2021-03-10T20:11:41.968778+0000 mon.a (mon.0) 381 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/195 objects degraded (3.590%), 3 pgs degraded) 2021-03-10T20:11:42.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:42 gibba023 bash[31815]: audit 2021-03-10T20:11:42.092718+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:42.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:42 gibba044 bash[25485]: cluster 2021-03-10T20:11:41.324276+0000 mgr.gibba044.wflcwh (mgr.34466) 185 : cluster [DBG] pgmap v86: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:11:42.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:42 gibba044 bash[25485]: cluster 2021-03-10T20:11:41.968778+0000 mon.a (mon.0) 381 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/195 objects degraded (3.590%), 3 pgs degraded) 2021-03-10T20:11:42.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:42 gibba044 bash[25485]: audit 2021-03-10T20:11:42.092718+0000 mon.a (mon.0) 382 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:44.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:44 gibba023 bash[30844]: cluster 2021-03-10T20:11:43.325916+0000 mgr.gibba044.wflcwh (mgr.34466) 186 : cluster [DBG] pgmap v87: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:11:44.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:44 gibba023 bash[31815]: cluster 2021-03-10T20:11:43.325916+0000 mgr.gibba044.wflcwh (mgr.34466) 186 : cluster [DBG] pgmap v87: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:11:44.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:44 gibba044 bash[25485]: cluster 2021-03-10T20:11:43.325916+0000 mgr.gibba044.wflcwh (mgr.34466) 186 : cluster [DBG] pgmap v87: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:11:46.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:46 gibba023 bash[30844]: cluster 2021-03-10T20:11:45.326412+0000 mgr.gibba044.wflcwh (mgr.34466) 187 : cluster [DBG] pgmap v88: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:11:46.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:46 gibba023 bash[31815]: cluster 2021-03-10T20:11:45.326412+0000 mgr.gibba044.wflcwh (mgr.34466) 187 : cluster [DBG] pgmap v88: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:11:46.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:46 gibba044 bash[25485]: cluster 2021-03-10T20:11:45.326412+0000 mgr.gibba044.wflcwh (mgr.34466) 187 : cluster [DBG] pgmap v88: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:11:47.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:47 gibba023 bash[30844]: audit 2021-03-10T20:11:47.119388+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T20:11:47.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:47 gibba023 bash[31815]: audit 2021-03-10T20:11:47.119388+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T20:11:47.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:47 gibba044 bash[25485]: audit 2021-03-10T20:11:47.119388+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T20:11:48.741 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:48 gibba023 bash[30844]: audit 2021-03-10T20:11:47.122158+0000 mgr.gibba044.wflcwh (mgr.34466) 188 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T20:11:48.741 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:48 gibba023 bash[30844]: cephadm 2021-03-10T20:11:47.126613+0000 mgr.gibba044.wflcwh (mgr.34466) 189 : cephadm [INF] Upgrade: osd.3 is safe to restart 2021-03-10T20:11:48.742 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:48 gibba023 bash[30844]: cluster 2021-03-10T20:11:47.327432+0000 mgr.gibba044.wflcwh (mgr.34466) 190 : cluster [DBG] pgmap v89: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:11:48.742 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:48 gibba023 bash[31815]: audit 2021-03-10T20:11:47.122158+0000 mgr.gibba044.wflcwh (mgr.34466) 188 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T20:11:48.742 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:48 gibba023 bash[31815]: cephadm 2021-03-10T20:11:47.126613+0000 mgr.gibba044.wflcwh (mgr.34466) 189 : cephadm [INF] Upgrade: osd.3 is safe to restart 2021-03-10T20:11:48.742 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:48 gibba023 bash[31815]: cluster 2021-03-10T20:11:47.327432+0000 mgr.gibba044.wflcwh (mgr.34466) 190 : cluster [DBG] pgmap v89: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:11:48.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:48 gibba044 bash[25485]: audit 2021-03-10T20:11:47.122158+0000 mgr.gibba044.wflcwh (mgr.34466) 188 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-03-10T20:11:48.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:48 gibba044 bash[25485]: cephadm 2021-03-10T20:11:47.126613+0000 mgr.gibba044.wflcwh (mgr.34466) 189 : cephadm [INF] Upgrade: osd.3 is safe to restart 2021-03-10T20:11:48.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:48 gibba044 bash[25485]: cluster 2021-03-10T20:11:47.327432+0000 mgr.gibba044.wflcwh (mgr.34466) 190 : cluster [DBG] pgmap v89: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:11:49.292 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:11:49.526 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:11:49.526 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (2m) 17s ago 8m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:11:49.526 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (8m) 110s ago 8m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:11:49.527 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (3m) 110s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:11:49.527 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (3m) 110s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:11:49.527 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (2m) 17s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:11:49.527 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (2m) 17s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:11:49.528 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (2m) 110s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:11:49.528 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (2m) 17s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:11:49.528 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (8m) 17s ago 8m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:11:49.528 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (8m) 110s ago 8m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:11:49.529 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (71s) 17s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:11:49.529 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (44s) 17s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:11:49.529 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (19s) 17s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:11:49.529 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (10m) 17s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 25229602755c 2021-03-10T20:11:49.529 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (10m) 110s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a745be9e28cb 2021-03-10T20:11:49.530 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (9m) 110s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0313bf557eb 2021-03-10T20:11:49.530 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (9m) 110s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 ffa9fe94cea1 2021-03-10T20:11:49.530 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (8m) 110s ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 082d0fe68f90 2021-03-10T20:11:49.531 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (8m) 110s ago 8m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:11:49.531 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 17s ago 6m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:11:49.531 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 110s ago 6m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:11:49.774 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:11:49.774 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:11:49.775 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:11:49.775 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:11:49.775 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:11:49.775 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:11:49.776 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:11:49.776 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:11:49.776 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 5, 2021-03-10T20:11:49.776 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:11:49.777 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:11:49.777 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:11:49.777 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:11:49.777 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 5, 2021-03-10T20:11:49.778 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 9 2021-03-10T20:11:49.778 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:11:49.778 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:11:50.550 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:50 gibba023 bash[30844]: cephadm 2021-03-10T20:11:49.265536+0000 mgr.gibba044.wflcwh (mgr.34466) 191 : cephadm [INF] Upgrade: Updating osd.3 2021-03-10T20:11:50.550 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:50 gibba023 bash[30844]: audit 2021-03-10T20:11:49.268926+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:50.550 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:50 gibba023 bash[30844]: audit 2021-03-10T20:11:49.273721+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T20:11:50.550 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:50 gibba023 bash[30844]: cephadm 2021-03-10T20:11:49.275087+0000 mgr.gibba044.wflcwh (mgr.34466) 192 : cephadm [INF] Deploying daemon osd.3 on gibba023 2021-03-10T20:11:50.551 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:50 gibba023 bash[30844]: audit 2021-03-10T20:11:49.285996+0000 mgr.gibba044.wflcwh (mgr.34466) 193 : audit [DBG] from='client.54193 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:11:50.551 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:50 gibba023 bash[30844]: cluster 2021-03-10T20:11:49.328371+0000 mgr.gibba044.wflcwh (mgr.34466) 194 : cluster [DBG] pgmap v90: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:11:50.551 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:50 gibba023 bash[30844]: audit 2021-03-10T20:11:49.774376+0000 mon.a (mon.0) 386 : audit [DBG] from='client.? 172.21.2.123:0/2053080145' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:50.552 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:50 gibba023 bash[31815]: cephadm 2021-03-10T20:11:49.265536+0000 mgr.gibba044.wflcwh (mgr.34466) 191 : cephadm [INF] Upgrade: Updating osd.3 2021-03-10T20:11:50.552 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:50 gibba023 bash[31815]: audit 2021-03-10T20:11:49.268926+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:50.552 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:50 gibba023 bash[31815]: audit 2021-03-10T20:11:49.273721+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T20:11:50.552 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:50 gibba023 bash[31815]: cephadm 2021-03-10T20:11:49.275087+0000 mgr.gibba044.wflcwh (mgr.34466) 192 : cephadm [INF] Deploying daemon osd.3 on gibba023 2021-03-10T20:11:50.553 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:50 gibba023 bash[31815]: audit 2021-03-10T20:11:49.285996+0000 mgr.gibba044.wflcwh (mgr.34466) 193 : audit [DBG] from='client.54193 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:11:50.553 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:50 gibba023 bash[31815]: cluster 2021-03-10T20:11:49.328371+0000 mgr.gibba044.wflcwh (mgr.34466) 194 : cluster [DBG] pgmap v90: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:11:50.553 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:50 gibba023 bash[31815]: audit 2021-03-10T20:11:49.774376+0000 mon.a (mon.0) 386 : audit [DBG] from='client.? 172.21.2.123:0/2053080145' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:50.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:50 gibba044 bash[25485]: cephadm 2021-03-10T20:11:49.265536+0000 mgr.gibba044.wflcwh (mgr.34466) 191 : cephadm [INF] Upgrade: Updating osd.3 2021-03-10T20:11:50.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:50 gibba044 bash[25485]: audit 2021-03-10T20:11:49.268926+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:50.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:50 gibba044 bash[25485]: audit 2021-03-10T20:11:49.273721+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2021-03-10T20:11:50.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:50 gibba044 bash[25485]: cephadm 2021-03-10T20:11:49.275087+0000 mgr.gibba044.wflcwh (mgr.34466) 192 : cephadm [INF] Deploying daemon osd.3 on gibba023 2021-03-10T20:11:50.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:50 gibba044 bash[25485]: audit 2021-03-10T20:11:49.285996+0000 mgr.gibba044.wflcwh (mgr.34466) 193 : audit [DBG] from='client.54193 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:11:50.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:50 gibba044 bash[25485]: cluster 2021-03-10T20:11:49.328371+0000 mgr.gibba044.wflcwh (mgr.34466) 194 : cluster [DBG] pgmap v90: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:11:50.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:50 gibba044 bash[25485]: audit 2021-03-10T20:11:49.774376+0000 mon.a (mon.0) 386 : audit [DBG] from='client.? 172.21.2.123:0/2053080145' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:51.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:51 gibba023 bash[30844]: audit 2021-03-10T20:11:49.516046+0000 mgr.gibba044.wflcwh (mgr.34466) 195 : audit [DBG] from='client.44220 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:11:51.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:51 gibba023 bash[31815]: audit 2021-03-10T20:11:49.516046+0000 mgr.gibba044.wflcwh (mgr.34466) 195 : audit [DBG] from='client.44220 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:11:51.425 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:11:51 gibba023 systemd[1]: Stopping Ceph osd.3 for dd719b26-81da-11eb-9080-001a4aab830c... 2021-03-10T20:11:51.426 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:11:51 gibba023 bash[19342]: debug 2021-03-10T20:11:51.306+0000 7f2620fab700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T20:11:51.426 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:11:51 gibba023 bash[19342]: debug 2021-03-10T20:11:51.306+0000 7f2620fab700 -1 osd.3 77 *** Got signal Terminated *** 2021-03-10T20:11:51.426 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:11:51 gibba023 bash[19342]: debug 2021-03-10T20:11:51.306+0000 7f2620fab700 -1 osd.3 77 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T20:11:51.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:51 gibba044 bash[25485]: audit 2021-03-10T20:11:49.516046+0000 mgr.gibba044.wflcwh (mgr.34466) 195 : audit [DBG] from='client.44220 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:11:52.674 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:11:52 gibba023 docker[37076]: ceph-dd719b26-81da-11eb-9080-001a4aab830c-osd.3 2021-03-10T20:11:52.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:51.328964+0000 mgr.gibba044.wflcwh (mgr.34466) 196 : cluster [DBG] pgmap v91: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:11:52.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:51.670822+0000 mon.a (mon.0) 387 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T20:11:52.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:51.670916+0000 mon.a (mon.0) 388 : cluster [INF] osd.3 failed (root=default,host=gibba023) (connection refused reported by osd.4) 2021-03-10T20:11:52.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:51.671369+0000 mon.a (mon.0) 389 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T20:11:52.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:51.671664+0000 mon.a (mon.0) 390 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T20:11:52.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:51.672136+0000 mon.a (mon.0) 391 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T20:11:52.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:51.672439+0000 mon.a (mon.0) 392 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T20:11:52.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:51.672859+0000 mon.a (mon.0) 393 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T20:11:52.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:51.673141+0000 mon.a (mon.0) 394 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T20:11:52.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:51.673726+0000 mon.a (mon.0) 395 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T20:11:52.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:51.674015+0000 mon.a (mon.0) 396 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T20:11:52.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:51.674605+0000 mon.a (mon.0) 397 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T20:11:52.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:51.674890+0000 mon.a (mon.0) 398 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:11:52.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:51.675450+0000 mon.a (mon.0) 399 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T20:11:52.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:51.675943+0000 mon.a (mon.0) 400 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T20:11:52.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:51.676339+0000 mon.a (mon.0) 401 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:11:52.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:52.070336+0000 mon.a (mon.0) 402 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T20:11:52.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:52.070661+0000 mon.a (mon.0) 403 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T20:11:52.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:52.071349+0000 mon.a (mon.0) 404 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T20:11:52.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:52.071584+0000 mon.a (mon.0) 405 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T20:11:52.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:52.072071+0000 mon.a (mon.0) 406 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T20:11:52.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:52.072361+0000 mon.a (mon.0) 407 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T20:11:52.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:52.072817+0000 mon.a (mon.0) 408 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T20:11:52.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:52.073100+0000 mon.a (mon.0) 409 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T20:11:52.681 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:52.073548+0000 mon.a (mon.0) 410 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T20:11:52.681 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:52.073973+0000 mon.a (mon.0) 411 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T20:11:52.681 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:52.074433+0000 mon.a (mon.0) 412 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T20:11:52.682 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:52.074834+0000 mon.a (mon.0) 413 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T20:11:52.682 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:52.075126+0000 mon.a (mon.0) 414 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:11:52.682 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[30844]: cluster 2021-03-10T20:11:52.075628+0000 mon.a (mon.0) 415 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:11:52.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:51.328964+0000 mgr.gibba044.wflcwh (mgr.34466) 196 : cluster [DBG] pgmap v91: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:11:52.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:51.670822+0000 mon.a (mon.0) 387 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T20:11:52.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:51.670916+0000 mon.a (mon.0) 388 : cluster [INF] osd.3 failed (root=default,host=gibba023) (connection refused reported by osd.4) 2021-03-10T20:11:52.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:51.671369+0000 mon.a (mon.0) 389 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T20:11:52.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:51.671664+0000 mon.a (mon.0) 390 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T20:11:52.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:51.672136+0000 mon.a (mon.0) 391 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T20:11:52.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:51.672439+0000 mon.a (mon.0) 392 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T20:11:52.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:51.672859+0000 mon.a (mon.0) 393 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T20:11:52.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:51.673141+0000 mon.a (mon.0) 394 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T20:11:52.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:51.673726+0000 mon.a (mon.0) 395 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T20:11:52.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:51.674015+0000 mon.a (mon.0) 396 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T20:11:52.686 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:51.674605+0000 mon.a (mon.0) 397 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T20:11:52.686 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:51.674890+0000 mon.a (mon.0) 398 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:11:52.686 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:51.675450+0000 mon.a (mon.0) 399 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T20:11:52.686 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:51.675943+0000 mon.a (mon.0) 400 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T20:11:52.686 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:51.676339+0000 mon.a (mon.0) 401 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:11:52.687 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:52.070336+0000 mon.a (mon.0) 402 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T20:11:52.687 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:52.070661+0000 mon.a (mon.0) 403 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T20:11:52.687 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:52.071349+0000 mon.a (mon.0) 404 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T20:11:52.687 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:52.071584+0000 mon.a (mon.0) 405 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T20:11:52.688 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:52.072071+0000 mon.a (mon.0) 406 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T20:11:52.688 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:52.072361+0000 mon.a (mon.0) 407 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T20:11:52.688 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:52.072817+0000 mon.a (mon.0) 408 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T20:11:52.688 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:52.073100+0000 mon.a (mon.0) 409 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T20:11:52.688 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:52.073548+0000 mon.a (mon.0) 410 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T20:11:52.689 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:52.073973+0000 mon.a (mon.0) 411 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T20:11:52.689 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:52.074433+0000 mon.a (mon.0) 412 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T20:11:52.689 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:52.074834+0000 mon.a (mon.0) 413 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T20:11:52.689 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:52.075126+0000 mon.a (mon.0) 414 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:11:52.689 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:52 gibba023 bash[31815]: cluster 2021-03-10T20:11:52.075628+0000 mon.a (mon.0) 415 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:11:52.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:51.328964+0000 mgr.gibba044.wflcwh (mgr.34466) 196 : cluster [DBG] pgmap v91: 129 pgs: 10 active+clean+wait, 119 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:11:52.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:51.670822+0000 mon.a (mon.0) 387 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T20:11:52.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:51.670916+0000 mon.a (mon.0) 388 : cluster [INF] osd.3 failed (root=default,host=gibba023) (connection refused reported by osd.4) 2021-03-10T20:11:52.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:51.671369+0000 mon.a (mon.0) 389 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T20:11:52.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:51.671664+0000 mon.a (mon.0) 390 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T20:11:52.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:51.672136+0000 mon.a (mon.0) 391 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T20:11:52.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:51.672439+0000 mon.a (mon.0) 392 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T20:11:52.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:51.672859+0000 mon.a (mon.0) 393 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T20:11:52.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:51.673141+0000 mon.a (mon.0) 394 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T20:11:52.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:51.673726+0000 mon.a (mon.0) 395 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T20:11:52.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:51.674015+0000 mon.a (mon.0) 396 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T20:11:52.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:51.674605+0000 mon.a (mon.0) 397 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T20:11:52.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:51.674890+0000 mon.a (mon.0) 398 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:11:52.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:51.675450+0000 mon.a (mon.0) 399 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T20:11:52.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:51.675943+0000 mon.a (mon.0) 400 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T20:11:52.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:51.676339+0000 mon.a (mon.0) 401 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:11:52.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:52.070336+0000 mon.a (mon.0) 402 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T20:11:52.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:52.070661+0000 mon.a (mon.0) 403 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-03-10T20:11:52.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:52.071349+0000 mon.a (mon.0) 404 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T20:11:52.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:52.071584+0000 mon.a (mon.0) 405 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T20:11:52.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:52.072071+0000 mon.a (mon.0) 406 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T20:11:52.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:52.072361+0000 mon.a (mon.0) 407 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-03-10T20:11:52.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:52.072817+0000 mon.a (mon.0) 408 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-03-10T20:11:52.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:52.073100+0000 mon.a (mon.0) 409 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T20:11:52.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:52.073548+0000 mon.a (mon.0) 410 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-03-10T20:11:52.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:52.073973+0000 mon.a (mon.0) 411 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-03-10T20:11:52.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:52.074433+0000 mon.a (mon.0) 412 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T20:11:52.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:52.074834+0000 mon.a (mon.0) 413 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-03-10T20:11:52.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:52.075126+0000 mon.a (mon.0) 414 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:11:52.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:52 gibba044 bash[25485]: cluster 2021-03-10T20:11:52.075628+0000 mon.a (mon.0) 415 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-03-10T20:11:53.656 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:53 gibba023 bash[30844]: cluster 2021-03-10T20:11:52.283823+0000 mon.a (mon.0) 416 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:11:53.656 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:53 gibba023 bash[30844]: cluster 2021-03-10T20:11:52.302289+0000 mon.a (mon.0) 417 : cluster [DBG] osdmap e78: 8 total, 7 up, 8 in 2021-03-10T20:11:53.657 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:53 gibba023 bash[31815]: cluster 2021-03-10T20:11:52.283823+0000 mon.a (mon.0) 416 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:11:53.657 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:53 gibba023 bash[31815]: cluster 2021-03-10T20:11:52.302289+0000 mon.a (mon.0) 417 : cluster [DBG] osdmap e78: 8 total, 7 up, 8 in 2021-03-10T20:11:53.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:53 gibba044 bash[25485]: cluster 2021-03-10T20:11:52.283823+0000 mon.a (mon.0) 416 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:11:53.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:53 gibba044 bash[25485]: cluster 2021-03-10T20:11:52.302289+0000 mon.a (mon.0) 417 : cluster [DBG] osdmap e78: 8 total, 7 up, 8 in 2021-03-10T20:11:54.541 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:54 gibba023 bash[30844]: cluster 2021-03-10T20:11:53.308511+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e79: 8 total, 7 up, 8 in 2021-03-10T20:11:54.542 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:54 gibba023 bash[30844]: cluster 2021-03-10T20:11:53.329545+0000 mgr.gibba044.wflcwh (mgr.34466) 197 : cluster [DBG] pgmap v94: 129 pgs: 11 stale+active+clean, 22 peering, 10 active+clean+wait, 86 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:11:54.542 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:54 gibba023 bash[31815]: cluster 2021-03-10T20:11:53.308511+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e79: 8 total, 7 up, 8 in 2021-03-10T20:11:54.542 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:54 gibba023 bash[31815]: cluster 2021-03-10T20:11:53.329545+0000 mgr.gibba044.wflcwh (mgr.34466) 197 : cluster [DBG] pgmap v94: 129 pgs: 11 stale+active+clean, 22 peering, 10 active+clean+wait, 86 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:11:54.543 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:11:54 gibba023 systemd[1]: ceph-dd719b26-81da-11eb-9080-001a4aab830c@osd.3.service: Succeeded. 2021-03-10T20:11:54.543 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:11:54 gibba023 systemd[1]: Stopped Ceph osd.3 for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:11:54.543 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:11:54 gibba023 systemd[1]: Started Ceph osd.3 for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:11:54.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:54 gibba044 bash[25485]: cluster 2021-03-10T20:11:53.308511+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e79: 8 total, 7 up, 8 in 2021-03-10T20:11:54.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:54 gibba044 bash[25485]: cluster 2021-03-10T20:11:53.329545+0000 mgr.gibba044.wflcwh (mgr.34466) 197 : cluster [DBG] pgmap v94: 129 pgs: 11 stale+active+clean, 22 peering, 10 active+clean+wait, 86 active+clean; 7.0 KiB data, 22 MiB used, 667 GiB / 672 GiB avail 2021-03-10T20:11:55.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:55 gibba023 bash[30844]: cluster 2021-03-10T20:11:54.307388+0000 mon.a (mon.0) 419 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 6 pgs peering (PG_AVAILABILITY) 2021-03-10T20:11:55.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:55 gibba023 bash[30844]: audit 2021-03-10T20:11:54.519579+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:55.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:55 gibba023 bash[30844]: audit 2021-03-10T20:11:54.522750+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:11:55.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:55 gibba023 bash[31815]: cluster 2021-03-10T20:11:54.307388+0000 mon.a (mon.0) 419 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 6 pgs peering (PG_AVAILABILITY) 2021-03-10T20:11:55.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:55 gibba023 bash[31815]: audit 2021-03-10T20:11:54.519579+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:55.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:55 gibba023 bash[31815]: audit 2021-03-10T20:11:54.522750+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:11:55.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:55 gibba044 bash[25485]: cluster 2021-03-10T20:11:54.307388+0000 mon.a (mon.0) 419 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 6 pgs peering (PG_AVAILABILITY) 2021-03-10T20:11:55.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:55 gibba044 bash[25485]: audit 2021-03-10T20:11:54.519579+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:55.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:55 gibba044 bash[25485]: audit 2021-03-10T20:11:54.522750+0000 mon.a (mon.0) 421 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:11:56.174 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:11:55 gibba023 bash[37249]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-03-10T20:11:56.175 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:11:55 gibba023 bash[37249]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2021-03-10T20:11:56.175 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:11:55 gibba023 bash[37249]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2021-03-10T20:11:56.175 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:11:55 gibba023 bash[37249]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2021-03-10T20:11:56.175 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:11:55 gibba023 bash[37249]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-03-10T20:11:56.176 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:11:55 gibba023 bash[37249]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-03-10T20:11:56.176 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:11:55 gibba023 bash[37249]: --> ceph-volume lvm activate successful for osd ID: 3 2021-03-10T20:11:56.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:56 gibba023 bash[30844]: cephadm 2021-03-10T20:11:54.525108+0000 mgr.gibba044.wflcwh (mgr.34466) 198 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:11:56.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:56 gibba023 bash[30844]: cluster 2021-03-10T20:11:55.331243+0000 mgr.gibba044.wflcwh (mgr.34466) 199 : cluster [DBG] pgmap v95: 129 pgs: 6 stale+active+clean, 5 active+undersized+degraded, 22 peering, 10 active+undersized, 86 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 6/195 objects degraded (3.077%) 2021-03-10T20:11:56.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:56 gibba023 bash[31815]: cephadm 2021-03-10T20:11:54.525108+0000 mgr.gibba044.wflcwh (mgr.34466) 198 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:11:56.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:56 gibba023 bash[31815]: cluster 2021-03-10T20:11:55.331243+0000 mgr.gibba044.wflcwh (mgr.34466) 199 : cluster [DBG] pgmap v95: 129 pgs: 6 stale+active+clean, 5 active+undersized+degraded, 22 peering, 10 active+undersized, 86 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 6/195 objects degraded (3.077%) 2021-03-10T20:11:56.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:56 gibba044 bash[25485]: cephadm 2021-03-10T20:11:54.525108+0000 mgr.gibba044.wflcwh (mgr.34466) 198 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:11:56.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:56 gibba044 bash[25485]: cluster 2021-03-10T20:11:55.331243+0000 mgr.gibba044.wflcwh (mgr.34466) 199 : cluster [DBG] pgmap v95: 129 pgs: 6 stale+active+clean, 5 active+undersized+degraded, 22 peering, 10 active+undersized, 86 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 6/195 objects degraded (3.077%) 2021-03-10T20:11:57.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:57 gibba023 bash[30844]: cluster 2021-03-10T20:11:56.325819+0000 mon.a (mon.0) 422 : cluster [WRN] Health check failed: Degraded data redundancy: 6/195 objects degraded (3.077%), 5 pgs degraded (PG_DEGRADED) 2021-03-10T20:11:57.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:57 gibba023 bash[31815]: cluster 2021-03-10T20:11:56.325819+0000 mon.a (mon.0) 422 : cluster [WRN] Health check failed: Degraded data redundancy: 6/195 objects degraded (3.077%), 5 pgs degraded (PG_DEGRADED) 2021-03-10T20:11:57.675 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:11:57 gibba023 bash[37378]: debug 2021-03-10T20:11:57.423+0000 7f11f9d6a700 1 -- 172.21.2.123:0/2643174582 <== mon.1 v2:172.21.2.123:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558f69ddc4e0 con 0x558f69e59400 2021-03-10T20:11:57.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:57 gibba044 bash[25485]: cluster 2021-03-10T20:11:56.325819+0000 mon.a (mon.0) 422 : cluster [WRN] Health check failed: Degraded data redundancy: 6/195 objects degraded (3.077%), 5 pgs degraded (PG_DEGRADED) 2021-03-10T20:11:58.354 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:11:58 gibba023 bash[37378]: debug 2021-03-10T20:11:58.015+0000 7f12017ff080 -1 Falling back to public interface 2021-03-10T20:11:58.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:58 gibba023 bash[30844]: cluster 2021-03-10T20:11:57.333012+0000 mgr.gibba044.wflcwh (mgr.34466) 200 : cluster [DBG] pgmap v96: 129 pgs: 11 active+undersized+degraded, 22 peering, 17 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 13/195 objects degraded (6.667%) 2021-03-10T20:11:58.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:58 gibba023 bash[30844]: audit 2021-03-10T20:11:58.079641+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:58.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:58 gibba023 bash[30844]: audit 2021-03-10T20:11:58.285447+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:58.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:58 gibba023 bash[30844]: audit 2021-03-10T20:11:58.293523+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:58.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:58 gibba023 bash[30844]: audit 2021-03-10T20:11:58.295905+0000 mon.a (mon.0) 426 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:58.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:58 gibba023 bash[30844]: audit 2021-03-10T20:11:58.297625+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:58.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:58 gibba023 bash[30844]: audit 2021-03-10T20:11:58.299728+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:58.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:58 gibba023 bash[30844]: audit 2021-03-10T20:11:58.303132+0000 mon.a (mon.0) 429 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T20:11:58.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:58 gibba023 bash[31815]: cluster 2021-03-10T20:11:57.333012+0000 mgr.gibba044.wflcwh (mgr.34466) 200 : cluster [DBG] pgmap v96: 129 pgs: 11 active+undersized+degraded, 22 peering, 17 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 13/195 objects degraded (6.667%) 2021-03-10T20:11:58.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:58 gibba023 bash[31815]: audit 2021-03-10T20:11:58.079641+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:58.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:58 gibba023 bash[31815]: audit 2021-03-10T20:11:58.285447+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:58.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:58 gibba023 bash[31815]: audit 2021-03-10T20:11:58.293523+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:58.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:58 gibba023 bash[31815]: audit 2021-03-10T20:11:58.295905+0000 mon.a (mon.0) 426 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:58.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:58 gibba023 bash[31815]: audit 2021-03-10T20:11:58.297625+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:58.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:58 gibba023 bash[31815]: audit 2021-03-10T20:11:58.299728+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:58.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:58 gibba023 bash[31815]: audit 2021-03-10T20:11:58.303132+0000 mon.a (mon.0) 429 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T20:11:58.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:58 gibba044 bash[25485]: cluster 2021-03-10T20:11:57.333012+0000 mgr.gibba044.wflcwh (mgr.34466) 200 : cluster [DBG] pgmap v96: 129 pgs: 11 active+undersized+degraded, 22 peering, 17 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 13/195 objects degraded (6.667%) 2021-03-10T20:11:58.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:58 gibba044 bash[25485]: audit 2021-03-10T20:11:58.079641+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:58.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:58 gibba044 bash[25485]: audit 2021-03-10T20:11:58.285447+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:11:58.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:58 gibba044 bash[25485]: audit 2021-03-10T20:11:58.293523+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:11:58.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:58 gibba044 bash[25485]: audit 2021-03-10T20:11:58.295905+0000 mon.a (mon.0) 426 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:58.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:58 gibba044 bash[25485]: audit 2021-03-10T20:11:58.297625+0000 mon.a (mon.0) 427 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:58.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:58 gibba044 bash[25485]: audit 2021-03-10T20:11:58.299728+0000 mon.a (mon.0) 428 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:11:58.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:58 gibba044 bash[25485]: audit 2021-03-10T20:11:58.303132+0000 mon.a (mon.0) 429 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T20:11:59.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:59 gibba023 bash[30844]: cephadm 2021-03-10T20:11:58.083167+0000 mgr.gibba044.wflcwh (mgr.34466) 201 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:11:59.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:59 gibba023 bash[30844]: cephadm 2021-03-10T20:11:58.294923+0000 mgr.gibba044.wflcwh (mgr.34466) 202 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:11:59.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:59 gibba023 bash[30844]: cephadm 2021-03-10T20:11:58.297368+0000 mgr.gibba044.wflcwh (mgr.34466) 203 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:11:59.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:59 gibba023 bash[30844]: cephadm 2021-03-10T20:11:58.299337+0000 mgr.gibba044.wflcwh (mgr.34466) 204 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:11:59.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:59 gibba023 bash[30844]: cephadm 2021-03-10T20:11:58.299376+0000 mgr.gibba044.wflcwh (mgr.34466) 205 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:11:59.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:59 gibba023 bash[30844]: cephadm 2021-03-10T20:11:58.301261+0000 mgr.gibba044.wflcwh (mgr.34466) 206 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:11:59.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:59 gibba023 bash[30844]: cephadm 2021-03-10T20:11:58.301411+0000 mgr.gibba044.wflcwh (mgr.34466) 207 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:11:59.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:59 gibba023 bash[30844]: cephadm 2021-03-10T20:11:58.302838+0000 mgr.gibba044.wflcwh (mgr.34466) 208 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:11:59.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:59 gibba023 bash[30844]: cephadm 2021-03-10T20:11:58.304496+0000 mgr.gibba044.wflcwh (mgr.34466) 209 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:11:59.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:59 gibba023 bash[30844]: cephadm 2021-03-10T20:11:58.304537+0000 mgr.gibba044.wflcwh (mgr.34466) 210 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:11:59.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:59 gibba023 bash[30844]: audit 2021-03-10T20:11:58.305493+0000 mgr.gibba044.wflcwh (mgr.34466) 211 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T20:11:59.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:11:59 gibba023 bash[30844]: cephadm 2021-03-10T20:11:58.306910+0000 mgr.gibba044.wflcwh (mgr.34466) 212 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2021-03-10T20:11:59.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:59 gibba023 bash[31815]: cephadm 2021-03-10T20:11:58.083167+0000 mgr.gibba044.wflcwh (mgr.34466) 201 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:11:59.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:59 gibba023 bash[31815]: cephadm 2021-03-10T20:11:58.294923+0000 mgr.gibba044.wflcwh (mgr.34466) 202 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:11:59.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:59 gibba023 bash[31815]: cephadm 2021-03-10T20:11:58.297368+0000 mgr.gibba044.wflcwh (mgr.34466) 203 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:11:59.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:59 gibba023 bash[31815]: cephadm 2021-03-10T20:11:58.299337+0000 mgr.gibba044.wflcwh (mgr.34466) 204 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:11:59.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:59 gibba023 bash[31815]: cephadm 2021-03-10T20:11:58.299376+0000 mgr.gibba044.wflcwh (mgr.34466) 205 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:11:59.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:59 gibba023 bash[31815]: cephadm 2021-03-10T20:11:58.301261+0000 mgr.gibba044.wflcwh (mgr.34466) 206 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:11:59.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:59 gibba023 bash[31815]: cephadm 2021-03-10T20:11:58.301411+0000 mgr.gibba044.wflcwh (mgr.34466) 207 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:11:59.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:59 gibba023 bash[31815]: cephadm 2021-03-10T20:11:58.302838+0000 mgr.gibba044.wflcwh (mgr.34466) 208 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:11:59.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:59 gibba023 bash[31815]: cephadm 2021-03-10T20:11:58.304496+0000 mgr.gibba044.wflcwh (mgr.34466) 209 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:11:59.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:59 gibba023 bash[31815]: cephadm 2021-03-10T20:11:58.304537+0000 mgr.gibba044.wflcwh (mgr.34466) 210 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:11:59.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:59 gibba023 bash[31815]: audit 2021-03-10T20:11:58.305493+0000 mgr.gibba044.wflcwh (mgr.34466) 211 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T20:11:59.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:11:59 gibba023 bash[31815]: cephadm 2021-03-10T20:11:58.306910+0000 mgr.gibba044.wflcwh (mgr.34466) 212 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2021-03-10T20:11:59.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:59 gibba044 bash[25485]: cephadm 2021-03-10T20:11:58.083167+0000 mgr.gibba044.wflcwh (mgr.34466) 201 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:11:59.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:59 gibba044 bash[25485]: cephadm 2021-03-10T20:11:58.294923+0000 mgr.gibba044.wflcwh (mgr.34466) 202 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:11:59.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:59 gibba044 bash[25485]: cephadm 2021-03-10T20:11:58.297368+0000 mgr.gibba044.wflcwh (mgr.34466) 203 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:11:59.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:59 gibba044 bash[25485]: cephadm 2021-03-10T20:11:58.299337+0000 mgr.gibba044.wflcwh (mgr.34466) 204 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:11:59.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:59 gibba044 bash[25485]: cephadm 2021-03-10T20:11:58.299376+0000 mgr.gibba044.wflcwh (mgr.34466) 205 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:11:59.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:59 gibba044 bash[25485]: cephadm 2021-03-10T20:11:58.301261+0000 mgr.gibba044.wflcwh (mgr.34466) 206 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:11:59.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:59 gibba044 bash[25485]: cephadm 2021-03-10T20:11:58.301411+0000 mgr.gibba044.wflcwh (mgr.34466) 207 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:11:59.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:59 gibba044 bash[25485]: cephadm 2021-03-10T20:11:58.302838+0000 mgr.gibba044.wflcwh (mgr.34466) 208 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:11:59.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:59 gibba044 bash[25485]: cephadm 2021-03-10T20:11:58.304496+0000 mgr.gibba044.wflcwh (mgr.34466) 209 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:11:59.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:59 gibba044 bash[25485]: cephadm 2021-03-10T20:11:58.304537+0000 mgr.gibba044.wflcwh (mgr.34466) 210 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:11:59.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:59 gibba044 bash[25485]: audit 2021-03-10T20:11:58.305493+0000 mgr.gibba044.wflcwh (mgr.34466) 211 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T20:11:59.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:11:59 gibba044 bash[25485]: cephadm 2021-03-10T20:11:58.306910+0000 mgr.gibba044.wflcwh (mgr.34466) 212 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2021-03-10T20:12:00.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:00 gibba023 bash[30844]: cluster 2021-03-10T20:11:59.335347+0000 mgr.gibba044.wflcwh (mgr.34466) 213 : cluster [DBG] pgmap v97: 129 pgs: 19 active+undersized+degraded, 31 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T20:12:00.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:00 gibba023 bash[30844]: cluster 2021-03-10T20:11:59.354676+0000 mon.a (mon.0) 430 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 6 pgs peering) 2021-03-10T20:12:00.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:00 gibba023 bash[31815]: cluster 2021-03-10T20:11:59.335347+0000 mgr.gibba044.wflcwh (mgr.34466) 213 : cluster [DBG] pgmap v97: 129 pgs: 19 active+undersized+degraded, 31 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T20:12:00.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:00 gibba023 bash[31815]: cluster 2021-03-10T20:11:59.354676+0000 mon.a (mon.0) 430 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 6 pgs peering) 2021-03-10T20:12:00.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:00 gibba044 bash[25485]: cluster 2021-03-10T20:11:59.335347+0000 mgr.gibba044.wflcwh (mgr.34466) 213 : cluster [DBG] pgmap v97: 129 pgs: 19 active+undersized+degraded, 31 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T20:12:00.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:00 gibba044 bash[25485]: cluster 2021-03-10T20:11:59.354676+0000 mon.a (mon.0) 430 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 6 pgs peering) 2021-03-10T20:12:01.674 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:12:01 gibba023 bash[37378]: debug 2021-03-10T20:12:01.287+0000 7f12017ff080 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: store not yet converted to per-pg omap 2021-03-10T20:12:01.675 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:12:01 gibba023 bash[37378]: debug 2021-03-10T20:12:01.287+0000 7f12017ff080 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T20:12:01.675 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:12:01 gibba023 bash[37378]: debug 2021-03-10T20:12:01.415+0000 7f12017ff080 -1 osd.3 77 log_to_monitors {default=true} 2021-03-10T20:12:02.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:01 gibba044 bash[25485]: cluster 2021-03-10T20:12:01.336030+0000 mgr.gibba044.wflcwh (mgr.34466) 214 : cluster [DBG] pgmap v98: 129 pgs: 19 active+undersized+degraded, 31 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T20:12:02.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:01 gibba044 bash[25485]: audit 2021-03-10T20:12:01.422580+0000 mon.c (mon.1) 13 : audit [INF] from='osd.3 [v2:172.21.2.123:6824/2970004912,v1:172.21.2.123:6825/2970004912]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T20:12:02.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:01 gibba044 bash[25485]: audit 2021-03-10T20:12:01.422812+0000 mon.a (mon.0) 431 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T20:12:02.424 INFO:journalctl@ceph.osd.3.gibba023.stdout:Mar 10 20:12:02 gibba023 bash[37378]: debug 2021-03-10T20:12:01.995+0000 7f11f44e2700 -1 osd.3 77 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:12:02.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:01 gibba023 bash[30844]: cluster 2021-03-10T20:12:01.336030+0000 mgr.gibba044.wflcwh (mgr.34466) 214 : cluster [DBG] pgmap v98: 129 pgs: 19 active+undersized+degraded, 31 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T20:12:02.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:01 gibba023 bash[30844]: audit 2021-03-10T20:12:01.422580+0000 mon.c (mon.1) 13 : audit [INF] from='osd.3 [v2:172.21.2.123:6824/2970004912,v1:172.21.2.123:6825/2970004912]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T20:12:02.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:01 gibba023 bash[30844]: audit 2021-03-10T20:12:01.422812+0000 mon.a (mon.0) 431 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T20:12:02.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:01 gibba023 bash[31815]: cluster 2021-03-10T20:12:01.336030+0000 mgr.gibba044.wflcwh (mgr.34466) 214 : cluster [DBG] pgmap v98: 129 pgs: 19 active+undersized+degraded, 31 active+undersized, 79 active+clean; 7.0 KiB data, 23 MiB used, 667 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T20:12:02.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:01 gibba023 bash[31815]: audit 2021-03-10T20:12:01.422580+0000 mon.c (mon.1) 13 : audit [INF] from='osd.3 [v2:172.21.2.123:6824/2970004912,v1:172.21.2.123:6825/2970004912]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T20:12:02.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:01 gibba023 bash[31815]: audit 2021-03-10T20:12:01.422812+0000 mon.a (mon.0) 431 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-03-10T20:12:03.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:03 gibba023 bash[30844]: audit 2021-03-10T20:12:01.993306+0000 mon.a (mon.0) 432 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T20:12:03.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:03 gibba023 bash[30844]: cluster 2021-03-10T20:12:01.993348+0000 mon.a (mon.0) 433 : cluster [DBG] osdmap e80: 8 total, 7 up, 8 in 2021-03-10T20:12:03.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:03 gibba023 bash[30844]: audit 2021-03-10T20:12:01.994240+0000 mon.c (mon.1) 14 : audit [INF] from='osd.3 [v2:172.21.2.123:6824/2970004912,v1:172.21.2.123:6825/2970004912]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:12:03.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:03 gibba023 bash[30844]: audit 2021-03-10T20:12:01.994505+0000 mon.a (mon.0) 434 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:12:03.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:03 gibba023 bash[31815]: audit 2021-03-10T20:12:01.993306+0000 mon.a (mon.0) 432 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T20:12:03.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:03 gibba023 bash[31815]: cluster 2021-03-10T20:12:01.993348+0000 mon.a (mon.0) 433 : cluster [DBG] osdmap e80: 8 total, 7 up, 8 in 2021-03-10T20:12:03.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:03 gibba023 bash[31815]: audit 2021-03-10T20:12:01.994240+0000 mon.c (mon.1) 14 : audit [INF] from='osd.3 [v2:172.21.2.123:6824/2970004912,v1:172.21.2.123:6825/2970004912]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:12:03.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:03 gibba023 bash[31815]: audit 2021-03-10T20:12:01.994505+0000 mon.a (mon.0) 434 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:12:03.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:03 gibba044 bash[25485]: audit 2021-03-10T20:12:01.993306+0000 mon.a (mon.0) 432 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-03-10T20:12:03.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:03 gibba044 bash[25485]: cluster 2021-03-10T20:12:01.993348+0000 mon.a (mon.0) 433 : cluster [DBG] osdmap e80: 8 total, 7 up, 8 in 2021-03-10T20:12:03.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:03 gibba044 bash[25485]: audit 2021-03-10T20:12:01.994240+0000 mon.c (mon.1) 14 : audit [INF] from='osd.3 [v2:172.21.2.123:6824/2970004912,v1:172.21.2.123:6825/2970004912]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:12:03.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:03 gibba044 bash[25485]: audit 2021-03-10T20:12:01.994505+0000 mon.a (mon.0) 434 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0820, "args": ["host=gibba023", "root=default"]}]: dispatch 2021-03-10T20:12:04.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:04 gibba023 bash[30844]: cluster 2021-03-10T20:12:02.993107+0000 mon.a (mon.0) 435 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:12:04.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:04 gibba023 bash[30844]: cluster 2021-03-10T20:12:03.003665+0000 mon.a (mon.0) 436 : cluster [INF] osd.3 [v2:172.21.2.123:6824/2970004912,v1:172.21.2.123:6825/2970004912] boot 2021-03-10T20:12:04.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:04 gibba023 bash[30844]: cluster 2021-03-10T20:12:03.003708+0000 mon.a (mon.0) 437 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-03-10T20:12:04.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:04 gibba023 bash[30844]: audit 2021-03-10T20:12:03.004268+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:12:04.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:04 gibba023 bash[30844]: cluster 2021-03-10T20:12:03.337131+0000 mgr.gibba044.wflcwh (mgr.34466) 215 : cluster [DBG] pgmap v101: 129 pgs: 19 active+undersized+degraded, 31 active+undersized, 79 active+clean; 7.0 KiB data, 27 MiB used, 668 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T20:12:04.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:04 gibba023 bash[30844]: cluster 2021-03-10T20:12:04.007786+0000 mon.a (mon.0) 439 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2021-03-10T20:12:04.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:04 gibba023 bash[31815]: cluster 2021-03-10T20:12:02.993107+0000 mon.a (mon.0) 435 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:12:04.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:04 gibba023 bash[31815]: cluster 2021-03-10T20:12:03.003665+0000 mon.a (mon.0) 436 : cluster [INF] osd.3 [v2:172.21.2.123:6824/2970004912,v1:172.21.2.123:6825/2970004912] boot 2021-03-10T20:12:04.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:04 gibba023 bash[31815]: cluster 2021-03-10T20:12:03.003708+0000 mon.a (mon.0) 437 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-03-10T20:12:04.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:04 gibba023 bash[31815]: audit 2021-03-10T20:12:03.004268+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:12:04.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:04 gibba023 bash[31815]: cluster 2021-03-10T20:12:03.337131+0000 mgr.gibba044.wflcwh (mgr.34466) 215 : cluster [DBG] pgmap v101: 129 pgs: 19 active+undersized+degraded, 31 active+undersized, 79 active+clean; 7.0 KiB data, 27 MiB used, 668 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T20:12:04.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:04 gibba023 bash[31815]: cluster 2021-03-10T20:12:04.007786+0000 mon.a (mon.0) 439 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2021-03-10T20:12:04.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:04 gibba044 bash[25485]: cluster 2021-03-10T20:12:02.993107+0000 mon.a (mon.0) 435 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:12:04.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:04 gibba044 bash[25485]: cluster 2021-03-10T20:12:03.003665+0000 mon.a (mon.0) 436 : cluster [INF] osd.3 [v2:172.21.2.123:6824/2970004912,v1:172.21.2.123:6825/2970004912] boot 2021-03-10T20:12:04.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:04 gibba044 bash[25485]: cluster 2021-03-10T20:12:03.003708+0000 mon.a (mon.0) 437 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-03-10T20:12:04.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:04 gibba044 bash[25485]: audit 2021-03-10T20:12:03.004268+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-03-10T20:12:04.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:04 gibba044 bash[25485]: cluster 2021-03-10T20:12:03.337131+0000 mgr.gibba044.wflcwh (mgr.34466) 215 : cluster [DBG] pgmap v101: 129 pgs: 19 active+undersized+degraded, 31 active+undersized, 79 active+clean; 7.0 KiB data, 27 MiB used, 668 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T20:12:04.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:04 gibba044 bash[25485]: cluster 2021-03-10T20:12:04.007786+0000 mon.a (mon.0) 439 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2021-03-10T20:12:05.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:05 gibba044 bash[25485]: cluster 2021-03-10T20:12:05.389387+0000 mon.a (mon.0) 440 : cluster [WRN] Health check update: Degraded data redundancy: 23/195 objects degraded (11.795%), 16 pgs degraded (PG_DEGRADED) 2021-03-10T20:12:05.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:05 gibba023 bash[30844]: cluster 2021-03-10T20:12:05.389387+0000 mon.a (mon.0) 440 : cluster [WRN] Health check update: Degraded data redundancy: 23/195 objects degraded (11.795%), 16 pgs degraded (PG_DEGRADED) 2021-03-10T20:12:05.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:05 gibba023 bash[31815]: cluster 2021-03-10T20:12:05.389387+0000 mon.a (mon.0) 440 : cluster [WRN] Health check update: Degraded data redundancy: 23/195 objects degraded (11.795%), 16 pgs degraded (PG_DEGRADED) 2021-03-10T20:12:06.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:06 gibba044 bash[25485]: cluster 2021-03-10T20:12:05.338533+0000 mgr.gibba044.wflcwh (mgr.34466) 216 : cluster [DBG] pgmap v103: 129 pgs: 6 peering, 16 active+undersized+degraded, 24 active+undersized, 83 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 23/195 objects degraded (11.795%) 2021-03-10T20:12:06.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:06 gibba023 bash[30844]: cluster 2021-03-10T20:12:05.338533+0000 mgr.gibba044.wflcwh (mgr.34466) 216 : cluster [DBG] pgmap v103: 129 pgs: 6 peering, 16 active+undersized+degraded, 24 active+undersized, 83 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 23/195 objects degraded (11.795%) 2021-03-10T20:12:06.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:06 gibba023 bash[31815]: cluster 2021-03-10T20:12:05.338533+0000 mgr.gibba044.wflcwh (mgr.34466) 216 : cluster [DBG] pgmap v103: 129 pgs: 6 peering, 16 active+undersized+degraded, 24 active+undersized, 83 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 23/195 objects degraded (11.795%) 2021-03-10T20:12:07.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:07 gibba023 bash[30844]: cluster 2021-03-10T20:12:07.340222+0000 mgr.gibba044.wflcwh (mgr.34466) 217 : cluster [DBG] pgmap v104: 129 pgs: 20 active+clean+wait, 6 peering, 5 active+undersized+degraded, 8 active+undersized, 90 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 5/195 objects degraded (2.564%) 2021-03-10T20:12:07.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:07 gibba023 bash[31815]: cluster 2021-03-10T20:12:07.340222+0000 mgr.gibba044.wflcwh (mgr.34466) 217 : cluster [DBG] pgmap v104: 129 pgs: 20 active+clean+wait, 6 peering, 5 active+undersized+degraded, 8 active+undersized, 90 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 5/195 objects degraded (2.564%) 2021-03-10T20:12:07.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:07 gibba044 bash[25485]: cluster 2021-03-10T20:12:07.340222+0000 mgr.gibba044.wflcwh (mgr.34466) 217 : cluster [DBG] pgmap v104: 129 pgs: 20 active+clean+wait, 6 peering, 5 active+undersized+degraded, 8 active+undersized, 90 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 5/195 objects degraded (2.564%) 2021-03-10T20:12:09.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:09 gibba044 bash[25485]: cluster 2021-03-10T20:12:09.392822+0000 mon.a (mon.0) 441 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/195 objects degraded (2.564%), 5 pgs degraded) 2021-03-10T20:12:09.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:09 gibba023 bash[30844]: cluster 2021-03-10T20:12:09.392822+0000 mon.a (mon.0) 441 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/195 objects degraded (2.564%), 5 pgs degraded) 2021-03-10T20:12:09.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:09 gibba023 bash[31815]: cluster 2021-03-10T20:12:09.392822+0000 mon.a (mon.0) 441 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 5/195 objects degraded (2.564%), 5 pgs degraded) 2021-03-10T20:12:10.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:10 gibba044 bash[25485]: cluster 2021-03-10T20:12:09.342028+0000 mgr.gibba044.wflcwh (mgr.34466) 218 : cluster [DBG] pgmap v105: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:12:10.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:10 gibba023 bash[30844]: cluster 2021-03-10T20:12:09.342028+0000 mgr.gibba044.wflcwh (mgr.34466) 218 : cluster [DBG] pgmap v105: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:12:10.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:10 gibba023 bash[31815]: cluster 2021-03-10T20:12:09.342028+0000 mgr.gibba044.wflcwh (mgr.34466) 218 : cluster [DBG] pgmap v105: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:12:12.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:11 gibba044 bash[25485]: cluster 2021-03-10T20:12:11.343422+0000 mgr.gibba044.wflcwh (mgr.34466) 219 : cluster [DBG] pgmap v106: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:12:12.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:11 gibba023 bash[30844]: cluster 2021-03-10T20:12:11.343422+0000 mgr.gibba044.wflcwh (mgr.34466) 219 : cluster [DBG] pgmap v106: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:12:12.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:11 gibba023 bash[31815]: cluster 2021-03-10T20:12:11.343422+0000 mgr.gibba044.wflcwh (mgr.34466) 219 : cluster [DBG] pgmap v106: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:12:13.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:13 gibba023 bash[30844]: audit 2021-03-10T20:12:12.106284+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:13.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:13 gibba023 bash[31815]: audit 2021-03-10T20:12:12.106284+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:13.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:13 gibba044 bash[25485]: audit 2021-03-10T20:12:12.106284+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:14.406 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:14 gibba044 bash[25485]: audit 2021-03-10T20:12:13.312123+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T20:12:14.406 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:14 gibba044 bash[25485]: audit 2021-03-10T20:12:13.315370+0000 mgr.gibba044.wflcwh (mgr.34466) 220 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T20:12:14.406 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:14 gibba044 bash[25485]: cephadm 2021-03-10T20:12:13.320112+0000 mgr.gibba044.wflcwh (mgr.34466) 221 : cephadm [INF] Upgrade: osd.4 is safe to restart 2021-03-10T20:12:14.407 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:14 gibba044 bash[25485]: cluster 2021-03-10T20:12:13.344022+0000 mgr.gibba044.wflcwh (mgr.34466) 222 : cluster [DBG] pgmap v107: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:12:14.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:14 gibba023 bash[30844]: audit 2021-03-10T20:12:13.312123+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T20:12:14.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:14 gibba023 bash[30844]: audit 2021-03-10T20:12:13.315370+0000 mgr.gibba044.wflcwh (mgr.34466) 220 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T20:12:14.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:14 gibba023 bash[30844]: cephadm 2021-03-10T20:12:13.320112+0000 mgr.gibba044.wflcwh (mgr.34466) 221 : cephadm [INF] Upgrade: osd.4 is safe to restart 2021-03-10T20:12:14.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:14 gibba023 bash[30844]: cluster 2021-03-10T20:12:13.344022+0000 mgr.gibba044.wflcwh (mgr.34466) 222 : cluster [DBG] pgmap v107: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:12:14.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:14 gibba023 bash[31815]: audit 2021-03-10T20:12:13.312123+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T20:12:14.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:14 gibba023 bash[31815]: audit 2021-03-10T20:12:13.315370+0000 mgr.gibba044.wflcwh (mgr.34466) 220 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-03-10T20:12:14.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:14 gibba023 bash[31815]: cephadm 2021-03-10T20:12:13.320112+0000 mgr.gibba044.wflcwh (mgr.34466) 221 : cephadm [INF] Upgrade: osd.4 is safe to restart 2021-03-10T20:12:14.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:14 gibba023 bash[31815]: cluster 2021-03-10T20:12:13.344022+0000 mgr.gibba044.wflcwh (mgr.34466) 222 : cluster [DBG] pgmap v107: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:12:16.395 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:16 gibba044 bash[25485]: cephadm 2021-03-10T20:12:15.170288+0000 mgr.gibba044.wflcwh (mgr.34466) 223 : cephadm [INF] Upgrade: Updating osd.4 2021-03-10T20:12:16.396 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:16 gibba044 bash[25485]: audit 2021-03-10T20:12:15.178396+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:16.396 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:16 gibba044 bash[25485]: audit 2021-03-10T20:12:15.180675+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T20:12:16.396 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:16 gibba044 bash[25485]: cephadm 2021-03-10T20:12:15.182355+0000 mgr.gibba044.wflcwh (mgr.34466) 224 : cephadm [INF] Deploying daemon osd.4 on gibba044 2021-03-10T20:12:16.396 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:16 gibba044 bash[25485]: cluster 2021-03-10T20:12:15.344470+0000 mgr.gibba044.wflcwh (mgr.34466) 225 : cluster [DBG] pgmap v108: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:12:16.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:16 gibba023 bash[30844]: cephadm 2021-03-10T20:12:15.170288+0000 mgr.gibba044.wflcwh (mgr.34466) 223 : cephadm [INF] Upgrade: Updating osd.4 2021-03-10T20:12:16.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:16 gibba023 bash[30844]: audit 2021-03-10T20:12:15.178396+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:16.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:16 gibba023 bash[30844]: audit 2021-03-10T20:12:15.180675+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T20:12:16.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:16 gibba023 bash[30844]: cephadm 2021-03-10T20:12:15.182355+0000 mgr.gibba044.wflcwh (mgr.34466) 224 : cephadm [INF] Deploying daemon osd.4 on gibba044 2021-03-10T20:12:16.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:16 gibba023 bash[30844]: cluster 2021-03-10T20:12:15.344470+0000 mgr.gibba044.wflcwh (mgr.34466) 225 : cluster [DBG] pgmap v108: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:12:16.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:16 gibba023 bash[31815]: cephadm 2021-03-10T20:12:15.170288+0000 mgr.gibba044.wflcwh (mgr.34466) 223 : cephadm [INF] Upgrade: Updating osd.4 2021-03-10T20:12:16.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:16 gibba023 bash[31815]: audit 2021-03-10T20:12:15.178396+0000 mon.a (mon.0) 444 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:16.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:16 gibba023 bash[31815]: audit 2021-03-10T20:12:15.180675+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2021-03-10T20:12:16.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:16 gibba023 bash[31815]: cephadm 2021-03-10T20:12:15.182355+0000 mgr.gibba044.wflcwh (mgr.34466) 224 : cephadm [INF] Deploying daemon osd.4 on gibba044 2021-03-10T20:12:16.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:16 gibba023 bash[31815]: cluster 2021-03-10T20:12:15.344470+0000 mgr.gibba044.wflcwh (mgr.34466) 225 : cluster [DBG] pgmap v108: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:12:17.172 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:12:17 gibba044 systemd[1]: Stopping Ceph osd.4 for dd719b26-81da-11eb-9080-001a4aab830c... 2021-03-10T20:12:17.469 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:12:17 gibba044 bash[12230]: debug 2021-03-10T20:12:17.169+0000 7f80f5764700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T20:12:17.470 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:12:17 gibba044 bash[12230]: debug 2021-03-10T20:12:17.169+0000 7f80f5764700 -1 osd.4 82 *** Got signal Terminated *** 2021-03-10T20:12:17.470 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:12:17 gibba044 bash[12230]: debug 2021-03-10T20:12:17.169+0000 7f80f5764700 -1 osd.4 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T20:12:17.471 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:17 gibba044 bash[25485]: cluster 2021-03-10T20:12:17.292624+0000 mon.a (mon.0) 446 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T20:12:17.471 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:17 gibba044 bash[25485]: cluster 2021-03-10T20:12:17.292746+0000 mon.a (mon.0) 447 : cluster [INF] osd.4 failed (root=default,host=gibba044) (connection refused reported by osd.1) 2021-03-10T20:12:17.471 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:17 gibba044 bash[25485]: cluster 2021-03-10T20:12:17.293380+0000 mon.a (mon.0) 448 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T20:12:17.471 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:17 gibba044 bash[25485]: cluster 2021-03-10T20:12:17.293796+0000 mon.a (mon.0) 449 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T20:12:17.471 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:17 gibba044 bash[25485]: cluster 2021-03-10T20:12:17.294304+0000 mon.a (mon.0) 450 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T20:12:17.472 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:17 gibba044 bash[25485]: cluster 2021-03-10T20:12:17.294720+0000 mon.a (mon.0) 451 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T20:12:17.472 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:17 gibba044 bash[25485]: cluster 2021-03-10T20:12:17.295132+0000 mon.a (mon.0) 452 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T20:12:17.472 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:17 gibba044 bash[25485]: cluster 2021-03-10T20:12:17.295536+0000 mon.a (mon.0) 453 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T20:12:17.473 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:17 gibba044 bash[25485]: cluster 2021-03-10T20:12:17.295941+0000 mon.a (mon.0) 454 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T20:12:17.473 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:17 gibba044 bash[25485]: cluster 2021-03-10T20:12:17.317795+0000 mon.a (mon.0) 455 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T20:12:17.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:17 gibba023 bash[30844]: cluster 2021-03-10T20:12:17.292624+0000 mon.a (mon.0) 446 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T20:12:17.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:17 gibba023 bash[30844]: cluster 2021-03-10T20:12:17.292746+0000 mon.a (mon.0) 447 : cluster [INF] osd.4 failed (root=default,host=gibba044) (connection refused reported by osd.1) 2021-03-10T20:12:17.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:17 gibba023 bash[30844]: cluster 2021-03-10T20:12:17.293380+0000 mon.a (mon.0) 448 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T20:12:17.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:17 gibba023 bash[30844]: cluster 2021-03-10T20:12:17.293796+0000 mon.a (mon.0) 449 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T20:12:17.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:17 gibba023 bash[30844]: cluster 2021-03-10T20:12:17.294304+0000 mon.a (mon.0) 450 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T20:12:17.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:17 gibba023 bash[30844]: cluster 2021-03-10T20:12:17.294720+0000 mon.a (mon.0) 451 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T20:12:17.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:17 gibba023 bash[30844]: cluster 2021-03-10T20:12:17.295132+0000 mon.a (mon.0) 452 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T20:12:17.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:17 gibba023 bash[30844]: cluster 2021-03-10T20:12:17.295536+0000 mon.a (mon.0) 453 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T20:12:17.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:17 gibba023 bash[30844]: cluster 2021-03-10T20:12:17.295941+0000 mon.a (mon.0) 454 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T20:12:17.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:17 gibba023 bash[30844]: cluster 2021-03-10T20:12:17.317795+0000 mon.a (mon.0) 455 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T20:12:17.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:17 gibba023 bash[31815]: cluster 2021-03-10T20:12:17.292624+0000 mon.a (mon.0) 446 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T20:12:17.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:17 gibba023 bash[31815]: cluster 2021-03-10T20:12:17.292746+0000 mon.a (mon.0) 447 : cluster [INF] osd.4 failed (root=default,host=gibba044) (connection refused reported by osd.1) 2021-03-10T20:12:17.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:17 gibba023 bash[31815]: cluster 2021-03-10T20:12:17.293380+0000 mon.a (mon.0) 448 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T20:12:17.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:17 gibba023 bash[31815]: cluster 2021-03-10T20:12:17.293796+0000 mon.a (mon.0) 449 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T20:12:17.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:17 gibba023 bash[31815]: cluster 2021-03-10T20:12:17.294304+0000 mon.a (mon.0) 450 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-03-10T20:12:17.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:17 gibba023 bash[31815]: cluster 2021-03-10T20:12:17.294720+0000 mon.a (mon.0) 451 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T20:12:17.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:17 gibba023 bash[31815]: cluster 2021-03-10T20:12:17.295132+0000 mon.a (mon.0) 452 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-03-10T20:12:17.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:17 gibba023 bash[31815]: cluster 2021-03-10T20:12:17.295536+0000 mon.a (mon.0) 453 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-03-10T20:12:17.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:17 gibba023 bash[31815]: cluster 2021-03-10T20:12:17.295941+0000 mon.a (mon.0) 454 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-03-10T20:12:17.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:17 gibba023 bash[31815]: cluster 2021-03-10T20:12:17.317795+0000 mon.a (mon.0) 455 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-03-10T20:12:18.249 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:12:17 gibba044 docker[26973]: ceph-dd719b26-81da-11eb-9080-001a4aab830c-osd.4 2021-03-10T20:12:18.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:18 gibba023 bash[30844]: cluster 2021-03-10T20:12:17.344608+0000 mon.a (mon.0) 456 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:12:18.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:18 gibba023 bash[30844]: cluster 2021-03-10T20:12:17.344997+0000 mgr.gibba044.wflcwh (mgr.34466) 226 : cluster [DBG] pgmap v109: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:12:18.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:18 gibba023 bash[30844]: cluster 2021-03-10T20:12:17.355782+0000 mon.a (mon.0) 457 : cluster [DBG] osdmap e83: 8 total, 7 up, 8 in 2021-03-10T20:12:18.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:18 gibba023 bash[31815]: cluster 2021-03-10T20:12:17.344608+0000 mon.a (mon.0) 456 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:12:18.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:18 gibba023 bash[31815]: cluster 2021-03-10T20:12:17.344997+0000 mgr.gibba044.wflcwh (mgr.34466) 226 : cluster [DBG] pgmap v109: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:12:18.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:18 gibba023 bash[31815]: cluster 2021-03-10T20:12:17.355782+0000 mon.a (mon.0) 457 : cluster [DBG] osdmap e83: 8 total, 7 up, 8 in 2021-03-10T20:12:18.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:18 gibba044 bash[25485]: cluster 2021-03-10T20:12:17.344608+0000 mon.a (mon.0) 456 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:12:18.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:18 gibba044 bash[25485]: cluster 2021-03-10T20:12:17.344997+0000 mgr.gibba044.wflcwh (mgr.34466) 226 : cluster [DBG] pgmap v109: 129 pgs: 20 active+clean+wait, 109 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail 2021-03-10T20:12:18.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:18 gibba044 bash[25485]: cluster 2021-03-10T20:12:17.355782+0000 mon.a (mon.0) 457 : cluster [DBG] osdmap e83: 8 total, 7 up, 8 in 2021-03-10T20:12:19.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:19 gibba044 bash[25485]: cluster 2021-03-10T20:12:18.358875+0000 mon.a (mon.0) 458 : cluster [DBG] osdmap e84: 8 total, 7 up, 8 in 2021-03-10T20:12:19.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:19 gibba023 bash[30844]: cluster 2021-03-10T20:12:18.358875+0000 mon.a (mon.0) 458 : cluster [DBG] osdmap e84: 8 total, 7 up, 8 in 2021-03-10T20:12:19.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:19 gibba023 bash[31815]: cluster 2021-03-10T20:12:18.358875+0000 mon.a (mon.0) 458 : cluster [DBG] osdmap e84: 8 total, 7 up, 8 in 2021-03-10T20:12:19.998 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:12:19 gibba044 systemd[1]: ceph-dd719b26-81da-11eb-9080-001a4aab830c@osd.4.service: Succeeded. 2021-03-10T20:12:19.999 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:12:19 gibba044 systemd[1]: Stopped Ceph osd.4 for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:12:19.999 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:12:19 gibba044 systemd[1]: Started Ceph osd.4 for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:12:20.015 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:12:20.243 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:12:20.244 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (3m) 22s ago 9m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:12:20.244 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (8m) 2m ago 8m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:12:20.244 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (3m) 2m ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:12:20.244 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (4m) 2m ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:12:20.245 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (3m) 22s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:12:20.245 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (3m) 22s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:12:20.245 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (2m) 2m ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:12:20.245 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (2m) 22s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:12:20.246 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (9m) 22s ago 9m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:12:20.246 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (9m) 2m ago 9m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:12:20.246 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (102s) 22s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:12:20.246 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (75s) 22s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:12:20.247 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (49s) 22s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:12:20.247 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (23s) 22s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:12:20.247 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 starting - - 2021-03-10T20:12:20.247 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (10m) 2m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d0313bf557eb 2021-03-10T20:12:20.247 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (9m) 2m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 ffa9fe94cea1 2021-03-10T20:12:20.248 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (9m) 2m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 082d0fe68f90 2021-03-10T20:12:20.248 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (8m) 2m ago 9m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:12:20.248 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 22s ago 6m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:12:20.248 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 2m ago 6m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:12:20.500 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:12:20.500 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:12:20.501 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:12:20.501 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:12:20.501 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:12:20.501 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:12:20.502 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:12:20.502 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:12:20.502 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3, 2021-03-10T20:12:20.502 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 4 2021-03-10T20:12:20.502 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:12:20.503 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:12:20.503 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:12:20.503 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3, 2021-03-10T20:12:20.503 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 10 2021-03-10T20:12:20.504 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:12:20.504 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:12:20.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:20 gibba023 bash[30844]: cluster 2021-03-10T20:12:19.346409+0000 mgr.gibba044.wflcwh (mgr.34466) 227 : cluster [DBG] pgmap v112: 129 pgs: 9 stale+active+clean, 3 active+undersized+degraded, 27 peering, 20 active+clean+wait, 6 active+undersized, 64 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 5/195 objects degraded (2.564%) 2021-03-10T20:12:20.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:20 gibba023 bash[30844]: cluster 2021-03-10T20:12:19.363711+0000 mon.a (mon.0) 459 : cluster [WRN] Health check failed: Reduced data availability: 5 pgs inactive, 7 pgs peering (PG_AVAILABILITY) 2021-03-10T20:12:20.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:20 gibba023 bash[30844]: cluster 2021-03-10T20:12:19.363797+0000 mon.a (mon.0) 460 : cluster [WRN] Health check failed: Degraded data redundancy: 5/195 objects degraded (2.564%), 3 pgs degraded (PG_DEGRADED) 2021-03-10T20:12:20.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:20 gibba023 bash[30844]: audit 2021-03-10T20:12:19.878373+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:20.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:20 gibba023 bash[30844]: audit 2021-03-10T20:12:19.879516+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:12:20.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:20 gibba023 bash[31815]: cluster 2021-03-10T20:12:19.346409+0000 mgr.gibba044.wflcwh (mgr.34466) 227 : cluster [DBG] pgmap v112: 129 pgs: 9 stale+active+clean, 3 active+undersized+degraded, 27 peering, 20 active+clean+wait, 6 active+undersized, 64 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 5/195 objects degraded (2.564%) 2021-03-10T20:12:20.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:20 gibba023 bash[31815]: cluster 2021-03-10T20:12:19.363711+0000 mon.a (mon.0) 459 : cluster [WRN] Health check failed: Reduced data availability: 5 pgs inactive, 7 pgs peering (PG_AVAILABILITY) 2021-03-10T20:12:20.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:20 gibba023 bash[31815]: cluster 2021-03-10T20:12:19.363797+0000 mon.a (mon.0) 460 : cluster [WRN] Health check failed: Degraded data redundancy: 5/195 objects degraded (2.564%), 3 pgs degraded (PG_DEGRADED) 2021-03-10T20:12:20.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:20 gibba023 bash[31815]: audit 2021-03-10T20:12:19.878373+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:20.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:20 gibba023 bash[31815]: audit 2021-03-10T20:12:19.879516+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:12:20.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:20 gibba044 bash[25485]: cluster 2021-03-10T20:12:19.346409+0000 mgr.gibba044.wflcwh (mgr.34466) 227 : cluster [DBG] pgmap v112: 129 pgs: 9 stale+active+clean, 3 active+undersized+degraded, 27 peering, 20 active+clean+wait, 6 active+undersized, 64 active+clean; 7.0 KiB data, 28 MiB used, 668 GiB / 672 GiB avail; 5/195 objects degraded (2.564%) 2021-03-10T20:12:20.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:20 gibba044 bash[25485]: cluster 2021-03-10T20:12:19.363711+0000 mon.a (mon.0) 459 : cluster [WRN] Health check failed: Reduced data availability: 5 pgs inactive, 7 pgs peering (PG_AVAILABILITY) 2021-03-10T20:12:20.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:20 gibba044 bash[25485]: cluster 2021-03-10T20:12:19.363797+0000 mon.a (mon.0) 460 : cluster [WRN] Health check failed: Degraded data redundancy: 5/195 objects degraded (2.564%), 3 pgs degraded (PG_DEGRADED) 2021-03-10T20:12:20.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:20 gibba044 bash[25485]: audit 2021-03-10T20:12:19.878373+0000 mon.a (mon.0) 461 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:20.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:20 gibba044 bash[25485]: audit 2021-03-10T20:12:19.879516+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:12:21.377 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:12:21 gibba044 bash[27149]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-03-10T20:12:21.377 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:12:21 gibba044 bash[27149]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2021-03-10T20:12:21.378 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:12:21 gibba044 bash[27149]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2021-03-10T20:12:21.378 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:12:21 gibba044 bash[27149]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2021-03-10T20:12:21.378 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:12:21 gibba044 bash[27149]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-03-10T20:12:21.378 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:12:21 gibba044 bash[27149]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-03-10T20:12:21.379 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:12:21 gibba044 bash[27149]: --> ceph-volume lvm activate successful for osd ID: 4 2021-03-10T20:12:21.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:21 gibba044 bash[25485]: audit 2021-03-10T20:12:20.009032+0000 mgr.gibba044.wflcwh (mgr.34466) 228 : audit [DBG] from='client.54217 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:12:21.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:21 gibba044 bash[25485]: audit 2021-03-10T20:12:20.233612+0000 mgr.gibba044.wflcwh (mgr.34466) 229 : audit [DBG] from='client.54223 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:12:21.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:21 gibba044 bash[25485]: audit 2021-03-10T20:12:20.500667+0000 mon.a (mon.0) 463 : audit [DBG] from='client.? 172.21.2.123:0/700078745' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:21.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:21 gibba023 bash[30844]: audit 2021-03-10T20:12:20.009032+0000 mgr.gibba044.wflcwh (mgr.34466) 228 : audit [DBG] from='client.54217 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:12:21.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:21 gibba023 bash[30844]: audit 2021-03-10T20:12:20.233612+0000 mgr.gibba044.wflcwh (mgr.34466) 229 : audit [DBG] from='client.54223 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:12:21.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:21 gibba023 bash[30844]: audit 2021-03-10T20:12:20.500667+0000 mon.a (mon.0) 463 : audit [DBG] from='client.? 172.21.2.123:0/700078745' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:21.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:21 gibba023 bash[31815]: audit 2021-03-10T20:12:20.009032+0000 mgr.gibba044.wflcwh (mgr.34466) 228 : audit [DBG] from='client.54217 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:12:21.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:21 gibba023 bash[31815]: audit 2021-03-10T20:12:20.233612+0000 mgr.gibba044.wflcwh (mgr.34466) 229 : audit [DBG] from='client.54223 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:12:21.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:21 gibba023 bash[31815]: audit 2021-03-10T20:12:20.500667+0000 mon.a (mon.0) 463 : audit [DBG] from='client.? 172.21.2.123:0/700078745' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:22.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:22 gibba023 bash[30844]: cluster 2021-03-10T20:12:21.348181+0000 mgr.gibba044.wflcwh (mgr.34466) 230 : cluster [DBG] pgmap v113: 129 pgs: 5 stale+active+clean, 9 active+undersized+degraded, 27 peering, 20 active+clean+wait, 12 active+undersized, 56 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 12/195 objects degraded (6.154%) 2021-03-10T20:12:22.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:22 gibba023 bash[31815]: cluster 2021-03-10T20:12:21.348181+0000 mgr.gibba044.wflcwh (mgr.34466) 230 : cluster [DBG] pgmap v113: 129 pgs: 5 stale+active+clean, 9 active+undersized+degraded, 27 peering, 20 active+clean+wait, 12 active+undersized, 56 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 12/195 objects degraded (6.154%) 2021-03-10T20:12:22.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:22 gibba044 bash[25485]: cluster 2021-03-10T20:12:21.348181+0000 mgr.gibba044.wflcwh (mgr.34466) 230 : cluster [DBG] pgmap v113: 129 pgs: 5 stale+active+clean, 9 active+undersized+degraded, 27 peering, 20 active+clean+wait, 12 active+undersized, 56 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 12/195 objects degraded (6.154%) 2021-03-10T20:12:22.749 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:12:22 gibba044 bash[27275]: debug 2021-03-10T20:12:22.517+0000 7ff80de31700 1 -- 172.21.2.144:0/1585814473 <== mon.2 v2:172.21.2.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556b43c7c4e0 con 0x556b43cf9400 2021-03-10T20:12:23.433 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:12:23 gibba044 bash[27275]: debug 2021-03-10T20:12:23.077+0000 7ff8158c6080 -1 Falling back to public interface 2021-03-10T20:12:23.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:23 gibba044 bash[25485]: cluster 2021-03-10T20:12:23.379305+0000 mon.a (mon.0) 464 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs inactive, 7 pgs peering) 2021-03-10T20:12:23.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:23 gibba023 bash[30844]: cluster 2021-03-10T20:12:23.379305+0000 mon.a (mon.0) 464 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs inactive, 7 pgs peering) 2021-03-10T20:12:23.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:23 gibba023 bash[31815]: cluster 2021-03-10T20:12:23.379305+0000 mon.a (mon.0) 464 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs inactive, 7 pgs peering) 2021-03-10T20:12:24.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:24 gibba044 bash[25485]: cluster 2021-03-10T20:12:23.348835+0000 mgr.gibba044.wflcwh (mgr.34466) 231 : cluster [DBG] pgmap v114: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 28/195 objects degraded (14.359%) 2021-03-10T20:12:24.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:24 gibba044 bash[25485]: audit 2021-03-10T20:12:23.757126+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:24.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:24 gibba044 bash[25485]: audit 2021-03-10T20:12:23.760889+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:24.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:24 gibba044 bash[25485]: audit 2021-03-10T20:12:23.765919+0000 mon.a (mon.0) 467 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:12:24.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:24 gibba044 bash[25485]: audit 2021-03-10T20:12:23.767728+0000 mon.a (mon.0) 468 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:24.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:24 gibba044 bash[25485]: audit 2021-03-10T20:12:23.769616+0000 mon.a (mon.0) 469 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:24.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:24 gibba044 bash[25485]: audit 2021-03-10T20:12:23.771346+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:24.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:24 gibba044 bash[25485]: audit 2021-03-10T20:12:23.775039+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T20:12:24.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:24 gibba023 bash[30844]: cluster 2021-03-10T20:12:23.348835+0000 mgr.gibba044.wflcwh (mgr.34466) 231 : cluster [DBG] pgmap v114: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 28/195 objects degraded (14.359%) 2021-03-10T20:12:24.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:24 gibba023 bash[30844]: audit 2021-03-10T20:12:23.757126+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:24.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:24 gibba023 bash[30844]: audit 2021-03-10T20:12:23.760889+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:24.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:24 gibba023 bash[30844]: audit 2021-03-10T20:12:23.765919+0000 mon.a (mon.0) 467 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:12:24.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:24 gibba023 bash[30844]: audit 2021-03-10T20:12:23.767728+0000 mon.a (mon.0) 468 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:24.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:24 gibba023 bash[30844]: audit 2021-03-10T20:12:23.769616+0000 mon.a (mon.0) 469 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:24.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:24 gibba023 bash[30844]: audit 2021-03-10T20:12:23.771346+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:24.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:24 gibba023 bash[30844]: audit 2021-03-10T20:12:23.775039+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T20:12:24.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:24 gibba023 bash[31815]: cluster 2021-03-10T20:12:23.348835+0000 mgr.gibba044.wflcwh (mgr.34466) 231 : cluster [DBG] pgmap v114: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 28/195 objects degraded (14.359%) 2021-03-10T20:12:24.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:24 gibba023 bash[31815]: audit 2021-03-10T20:12:23.757126+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:24.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:24 gibba023 bash[31815]: audit 2021-03-10T20:12:23.760889+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:24.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:24 gibba023 bash[31815]: audit 2021-03-10T20:12:23.765919+0000 mon.a (mon.0) 467 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:12:24.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:24 gibba023 bash[31815]: audit 2021-03-10T20:12:23.767728+0000 mon.a (mon.0) 468 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:24.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:24 gibba023 bash[31815]: audit 2021-03-10T20:12:23.769616+0000 mon.a (mon.0) 469 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:24.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:24 gibba023 bash[31815]: audit 2021-03-10T20:12:23.771346+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:24.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:24 gibba023 bash[31815]: audit 2021-03-10T20:12:23.775039+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T20:12:25.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:25 gibba044 bash[25485]: cephadm 2021-03-10T20:12:23.767091+0000 mgr.gibba044.wflcwh (mgr.34466) 232 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:12:25.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:25 gibba044 bash[25485]: cephadm 2021-03-10T20:12:23.769553+0000 mgr.gibba044.wflcwh (mgr.34466) 233 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:12:25.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:25 gibba044 bash[25485]: cephadm 2021-03-10T20:12:23.771226+0000 mgr.gibba044.wflcwh (mgr.34466) 234 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:12:25.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:25 gibba044 bash[25485]: cephadm 2021-03-10T20:12:23.771283+0000 mgr.gibba044.wflcwh (mgr.34466) 235 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:12:25.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:25 gibba044 bash[25485]: cephadm 2021-03-10T20:12:23.773016+0000 mgr.gibba044.wflcwh (mgr.34466) 236 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:12:25.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:25 gibba044 bash[25485]: cephadm 2021-03-10T20:12:23.773071+0000 mgr.gibba044.wflcwh (mgr.34466) 237 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:12:25.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:25 gibba044 bash[25485]: cephadm 2021-03-10T20:12:23.774871+0000 mgr.gibba044.wflcwh (mgr.34466) 238 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:12:25.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:25 gibba044 bash[25485]: cephadm 2021-03-10T20:12:23.776453+0000 mgr.gibba044.wflcwh (mgr.34466) 239 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:12:25.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:25 gibba044 bash[25485]: cephadm 2021-03-10T20:12:23.776514+0000 mgr.gibba044.wflcwh (mgr.34466) 240 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:12:25.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:25 gibba044 bash[25485]: audit 2021-03-10T20:12:23.777617+0000 mgr.gibba044.wflcwh (mgr.34466) 241 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T20:12:25.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:25 gibba044 bash[25485]: cephadm 2021-03-10T20:12:23.779242+0000 mgr.gibba044.wflcwh (mgr.34466) 242 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2021-03-10T20:12:25.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:25 gibba023 bash[30844]: cephadm 2021-03-10T20:12:23.767091+0000 mgr.gibba044.wflcwh (mgr.34466) 232 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:12:25.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:25 gibba023 bash[30844]: cephadm 2021-03-10T20:12:23.769553+0000 mgr.gibba044.wflcwh (mgr.34466) 233 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:12:25.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:25 gibba023 bash[30844]: cephadm 2021-03-10T20:12:23.771226+0000 mgr.gibba044.wflcwh (mgr.34466) 234 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:12:25.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:25 gibba023 bash[30844]: cephadm 2021-03-10T20:12:23.771283+0000 mgr.gibba044.wflcwh (mgr.34466) 235 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:12:25.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:25 gibba023 bash[30844]: cephadm 2021-03-10T20:12:23.773016+0000 mgr.gibba044.wflcwh (mgr.34466) 236 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:12:25.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:25 gibba023 bash[30844]: cephadm 2021-03-10T20:12:23.773071+0000 mgr.gibba044.wflcwh (mgr.34466) 237 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:12:25.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:25 gibba023 bash[30844]: cephadm 2021-03-10T20:12:23.774871+0000 mgr.gibba044.wflcwh (mgr.34466) 238 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:12:25.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:25 gibba023 bash[30844]: cephadm 2021-03-10T20:12:23.776453+0000 mgr.gibba044.wflcwh (mgr.34466) 239 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:12:25.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:25 gibba023 bash[30844]: cephadm 2021-03-10T20:12:23.776514+0000 mgr.gibba044.wflcwh (mgr.34466) 240 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:12:25.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:25 gibba023 bash[30844]: audit 2021-03-10T20:12:23.777617+0000 mgr.gibba044.wflcwh (mgr.34466) 241 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T20:12:25.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:25 gibba023 bash[30844]: cephadm 2021-03-10T20:12:23.779242+0000 mgr.gibba044.wflcwh (mgr.34466) 242 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2021-03-10T20:12:25.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:25 gibba023 bash[31815]: cephadm 2021-03-10T20:12:23.767091+0000 mgr.gibba044.wflcwh (mgr.34466) 232 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:12:25.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:25 gibba023 bash[31815]: cephadm 2021-03-10T20:12:23.769553+0000 mgr.gibba044.wflcwh (mgr.34466) 233 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:12:25.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:25 gibba023 bash[31815]: cephadm 2021-03-10T20:12:23.771226+0000 mgr.gibba044.wflcwh (mgr.34466) 234 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:12:25.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:25 gibba023 bash[31815]: cephadm 2021-03-10T20:12:23.771283+0000 mgr.gibba044.wflcwh (mgr.34466) 235 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:12:25.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:25 gibba023 bash[31815]: cephadm 2021-03-10T20:12:23.773016+0000 mgr.gibba044.wflcwh (mgr.34466) 236 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:12:25.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:25 gibba023 bash[31815]: cephadm 2021-03-10T20:12:23.773071+0000 mgr.gibba044.wflcwh (mgr.34466) 237 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:12:25.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:25 gibba023 bash[31815]: cephadm 2021-03-10T20:12:23.774871+0000 mgr.gibba044.wflcwh (mgr.34466) 238 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:12:25.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:25 gibba023 bash[31815]: cephadm 2021-03-10T20:12:23.776453+0000 mgr.gibba044.wflcwh (mgr.34466) 239 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:12:25.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:25 gibba023 bash[31815]: cephadm 2021-03-10T20:12:23.776514+0000 mgr.gibba044.wflcwh (mgr.34466) 240 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:12:25.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:25 gibba023 bash[31815]: audit 2021-03-10T20:12:23.777617+0000 mgr.gibba044.wflcwh (mgr.34466) 241 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T20:12:25.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:25 gibba023 bash[31815]: cephadm 2021-03-10T20:12:23.779242+0000 mgr.gibba044.wflcwh (mgr.34466) 242 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2021-03-10T20:12:26.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:26 gibba044 bash[25485]: cluster 2021-03-10T20:12:25.350453+0000 mgr.gibba044.wflcwh (mgr.34466) 243 : cluster [DBG] pgmap v115: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 28/195 objects degraded (14.359%) 2021-03-10T20:12:26.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:26 gibba044 bash[25485]: cluster 2021-03-10T20:12:25.986144+0000 mon.a (mon.0) 472 : cluster [WRN] Health check update: Degraded data redundancy: 28/195 objects degraded (14.359%), 21 pgs degraded (PG_DEGRADED) 2021-03-10T20:12:26.750 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:12:26 gibba044 bash[27275]: debug 2021-03-10T20:12:26.349+0000 7ff8158c6080 -1 bluestore(/var/lib/ceph/osd/ceph-4) fsck warning: store not yet converted to per-pg omap 2021-03-10T20:12:26.750 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:12:26 gibba044 bash[27275]: debug 2021-03-10T20:12:26.353+0000 7ff80238e700 -1 bluestore(/var/lib/ceph/osd/ceph-4) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T20:12:26.750 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:12:26 gibba044 bash[27275]: debug 2021-03-10T20:12:26.481+0000 7ff8158c6080 -1 osd.4 82 log_to_monitors {default=true} 2021-03-10T20:12:26.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:26 gibba023 bash[30844]: cluster 2021-03-10T20:12:25.350453+0000 mgr.gibba044.wflcwh (mgr.34466) 243 : cluster [DBG] pgmap v115: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 28/195 objects degraded (14.359%) 2021-03-10T20:12:26.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:26 gibba023 bash[30844]: cluster 2021-03-10T20:12:25.986144+0000 mon.a (mon.0) 472 : cluster [WRN] Health check update: Degraded data redundancy: 28/195 objects degraded (14.359%), 21 pgs degraded (PG_DEGRADED) 2021-03-10T20:12:26.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:26 gibba023 bash[31815]: cluster 2021-03-10T20:12:25.350453+0000 mgr.gibba044.wflcwh (mgr.34466) 243 : cluster [DBG] pgmap v115: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 28/195 objects degraded (14.359%) 2021-03-10T20:12:26.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:26 gibba023 bash[31815]: cluster 2021-03-10T20:12:25.986144+0000 mon.a (mon.0) 472 : cluster [WRN] Health check update: Degraded data redundancy: 28/195 objects degraded (14.359%), 21 pgs degraded (PG_DEGRADED) 2021-03-10T20:12:27.749 INFO:journalctl@ceph.osd.4.gibba044.stdout:Mar 10 20:12:27 gibba044 bash[27275]: debug 2021-03-10T20:12:27.477+0000 7ff8085a9700 -1 osd.4 82 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:12:27.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:27 gibba044 bash[25485]: audit 2021-03-10T20:12:26.485493+0000 mon.a (mon.0) 473 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T20:12:27.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:27 gibba044 bash[25485]: audit 2021-03-10T20:12:26.487108+0000 mon.b (mon.2) 3 : audit [INF] from='osd.4 [v2:172.21.2.144:6800/26336570,v1:172.21.2.144:6801/26336570]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T20:12:27.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:27 gibba044 bash[25485]: audit 2021-03-10T20:12:27.074504+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:12:27.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:27 gibba044 bash[25485]: audit 2021-03-10T20:12:27.080224+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:12:27.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:27 gibba023 bash[30844]: audit 2021-03-10T20:12:26.485493+0000 mon.a (mon.0) 473 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T20:12:27.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:27 gibba023 bash[30844]: audit 2021-03-10T20:12:26.487108+0000 mon.b (mon.2) 3 : audit [INF] from='osd.4 [v2:172.21.2.144:6800/26336570,v1:172.21.2.144:6801/26336570]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T20:12:27.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:27 gibba023 bash[30844]: audit 2021-03-10T20:12:27.074504+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:12:27.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:27 gibba023 bash[30844]: audit 2021-03-10T20:12:27.080224+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:12:27.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:27 gibba023 bash[31815]: audit 2021-03-10T20:12:26.485493+0000 mon.a (mon.0) 473 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T20:12:27.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:27 gibba023 bash[31815]: audit 2021-03-10T20:12:26.487108+0000 mon.b (mon.2) 3 : audit [INF] from='osd.4 [v2:172.21.2.144:6800/26336570,v1:172.21.2.144:6801/26336570]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-03-10T20:12:27.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:27 gibba023 bash[31815]: audit 2021-03-10T20:12:27.074504+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:12:27.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:27 gibba023 bash[31815]: audit 2021-03-10T20:12:27.080224+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:12:28.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:28 gibba044 bash[25485]: cluster 2021-03-10T20:12:27.352343+0000 mgr.gibba044.wflcwh (mgr.34466) 244 : cluster [DBG] pgmap v116: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 28/195 objects degraded (14.359%) 2021-03-10T20:12:28.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:28 gibba044 bash[25485]: audit 2021-03-10T20:12:27.465454+0000 mon.a (mon.0) 476 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T20:12:28.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:28 gibba044 bash[25485]: cluster 2021-03-10T20:12:27.465522+0000 mon.a (mon.0) 477 : cluster [DBG] osdmap e85: 8 total, 7 up, 8 in 2021-03-10T20:12:28.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:28 gibba044 bash[25485]: audit 2021-03-10T20:12:27.470181+0000 mon.b (mon.2) 4 : audit [INF] from='osd.4 [v2:172.21.2.144:6800/26336570,v1:172.21.2.144:6801/26336570]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:12:28.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:28 gibba044 bash[25485]: audit 2021-03-10T20:12:27.470291+0000 mon.a (mon.0) 478 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:12:28.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:28 gibba023 bash[30844]: cluster 2021-03-10T20:12:27.352343+0000 mgr.gibba044.wflcwh (mgr.34466) 244 : cluster [DBG] pgmap v116: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 28/195 objects degraded (14.359%) 2021-03-10T20:12:28.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:28 gibba023 bash[30844]: audit 2021-03-10T20:12:27.465454+0000 mon.a (mon.0) 476 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T20:12:28.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:28 gibba023 bash[30844]: cluster 2021-03-10T20:12:27.465522+0000 mon.a (mon.0) 477 : cluster [DBG] osdmap e85: 8 total, 7 up, 8 in 2021-03-10T20:12:28.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:28 gibba023 bash[30844]: audit 2021-03-10T20:12:27.470181+0000 mon.b (mon.2) 4 : audit [INF] from='osd.4 [v2:172.21.2.144:6800/26336570,v1:172.21.2.144:6801/26336570]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:12:28.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:28 gibba023 bash[30844]: audit 2021-03-10T20:12:27.470291+0000 mon.a (mon.0) 478 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:12:28.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:28 gibba023 bash[31815]: cluster 2021-03-10T20:12:27.352343+0000 mgr.gibba044.wflcwh (mgr.34466) 244 : cluster [DBG] pgmap v116: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 29 MiB used, 668 GiB / 672 GiB avail; 28/195 objects degraded (14.359%) 2021-03-10T20:12:28.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:28 gibba023 bash[31815]: audit 2021-03-10T20:12:27.465454+0000 mon.a (mon.0) 476 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-03-10T20:12:28.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:28 gibba023 bash[31815]: cluster 2021-03-10T20:12:27.465522+0000 mon.a (mon.0) 477 : cluster [DBG] osdmap e85: 8 total, 7 up, 8 in 2021-03-10T20:12:28.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:28 gibba023 bash[31815]: audit 2021-03-10T20:12:27.470181+0000 mon.b (mon.2) 4 : audit [INF] from='osd.4 [v2:172.21.2.144:6800/26336570,v1:172.21.2.144:6801/26336570]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:12:28.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:28 gibba023 bash[31815]: audit 2021-03-10T20:12:27.470291+0000 mon.a (mon.0) 478 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:12:29.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:29 gibba044 bash[25485]: cluster 2021-03-10T20:12:28.470992+0000 mon.a (mon.0) 479 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:12:29.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:29 gibba044 bash[25485]: cluster 2021-03-10T20:12:28.481387+0000 mon.a (mon.0) 480 : cluster [INF] osd.4 [v2:172.21.2.144:6800/26336570,v1:172.21.2.144:6801/26336570] boot 2021-03-10T20:12:29.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:29 gibba044 bash[25485]: cluster 2021-03-10T20:12:28.481408+0000 mon.a (mon.0) 481 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-03-10T20:12:29.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:29 gibba044 bash[25485]: audit 2021-03-10T20:12:28.481480+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:12:29.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:29 gibba044 bash[25485]: cluster 2021-03-10T20:12:29.353772+0000 mgr.gibba044.wflcwh (mgr.34466) 245 : cluster [DBG] pgmap v119: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 28/195 objects degraded (14.359%) 2021-03-10T20:12:29.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:29 gibba023 bash[30844]: cluster 2021-03-10T20:12:28.470992+0000 mon.a (mon.0) 479 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:12:29.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:29 gibba023 bash[30844]: cluster 2021-03-10T20:12:28.481387+0000 mon.a (mon.0) 480 : cluster [INF] osd.4 [v2:172.21.2.144:6800/26336570,v1:172.21.2.144:6801/26336570] boot 2021-03-10T20:12:29.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:29 gibba023 bash[30844]: cluster 2021-03-10T20:12:28.481408+0000 mon.a (mon.0) 481 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-03-10T20:12:29.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:29 gibba023 bash[30844]: audit 2021-03-10T20:12:28.481480+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:12:29.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:29 gibba023 bash[30844]: cluster 2021-03-10T20:12:29.353772+0000 mgr.gibba044.wflcwh (mgr.34466) 245 : cluster [DBG] pgmap v119: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 28/195 objects degraded (14.359%) 2021-03-10T20:12:29.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:29 gibba023 bash[31815]: cluster 2021-03-10T20:12:28.470992+0000 mon.a (mon.0) 479 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:12:29.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:29 gibba023 bash[31815]: cluster 2021-03-10T20:12:28.481387+0000 mon.a (mon.0) 480 : cluster [INF] osd.4 [v2:172.21.2.144:6800/26336570,v1:172.21.2.144:6801/26336570] boot 2021-03-10T20:12:29.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:29 gibba023 bash[31815]: cluster 2021-03-10T20:12:28.481408+0000 mon.a (mon.0) 481 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-03-10T20:12:29.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:29 gibba023 bash[31815]: audit 2021-03-10T20:12:28.481480+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-03-10T20:12:29.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:29 gibba023 bash[31815]: cluster 2021-03-10T20:12:29.353772+0000 mgr.gibba044.wflcwh (mgr.34466) 245 : cluster [DBG] pgmap v119: 129 pgs: 21 active+undersized+degraded, 35 active+undersized, 73 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 28/195 objects degraded (14.359%) 2021-03-10T20:12:30.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:30 gibba044 bash[25485]: cluster 2021-03-10T20:12:29.485946+0000 mon.a (mon.0) 483 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2021-03-10T20:12:30.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:30 gibba023 bash[30844]: cluster 2021-03-10T20:12:29.485946+0000 mon.a (mon.0) 483 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2021-03-10T20:12:30.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:30 gibba023 bash[31815]: cluster 2021-03-10T20:12:29.485946+0000 mon.a (mon.0) 483 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2021-03-10T20:12:32.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:32 gibba023 bash[30844]: cluster 2021-03-10T20:12:31.355310+0000 mgr.gibba044.wflcwh (mgr.34466) 246 : cluster [DBG] pgmap v121: 129 pgs: 19 active+undersized+degraded, 29 active+undersized, 81 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T20:12:32.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:32 gibba023 bash[31815]: cluster 2021-03-10T20:12:31.355310+0000 mgr.gibba044.wflcwh (mgr.34466) 246 : cluster [DBG] pgmap v121: 129 pgs: 19 active+undersized+degraded, 29 active+undersized, 81 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T20:12:32.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:32 gibba044 bash[25485]: cluster 2021-03-10T20:12:31.355310+0000 mgr.gibba044.wflcwh (mgr.34466) 246 : cluster [DBG] pgmap v121: 129 pgs: 19 active+undersized+degraded, 29 active+undersized, 81 active+clean; 7.0 KiB data, 34 MiB used, 669 GiB / 672 GiB avail; 26/195 objects degraded (13.333%) 2021-03-10T20:12:33.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:33 gibba023 bash[30844]: cluster 2021-03-10T20:12:31.994075+0000 mon.a (mon.0) 484 : cluster [WRN] Health check update: Degraded data redundancy: 26/195 objects degraded (13.333%), 19 pgs degraded (PG_DEGRADED) 2021-03-10T20:12:33.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:33 gibba023 bash[31815]: cluster 2021-03-10T20:12:31.994075+0000 mon.a (mon.0) 484 : cluster [WRN] Health check update: Degraded data redundancy: 26/195 objects degraded (13.333%), 19 pgs degraded (PG_DEGRADED) 2021-03-10T20:12:33.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:33 gibba044 bash[25485]: cluster 2021-03-10T20:12:31.994075+0000 mon.a (mon.0) 484 : cluster [WRN] Health check update: Degraded data redundancy: 26/195 objects degraded (13.333%), 19 pgs degraded (PG_DEGRADED) 2021-03-10T20:12:34.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:34 gibba023 bash[30844]: cluster 2021-03-10T20:12:33.357071+0000 mgr.gibba044.wflcwh (mgr.34466) 247 : cluster [DBG] pgmap v122: 129 pgs: 18 active+clean+wait, 1 active+undersized+degraded, 6 active+undersized, 104 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 1/195 objects degraded (0.513%) 2021-03-10T20:12:34.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:34 gibba023 bash[31815]: cluster 2021-03-10T20:12:33.357071+0000 mgr.gibba044.wflcwh (mgr.34466) 247 : cluster [DBG] pgmap v122: 129 pgs: 18 active+clean+wait, 1 active+undersized+degraded, 6 active+undersized, 104 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 1/195 objects degraded (0.513%) 2021-03-10T20:12:34.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:34 gibba044 bash[25485]: cluster 2021-03-10T20:12:33.357071+0000 mgr.gibba044.wflcwh (mgr.34466) 247 : cluster [DBG] pgmap v122: 129 pgs: 18 active+clean+wait, 1 active+undersized+degraded, 6 active+undersized, 104 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 1/195 objects degraded (0.513%) 2021-03-10T20:12:35.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:35 gibba044 bash[25485]: cluster 2021-03-10T20:12:35.409134+0000 mon.a (mon.0) 485 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/195 objects degraded (0.513%), 1 pg degraded) 2021-03-10T20:12:35.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:35 gibba023 bash[30844]: cluster 2021-03-10T20:12:35.409134+0000 mon.a (mon.0) 485 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/195 objects degraded (0.513%), 1 pg degraded) 2021-03-10T20:12:35.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:35 gibba023 bash[31815]: cluster 2021-03-10T20:12:35.409134+0000 mon.a (mon.0) 485 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/195 objects degraded (0.513%), 1 pg degraded) 2021-03-10T20:12:36.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:36 gibba044 bash[25485]: cluster 2021-03-10T20:12:35.358559+0000 mgr.gibba044.wflcwh (mgr.34466) 248 : cluster [DBG] pgmap v123: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:12:36.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:36 gibba023 bash[30844]: cluster 2021-03-10T20:12:35.358559+0000 mgr.gibba044.wflcwh (mgr.34466) 248 : cluster [DBG] pgmap v123: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:12:36.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:36 gibba023 bash[31815]: cluster 2021-03-10T20:12:35.358559+0000 mgr.gibba044.wflcwh (mgr.34466) 248 : cluster [DBG] pgmap v123: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:12:38.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:38 gibba023 bash[30844]: audit 2021-03-10T20:12:37.120548+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:38.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:38 gibba023 bash[30844]: cluster 2021-03-10T20:12:37.359878+0000 mgr.gibba044.wflcwh (mgr.34466) 249 : cluster [DBG] pgmap v124: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:12:38.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:38 gibba023 bash[31815]: audit 2021-03-10T20:12:37.120548+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:38.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:38 gibba023 bash[31815]: cluster 2021-03-10T20:12:37.359878+0000 mgr.gibba044.wflcwh (mgr.34466) 249 : cluster [DBG] pgmap v124: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:12:38.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:38 gibba044 bash[25485]: audit 2021-03-10T20:12:37.120548+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:38.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:38 gibba044 bash[25485]: cluster 2021-03-10T20:12:37.359878+0000 mgr.gibba044.wflcwh (mgr.34466) 249 : cluster [DBG] pgmap v124: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:12:39.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:39 gibba044 bash[25485]: audit 2021-03-10T20:12:38.793575+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T20:12:39.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:39 gibba023 bash[30844]: audit 2021-03-10T20:12:38.793575+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T20:12:39.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:39 gibba023 bash[31815]: audit 2021-03-10T20:12:38.793575+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T20:12:40.202 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:40 gibba044 bash[25485]: audit 2021-03-10T20:12:38.796768+0000 mgr.gibba044.wflcwh (mgr.34466) 250 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T20:12:40.202 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:40 gibba044 bash[25485]: cephadm 2021-03-10T20:12:38.801057+0000 mgr.gibba044.wflcwh (mgr.34466) 251 : cephadm [INF] Upgrade: osd.5 is safe to restart 2021-03-10T20:12:40.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:40 gibba023 bash[30844]: audit 2021-03-10T20:12:38.796768+0000 mgr.gibba044.wflcwh (mgr.34466) 250 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T20:12:40.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:40 gibba023 bash[30844]: cephadm 2021-03-10T20:12:38.801057+0000 mgr.gibba044.wflcwh (mgr.34466) 251 : cephadm [INF] Upgrade: osd.5 is safe to restart 2021-03-10T20:12:40.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:40 gibba023 bash[30844]: cluster 2021-03-10T20:12:39.361489+0000 mgr.gibba044.wflcwh (mgr.34466) 252 : cluster [DBG] pgmap v125: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:12:40.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:40 gibba023 bash[31815]: audit 2021-03-10T20:12:38.796768+0000 mgr.gibba044.wflcwh (mgr.34466) 250 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2021-03-10T20:12:40.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:40 gibba023 bash[31815]: cephadm 2021-03-10T20:12:38.801057+0000 mgr.gibba044.wflcwh (mgr.34466) 251 : cephadm [INF] Upgrade: osd.5 is safe to restart 2021-03-10T20:12:40.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:40 gibba023 bash[31815]: cluster 2021-03-10T20:12:39.361489+0000 mgr.gibba044.wflcwh (mgr.34466) 252 : cluster [DBG] pgmap v125: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:12:40.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:40 gibba044 bash[25485]: cluster 2021-03-10T20:12:39.361489+0000 mgr.gibba044.wflcwh (mgr.34466) 252 : cluster [DBG] pgmap v125: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:12:41.802 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:41 gibba044 bash[25485]: cephadm 2021-03-10T20:12:40.536699+0000 mgr.gibba044.wflcwh (mgr.34466) 253 : cephadm [INF] Upgrade: Updating osd.5 2021-03-10T20:12:41.803 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:41 gibba044 bash[25485]: audit 2021-03-10T20:12:40.544152+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:41.803 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:41 gibba044 bash[25485]: audit 2021-03-10T20:12:40.545771+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T20:12:41.803 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:41 gibba044 bash[25485]: cephadm 2021-03-10T20:12:40.547885+0000 mgr.gibba044.wflcwh (mgr.34466) 254 : cephadm [INF] Deploying daemon osd.5 on gibba044 2021-03-10T20:12:41.804 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:41 gibba044 bash[25485]: cluster 2021-03-10T20:12:41.362711+0000 mgr.gibba044.wflcwh (mgr.34466) 255 : cluster [DBG] pgmap v126: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:12:41.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:41 gibba023 bash[30844]: cephadm 2021-03-10T20:12:40.536699+0000 mgr.gibba044.wflcwh (mgr.34466) 253 : cephadm [INF] Upgrade: Updating osd.5 2021-03-10T20:12:41.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:41 gibba023 bash[30844]: audit 2021-03-10T20:12:40.544152+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:41.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:41 gibba023 bash[30844]: audit 2021-03-10T20:12:40.545771+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T20:12:41.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:41 gibba023 bash[30844]: cephadm 2021-03-10T20:12:40.547885+0000 mgr.gibba044.wflcwh (mgr.34466) 254 : cephadm [INF] Deploying daemon osd.5 on gibba044 2021-03-10T20:12:41.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:41 gibba023 bash[30844]: cluster 2021-03-10T20:12:41.362711+0000 mgr.gibba044.wflcwh (mgr.34466) 255 : cluster [DBG] pgmap v126: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:12:41.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:41 gibba023 bash[31815]: cephadm 2021-03-10T20:12:40.536699+0000 mgr.gibba044.wflcwh (mgr.34466) 253 : cephadm [INF] Upgrade: Updating osd.5 2021-03-10T20:12:41.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:41 gibba023 bash[31815]: audit 2021-03-10T20:12:40.544152+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:41.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:41 gibba023 bash[31815]: audit 2021-03-10T20:12:40.545771+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2021-03-10T20:12:41.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:41 gibba023 bash[31815]: cephadm 2021-03-10T20:12:40.547885+0000 mgr.gibba044.wflcwh (mgr.34466) 254 : cephadm [INF] Deploying daemon osd.5 on gibba044 2021-03-10T20:12:41.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:41 gibba023 bash[31815]: cluster 2021-03-10T20:12:41.362711+0000 mgr.gibba044.wflcwh (mgr.34466) 255 : cluster [DBG] pgmap v126: 129 pgs: 18 active+clean+wait, 111 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:12:42.587 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:12:42 gibba044 systemd[1]: Stopping Ceph osd.5 for dd719b26-81da-11eb-9080-001a4aab830c... 2021-03-10T20:12:42.587 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:12:42 gibba044 bash[13682]: debug 2021-03-10T20:12:42.462+0000 7fc8e05f6700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T20:12:42.587 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:12:42 gibba044 bash[13682]: debug 2021-03-10T20:12:42.462+0000 7fc8e05f6700 -1 osd.5 87 *** Got signal Terminated *** 2021-03-10T20:12:42.587 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:12:42 gibba044 bash[13682]: debug 2021-03-10T20:12:42.462+0000 7fc8e05f6700 -1 osd.5 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T20:12:43.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[30844]: cluster 2021-03-10T20:12:42.568543+0000 mon.a (mon.0) 490 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T20:12:43.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[30844]: cluster 2021-03-10T20:12:42.568687+0000 mon.a (mon.0) 491 : cluster [INF] osd.5 failed (root=default,host=gibba044) (connection refused reported by osd.2) 2021-03-10T20:12:43.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[30844]: cluster 2021-03-10T20:12:42.568970+0000 mon.a (mon.0) 492 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T20:12:43.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[30844]: cluster 2021-03-10T20:12:42.569042+0000 mon.a (mon.0) 493 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T20:12:43.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[30844]: cluster 2021-03-10T20:12:42.569187+0000 mon.a (mon.0) 494 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T20:12:43.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[30844]: cluster 2021-03-10T20:12:42.569291+0000 mon.a (mon.0) 495 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T20:12:43.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[30844]: cluster 2021-03-10T20:12:42.569442+0000 mon.a (mon.0) 496 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T20:12:43.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[30844]: cluster 2021-03-10T20:12:42.569623+0000 mon.a (mon.0) 497 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T20:12:43.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[30844]: cluster 2021-03-10T20:12:42.569736+0000 mon.a (mon.0) 498 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T20:12:43.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[30844]: cluster 2021-03-10T20:12:42.767856+0000 mon.a (mon.0) 499 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T20:12:43.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[30844]: cluster 2021-03-10T20:12:42.768273+0000 mon.a (mon.0) 500 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T20:12:43.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[30844]: cluster 2021-03-10T20:12:42.768960+0000 mon.a (mon.0) 501 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T20:12:43.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[30844]: cluster 2021-03-10T20:12:42.769380+0000 mon.a (mon.0) 502 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T20:12:43.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[30844]: cluster 2021-03-10T20:12:42.769837+0000 mon.a (mon.0) 503 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T20:12:43.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[30844]: cluster 2021-03-10T20:12:42.770252+0000 mon.a (mon.0) 504 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T20:12:43.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[30844]: cluster 2021-03-10T20:12:42.770704+0000 mon.a (mon.0) 505 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T20:12:43.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[30844]: cluster 2021-03-10T20:12:42.771191+0000 mon.a (mon.0) 506 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T20:12:43.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[30844]: cluster 2021-03-10T20:12:42.771656+0000 mon.a (mon.0) 507 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T20:12:43.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[30844]: cluster 2021-03-10T20:12:42.772099+0000 mon.a (mon.0) 508 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T20:12:43.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[30844]: cluster 2021-03-10T20:12:42.772381+0000 mon.a (mon.0) 509 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T20:12:43.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[30844]: cluster 2021-03-10T20:12:42.772888+0000 mon.a (mon.0) 510 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T20:12:43.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[30844]: cluster 2021-03-10T20:12:42.773336+0000 mon.a (mon.0) 511 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T20:12:43.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[30844]: cluster 2021-03-10T20:12:42.773774+0000 mon.a (mon.0) 512 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T20:12:43.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[31815]: cluster 2021-03-10T20:12:42.568543+0000 mon.a (mon.0) 490 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T20:12:43.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[31815]: cluster 2021-03-10T20:12:42.568687+0000 mon.a (mon.0) 491 : cluster [INF] osd.5 failed (root=default,host=gibba044) (connection refused reported by osd.2) 2021-03-10T20:12:43.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[31815]: cluster 2021-03-10T20:12:42.568970+0000 mon.a (mon.0) 492 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T20:12:43.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[31815]: cluster 2021-03-10T20:12:42.569042+0000 mon.a (mon.0) 493 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T20:12:43.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[31815]: cluster 2021-03-10T20:12:42.569187+0000 mon.a (mon.0) 494 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T20:12:43.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[31815]: cluster 2021-03-10T20:12:42.569291+0000 mon.a (mon.0) 495 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T20:12:43.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[31815]: cluster 2021-03-10T20:12:42.569442+0000 mon.a (mon.0) 496 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T20:12:43.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[31815]: cluster 2021-03-10T20:12:42.569623+0000 mon.a (mon.0) 497 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T20:12:43.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[31815]: cluster 2021-03-10T20:12:42.569736+0000 mon.a (mon.0) 498 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T20:12:43.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[31815]: cluster 2021-03-10T20:12:42.767856+0000 mon.a (mon.0) 499 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T20:12:43.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[31815]: cluster 2021-03-10T20:12:42.768273+0000 mon.a (mon.0) 500 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T20:12:43.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[31815]: cluster 2021-03-10T20:12:42.768960+0000 mon.a (mon.0) 501 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T20:12:43.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[31815]: cluster 2021-03-10T20:12:42.769380+0000 mon.a (mon.0) 502 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T20:12:43.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[31815]: cluster 2021-03-10T20:12:42.769837+0000 mon.a (mon.0) 503 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T20:12:43.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[31815]: cluster 2021-03-10T20:12:42.770252+0000 mon.a (mon.0) 504 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T20:12:43.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[31815]: cluster 2021-03-10T20:12:42.770704+0000 mon.a (mon.0) 505 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T20:12:43.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[31815]: cluster 2021-03-10T20:12:42.771191+0000 mon.a (mon.0) 506 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T20:12:43.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[31815]: cluster 2021-03-10T20:12:42.771656+0000 mon.a (mon.0) 507 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T20:12:43.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[31815]: cluster 2021-03-10T20:12:42.772099+0000 mon.a (mon.0) 508 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T20:12:43.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[31815]: cluster 2021-03-10T20:12:42.772381+0000 mon.a (mon.0) 509 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T20:12:43.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[31815]: cluster 2021-03-10T20:12:42.772888+0000 mon.a (mon.0) 510 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T20:12:43.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[31815]: cluster 2021-03-10T20:12:42.773336+0000 mon.a (mon.0) 511 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T20:12:43.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:43 gibba023 bash[31815]: cluster 2021-03-10T20:12:42.773774+0000 mon.a (mon.0) 512 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T20:12:43.498 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:12:43 gibba044 docker[28211]: ceph-dd719b26-81da-11eb-9080-001a4aab830c-osd.5 2021-03-10T20:12:43.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:43 gibba044 bash[25485]: cluster 2021-03-10T20:12:42.568543+0000 mon.a (mon.0) 490 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T20:12:43.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:43 gibba044 bash[25485]: cluster 2021-03-10T20:12:42.568687+0000 mon.a (mon.0) 491 : cluster [INF] osd.5 failed (root=default,host=gibba044) (connection refused reported by osd.2) 2021-03-10T20:12:43.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:43 gibba044 bash[25485]: cluster 2021-03-10T20:12:42.568970+0000 mon.a (mon.0) 492 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T20:12:43.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:43 gibba044 bash[25485]: cluster 2021-03-10T20:12:42.569042+0000 mon.a (mon.0) 493 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T20:12:43.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:43 gibba044 bash[25485]: cluster 2021-03-10T20:12:42.569187+0000 mon.a (mon.0) 494 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T20:12:43.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:43 gibba044 bash[25485]: cluster 2021-03-10T20:12:42.569291+0000 mon.a (mon.0) 495 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T20:12:43.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:43 gibba044 bash[25485]: cluster 2021-03-10T20:12:42.569442+0000 mon.a (mon.0) 496 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T20:12:43.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:43 gibba044 bash[25485]: cluster 2021-03-10T20:12:42.569623+0000 mon.a (mon.0) 497 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T20:12:43.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:43 gibba044 bash[25485]: cluster 2021-03-10T20:12:42.569736+0000 mon.a (mon.0) 498 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T20:12:43.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:43 gibba044 bash[25485]: cluster 2021-03-10T20:12:42.767856+0000 mon.a (mon.0) 499 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T20:12:43.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:43 gibba044 bash[25485]: cluster 2021-03-10T20:12:42.768273+0000 mon.a (mon.0) 500 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-03-10T20:12:43.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:43 gibba044 bash[25485]: cluster 2021-03-10T20:12:42.768960+0000 mon.a (mon.0) 501 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T20:12:43.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:43 gibba044 bash[25485]: cluster 2021-03-10T20:12:42.769380+0000 mon.a (mon.0) 502 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T20:12:43.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:43 gibba044 bash[25485]: cluster 2021-03-10T20:12:42.769837+0000 mon.a (mon.0) 503 : cluster [DBG] osd.5 reported immediately failed by osd.4 2021-03-10T20:12:43.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:43 gibba044 bash[25485]: cluster 2021-03-10T20:12:42.770252+0000 mon.a (mon.0) 504 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-03-10T20:12:43.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:43 gibba044 bash[25485]: cluster 2021-03-10T20:12:42.770704+0000 mon.a (mon.0) 505 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T20:12:43.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:43 gibba044 bash[25485]: cluster 2021-03-10T20:12:42.771191+0000 mon.a (mon.0) 506 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T20:12:43.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:43 gibba044 bash[25485]: cluster 2021-03-10T20:12:42.771656+0000 mon.a (mon.0) 507 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T20:12:43.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:43 gibba044 bash[25485]: cluster 2021-03-10T20:12:42.772099+0000 mon.a (mon.0) 508 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-03-10T20:12:43.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:43 gibba044 bash[25485]: cluster 2021-03-10T20:12:42.772381+0000 mon.a (mon.0) 509 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T20:12:43.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:43 gibba044 bash[25485]: cluster 2021-03-10T20:12:42.772888+0000 mon.a (mon.0) 510 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-03-10T20:12:43.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:43 gibba044 bash[25485]: cluster 2021-03-10T20:12:42.773336+0000 mon.a (mon.0) 511 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-03-10T20:12:43.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:43 gibba044 bash[25485]: cluster 2021-03-10T20:12:42.773774+0000 mon.a (mon.0) 512 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-03-10T20:12:44.363 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:44 gibba044 bash[25485]: cluster 2021-03-10T20:12:43.005155+0000 mon.a (mon.0) 513 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:12:44.363 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:44 gibba044 bash[25485]: cluster 2021-03-10T20:12:43.017610+0000 mon.a (mon.0) 514 : cluster [DBG] osdmap e88: 8 total, 7 up, 8 in 2021-03-10T20:12:44.363 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:44 gibba044 bash[25485]: cluster 2021-03-10T20:12:43.363776+0000 mgr.gibba044.wflcwh (mgr.34466) 256 : cluster [DBG] pgmap v128: 129 pgs: 17 stale+active+clean, 112 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:12:44.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:44 gibba023 bash[30844]: cluster 2021-03-10T20:12:43.005155+0000 mon.a (mon.0) 513 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:12:44.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:44 gibba023 bash[30844]: cluster 2021-03-10T20:12:43.017610+0000 mon.a (mon.0) 514 : cluster [DBG] osdmap e88: 8 total, 7 up, 8 in 2021-03-10T20:12:44.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:44 gibba023 bash[30844]: cluster 2021-03-10T20:12:43.363776+0000 mgr.gibba044.wflcwh (mgr.34466) 256 : cluster [DBG] pgmap v128: 129 pgs: 17 stale+active+clean, 112 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:12:44.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:44 gibba023 bash[31815]: cluster 2021-03-10T20:12:43.005155+0000 mon.a (mon.0) 513 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:12:44.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:44 gibba023 bash[31815]: cluster 2021-03-10T20:12:43.017610+0000 mon.a (mon.0) 514 : cluster [DBG] osdmap e88: 8 total, 7 up, 8 in 2021-03-10T20:12:44.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:44 gibba023 bash[31815]: cluster 2021-03-10T20:12:43.363776+0000 mgr.gibba044.wflcwh (mgr.34466) 256 : cluster [DBG] pgmap v128: 129 pgs: 17 stale+active+clean, 112 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:12:45.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:45 gibba044 bash[25485]: cluster 2021-03-10T20:12:44.021891+0000 mon.a (mon.0) 515 : cluster [DBG] osdmap e89: 8 total, 7 up, 8 in 2021-03-10T20:12:45.249 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:12:44 gibba044 systemd[1]: ceph-dd719b26-81da-11eb-9080-001a4aab830c@osd.5.service: Succeeded. 2021-03-10T20:12:45.249 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:12:44 gibba044 systemd[1]: Stopped Ceph osd.5 for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:12:45.249 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:12:45 gibba044 systemd[1]: Started Ceph osd.5 for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:12:45.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:45 gibba023 bash[30844]: cluster 2021-03-10T20:12:44.021891+0000 mon.a (mon.0) 515 : cluster [DBG] osdmap e89: 8 total, 7 up, 8 in 2021-03-10T20:12:45.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:45 gibba023 bash[31815]: cluster 2021-03-10T20:12:44.021891+0000 mon.a (mon.0) 515 : cluster [DBG] osdmap e89: 8 total, 7 up, 8 in 2021-03-10T20:12:46.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:46 gibba044 bash[25485]: audit 2021-03-10T20:12:45.156833+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:46.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:46 gibba044 bash[25485]: audit 2021-03-10T20:12:45.158220+0000 mon.a (mon.0) 517 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:12:46.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:46 gibba044 bash[25485]: cluster 2021-03-10T20:12:45.364249+0000 mgr.gibba044.wflcwh (mgr.34466) 257 : cluster [DBG] pgmap v130: 129 pgs: 5 peering, 15 stale+active+clean, 5 active+undersized, 104 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:12:46.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:46 gibba023 bash[30844]: audit 2021-03-10T20:12:45.156833+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:46.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:46 gibba023 bash[30844]: audit 2021-03-10T20:12:45.158220+0000 mon.a (mon.0) 517 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:12:46.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:46 gibba023 bash[30844]: cluster 2021-03-10T20:12:45.364249+0000 mgr.gibba044.wflcwh (mgr.34466) 257 : cluster [DBG] pgmap v130: 129 pgs: 5 peering, 15 stale+active+clean, 5 active+undersized, 104 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:12:46.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:46 gibba023 bash[31815]: audit 2021-03-10T20:12:45.156833+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:46.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:46 gibba023 bash[31815]: audit 2021-03-10T20:12:45.158220+0000 mon.a (mon.0) 517 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:12:46.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:46 gibba023 bash[31815]: cluster 2021-03-10T20:12:45.364249+0000 mgr.gibba044.wflcwh (mgr.34466) 257 : cluster [DBG] pgmap v130: 129 pgs: 5 peering, 15 stale+active+clean, 5 active+undersized, 104 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail 2021-03-10T20:12:46.748 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:12:46 gibba044 bash[28390]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-03-10T20:12:46.749 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:12:46 gibba044 bash[28390]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2021-03-10T20:12:46.749 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:12:46 gibba044 bash[28390]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2021-03-10T20:12:46.749 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:12:46 gibba044 bash[28390]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2021-03-10T20:12:46.749 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:12:46 gibba044 bash[28390]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-03-10T20:12:46.750 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:12:46 gibba044 bash[28390]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-03-10T20:12:46.750 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:12:46 gibba044 bash[28390]: --> ceph-volume lvm activate successful for osd ID: 5 2021-03-10T20:12:47.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:47 gibba044 bash[25485]: cluster 2021-03-10T20:12:46.153235+0000 mon.a (mon.0) 518 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:12:47.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:47 gibba023 bash[30844]: cluster 2021-03-10T20:12:46.153235+0000 mon.a (mon.0) 518 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:12:47.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:47 gibba023 bash[31815]: cluster 2021-03-10T20:12:46.153235+0000 mon.a (mon.0) 518 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:12:48.172 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:12:47 gibba044 bash[28514]: debug 2021-03-10T20:12:47.846+0000 7f867e907700 1 -- 172.21.2.144:0/1957332830 <== mon.2 v2:172.21.2.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a7743f84e0 con 0x55a774474c00 2021-03-10T20:12:48.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:48 gibba023 bash[30844]: cluster 2021-03-10T20:12:47.365830+0000 mgr.gibba044.wflcwh (mgr.34466) 258 : cluster [DBG] pgmap v131: 129 pgs: 3 active+undersized+degraded, 5 peering, 8 stale+active+clean, 17 active+undersized, 96 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 6/195 objects degraded (3.077%) 2021-03-10T20:12:48.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:48 gibba023 bash[31815]: cluster 2021-03-10T20:12:47.365830+0000 mgr.gibba044.wflcwh (mgr.34466) 258 : cluster [DBG] pgmap v131: 129 pgs: 3 active+undersized+degraded, 5 peering, 8 stale+active+clean, 17 active+undersized, 96 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 6/195 objects degraded (3.077%) 2021-03-10T20:12:48.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:48 gibba044 bash[25485]: cluster 2021-03-10T20:12:47.365830+0000 mgr.gibba044.wflcwh (mgr.34466) 258 : cluster [DBG] pgmap v131: 129 pgs: 3 active+undersized+degraded, 5 peering, 8 stale+active+clean, 17 active+undersized, 96 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 6/195 objects degraded (3.077%) 2021-03-10T20:12:48.499 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:12:48 gibba044 bash[28514]: debug 2021-03-10T20:12:48.390+0000 7f868639c080 -1 Falling back to public interface 2021-03-10T20:12:49.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:49 gibba044 bash[25485]: cluster 2021-03-10T20:12:48.161327+0000 mon.a (mon.0) 519 : cluster [WRN] Health check failed: Degraded data redundancy: 6/195 objects degraded (3.077%), 3 pgs degraded (PG_DEGRADED) 2021-03-10T20:12:49.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:49 gibba023 bash[30844]: cluster 2021-03-10T20:12:48.161327+0000 mon.a (mon.0) 519 : cluster [WRN] Health check failed: Degraded data redundancy: 6/195 objects degraded (3.077%), 3 pgs degraded (PG_DEGRADED) 2021-03-10T20:12:49.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:49 gibba023 bash[31815]: cluster 2021-03-10T20:12:48.161327+0000 mon.a (mon.0) 519 : cluster [WRN] Health check failed: Degraded data redundancy: 6/195 objects degraded (3.077%), 3 pgs degraded (PG_DEGRADED) 2021-03-10T20:12:50.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:50 gibba044 bash[25485]: cluster 2021-03-10T20:12:49.367797+0000 mgr.gibba044.wflcwh (mgr.34466) 259 : cluster [DBG] pgmap v132: 129 pgs: 15 active+undersized+degraded, 29 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:12:50.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:50 gibba023 bash[30844]: cluster 2021-03-10T20:12:49.367797+0000 mgr.gibba044.wflcwh (mgr.34466) 259 : cluster [DBG] pgmap v132: 129 pgs: 15 active+undersized+degraded, 29 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:12:50.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:50 gibba023 bash[31815]: cluster 2021-03-10T20:12:49.367797+0000 mgr.gibba044.wflcwh (mgr.34466) 259 : cluster [DBG] pgmap v132: 129 pgs: 15 active+undersized+degraded, 29 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:12:50.738 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:12:50.964 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:12:50.964 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (4m) 52s ago 9m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:12:50.965 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (9m) 0s ago 9m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:12:50.965 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (4m) 0s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:12:50.965 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (4m) 0s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:12:50.965 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (3m) 52s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:12:50.966 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (3m) 52s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:12:50.966 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (3m) 0s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:12:50.966 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (3m) 52s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:12:50.966 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (9m) 52s ago 9m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:12:50.966 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (9m) 0s ago 9m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:12:50.967 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (2m) 52s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:12:50.967 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (106s) 52s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:12:50.967 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (80s) 52s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:12:50.967 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (54s) 52s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:12:50.967 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (29s) 0s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:12:50.968 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (3s) 0s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:12:50.968 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (10m) 0s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 ffa9fe94cea1 2021-03-10T20:12:50.968 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (10m) 0s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 082d0fe68f90 2021-03-10T20:12:50.968 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (9m) 0s ago 9m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:12:50.968 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 52s ago 7m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:12:50.969 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 0s ago 7m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:12:51.216 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:12:51.216 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:12:51.217 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:12:51.217 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:12:51.217 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:12:51.217 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:12:51.218 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:12:51.218 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:12:51.218 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2021-03-10T20:12:51.218 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 5 2021-03-10T20:12:51.219 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:12:51.219 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:12:51.219 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:12:51.219 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2021-03-10T20:12:51.219 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 11 2021-03-10T20:12:51.219 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:12:51.220 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:12:51.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:51 gibba044 bash[25485]: cluster 2021-03-10T20:12:50.177080+0000 mon.a (mon.0) 520 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T20:12:51.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:51 gibba044 bash[25485]: audit 2021-03-10T20:12:50.503738+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:51.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:51 gibba044 bash[25485]: audit 2021-03-10T20:12:50.508869+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:51.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:51 gibba044 bash[25485]: audit 2021-03-10T20:12:50.513381+0000 mon.a (mon.0) 523 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:12:51.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:51 gibba044 bash[25485]: audit 2021-03-10T20:12:50.514667+0000 mon.a (mon.0) 524 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:51.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:51 gibba044 bash[25485]: audit 2021-03-10T20:12:50.516102+0000 mon.a (mon.0) 525 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:51.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:51 gibba044 bash[25485]: audit 2021-03-10T20:12:50.517372+0000 mon.a (mon.0) 526 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:51.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:51 gibba044 bash[25485]: audit 2021-03-10T20:12:50.519730+0000 mon.a (mon.0) 527 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T20:12:51.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:51 gibba023 bash[30844]: cluster 2021-03-10T20:12:50.177080+0000 mon.a (mon.0) 520 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T20:12:51.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:51 gibba023 bash[30844]: audit 2021-03-10T20:12:50.503738+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:51.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:51 gibba023 bash[30844]: audit 2021-03-10T20:12:50.508869+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:51.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:51 gibba023 bash[30844]: audit 2021-03-10T20:12:50.513381+0000 mon.a (mon.0) 523 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:12:51.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:51 gibba023 bash[30844]: audit 2021-03-10T20:12:50.514667+0000 mon.a (mon.0) 524 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:51.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:51 gibba023 bash[30844]: audit 2021-03-10T20:12:50.516102+0000 mon.a (mon.0) 525 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:51.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:51 gibba023 bash[30844]: audit 2021-03-10T20:12:50.517372+0000 mon.a (mon.0) 526 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:51.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:51 gibba023 bash[30844]: audit 2021-03-10T20:12:50.519730+0000 mon.a (mon.0) 527 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T20:12:51.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:51 gibba023 bash[31815]: cluster 2021-03-10T20:12:50.177080+0000 mon.a (mon.0) 520 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T20:12:51.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:51 gibba023 bash[31815]: audit 2021-03-10T20:12:50.503738+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:51.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:51 gibba023 bash[31815]: audit 2021-03-10T20:12:50.508869+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:12:51.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:51 gibba023 bash[31815]: audit 2021-03-10T20:12:50.513381+0000 mon.a (mon.0) 523 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:12:51.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:51 gibba023 bash[31815]: audit 2021-03-10T20:12:50.514667+0000 mon.a (mon.0) 524 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:51.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:51 gibba023 bash[31815]: audit 2021-03-10T20:12:50.516102+0000 mon.a (mon.0) 525 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:51.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:51 gibba023 bash[31815]: audit 2021-03-10T20:12:50.517372+0000 mon.a (mon.0) 526 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:51.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:51 gibba023 bash[31815]: audit 2021-03-10T20:12:50.519730+0000 mon.a (mon.0) 527 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T20:12:51.998 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:12:51 gibba044 bash[28514]: debug 2021-03-10T20:12:51.698+0000 7f868639c080 -1 bluestore(/var/lib/ceph/osd/ceph-5) fsck warning: store not yet converted to per-pg omap 2021-03-10T20:12:51.999 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:12:51 gibba044 bash[28514]: debug 2021-03-10T20:12:51.698+0000 7f866fe5e700 -1 bluestore(/var/lib/ceph/osd/ceph-5) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T20:12:51.999 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:12:51 gibba044 bash[28514]: debug 2021-03-10T20:12:51.822+0000 7f868639c080 -1 osd.5 87 log_to_monitors {default=true} 2021-03-10T20:12:52.498 INFO:journalctl@ceph.osd.5.gibba044.stdout:Mar 10 20:12:52 gibba044 bash[28514]: debug 2021-03-10T20:12:52.214+0000 7f8675878700 -1 osd.5 87 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:12:52.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:52 gibba044 bash[25485]: cephadm 2021-03-10T20:12:50.515088+0000 mgr.gibba044.wflcwh (mgr.34466) 260 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:12:52.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:52 gibba044 bash[25485]: cephadm 2021-03-10T20:12:50.516820+0000 mgr.gibba044.wflcwh (mgr.34466) 261 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:12:52.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:52 gibba044 bash[25485]: cephadm 2021-03-10T20:12:50.518119+0000 mgr.gibba044.wflcwh (mgr.34466) 262 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:12:52.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:52 gibba044 bash[25485]: cephadm 2021-03-10T20:12:50.518249+0000 mgr.gibba044.wflcwh (mgr.34466) 263 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:12:52.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:52 gibba044 bash[25485]: cephadm 2021-03-10T20:12:50.519540+0000 mgr.gibba044.wflcwh (mgr.34466) 264 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:12:52.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:52 gibba044 bash[25485]: cephadm 2021-03-10T20:12:50.519640+0000 mgr.gibba044.wflcwh (mgr.34466) 265 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:12:52.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:52 gibba044 bash[25485]: cephadm 2021-03-10T20:12:50.520710+0000 mgr.gibba044.wflcwh (mgr.34466) 266 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:12:52.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:52 gibba044 bash[25485]: cephadm 2021-03-10T20:12:50.521719+0000 mgr.gibba044.wflcwh (mgr.34466) 267 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:12:52.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:52 gibba044 bash[25485]: cephadm 2021-03-10T20:12:50.521773+0000 mgr.gibba044.wflcwh (mgr.34466) 268 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:12:52.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:52 gibba044 bash[25485]: audit 2021-03-10T20:12:50.522438+0000 mgr.gibba044.wflcwh (mgr.34466) 269 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T20:12:52.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:52 gibba044 bash[25485]: cephadm 2021-03-10T20:12:50.523504+0000 mgr.gibba044.wflcwh (mgr.34466) 270 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2021-03-10T20:12:52.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:52 gibba044 bash[25485]: audit 2021-03-10T20:12:50.732347+0000 mgr.gibba044.wflcwh (mgr.34466) 271 : audit [DBG] from='client.54235 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:12:52.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:52 gibba044 bash[25485]: audit 2021-03-10T20:12:50.954377+0000 mgr.gibba044.wflcwh (mgr.34466) 272 : audit [DBG] from='client.54241 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:12:52.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:52 gibba044 bash[25485]: audit 2021-03-10T20:12:51.216743+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.2.123:0/1409478041' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:52.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:52 gibba044 bash[25485]: cluster 2021-03-10T20:12:51.369621+0000 mgr.gibba044.wflcwh (mgr.34466) 273 : cluster [DBG] pgmap v133: 129 pgs: 15 active+undersized+degraded, 29 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:12:52.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:52 gibba044 bash[25485]: audit 2021-03-10T20:12:51.827249+0000 mon.a (mon.0) 528 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T20:12:52.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:52 gibba044 bash[25485]: audit 2021-03-10T20:12:51.828862+0000 mon.b (mon.2) 5 : audit [INF] from='osd.5 [v2:172.21.2.144:6808/2456411108,v1:172.21.2.144:6809/2456411108]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T20:12:52.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[30844]: cephadm 2021-03-10T20:12:50.515088+0000 mgr.gibba044.wflcwh (mgr.34466) 260 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:12:52.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[30844]: cephadm 2021-03-10T20:12:50.516820+0000 mgr.gibba044.wflcwh (mgr.34466) 261 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:12:52.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[30844]: cephadm 2021-03-10T20:12:50.518119+0000 mgr.gibba044.wflcwh (mgr.34466) 262 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:12:52.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[30844]: cephadm 2021-03-10T20:12:50.518249+0000 mgr.gibba044.wflcwh (mgr.34466) 263 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:12:52.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[30844]: cephadm 2021-03-10T20:12:50.519540+0000 mgr.gibba044.wflcwh (mgr.34466) 264 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:12:52.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[30844]: cephadm 2021-03-10T20:12:50.519640+0000 mgr.gibba044.wflcwh (mgr.34466) 265 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:12:52.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[30844]: cephadm 2021-03-10T20:12:50.520710+0000 mgr.gibba044.wflcwh (mgr.34466) 266 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:12:52.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[30844]: cephadm 2021-03-10T20:12:50.521719+0000 mgr.gibba044.wflcwh (mgr.34466) 267 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:12:52.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[30844]: cephadm 2021-03-10T20:12:50.521773+0000 mgr.gibba044.wflcwh (mgr.34466) 268 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:12:52.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[30844]: audit 2021-03-10T20:12:50.522438+0000 mgr.gibba044.wflcwh (mgr.34466) 269 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T20:12:52.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[30844]: cephadm 2021-03-10T20:12:50.523504+0000 mgr.gibba044.wflcwh (mgr.34466) 270 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2021-03-10T20:12:52.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[30844]: audit 2021-03-10T20:12:50.732347+0000 mgr.gibba044.wflcwh (mgr.34466) 271 : audit [DBG] from='client.54235 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:12:52.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[30844]: audit 2021-03-10T20:12:50.954377+0000 mgr.gibba044.wflcwh (mgr.34466) 272 : audit [DBG] from='client.54241 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:12:52.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[30844]: audit 2021-03-10T20:12:51.216743+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.2.123:0/1409478041' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:52.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[30844]: cluster 2021-03-10T20:12:51.369621+0000 mgr.gibba044.wflcwh (mgr.34466) 273 : cluster [DBG] pgmap v133: 129 pgs: 15 active+undersized+degraded, 29 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:12:52.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[30844]: audit 2021-03-10T20:12:51.827249+0000 mon.a (mon.0) 528 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T20:12:52.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[30844]: audit 2021-03-10T20:12:51.828862+0000 mon.b (mon.2) 5 : audit [INF] from='osd.5 [v2:172.21.2.144:6808/2456411108,v1:172.21.2.144:6809/2456411108]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T20:12:52.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[31815]: cephadm 2021-03-10T20:12:50.515088+0000 mgr.gibba044.wflcwh (mgr.34466) 260 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:12:52.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[31815]: cephadm 2021-03-10T20:12:50.516820+0000 mgr.gibba044.wflcwh (mgr.34466) 261 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:12:52.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[31815]: cephadm 2021-03-10T20:12:50.518119+0000 mgr.gibba044.wflcwh (mgr.34466) 262 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:12:52.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[31815]: cephadm 2021-03-10T20:12:50.518249+0000 mgr.gibba044.wflcwh (mgr.34466) 263 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:12:52.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[31815]: cephadm 2021-03-10T20:12:50.519540+0000 mgr.gibba044.wflcwh (mgr.34466) 264 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:12:52.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[31815]: cephadm 2021-03-10T20:12:50.519640+0000 mgr.gibba044.wflcwh (mgr.34466) 265 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:12:52.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[31815]: cephadm 2021-03-10T20:12:50.520710+0000 mgr.gibba044.wflcwh (mgr.34466) 266 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:12:52.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[31815]: cephadm 2021-03-10T20:12:50.521719+0000 mgr.gibba044.wflcwh (mgr.34466) 267 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:12:52.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[31815]: cephadm 2021-03-10T20:12:50.521773+0000 mgr.gibba044.wflcwh (mgr.34466) 268 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:12:52.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[31815]: audit 2021-03-10T20:12:50.522438+0000 mgr.gibba044.wflcwh (mgr.34466) 269 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T20:12:52.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[31815]: cephadm 2021-03-10T20:12:50.523504+0000 mgr.gibba044.wflcwh (mgr.34466) 270 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2021-03-10T20:12:52.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[31815]: audit 2021-03-10T20:12:50.732347+0000 mgr.gibba044.wflcwh (mgr.34466) 271 : audit [DBG] from='client.54235 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:12:52.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[31815]: audit 2021-03-10T20:12:50.954377+0000 mgr.gibba044.wflcwh (mgr.34466) 272 : audit [DBG] from='client.54241 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:12:52.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[31815]: audit 2021-03-10T20:12:51.216743+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.2.123:0/1409478041' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:12:52.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[31815]: cluster 2021-03-10T20:12:51.369621+0000 mgr.gibba044.wflcwh (mgr.34466) 273 : cluster [DBG] pgmap v133: 129 pgs: 15 active+undersized+degraded, 29 active+undersized, 85 active+clean; 7.0 KiB data, 35 MiB used, 669 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:12:52.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[31815]: audit 2021-03-10T20:12:51.827249+0000 mon.a (mon.0) 528 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T20:12:52.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:52 gibba023 bash[31815]: audit 2021-03-10T20:12:51.828862+0000 mon.b (mon.2) 5 : audit [INF] from='osd.5 [v2:172.21.2.144:6808/2456411108,v1:172.21.2.144:6809/2456411108]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-03-10T20:12:53.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:53 gibba044 bash[25485]: audit 2021-03-10T20:12:52.205193+0000 mon.a (mon.0) 529 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T20:12:53.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:53 gibba044 bash[25485]: cluster 2021-03-10T20:12:52.205306+0000 mon.a (mon.0) 530 : cluster [DBG] osdmap e90: 8 total, 7 up, 8 in 2021-03-10T20:12:53.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:53 gibba044 bash[25485]: audit 2021-03-10T20:12:52.206501+0000 mon.a (mon.0) 531 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:12:53.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:53 gibba044 bash[25485]: audit 2021-03-10T20:12:52.208659+0000 mon.b (mon.2) 6 : audit [INF] from='osd.5 [v2:172.21.2.144:6808/2456411108,v1:172.21.2.144:6809/2456411108]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:12:53.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:53 gibba023 bash[30844]: audit 2021-03-10T20:12:52.205193+0000 mon.a (mon.0) 529 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T20:12:53.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:53 gibba023 bash[30844]: cluster 2021-03-10T20:12:52.205306+0000 mon.a (mon.0) 530 : cluster [DBG] osdmap e90: 8 total, 7 up, 8 in 2021-03-10T20:12:53.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:53 gibba023 bash[30844]: audit 2021-03-10T20:12:52.206501+0000 mon.a (mon.0) 531 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:12:53.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:53 gibba023 bash[30844]: audit 2021-03-10T20:12:52.208659+0000 mon.b (mon.2) 6 : audit [INF] from='osd.5 [v2:172.21.2.144:6808/2456411108,v1:172.21.2.144:6809/2456411108]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:12:53.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:53 gibba023 bash[31815]: audit 2021-03-10T20:12:52.205193+0000 mon.a (mon.0) 529 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-03-10T20:12:53.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:53 gibba023 bash[31815]: cluster 2021-03-10T20:12:52.205306+0000 mon.a (mon.0) 530 : cluster [DBG] osdmap e90: 8 total, 7 up, 8 in 2021-03-10T20:12:53.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:53 gibba023 bash[31815]: audit 2021-03-10T20:12:52.206501+0000 mon.a (mon.0) 531 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:12:53.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:53 gibba023 bash[31815]: audit 2021-03-10T20:12:52.208659+0000 mon.b (mon.2) 6 : audit [INF] from='osd.5 [v2:172.21.2.144:6808/2456411108,v1:172.21.2.144:6809/2456411108]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:12:54.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:54 gibba044 bash[25485]: cluster 2021-03-10T20:12:53.205139+0000 mon.a (mon.0) 532 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:12:54.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:54 gibba044 bash[25485]: cluster 2021-03-10T20:12:53.215778+0000 mon.a (mon.0) 533 : cluster [INF] osd.5 [v2:172.21.2.144:6808/2456411108,v1:172.21.2.144:6809/2456411108] boot 2021-03-10T20:12:54.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:54 gibba044 bash[25485]: cluster 2021-03-10T20:12:53.215815+0000 mon.a (mon.0) 534 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2021-03-10T20:12:54.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:54 gibba044 bash[25485]: audit 2021-03-10T20:12:53.216284+0000 mon.a (mon.0) 535 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:12:54.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:54 gibba044 bash[25485]: cluster 2021-03-10T20:12:53.371157+0000 mgr.gibba044.wflcwh (mgr.34466) 274 : cluster [DBG] pgmap v136: 129 pgs: 15 active+undersized+degraded, 29 active+undersized, 85 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:12:54.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:54 gibba044 bash[25485]: cluster 2021-03-10T20:12:54.218991+0000 mon.a (mon.0) 536 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2021-03-10T20:12:54.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:54 gibba023 bash[30844]: cluster 2021-03-10T20:12:53.205139+0000 mon.a (mon.0) 532 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:12:54.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:54 gibba023 bash[30844]: cluster 2021-03-10T20:12:53.215778+0000 mon.a (mon.0) 533 : cluster [INF] osd.5 [v2:172.21.2.144:6808/2456411108,v1:172.21.2.144:6809/2456411108] boot 2021-03-10T20:12:54.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:54 gibba023 bash[30844]: cluster 2021-03-10T20:12:53.215815+0000 mon.a (mon.0) 534 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2021-03-10T20:12:54.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:54 gibba023 bash[30844]: audit 2021-03-10T20:12:53.216284+0000 mon.a (mon.0) 535 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:12:54.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:54 gibba023 bash[30844]: cluster 2021-03-10T20:12:53.371157+0000 mgr.gibba044.wflcwh (mgr.34466) 274 : cluster [DBG] pgmap v136: 129 pgs: 15 active+undersized+degraded, 29 active+undersized, 85 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:12:54.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:54 gibba023 bash[30844]: cluster 2021-03-10T20:12:54.218991+0000 mon.a (mon.0) 536 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2021-03-10T20:12:54.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:54 gibba023 bash[31815]: cluster 2021-03-10T20:12:53.205139+0000 mon.a (mon.0) 532 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:12:54.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:54 gibba023 bash[31815]: cluster 2021-03-10T20:12:53.215778+0000 mon.a (mon.0) 533 : cluster [INF] osd.5 [v2:172.21.2.144:6808/2456411108,v1:172.21.2.144:6809/2456411108] boot 2021-03-10T20:12:54.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:54 gibba023 bash[31815]: cluster 2021-03-10T20:12:53.215815+0000 mon.a (mon.0) 534 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2021-03-10T20:12:54.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:54 gibba023 bash[31815]: audit 2021-03-10T20:12:53.216284+0000 mon.a (mon.0) 535 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-03-10T20:12:54.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:54 gibba023 bash[31815]: cluster 2021-03-10T20:12:53.371157+0000 mgr.gibba044.wflcwh (mgr.34466) 274 : cluster [DBG] pgmap v136: 129 pgs: 15 active+undersized+degraded, 29 active+undersized, 85 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:12:54.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:54 gibba023 bash[31815]: cluster 2021-03-10T20:12:54.218991+0000 mon.a (mon.0) 536 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2021-03-10T20:12:55.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:55 gibba044 bash[25485]: cluster 2021-03-10T20:12:55.372455+0000 mgr.gibba044.wflcwh (mgr.34466) 275 : cluster [DBG] pgmap v138: 129 pgs: 4 peering, 12 active+undersized+degraded, 24 active+undersized, 89 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 17/195 objects degraded (8.718%) 2021-03-10T20:12:55.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:55 gibba044 bash[25485]: cluster 2021-03-10T20:12:55.423250+0000 mon.a (mon.0) 537 : cluster [WRN] Health check update: Degraded data redundancy: 17/195 objects degraded (8.718%), 12 pgs degraded (PG_DEGRADED) 2021-03-10T20:12:55.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:55 gibba023 bash[30844]: cluster 2021-03-10T20:12:55.372455+0000 mgr.gibba044.wflcwh (mgr.34466) 275 : cluster [DBG] pgmap v138: 129 pgs: 4 peering, 12 active+undersized+degraded, 24 active+undersized, 89 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 17/195 objects degraded (8.718%) 2021-03-10T20:12:55.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:55 gibba023 bash[30844]: cluster 2021-03-10T20:12:55.423250+0000 mon.a (mon.0) 537 : cluster [WRN] Health check update: Degraded data redundancy: 17/195 objects degraded (8.718%), 12 pgs degraded (PG_DEGRADED) 2021-03-10T20:12:55.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:55 gibba023 bash[31815]: cluster 2021-03-10T20:12:55.372455+0000 mgr.gibba044.wflcwh (mgr.34466) 275 : cluster [DBG] pgmap v138: 129 pgs: 4 peering, 12 active+undersized+degraded, 24 active+undersized, 89 active+clean; 7.0 KiB data, 40 MiB used, 670 GiB / 672 GiB avail; 17/195 objects degraded (8.718%) 2021-03-10T20:12:55.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:55 gibba023 bash[31815]: cluster 2021-03-10T20:12:55.423250+0000 mon.a (mon.0) 537 : cluster [WRN] Health check update: Degraded data redundancy: 17/195 objects degraded (8.718%), 12 pgs degraded (PG_DEGRADED) 2021-03-10T20:12:58.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:58 gibba044 bash[25485]: cluster 2021-03-10T20:12:57.373991+0000 mgr.gibba044.wflcwh (mgr.34466) 276 : cluster [DBG] pgmap v139: 129 pgs: 17 active+clean+wait, 4 peering, 3 active+undersized+degraded, 8 active+undersized, 97 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 3/195 objects degraded (1.538%) 2021-03-10T20:12:58.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:58 gibba023 bash[30844]: cluster 2021-03-10T20:12:57.373991+0000 mgr.gibba044.wflcwh (mgr.34466) 276 : cluster [DBG] pgmap v139: 129 pgs: 17 active+clean+wait, 4 peering, 3 active+undersized+degraded, 8 active+undersized, 97 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 3/195 objects degraded (1.538%) 2021-03-10T20:12:58.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:58 gibba023 bash[31815]: cluster 2021-03-10T20:12:57.373991+0000 mgr.gibba044.wflcwh (mgr.34466) 276 : cluster [DBG] pgmap v139: 129 pgs: 17 active+clean+wait, 4 peering, 3 active+undersized+degraded, 8 active+undersized, 97 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 3/195 objects degraded (1.538%) 2021-03-10T20:12:59.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:59 gibba044 bash[25485]: cluster 2021-03-10T20:12:59.375678+0000 mgr.gibba044.wflcwh (mgr.34466) 277 : cluster [DBG] pgmap v140: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:12:59.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:12:59 gibba044 bash[25485]: cluster 2021-03-10T20:12:59.433053+0000 mon.a (mon.0) 538 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/195 objects degraded (1.538%), 3 pgs degraded) 2021-03-10T20:12:59.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:59 gibba023 bash[30844]: cluster 2021-03-10T20:12:59.375678+0000 mgr.gibba044.wflcwh (mgr.34466) 277 : cluster [DBG] pgmap v140: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:12:59.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:12:59 gibba023 bash[30844]: cluster 2021-03-10T20:12:59.433053+0000 mon.a (mon.0) 538 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/195 objects degraded (1.538%), 3 pgs degraded) 2021-03-10T20:12:59.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:59 gibba023 bash[31815]: cluster 2021-03-10T20:12:59.375678+0000 mgr.gibba044.wflcwh (mgr.34466) 277 : cluster [DBG] pgmap v140: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:12:59.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:12:59 gibba023 bash[31815]: cluster 2021-03-10T20:12:59.433053+0000 mon.a (mon.0) 538 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/195 objects degraded (1.538%), 3 pgs degraded) 2021-03-10T20:13:02.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:02 gibba023 bash[30844]: cluster 2021-03-10T20:13:01.377104+0000 mgr.gibba044.wflcwh (mgr.34466) 278 : cluster [DBG] pgmap v141: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:13:02.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:02 gibba023 bash[31815]: cluster 2021-03-10T20:13:01.377104+0000 mgr.gibba044.wflcwh (mgr.34466) 278 : cluster [DBG] pgmap v141: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:13:02.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:02 gibba044 bash[25485]: cluster 2021-03-10T20:13:01.377104+0000 mgr.gibba044.wflcwh (mgr.34466) 278 : cluster [DBG] pgmap v141: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:13:03.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:03 gibba023 bash[30844]: audit 2021-03-10T20:13:02.133547+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:03.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:03 gibba023 bash[31815]: audit 2021-03-10T20:13:02.133547+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:03.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:03 gibba044 bash[25485]: audit 2021-03-10T20:13:02.133547+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:04.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:04 gibba023 bash[30844]: cluster 2021-03-10T20:13:03.378768+0000 mgr.gibba044.wflcwh (mgr.34466) 279 : cluster [DBG] pgmap v142: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:13:04.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:04 gibba023 bash[31815]: cluster 2021-03-10T20:13:03.378768+0000 mgr.gibba044.wflcwh (mgr.34466) 279 : cluster [DBG] pgmap v142: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:13:04.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:04 gibba044 bash[25485]: cluster 2021-03-10T20:13:03.378768+0000 mgr.gibba044.wflcwh (mgr.34466) 279 : cluster [DBG] pgmap v142: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:13:06.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:06 gibba044 bash[25485]: cluster 2021-03-10T20:13:05.380261+0000 mgr.gibba044.wflcwh (mgr.34466) 280 : cluster [DBG] pgmap v143: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:13:06.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:06 gibba044 bash[25485]: audit 2021-03-10T20:13:05.537864+0000 mon.a (mon.0) 540 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T20:13:06.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:06 gibba023 bash[30844]: cluster 2021-03-10T20:13:05.380261+0000 mgr.gibba044.wflcwh (mgr.34466) 280 : cluster [DBG] pgmap v143: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:13:06.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:06 gibba023 bash[30844]: audit 2021-03-10T20:13:05.537864+0000 mon.a (mon.0) 540 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T20:13:06.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:06 gibba023 bash[31815]: cluster 2021-03-10T20:13:05.380261+0000 mgr.gibba044.wflcwh (mgr.34466) 280 : cluster [DBG] pgmap v143: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:13:06.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:06 gibba023 bash[31815]: audit 2021-03-10T20:13:05.537864+0000 mon.a (mon.0) 540 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T20:13:07.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:07 gibba044 bash[25485]: audit 2021-03-10T20:13:05.541383+0000 mgr.gibba044.wflcwh (mgr.34466) 281 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T20:13:07.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:07 gibba044 bash[25485]: cephadm 2021-03-10T20:13:05.546043+0000 mgr.gibba044.wflcwh (mgr.34466) 282 : cephadm [INF] Upgrade: osd.6 is safe to restart 2021-03-10T20:13:07.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:07 gibba044 bash[25485]: audit 2021-03-10T20:13:07.343012+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:07.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:07 gibba044 bash[25485]: audit 2021-03-10T20:13:07.344930+0000 mon.a (mon.0) 542 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T20:13:07.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:07 gibba023 bash[30844]: audit 2021-03-10T20:13:05.541383+0000 mgr.gibba044.wflcwh (mgr.34466) 281 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T20:13:07.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:07 gibba023 bash[30844]: cephadm 2021-03-10T20:13:05.546043+0000 mgr.gibba044.wflcwh (mgr.34466) 282 : cephadm [INF] Upgrade: osd.6 is safe to restart 2021-03-10T20:13:07.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:07 gibba023 bash[30844]: audit 2021-03-10T20:13:07.343012+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:07.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:07 gibba023 bash[30844]: audit 2021-03-10T20:13:07.344930+0000 mon.a (mon.0) 542 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T20:13:07.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:07 gibba023 bash[31815]: audit 2021-03-10T20:13:05.541383+0000 mgr.gibba044.wflcwh (mgr.34466) 281 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-03-10T20:13:07.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:07 gibba023 bash[31815]: cephadm 2021-03-10T20:13:05.546043+0000 mgr.gibba044.wflcwh (mgr.34466) 282 : cephadm [INF] Upgrade: osd.6 is safe to restart 2021-03-10T20:13:07.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:07 gibba023 bash[31815]: audit 2021-03-10T20:13:07.343012+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:07.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:07 gibba023 bash[31815]: audit 2021-03-10T20:13:07.344930+0000 mon.a (mon.0) 542 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2021-03-10T20:13:08.626 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:08 gibba044 bash[25485]: cephadm 2021-03-10T20:13:07.335419+0000 mgr.gibba044.wflcwh (mgr.34466) 283 : cephadm [INF] Upgrade: Updating osd.6 2021-03-10T20:13:08.626 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:08 gibba044 bash[25485]: cephadm 2021-03-10T20:13:07.347151+0000 mgr.gibba044.wflcwh (mgr.34466) 284 : cephadm [INF] Deploying daemon osd.6 on gibba044 2021-03-10T20:13:08.626 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:08 gibba044 bash[25485]: cluster 2021-03-10T20:13:07.380756+0000 mgr.gibba044.wflcwh (mgr.34466) 285 : cluster [DBG] pgmap v144: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:13:08.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:08 gibba023 bash[30844]: cephadm 2021-03-10T20:13:07.335419+0000 mgr.gibba044.wflcwh (mgr.34466) 283 : cephadm [INF] Upgrade: Updating osd.6 2021-03-10T20:13:08.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:08 gibba023 bash[30844]: cephadm 2021-03-10T20:13:07.347151+0000 mgr.gibba044.wflcwh (mgr.34466) 284 : cephadm [INF] Deploying daemon osd.6 on gibba044 2021-03-10T20:13:08.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:08 gibba023 bash[30844]: cluster 2021-03-10T20:13:07.380756+0000 mgr.gibba044.wflcwh (mgr.34466) 285 : cluster [DBG] pgmap v144: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:13:08.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:08 gibba023 bash[31815]: cephadm 2021-03-10T20:13:07.335419+0000 mgr.gibba044.wflcwh (mgr.34466) 283 : cephadm [INF] Upgrade: Updating osd.6 2021-03-10T20:13:08.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:08 gibba023 bash[31815]: cephadm 2021-03-10T20:13:07.347151+0000 mgr.gibba044.wflcwh (mgr.34466) 284 : cephadm [INF] Deploying daemon osd.6 on gibba044 2021-03-10T20:13:08.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:08 gibba023 bash[31815]: cluster 2021-03-10T20:13:07.380756+0000 mgr.gibba044.wflcwh (mgr.34466) 285 : cluster [DBG] pgmap v144: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:13:09.440 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:13:09 gibba044 systemd[1]: Stopping Ceph osd.6 for dd719b26-81da-11eb-9080-001a4aab830c... 2021-03-10T20:13:09.440 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:13:09 gibba044 bash[15158]: debug 2021-03-10T20:13:09.286+0000 7f87a0495700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T20:13:09.441 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:13:09 gibba044 bash[15158]: debug 2021-03-10T20:13:09.286+0000 7f87a0495700 -1 osd.6 92 *** Got signal Terminated *** 2021-03-10T20:13:09.441 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:13:09 gibba044 bash[15158]: debug 2021-03-10T20:13:09.286+0000 7f87a0495700 -1 osd.6 92 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T20:13:09.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:09 gibba044 bash[25485]: cluster 2021-03-10T20:13:09.440229+0000 mon.a (mon.0) 543 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T20:13:09.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:09 gibba044 bash[25485]: cluster 2021-03-10T20:13:09.440323+0000 mon.a (mon.0) 544 : cluster [INF] osd.6 failed (root=default,host=gibba044) (connection refused reported by osd.7) 2021-03-10T20:13:09.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:09 gibba023 bash[30844]: cluster 2021-03-10T20:13:09.440229+0000 mon.a (mon.0) 543 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T20:13:09.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:09 gibba023 bash[30844]: cluster 2021-03-10T20:13:09.440323+0000 mon.a (mon.0) 544 : cluster [INF] osd.6 failed (root=default,host=gibba044) (connection refused reported by osd.7) 2021-03-10T20:13:09.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:09 gibba023 bash[31815]: cluster 2021-03-10T20:13:09.440229+0000 mon.a (mon.0) 543 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-03-10T20:13:09.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:09 gibba023 bash[31815]: cluster 2021-03-10T20:13:09.440323+0000 mon.a (mon.0) 544 : cluster [INF] osd.6 failed (root=default,host=gibba044) (connection refused reported by osd.7) 2021-03-10T20:13:10.473 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:13:10 gibba044 docker[29448]: ceph-dd719b26-81da-11eb-9080-001a4aab830c-osd.6 2021-03-10T20:13:10.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:10 gibba044 bash[25485]: cluster 2021-03-10T20:13:09.382191+0000 mgr.gibba044.wflcwh (mgr.34466) 286 : cluster [DBG] pgmap v145: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:13:10.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:10 gibba044 bash[25485]: cluster 2021-03-10T20:13:09.449597+0000 mon.a (mon.0) 545 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:13:10.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:10 gibba044 bash[25485]: cluster 2021-03-10T20:13:09.461165+0000 mon.a (mon.0) 546 : cluster [DBG] osdmap e93: 8 total, 7 up, 8 in 2021-03-10T20:13:10.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:10 gibba023 bash[30844]: cluster 2021-03-10T20:13:09.382191+0000 mgr.gibba044.wflcwh (mgr.34466) 286 : cluster [DBG] pgmap v145: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:13:10.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:10 gibba023 bash[30844]: cluster 2021-03-10T20:13:09.449597+0000 mon.a (mon.0) 545 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:13:10.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:10 gibba023 bash[30844]: cluster 2021-03-10T20:13:09.461165+0000 mon.a (mon.0) 546 : cluster [DBG] osdmap e93: 8 total, 7 up, 8 in 2021-03-10T20:13:10.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:10 gibba023 bash[31815]: cluster 2021-03-10T20:13:09.382191+0000 mgr.gibba044.wflcwh (mgr.34466) 286 : cluster [DBG] pgmap v145: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:13:10.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:10 gibba023 bash[31815]: cluster 2021-03-10T20:13:09.449597+0000 mon.a (mon.0) 545 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:13:10.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:10 gibba023 bash[31815]: cluster 2021-03-10T20:13:09.461165+0000 mon.a (mon.0) 546 : cluster [DBG] osdmap e93: 8 total, 7 up, 8 in 2021-03-10T20:13:11.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:11 gibba044 bash[25485]: cluster 2021-03-10T20:13:10.470493+0000 mon.a (mon.0) 547 : cluster [DBG] osdmap e94: 8 total, 7 up, 8 in 2021-03-10T20:13:11.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:11 gibba044 bash[25485]: cluster 2021-03-10T20:13:11.383198+0000 mgr.gibba044.wflcwh (mgr.34466) 287 : cluster [DBG] pgmap v148: 129 pgs: 12 stale+active+clean, 4 peering, 17 active+clean+wait, 96 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:13:11.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:11 gibba023 bash[30844]: cluster 2021-03-10T20:13:10.470493+0000 mon.a (mon.0) 547 : cluster [DBG] osdmap e94: 8 total, 7 up, 8 in 2021-03-10T20:13:11.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:11 gibba023 bash[30844]: cluster 2021-03-10T20:13:11.383198+0000 mgr.gibba044.wflcwh (mgr.34466) 287 : cluster [DBG] pgmap v148: 129 pgs: 12 stale+active+clean, 4 peering, 17 active+clean+wait, 96 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:13:11.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:11 gibba023 bash[31815]: cluster 2021-03-10T20:13:10.470493+0000 mon.a (mon.0) 547 : cluster [DBG] osdmap e94: 8 total, 7 up, 8 in 2021-03-10T20:13:11.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:11 gibba023 bash[31815]: cluster 2021-03-10T20:13:11.383198+0000 mgr.gibba044.wflcwh (mgr.34466) 287 : cluster [DBG] pgmap v148: 129 pgs: 12 stale+active+clean, 4 peering, 17 active+clean+wait, 96 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail 2021-03-10T20:13:12.248 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:13:11 gibba044 systemd[1]: ceph-dd719b26-81da-11eb-9080-001a4aab830c@osd.6.service: Succeeded. 2021-03-10T20:13:12.248 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:13:11 gibba044 systemd[1]: Stopped Ceph osd.6 for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:13:12.248 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:13:12 gibba044 systemd[1]: Started Ceph osd.6 for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:13:12.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:12 gibba044 bash[25485]: cluster 2021-03-10T20:13:12.012056+0000 mon.a (mon.0) 548 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:13:12.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:12 gibba044 bash[25485]: audit 2021-03-10T20:13:12.074288+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:12.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:12 gibba044 bash[25485]: audit 2021-03-10T20:13:12.075953+0000 mon.a (mon.0) 550 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:13:12.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:12 gibba044 bash[25485]: cephadm 2021-03-10T20:13:12.077923+0000 mgr.gibba044.wflcwh (mgr.34466) 288 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:13:12.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:12 gibba023 bash[30844]: cluster 2021-03-10T20:13:12.012056+0000 mon.a (mon.0) 548 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:13:12.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:12 gibba023 bash[30844]: audit 2021-03-10T20:13:12.074288+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:12.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:12 gibba023 bash[30844]: audit 2021-03-10T20:13:12.075953+0000 mon.a (mon.0) 550 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:13:12.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:12 gibba023 bash[30844]: cephadm 2021-03-10T20:13:12.077923+0000 mgr.gibba044.wflcwh (mgr.34466) 288 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:13:12.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:12 gibba023 bash[31815]: cluster 2021-03-10T20:13:12.012056+0000 mon.a (mon.0) 548 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:13:12.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:12 gibba023 bash[31815]: audit 2021-03-10T20:13:12.074288+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:12.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:12 gibba023 bash[31815]: audit 2021-03-10T20:13:12.075953+0000 mon.a (mon.0) 550 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:13:12.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:12 gibba023 bash[31815]: cephadm 2021-03-10T20:13:12.077923+0000 mgr.gibba044.wflcwh (mgr.34466) 288 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:13:13.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:13 gibba044 bash[25485]: cluster 2021-03-10T20:13:13.385111+0000 mgr.gibba044.wflcwh (mgr.34466) 289 : cluster [DBG] pgmap v149: 129 pgs: 2 stale+active+clean, 12 active+undersized+degraded, 4 peering, 24 active+undersized, 87 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 18/195 objects degraded (9.231%) 2021-03-10T20:13:13.749 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:13:13 gibba044 bash[29627]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-03-10T20:13:13.749 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:13:13 gibba044 bash[29627]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2021-03-10T20:13:13.749 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:13:13 gibba044 bash[29627]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2021-03-10T20:13:13.750 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:13:13 gibba044 bash[29627]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2021-03-10T20:13:13.750 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:13:13 gibba044 bash[29627]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-03-10T20:13:13.750 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:13:13 gibba044 bash[29627]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-03-10T20:13:13.750 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:13:13 gibba044 bash[29627]: --> ceph-volume lvm activate successful for osd ID: 6 2021-03-10T20:13:13.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:13 gibba023 bash[30844]: cluster 2021-03-10T20:13:13.385111+0000 mgr.gibba044.wflcwh (mgr.34466) 289 : cluster [DBG] pgmap v149: 129 pgs: 2 stale+active+clean, 12 active+undersized+degraded, 4 peering, 24 active+undersized, 87 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 18/195 objects degraded (9.231%) 2021-03-10T20:13:13.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:13 gibba023 bash[31815]: cluster 2021-03-10T20:13:13.385111+0000 mgr.gibba044.wflcwh (mgr.34466) 289 : cluster [DBG] pgmap v149: 129 pgs: 2 stale+active+clean, 12 active+undersized+degraded, 4 peering, 24 active+undersized, 87 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 18/195 objects degraded (9.231%) 2021-03-10T20:13:14.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:14 gibba044 bash[25485]: cluster 2021-03-10T20:13:13.482046+0000 mon.a (mon.0) 551 : cluster [WRN] Health check failed: Degraded data redundancy: 18/195 objects degraded (9.231%), 12 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:14.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:14 gibba023 bash[30844]: cluster 2021-03-10T20:13:13.482046+0000 mon.a (mon.0) 551 : cluster [WRN] Health check failed: Degraded data redundancy: 18/195 objects degraded (9.231%), 12 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:14.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:14 gibba023 bash[31815]: cluster 2021-03-10T20:13:13.482046+0000 mon.a (mon.0) 551 : cluster [WRN] Health check failed: Degraded data redundancy: 18/195 objects degraded (9.231%), 12 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:15.248 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:13:14 gibba044 bash[29747]: debug 2021-03-10T20:13:14.758+0000 7fe6e75c7700 1 -- 172.21.2.144:0/3251190991 <== mon.2 v2:172.21.2.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55afbd8064e0 con 0x55afbd882c00 2021-03-10T20:13:15.748 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:13:15 gibba044 bash[29747]: debug 2021-03-10T20:13:15.334+0000 7fe6ef05c080 -1 Falling back to public interface 2021-03-10T20:13:15.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:15 gibba044 bash[25485]: cluster 2021-03-10T20:13:15.385633+0000 mgr.gibba044.wflcwh (mgr.34466) 290 : cluster [DBG] pgmap v150: 129 pgs: 12 active+undersized+degraded, 4 peering, 27 active+undersized, 86 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 18/195 objects degraded (9.231%) 2021-03-10T20:13:15.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:15 gibba023 bash[30844]: cluster 2021-03-10T20:13:15.385633+0000 mgr.gibba044.wflcwh (mgr.34466) 290 : cluster [DBG] pgmap v150: 129 pgs: 12 active+undersized+degraded, 4 peering, 27 active+undersized, 86 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 18/195 objects degraded (9.231%) 2021-03-10T20:13:15.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:15 gibba023 bash[31815]: cluster 2021-03-10T20:13:15.385633+0000 mgr.gibba044.wflcwh (mgr.34466) 290 : cluster [DBG] pgmap v150: 129 pgs: 12 active+undersized+degraded, 4 peering, 27 active+undersized, 86 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 18/195 objects degraded (9.231%) 2021-03-10T20:13:17.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:16 gibba044 bash[25485]: audit 2021-03-10T20:13:15.961754+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:17.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:16 gibba044 bash[25485]: cephadm 2021-03-10T20:13:15.965308+0000 mgr.gibba044.wflcwh (mgr.34466) 291 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:13:17.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:16 gibba044 bash[25485]: audit 2021-03-10T20:13:16.161446+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:17.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:16 gibba044 bash[25485]: audit 2021-03-10T20:13:16.165396+0000 mon.a (mon.0) 554 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:13:17.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:16 gibba044 bash[25485]: audit 2021-03-10T20:13:16.167177+0000 mon.a (mon.0) 555 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:17.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:16 gibba044 bash[25485]: cephadm 2021-03-10T20:13:16.167246+0000 mgr.gibba044.wflcwh (mgr.34466) 292 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:13:17.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:16 gibba044 bash[25485]: audit 2021-03-10T20:13:16.168972+0000 mon.a (mon.0) 556 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:17.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:16 gibba044 bash[25485]: cephadm 2021-03-10T20:13:16.169225+0000 mgr.gibba044.wflcwh (mgr.34466) 293 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:13:17.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:16 gibba044 bash[25485]: audit 2021-03-10T20:13:16.170534+0000 mon.a (mon.0) 557 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:17.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:16 gibba044 bash[25485]: cephadm 2021-03-10T20:13:16.171002+0000 mgr.gibba044.wflcwh (mgr.34466) 294 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:13:17.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:16 gibba044 bash[25485]: cephadm 2021-03-10T20:13:16.171039+0000 mgr.gibba044.wflcwh (mgr.34466) 295 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:13:17.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:16 gibba044 bash[25485]: audit 2021-03-10T20:13:16.172656+0000 mon.a (mon.0) 558 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T20:13:17.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:16 gibba044 bash[25485]: cephadm 2021-03-10T20:13:16.172765+0000 mgr.gibba044.wflcwh (mgr.34466) 296 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:13:17.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:16 gibba044 bash[25485]: cephadm 2021-03-10T20:13:16.172800+0000 mgr.gibba044.wflcwh (mgr.34466) 297 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:13:17.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:16 gibba044 bash[25485]: cephadm 2021-03-10T20:13:16.174043+0000 mgr.gibba044.wflcwh (mgr.34466) 298 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:13:17.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:16 gibba044 bash[25485]: cephadm 2021-03-10T20:13:16.174900+0000 mgr.gibba044.wflcwh (mgr.34466) 299 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:13:17.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:16 gibba044 bash[25485]: cephadm 2021-03-10T20:13:16.174937+0000 mgr.gibba044.wflcwh (mgr.34466) 300 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:13:17.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:16 gibba044 bash[25485]: audit 2021-03-10T20:13:16.175563+0000 mgr.gibba044.wflcwh (mgr.34466) 301 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T20:13:17.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:16 gibba044 bash[25485]: cephadm 2021-03-10T20:13:16.176830+0000 mgr.gibba044.wflcwh (mgr.34466) 302 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2021-03-10T20:13:17.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[30844]: audit 2021-03-10T20:13:15.961754+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:17.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[30844]: cephadm 2021-03-10T20:13:15.965308+0000 mgr.gibba044.wflcwh (mgr.34466) 291 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:13:17.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[30844]: audit 2021-03-10T20:13:16.161446+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:17.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[30844]: audit 2021-03-10T20:13:16.165396+0000 mon.a (mon.0) 554 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:13:17.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[30844]: audit 2021-03-10T20:13:16.167177+0000 mon.a (mon.0) 555 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:17.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[30844]: cephadm 2021-03-10T20:13:16.167246+0000 mgr.gibba044.wflcwh (mgr.34466) 292 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:13:17.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[30844]: audit 2021-03-10T20:13:16.168972+0000 mon.a (mon.0) 556 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:17.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[30844]: cephadm 2021-03-10T20:13:16.169225+0000 mgr.gibba044.wflcwh (mgr.34466) 293 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:13:17.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[30844]: audit 2021-03-10T20:13:16.170534+0000 mon.a (mon.0) 557 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:17.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[30844]: cephadm 2021-03-10T20:13:16.171002+0000 mgr.gibba044.wflcwh (mgr.34466) 294 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:13:17.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[30844]: cephadm 2021-03-10T20:13:16.171039+0000 mgr.gibba044.wflcwh (mgr.34466) 295 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:13:17.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[30844]: audit 2021-03-10T20:13:16.172656+0000 mon.a (mon.0) 558 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T20:13:17.432 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[30844]: cephadm 2021-03-10T20:13:16.172765+0000 mgr.gibba044.wflcwh (mgr.34466) 296 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:13:17.432 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[30844]: cephadm 2021-03-10T20:13:16.172800+0000 mgr.gibba044.wflcwh (mgr.34466) 297 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:13:17.433 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[30844]: cephadm 2021-03-10T20:13:16.174043+0000 mgr.gibba044.wflcwh (mgr.34466) 298 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:13:17.433 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[30844]: cephadm 2021-03-10T20:13:16.174900+0000 mgr.gibba044.wflcwh (mgr.34466) 299 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:13:17.433 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[30844]: cephadm 2021-03-10T20:13:16.174937+0000 mgr.gibba044.wflcwh (mgr.34466) 300 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:13:17.434 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[30844]: audit 2021-03-10T20:13:16.175563+0000 mgr.gibba044.wflcwh (mgr.34466) 301 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T20:13:17.434 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[30844]: cephadm 2021-03-10T20:13:16.176830+0000 mgr.gibba044.wflcwh (mgr.34466) 302 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2021-03-10T20:13:17.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[31815]: audit 2021-03-10T20:13:15.961754+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:17.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[31815]: cephadm 2021-03-10T20:13:15.965308+0000 mgr.gibba044.wflcwh (mgr.34466) 291 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:13:17.436 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[31815]: audit 2021-03-10T20:13:16.161446+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:17.436 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[31815]: audit 2021-03-10T20:13:16.165396+0000 mon.a (mon.0) 554 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:13:17.437 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[31815]: audit 2021-03-10T20:13:16.167177+0000 mon.a (mon.0) 555 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:17.437 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[31815]: cephadm 2021-03-10T20:13:16.167246+0000 mgr.gibba044.wflcwh (mgr.34466) 292 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:13:17.438 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[31815]: audit 2021-03-10T20:13:16.168972+0000 mon.a (mon.0) 556 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:17.438 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[31815]: cephadm 2021-03-10T20:13:16.169225+0000 mgr.gibba044.wflcwh (mgr.34466) 293 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:13:17.439 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[31815]: audit 2021-03-10T20:13:16.170534+0000 mon.a (mon.0) 557 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:17.439 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[31815]: cephadm 2021-03-10T20:13:16.171002+0000 mgr.gibba044.wflcwh (mgr.34466) 294 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:13:17.440 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[31815]: cephadm 2021-03-10T20:13:16.171039+0000 mgr.gibba044.wflcwh (mgr.34466) 295 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:13:17.440 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[31815]: audit 2021-03-10T20:13:16.172656+0000 mon.a (mon.0) 558 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T20:13:17.440 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[31815]: cephadm 2021-03-10T20:13:16.172765+0000 mgr.gibba044.wflcwh (mgr.34466) 296 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:13:17.441 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[31815]: cephadm 2021-03-10T20:13:16.172800+0000 mgr.gibba044.wflcwh (mgr.34466) 297 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:13:17.441 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[31815]: cephadm 2021-03-10T20:13:16.174043+0000 mgr.gibba044.wflcwh (mgr.34466) 298 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:13:17.442 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[31815]: cephadm 2021-03-10T20:13:16.174900+0000 mgr.gibba044.wflcwh (mgr.34466) 299 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:13:17.442 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[31815]: cephadm 2021-03-10T20:13:16.174937+0000 mgr.gibba044.wflcwh (mgr.34466) 300 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:13:17.443 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[31815]: audit 2021-03-10T20:13:16.175563+0000 mgr.gibba044.wflcwh (mgr.34466) 301 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T20:13:17.443 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:16 gibba023 bash[31815]: cephadm 2021-03-10T20:13:16.176830+0000 mgr.gibba044.wflcwh (mgr.34466) 302 : cephadm [ERR] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2021-03-10T20:13:18.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:17 gibba044 bash[25485]: cluster 2021-03-10T20:13:17.387491+0000 mgr.gibba044.wflcwh (mgr.34466) 303 : cluster [DBG] pgmap v151: 129 pgs: 13 active+undersized+degraded, 30 active+undersized, 86 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 21/195 objects degraded (10.769%) 2021-03-10T20:13:18.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:17 gibba023 bash[30844]: cluster 2021-03-10T20:13:17.387491+0000 mgr.gibba044.wflcwh (mgr.34466) 303 : cluster [DBG] pgmap v151: 129 pgs: 13 active+undersized+degraded, 30 active+undersized, 86 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 21/195 objects degraded (10.769%) 2021-03-10T20:13:18.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:17 gibba023 bash[31815]: cluster 2021-03-10T20:13:17.387491+0000 mgr.gibba044.wflcwh (mgr.34466) 303 : cluster [DBG] pgmap v151: 129 pgs: 13 active+undersized+degraded, 30 active+undersized, 86 active+clean; 7.0 KiB data, 41 MiB used, 670 GiB / 672 GiB avail; 21/195 objects degraded (10.769%) 2021-03-10T20:13:18.977 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:13:18 gibba044 bash[29747]: debug 2021-03-10T20:13:18.546+0000 7fe6ef05c080 -1 bluestore(/var/lib/ceph/osd/ceph-6) fsck warning: store not yet converted to per-pg omap 2021-03-10T20:13:18.978 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:13:18 gibba044 bash[29747]: debug 2021-03-10T20:13:18.550+0000 7fe6dab22700 -1 bluestore(/var/lib/ceph/osd/ceph-6) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T20:13:18.978 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:13:18 gibba044 bash[29747]: debug 2021-03-10T20:13:18.550+0000 7fe6dab22700 -1 bluestore(/var/lib/ceph/osd/ceph-6) fsck warning: #1:e49187f3:::INTEL_SSDPEL1K375GA_PHKM913400CL375A:head# has omap that is not per-pg or pgmeta 2021-03-10T20:13:18.978 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:13:18 gibba044 bash[29747]: debug 2021-03-10T20:13:18.674+0000 7fe6ef05c080 -1 osd.6 92 log_to_monitors {default=true} 2021-03-10T20:13:19.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:18 gibba044 bash[25485]: cluster 2021-03-10T20:13:17.961299+0000 mon.a (mon.0) 559 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T20:13:19.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:18 gibba044 bash[25485]: audit 2021-03-10T20:13:18.678765+0000 mon.a (mon.0) 560 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:13:19.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:18 gibba044 bash[25485]: audit 2021-03-10T20:13:18.680653+0000 mon.b (mon.2) 7 : audit [INF] from='osd.6 [v2:172.21.2.144:6816/2158926316,v1:172.21.2.144:6817/2158926316]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:13:19.249 INFO:journalctl@ceph.osd.6.gibba044.stdout:Mar 10 20:13:19 gibba044 bash[29747]: debug 2021-03-10T20:13:19.006+0000 7fe6e053c700 -1 osd.6 92 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:13:19.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:18 gibba023 bash[30844]: cluster 2021-03-10T20:13:17.961299+0000 mon.a (mon.0) 559 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T20:13:19.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:18 gibba023 bash[30844]: audit 2021-03-10T20:13:18.678765+0000 mon.a (mon.0) 560 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:13:19.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:18 gibba023 bash[30844]: audit 2021-03-10T20:13:18.680653+0000 mon.b (mon.2) 7 : audit [INF] from='osd.6 [v2:172.21.2.144:6816/2158926316,v1:172.21.2.144:6817/2158926316]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:13:19.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:18 gibba023 bash[31815]: cluster 2021-03-10T20:13:17.961299+0000 mon.a (mon.0) 559 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T20:13:19.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:18 gibba023 bash[31815]: audit 2021-03-10T20:13:18.678765+0000 mon.a (mon.0) 560 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:13:19.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:18 gibba023 bash[31815]: audit 2021-03-10T20:13:18.680653+0000 mon.b (mon.2) 7 : audit [INF] from='osd.6 [v2:172.21.2.144:6816/2158926316,v1:172.21.2.144:6817/2158926316]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-03-10T20:13:20.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:19 gibba044 bash[25485]: audit 2021-03-10T20:13:18.986369+0000 mon.a (mon.0) 561 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T20:13:20.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:19 gibba044 bash[25485]: cluster 2021-03-10T20:13:18.986412+0000 mon.a (mon.0) 562 : cluster [DBG] osdmap e95: 8 total, 7 up, 8 in 2021-03-10T20:13:20.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:19 gibba044 bash[25485]: audit 2021-03-10T20:13:18.991124+0000 mon.a (mon.0) 563 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:13:20.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:19 gibba044 bash[25485]: audit 2021-03-10T20:13:18.993171+0000 mon.b (mon.2) 8 : audit [INF] from='osd.6 [v2:172.21.2.144:6816/2158926316,v1:172.21.2.144:6817/2158926316]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:13:20.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:19 gibba044 bash[25485]: cluster 2021-03-10T20:13:19.387910+0000 mgr.gibba044.wflcwh (mgr.34466) 304 : cluster [DBG] pgmap v153: 129 pgs: 13 active+undersized+degraded, 30 active+undersized, 86 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 21/195 objects degraded (10.769%) 2021-03-10T20:13:20.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:19 gibba023 bash[30844]: audit 2021-03-10T20:13:18.986369+0000 mon.a (mon.0) 561 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T20:13:20.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:19 gibba023 bash[30844]: cluster 2021-03-10T20:13:18.986412+0000 mon.a (mon.0) 562 : cluster [DBG] osdmap e95: 8 total, 7 up, 8 in 2021-03-10T20:13:20.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:19 gibba023 bash[30844]: audit 2021-03-10T20:13:18.991124+0000 mon.a (mon.0) 563 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:13:20.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:19 gibba023 bash[30844]: audit 2021-03-10T20:13:18.993171+0000 mon.b (mon.2) 8 : audit [INF] from='osd.6 [v2:172.21.2.144:6816/2158926316,v1:172.21.2.144:6817/2158926316]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:13:20.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:19 gibba023 bash[30844]: cluster 2021-03-10T20:13:19.387910+0000 mgr.gibba044.wflcwh (mgr.34466) 304 : cluster [DBG] pgmap v153: 129 pgs: 13 active+undersized+degraded, 30 active+undersized, 86 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 21/195 objects degraded (10.769%) 2021-03-10T20:13:20.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:19 gibba023 bash[31815]: audit 2021-03-10T20:13:18.986369+0000 mon.a (mon.0) 561 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-03-10T20:13:20.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:19 gibba023 bash[31815]: cluster 2021-03-10T20:13:18.986412+0000 mon.a (mon.0) 562 : cluster [DBG] osdmap e95: 8 total, 7 up, 8 in 2021-03-10T20:13:20.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:19 gibba023 bash[31815]: audit 2021-03-10T20:13:18.991124+0000 mon.a (mon.0) 563 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:13:20.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:19 gibba023 bash[31815]: audit 2021-03-10T20:13:18.993171+0000 mon.b (mon.2) 8 : audit [INF] from='osd.6 [v2:172.21.2.144:6816/2158926316,v1:172.21.2.144:6817/2158926316]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:13:20.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:19 gibba023 bash[31815]: cluster 2021-03-10T20:13:19.387910+0000 mgr.gibba044.wflcwh (mgr.34466) 304 : cluster [DBG] pgmap v153: 129 pgs: 13 active+undersized+degraded, 30 active+undersized, 86 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 21/195 objects degraded (10.769%) 2021-03-10T20:13:21.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:21 gibba044 bash[25485]: cluster 2021-03-10T20:13:19.987818+0000 mon.a (mon.0) 564 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:13:21.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:21 gibba044 bash[25485]: cluster 2021-03-10T20:13:19.999745+0000 mon.a (mon.0) 565 : cluster [INF] osd.6 [v2:172.21.2.144:6816/2158926316,v1:172.21.2.144:6817/2158926316] boot 2021-03-10T20:13:21.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:21 gibba044 bash[25485]: cluster 2021-03-10T20:13:19.999765+0000 mon.a (mon.0) 566 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-03-10T20:13:21.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:21 gibba044 bash[25485]: audit 2021-03-10T20:13:19.999905+0000 mon.a (mon.0) 567 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:13:21.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:20 gibba023 bash[30844]: cluster 2021-03-10T20:13:19.987818+0000 mon.a (mon.0) 564 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:13:21.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:20 gibba023 bash[30844]: cluster 2021-03-10T20:13:19.999745+0000 mon.a (mon.0) 565 : cluster [INF] osd.6 [v2:172.21.2.144:6816/2158926316,v1:172.21.2.144:6817/2158926316] boot 2021-03-10T20:13:21.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:20 gibba023 bash[30844]: cluster 2021-03-10T20:13:19.999765+0000 mon.a (mon.0) 566 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-03-10T20:13:21.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:20 gibba023 bash[30844]: audit 2021-03-10T20:13:19.999905+0000 mon.a (mon.0) 567 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:13:21.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:20 gibba023 bash[31815]: cluster 2021-03-10T20:13:19.987818+0000 mon.a (mon.0) 564 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:13:21.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:20 gibba023 bash[31815]: cluster 2021-03-10T20:13:19.999745+0000 mon.a (mon.0) 565 : cluster [INF] osd.6 [v2:172.21.2.144:6816/2158926316,v1:172.21.2.144:6817/2158926316] boot 2021-03-10T20:13:21.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:20 gibba023 bash[31815]: cluster 2021-03-10T20:13:19.999765+0000 mon.a (mon.0) 566 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-03-10T20:13:21.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:20 gibba023 bash[31815]: audit 2021-03-10T20:13:19.999905+0000 mon.a (mon.0) 567 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-03-10T20:13:21.462 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:13:21.689 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:13:21.689 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (4m) 83s ago 10m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:13:21.689 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (9m) 5s ago 9m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:13:21.690 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (4m) 5s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:13:21.690 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (5m) 5s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:13:21.690 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (4m) 83s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:13:21.690 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (4m) 83s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:13:21.691 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (3m) 5s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:13:21.691 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (3m) 83s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:13:21.691 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (10m) 83s ago 10m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:13:21.692 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (10m) 5s ago 10m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:13:21.692 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (2m) 83s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:13:21.692 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (2m) 83s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:13:21.692 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (111s) 83s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:13:21.692 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (85s) 83s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:13:21.693 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (60s) 5s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:13:21.693 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (34s) 5s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:13:21.693 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (7s) 5s ago 10m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:13:21.694 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (10m) 5s ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 082d0fe68f90 2021-03-10T20:13:21.694 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (9m) 5s ago 10m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:13:21.694 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 83s ago 7m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:13:21.694 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 5s ago 8m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:13:21.971 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:13:21.972 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:13:21.972 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:13:21.972 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:13:21.972 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:13:21.972 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:13:21.973 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:13:21.973 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:13:21.973 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2021-03-10T20:13:21.973 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 7 2021-03-10T20:13:21.973 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:13:21.974 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:13:21.974 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:13:21.974 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2021-03-10T20:13:21.974 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 13 2021-03-10T20:13:21.975 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:13:21.975 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:13:22.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:22 gibba023 bash[30844]: cluster 2021-03-10T20:13:21.004710+0000 mon.a (mon.0) 568 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2021-03-10T20:13:22.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:22 gibba023 bash[30844]: cluster 2021-03-10T20:13:21.011031+0000 mon.a (mon.0) 569 : cluster [WRN] Health check update: Degraded data redundancy: 21/195 objects degraded (10.769%), 13 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:22.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:22 gibba023 bash[30844]: cluster 2021-03-10T20:13:21.389193+0000 mgr.gibba044.wflcwh (mgr.34466) 305 : cluster [DBG] pgmap v156: 129 pgs: 3 peering, 12 active+undersized+degraded, 28 active+undersized, 86 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 18/195 objects degraded (9.231%) 2021-03-10T20:13:22.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:22 gibba023 bash[30844]: audit 2021-03-10T20:13:21.456489+0000 mgr.gibba044.wflcwh (mgr.34466) 306 : audit [DBG] from='client.44274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:13:22.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:22 gibba023 bash[30844]: audit 2021-03-10T20:13:21.971960+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.2.123:0/2822942172' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:22.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:22 gibba023 bash[31815]: cluster 2021-03-10T20:13:21.004710+0000 mon.a (mon.0) 568 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2021-03-10T20:13:22.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:22 gibba023 bash[31815]: cluster 2021-03-10T20:13:21.011031+0000 mon.a (mon.0) 569 : cluster [WRN] Health check update: Degraded data redundancy: 21/195 objects degraded (10.769%), 13 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:22.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:22 gibba023 bash[31815]: cluster 2021-03-10T20:13:21.389193+0000 mgr.gibba044.wflcwh (mgr.34466) 305 : cluster [DBG] pgmap v156: 129 pgs: 3 peering, 12 active+undersized+degraded, 28 active+undersized, 86 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 18/195 objects degraded (9.231%) 2021-03-10T20:13:22.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:22 gibba023 bash[31815]: audit 2021-03-10T20:13:21.456489+0000 mgr.gibba044.wflcwh (mgr.34466) 306 : audit [DBG] from='client.44274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:13:22.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:22 gibba023 bash[31815]: audit 2021-03-10T20:13:21.971960+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.2.123:0/2822942172' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:22.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:22 gibba044 bash[25485]: cluster 2021-03-10T20:13:21.004710+0000 mon.a (mon.0) 568 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2021-03-10T20:13:22.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:22 gibba044 bash[25485]: cluster 2021-03-10T20:13:21.011031+0000 mon.a (mon.0) 569 : cluster [WRN] Health check update: Degraded data redundancy: 21/195 objects degraded (10.769%), 13 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:22.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:22 gibba044 bash[25485]: cluster 2021-03-10T20:13:21.389193+0000 mgr.gibba044.wflcwh (mgr.34466) 305 : cluster [DBG] pgmap v156: 129 pgs: 3 peering, 12 active+undersized+degraded, 28 active+undersized, 86 active+clean; 7.0 KiB data, 46 MiB used, 671 GiB / 672 GiB avail; 18/195 objects degraded (9.231%) 2021-03-10T20:13:22.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:22 gibba044 bash[25485]: audit 2021-03-10T20:13:21.456489+0000 mgr.gibba044.wflcwh (mgr.34466) 306 : audit [DBG] from='client.44274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:13:22.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:22 gibba044 bash[25485]: audit 2021-03-10T20:13:21.971960+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.2.123:0/2822942172' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:23.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:23 gibba023 bash[30844]: audit 2021-03-10T20:13:21.679158+0000 mgr.gibba044.wflcwh (mgr.34466) 307 : audit [DBG] from='client.54259 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:13:23.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:23 gibba023 bash[31815]: audit 2021-03-10T20:13:21.679158+0000 mgr.gibba044.wflcwh (mgr.34466) 307 : audit [DBG] from='client.54259 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:13:23.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:23 gibba044 bash[25485]: audit 2021-03-10T20:13:21.679158+0000 mgr.gibba044.wflcwh (mgr.34466) 307 : audit [DBG] from='client.54259 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:13:24.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:24 gibba023 bash[30844]: cluster 2021-03-10T20:13:23.391046+0000 mgr.gibba044.wflcwh (mgr.34466) 308 : cluster [DBG] pgmap v157: 129 pgs: 3 peering, 3 active+undersized+degraded, 11 active+undersized, 112 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail; 3/195 objects degraded (1.538%) 2021-03-10T20:13:24.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:24 gibba023 bash[31815]: cluster 2021-03-10T20:13:23.391046+0000 mgr.gibba044.wflcwh (mgr.34466) 308 : cluster [DBG] pgmap v157: 129 pgs: 3 peering, 3 active+undersized+degraded, 11 active+undersized, 112 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail; 3/195 objects degraded (1.538%) 2021-03-10T20:13:24.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:24 gibba044 bash[25485]: cluster 2021-03-10T20:13:23.391046+0000 mgr.gibba044.wflcwh (mgr.34466) 308 : cluster [DBG] pgmap v157: 129 pgs: 3 peering, 3 active+undersized+degraded, 11 active+undersized, 112 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail; 3/195 objects degraded (1.538%) 2021-03-10T20:13:25.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:25 gibba044 bash[25485]: cluster 2021-03-10T20:13:25.392619+0000 mgr.gibba044.wflcwh (mgr.34466) 309 : cluster [DBG] pgmap v158: 129 pgs: 13 active+clean+wait, 3 peering, 113 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:13:25.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:25 gibba044 bash[25485]: cluster 2021-03-10T20:13:25.442879+0000 mon.a (mon.0) 570 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/195 objects degraded (1.538%), 3 pgs degraded) 2021-03-10T20:13:25.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:25 gibba023 bash[30844]: cluster 2021-03-10T20:13:25.392619+0000 mgr.gibba044.wflcwh (mgr.34466) 309 : cluster [DBG] pgmap v158: 129 pgs: 13 active+clean+wait, 3 peering, 113 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:13:25.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:25 gibba023 bash[30844]: cluster 2021-03-10T20:13:25.442879+0000 mon.a (mon.0) 570 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/195 objects degraded (1.538%), 3 pgs degraded) 2021-03-10T20:13:25.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:25 gibba023 bash[31815]: cluster 2021-03-10T20:13:25.392619+0000 mgr.gibba044.wflcwh (mgr.34466) 309 : cluster [DBG] pgmap v158: 129 pgs: 13 active+clean+wait, 3 peering, 113 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:13:25.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:25 gibba023 bash[31815]: cluster 2021-03-10T20:13:25.442879+0000 mon.a (mon.0) 570 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/195 objects degraded (1.538%), 3 pgs degraded) 2021-03-10T20:13:27.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:27 gibba023 bash[30844]: audit 2021-03-10T20:13:27.076574+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:13:27.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:27 gibba023 bash[30844]: audit 2021-03-10T20:13:27.082458+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:13:27.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:27 gibba023 bash[31815]: audit 2021-03-10T20:13:27.076574+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:13:27.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:27 gibba023 bash[31815]: audit 2021-03-10T20:13:27.082458+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:13:27.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:27 gibba044 bash[25485]: audit 2021-03-10T20:13:27.076574+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:13:27.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:27 gibba044 bash[25485]: audit 2021-03-10T20:13:27.082458+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:13:28.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:28 gibba023 bash[30844]: cluster 2021-03-10T20:13:27.394151+0000 mgr.gibba044.wflcwh (mgr.34466) 310 : cluster [DBG] pgmap v159: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:13:28.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:28 gibba023 bash[31815]: cluster 2021-03-10T20:13:27.394151+0000 mgr.gibba044.wflcwh (mgr.34466) 310 : cluster [DBG] pgmap v159: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:13:28.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:28 gibba044 bash[25485]: cluster 2021-03-10T20:13:27.394151+0000 mgr.gibba044.wflcwh (mgr.34466) 310 : cluster [DBG] pgmap v159: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:13:30.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:30 gibba044 bash[25485]: cluster 2021-03-10T20:13:29.395751+0000 mgr.gibba044.wflcwh (mgr.34466) 311 : cluster [DBG] pgmap v160: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:13:30.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:30 gibba023 bash[30844]: cluster 2021-03-10T20:13:29.395751+0000 mgr.gibba044.wflcwh (mgr.34466) 311 : cluster [DBG] pgmap v160: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:13:30.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:30 gibba023 bash[31815]: cluster 2021-03-10T20:13:29.395751+0000 mgr.gibba044.wflcwh (mgr.34466) 311 : cluster [DBG] pgmap v160: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:13:32.356 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:32 gibba044 bash[25485]: audit 2021-03-10T20:13:31.190734+0000 mon.a (mon.0) 573 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T20:13:32.356 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:32 gibba044 bash[25485]: audit 2021-03-10T20:13:31.194507+0000 mgr.gibba044.wflcwh (mgr.34466) 312 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T20:13:32.357 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:32 gibba044 bash[25485]: cephadm 2021-03-10T20:13:31.199395+0000 mgr.gibba044.wflcwh (mgr.34466) 313 : cephadm [INF] Upgrade: osd.7 is safe to restart 2021-03-10T20:13:32.357 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:32 gibba044 bash[25485]: cluster 2021-03-10T20:13:31.396186+0000 mgr.gibba044.wflcwh (mgr.34466) 314 : cluster [DBG] pgmap v161: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:13:32.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:32 gibba023 bash[30844]: audit 2021-03-10T20:13:31.190734+0000 mon.a (mon.0) 573 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T20:13:32.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:32 gibba023 bash[30844]: audit 2021-03-10T20:13:31.194507+0000 mgr.gibba044.wflcwh (mgr.34466) 312 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T20:13:32.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:32 gibba023 bash[30844]: cephadm 2021-03-10T20:13:31.199395+0000 mgr.gibba044.wflcwh (mgr.34466) 313 : cephadm [INF] Upgrade: osd.7 is safe to restart 2021-03-10T20:13:32.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:32 gibba023 bash[30844]: cluster 2021-03-10T20:13:31.396186+0000 mgr.gibba044.wflcwh (mgr.34466) 314 : cluster [DBG] pgmap v161: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:13:32.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:32 gibba023 bash[31815]: audit 2021-03-10T20:13:31.190734+0000 mon.a (mon.0) 573 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T20:13:32.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:32 gibba023 bash[31815]: audit 2021-03-10T20:13:31.194507+0000 mgr.gibba044.wflcwh (mgr.34466) 312 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-03-10T20:13:32.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:32 gibba023 bash[31815]: cephadm 2021-03-10T20:13:31.199395+0000 mgr.gibba044.wflcwh (mgr.34466) 313 : cephadm [INF] Upgrade: osd.7 is safe to restart 2021-03-10T20:13:32.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:32 gibba023 bash[31815]: cluster 2021-03-10T20:13:31.396186+0000 mgr.gibba044.wflcwh (mgr.34466) 314 : cluster [DBG] pgmap v161: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:13:33.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:33 gibba023 bash[30844]: audit 2021-03-10T20:13:32.147580+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:33.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:33 gibba023 bash[31815]: audit 2021-03-10T20:13:32.147580+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:33.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:33 gibba044 bash[25485]: audit 2021-03-10T20:13:32.147580+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:34.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:34 gibba023 bash[30844]: cephadm 2021-03-10T20:13:33.164793+0000 mgr.gibba044.wflcwh (mgr.34466) 315 : cephadm [INF] Upgrade: Updating osd.7 2021-03-10T20:13:34.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:34 gibba023 bash[30844]: audit 2021-03-10T20:13:33.172040+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:34.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:34 gibba023 bash[30844]: audit 2021-03-10T20:13:33.174091+0000 mon.a (mon.0) 576 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T20:13:34.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:34 gibba023 bash[30844]: cephadm 2021-03-10T20:13:33.176483+0000 mgr.gibba044.wflcwh (mgr.34466) 316 : cephadm [INF] Deploying daemon osd.7 on gibba044 2021-03-10T20:13:34.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:34 gibba023 bash[30844]: cluster 2021-03-10T20:13:33.396778+0000 mgr.gibba044.wflcwh (mgr.34466) 317 : cluster [DBG] pgmap v162: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:13:34.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:34 gibba023 bash[31815]: cephadm 2021-03-10T20:13:33.164793+0000 mgr.gibba044.wflcwh (mgr.34466) 315 : cephadm [INF] Upgrade: Updating osd.7 2021-03-10T20:13:34.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:34 gibba023 bash[31815]: audit 2021-03-10T20:13:33.172040+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:34.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:34 gibba023 bash[31815]: audit 2021-03-10T20:13:33.174091+0000 mon.a (mon.0) 576 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T20:13:34.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:34 gibba023 bash[31815]: cephadm 2021-03-10T20:13:33.176483+0000 mgr.gibba044.wflcwh (mgr.34466) 316 : cephadm [INF] Deploying daemon osd.7 on gibba044 2021-03-10T20:13:34.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:34 gibba023 bash[31815]: cluster 2021-03-10T20:13:33.396778+0000 mgr.gibba044.wflcwh (mgr.34466) 317 : cluster [DBG] pgmap v162: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:13:34.478 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:34 gibba044 bash[25485]: cephadm 2021-03-10T20:13:33.164793+0000 mgr.gibba044.wflcwh (mgr.34466) 315 : cephadm [INF] Upgrade: Updating osd.7 2021-03-10T20:13:34.478 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:34 gibba044 bash[25485]: audit 2021-03-10T20:13:33.172040+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:34.478 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:34 gibba044 bash[25485]: audit 2021-03-10T20:13:33.174091+0000 mon.a (mon.0) 576 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2021-03-10T20:13:34.479 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:34 gibba044 bash[25485]: cephadm 2021-03-10T20:13:33.176483+0000 mgr.gibba044.wflcwh (mgr.34466) 316 : cephadm [INF] Deploying daemon osd.7 on gibba044 2021-03-10T20:13:34.479 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:34 gibba044 bash[25485]: cluster 2021-03-10T20:13:33.396778+0000 mgr.gibba044.wflcwh (mgr.34466) 317 : cluster [DBG] pgmap v162: 129 pgs: 13 active+clean+wait, 116 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:13:35.198 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:13:34 gibba044 systemd[1]: Stopping Ceph osd.7 for dd719b26-81da-11eb-9080-001a4aab830c... 2021-03-10T20:13:35.198 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:13:35 gibba044 bash[16667]: debug 2021-03-10T20:13:35.078+0000 7f10c26ed700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-03-10T20:13:35.199 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:13:35 gibba044 bash[16667]: debug 2021-03-10T20:13:35.078+0000 7f10c26ed700 -1 osd.7 97 *** Got signal Terminated *** 2021-03-10T20:13:35.199 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:13:35 gibba044 bash[16667]: debug 2021-03-10T20:13:35.078+0000 7f10c26ed700 -1 osd.7 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-03-10T20:13:35.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:35 gibba044 bash[25485]: cluster 2021-03-10T20:13:35.179717+0000 mon.a (mon.0) 577 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T20:13:35.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:35 gibba044 bash[25485]: cluster 2021-03-10T20:13:35.179803+0000 mon.a (mon.0) 578 : cluster [INF] osd.7 failed (root=default,host=gibba044) (connection refused reported by osd.3) 2021-03-10T20:13:35.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:35 gibba044 bash[25485]: cluster 2021-03-10T20:13:35.180409+0000 mon.a (mon.0) 579 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T20:13:35.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:35 gibba044 bash[25485]: cluster 2021-03-10T20:13:35.180722+0000 mon.a (mon.0) 580 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T20:13:35.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:35 gibba044 bash[25485]: cluster 2021-03-10T20:13:35.181244+0000 mon.a (mon.0) 581 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T20:13:35.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:35 gibba044 bash[25485]: cluster 2021-03-10T20:13:35.181528+0000 mon.a (mon.0) 582 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T20:13:35.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:35 gibba044 bash[25485]: cluster 2021-03-10T20:13:35.182103+0000 mon.a (mon.0) 583 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T20:13:35.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:35 gibba044 bash[25485]: cluster 2021-03-10T20:13:35.182431+0000 mon.a (mon.0) 584 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T20:13:35.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:35 gibba044 bash[25485]: cluster 2021-03-10T20:13:35.182945+0000 mon.a (mon.0) 585 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T20:13:35.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:35 gibba023 bash[30844]: cluster 2021-03-10T20:13:35.179717+0000 mon.a (mon.0) 577 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T20:13:35.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:35 gibba023 bash[30844]: cluster 2021-03-10T20:13:35.179803+0000 mon.a (mon.0) 578 : cluster [INF] osd.7 failed (root=default,host=gibba044) (connection refused reported by osd.3) 2021-03-10T20:13:35.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:35 gibba023 bash[30844]: cluster 2021-03-10T20:13:35.180409+0000 mon.a (mon.0) 579 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T20:13:35.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:35 gibba023 bash[30844]: cluster 2021-03-10T20:13:35.180722+0000 mon.a (mon.0) 580 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T20:13:35.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:35 gibba023 bash[30844]: cluster 2021-03-10T20:13:35.181244+0000 mon.a (mon.0) 581 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T20:13:35.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:35 gibba023 bash[30844]: cluster 2021-03-10T20:13:35.181528+0000 mon.a (mon.0) 582 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T20:13:35.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:35 gibba023 bash[30844]: cluster 2021-03-10T20:13:35.182103+0000 mon.a (mon.0) 583 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T20:13:35.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:35 gibba023 bash[30844]: cluster 2021-03-10T20:13:35.182431+0000 mon.a (mon.0) 584 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T20:13:35.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:35 gibba023 bash[30844]: cluster 2021-03-10T20:13:35.182945+0000 mon.a (mon.0) 585 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T20:13:35.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:35 gibba023 bash[31815]: cluster 2021-03-10T20:13:35.179717+0000 mon.a (mon.0) 577 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T20:13:35.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:35 gibba023 bash[31815]: cluster 2021-03-10T20:13:35.179803+0000 mon.a (mon.0) 578 : cluster [INF] osd.7 failed (root=default,host=gibba044) (connection refused reported by osd.3) 2021-03-10T20:13:35.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:35 gibba023 bash[31815]: cluster 2021-03-10T20:13:35.180409+0000 mon.a (mon.0) 579 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-03-10T20:13:35.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:35 gibba023 bash[31815]: cluster 2021-03-10T20:13:35.180722+0000 mon.a (mon.0) 580 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T20:13:35.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:35 gibba023 bash[31815]: cluster 2021-03-10T20:13:35.181244+0000 mon.a (mon.0) 581 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T20:13:35.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:35 gibba023 bash[31815]: cluster 2021-03-10T20:13:35.181528+0000 mon.a (mon.0) 582 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T20:13:35.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:35 gibba023 bash[31815]: cluster 2021-03-10T20:13:35.182103+0000 mon.a (mon.0) 583 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-03-10T20:13:35.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:35 gibba023 bash[31815]: cluster 2021-03-10T20:13:35.182431+0000 mon.a (mon.0) 584 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-03-10T20:13:35.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:35 gibba023 bash[31815]: cluster 2021-03-10T20:13:35.182945+0000 mon.a (mon.0) 585 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-03-10T20:13:36.247 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:13:35 gibba044 docker[30676]: ceph-dd719b26-81da-11eb-9080-001a4aab830c-osd.7 2021-03-10T20:13:36.589 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:36 gibba044 bash[25485]: cluster 2021-03-10T20:13:35.231556+0000 mon.a (mon.0) 586 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:13:36.590 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:36 gibba044 bash[25485]: cluster 2021-03-10T20:13:35.242059+0000 mon.a (mon.0) 587 : cluster [DBG] osdmap e98: 8 total, 7 up, 8 in 2021-03-10T20:13:36.590 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:36 gibba044 bash[25485]: cluster 2021-03-10T20:13:35.397844+0000 mgr.gibba044.wflcwh (mgr.34466) 318 : cluster [DBG] pgmap v164: 129 pgs: 16 stale+active+clean, 4 peering, 13 active+clean+wait, 96 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:13:36.590 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:36 gibba044 bash[25485]: cluster 2021-03-10T20:13:36.246008+0000 mon.a (mon.0) 588 : cluster [DBG] osdmap e99: 8 total, 7 up, 8 in 2021-03-10T20:13:36.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:36 gibba023 bash[30844]: cluster 2021-03-10T20:13:35.231556+0000 mon.a (mon.0) 586 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:13:36.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:36 gibba023 bash[30844]: cluster 2021-03-10T20:13:35.242059+0000 mon.a (mon.0) 587 : cluster [DBG] osdmap e98: 8 total, 7 up, 8 in 2021-03-10T20:13:36.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:36 gibba023 bash[30844]: cluster 2021-03-10T20:13:35.397844+0000 mgr.gibba044.wflcwh (mgr.34466) 318 : cluster [DBG] pgmap v164: 129 pgs: 16 stale+active+clean, 4 peering, 13 active+clean+wait, 96 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:13:36.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:36 gibba023 bash[30844]: cluster 2021-03-10T20:13:36.246008+0000 mon.a (mon.0) 588 : cluster [DBG] osdmap e99: 8 total, 7 up, 8 in 2021-03-10T20:13:36.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:36 gibba023 bash[31815]: cluster 2021-03-10T20:13:35.231556+0000 mon.a (mon.0) 586 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-03-10T20:13:36.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:36 gibba023 bash[31815]: cluster 2021-03-10T20:13:35.242059+0000 mon.a (mon.0) 587 : cluster [DBG] osdmap e98: 8 total, 7 up, 8 in 2021-03-10T20:13:36.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:36 gibba023 bash[31815]: cluster 2021-03-10T20:13:35.397844+0000 mgr.gibba044.wflcwh (mgr.34466) 318 : cluster [DBG] pgmap v164: 129 pgs: 16 stale+active+clean, 4 peering, 13 active+clean+wait, 96 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail 2021-03-10T20:13:36.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:36 gibba023 bash[31815]: cluster 2021-03-10T20:13:36.246008+0000 mon.a (mon.0) 588 : cluster [DBG] osdmap e99: 8 total, 7 up, 8 in 2021-03-10T20:13:37.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:37 gibba044 bash[25485]: cluster 2021-03-10T20:13:37.399516+0000 mgr.gibba044.wflcwh (mgr.34466) 319 : cluster [DBG] pgmap v166: 129 pgs: 12 stale+active+clean, 11 active+undersized+degraded, 9 peering, 13 active+clean+wait, 8 active+undersized, 76 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail; 17/195 objects degraded (8.718%) 2021-03-10T20:13:37.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:37 gibba044 bash[25485]: cluster 2021-03-10T20:13:37.449728+0000 mon.a (mon.0) 589 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:13:37.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:37 gibba044 bash[25485]: cluster 2021-03-10T20:13:37.449820+0000 mon.a (mon.0) 590 : cluster [WRN] Health check failed: Degraded data redundancy: 17/195 objects degraded (8.718%), 11 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:37.749 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:13:37 gibba044 systemd[1]: ceph-dd719b26-81da-11eb-9080-001a4aab830c@osd.7.service: Succeeded. 2021-03-10T20:13:37.749 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:13:37 gibba044 systemd[1]: Stopped Ceph osd.7 for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:13:37.749 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:13:37 gibba044 systemd[1]: Started Ceph osd.7 for dd719b26-81da-11eb-9080-001a4aab830c. 2021-03-10T20:13:37.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:37 gibba023 bash[30844]: cluster 2021-03-10T20:13:37.399516+0000 mgr.gibba044.wflcwh (mgr.34466) 319 : cluster [DBG] pgmap v166: 129 pgs: 12 stale+active+clean, 11 active+undersized+degraded, 9 peering, 13 active+clean+wait, 8 active+undersized, 76 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail; 17/195 objects degraded (8.718%) 2021-03-10T20:13:37.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:37 gibba023 bash[30844]: cluster 2021-03-10T20:13:37.449728+0000 mon.a (mon.0) 589 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:13:37.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:37 gibba023 bash[30844]: cluster 2021-03-10T20:13:37.449820+0000 mon.a (mon.0) 590 : cluster [WRN] Health check failed: Degraded data redundancy: 17/195 objects degraded (8.718%), 11 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:37.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:37 gibba023 bash[31815]: cluster 2021-03-10T20:13:37.399516+0000 mgr.gibba044.wflcwh (mgr.34466) 319 : cluster [DBG] pgmap v166: 129 pgs: 12 stale+active+clean, 11 active+undersized+degraded, 9 peering, 13 active+clean+wait, 8 active+undersized, 76 active+clean; 7.0 KiB data, 47 MiB used, 671 GiB / 672 GiB avail; 17/195 objects degraded (8.718%) 2021-03-10T20:13:37.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:37 gibba023 bash[31815]: cluster 2021-03-10T20:13:37.449728+0000 mon.a (mon.0) 589 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-03-10T20:13:37.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:37 gibba023 bash[31815]: cluster 2021-03-10T20:13:37.449820+0000 mon.a (mon.0) 590 : cluster [WRN] Health check failed: Degraded data redundancy: 17/195 objects degraded (8.718%), 11 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:38.817 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:38 gibba044 bash[25485]: audit 2021-03-10T20:13:37.639987+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:38.818 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:38 gibba044 bash[25485]: audit 2021-03-10T20:13:37.641336+0000 mon.a (mon.0) 592 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:13:38.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:38 gibba023 bash[30844]: audit 2021-03-10T20:13:37.639987+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:38.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:38 gibba023 bash[30844]: audit 2021-03-10T20:13:37.641336+0000 mon.a (mon.0) 592 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:13:38.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:38 gibba023 bash[31815]: audit 2021-03-10T20:13:37.639987+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:38.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:38 gibba023 bash[31815]: audit 2021-03-10T20:13:37.641336+0000 mon.a (mon.0) 592 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:13:39.248 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:13:38 gibba044 bash[30850]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-03-10T20:13:39.248 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:13:38 gibba044 bash[30850]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2021-03-10T20:13:39.249 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:13:38 gibba044 bash[30850]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2021-03-10T20:13:39.249 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:13:38 gibba044 bash[30850]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2021-03-10T20:13:39.249 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:13:38 gibba044 bash[30850]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-03-10T20:13:39.249 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:13:38 gibba044 bash[30850]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-03-10T20:13:39.249 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:13:38 gibba044 bash[30850]: --> ceph-volume lvm activate successful for osd ID: 7 2021-03-10T20:13:39.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:39 gibba023 bash[30844]: cluster 2021-03-10T20:13:39.401323+0000 mgr.gibba044.wflcwh (mgr.34466) 320 : cluster [DBG] pgmap v167: 129 pgs: 22 active+undersized+degraded, 9 peering, 26 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 31/195 objects degraded (15.897%) 2021-03-10T20:13:39.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:39 gibba023 bash[31815]: cluster 2021-03-10T20:13:39.401323+0000 mgr.gibba044.wflcwh (mgr.34466) 320 : cluster [DBG] pgmap v167: 129 pgs: 22 active+undersized+degraded, 9 peering, 26 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 31/195 objects degraded (15.897%) 2021-03-10T20:13:39.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:39 gibba044 bash[25485]: cluster 2021-03-10T20:13:39.401323+0000 mgr.gibba044.wflcwh (mgr.34466) 320 : cluster [DBG] pgmap v167: 129 pgs: 22 active+undersized+degraded, 9 peering, 26 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 31/195 objects degraded (15.897%) 2021-03-10T20:13:40.748 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:13:40 gibba044 bash[30979]: debug 2021-03-10T20:13:40.434+0000 7f1b81513700 1 -- 172.21.2.144:0/1676625759 <== mon.2 v2:172.21.2.144:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557ee6da44e0 con 0x557ee6e21400 2021-03-10T20:13:41.499 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:13:41 gibba044 bash[30979]: debug 2021-03-10T20:13:41.014+0000 7f1b88fa8080 -1 Falling back to public interface 2021-03-10T20:13:42.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: audit 2021-03-10T20:13:41.319492+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:42.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: audit 2021-03-10T20:13:41.323298+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:42.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: audit 2021-03-10T20:13:41.328925+0000 mon.a (mon.0) 595 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:13:42.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: cephadm 2021-03-10T20:13:41.330498+0000 mgr.gibba044.wflcwh (mgr.34466) 321 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:13:42.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: audit 2021-03-10T20:13:41.331107+0000 mon.a (mon.0) 596 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:42.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: audit 2021-03-10T20:13:41.333130+0000 mon.a (mon.0) 597 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:42.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: cephadm 2021-03-10T20:13:41.333265+0000 mgr.gibba044.wflcwh (mgr.34466) 322 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:13:42.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: cephadm 2021-03-10T20:13:41.335212+0000 mgr.gibba044.wflcwh (mgr.34466) 323 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:13:42.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: cephadm 2021-03-10T20:13:41.335279+0000 mgr.gibba044.wflcwh (mgr.34466) 324 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:13:42.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: audit 2021-03-10T20:13:41.335657+0000 mon.a (mon.0) 598 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:42.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: cephadm 2021-03-10T20:13:41.337808+0000 mgr.gibba044.wflcwh (mgr.34466) 325 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:13:42.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: cephadm 2021-03-10T20:13:41.337892+0000 mgr.gibba044.wflcwh (mgr.34466) 326 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:13:42.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: audit 2021-03-10T20:13:41.339649+0000 mon.a (mon.0) 599 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:42.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: cephadm 2021-03-10T20:13:41.339762+0000 mgr.gibba044.wflcwh (mgr.34466) 327 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:13:42.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: cephadm 2021-03-10T20:13:41.341315+0000 mgr.gibba044.wflcwh (mgr.34466) 328 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:13:42.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: cephadm 2021-03-10T20:13:41.341410+0000 mgr.gibba044.wflcwh (mgr.34466) 329 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:13:42.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: cephadm 2021-03-10T20:13:41.343983+0000 mgr.gibba044.wflcwh (mgr.34466) 330 : cephadm [INF] Upgrade: Setting container_image for all osd 2021-03-10T20:13:42.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: audit 2021-03-10T20:13:41.345988+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:42.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: audit 2021-03-10T20:13:41.347470+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-03-10T20:13:42.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: audit 2021-03-10T20:13:41.351837+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2021-03-10T20:13:42.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: audit 2021-03-10T20:13:41.319492+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:42.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: audit 2021-03-10T20:13:41.323298+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:42.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: audit 2021-03-10T20:13:41.328925+0000 mon.a (mon.0) 595 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:13:42.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: cephadm 2021-03-10T20:13:41.330498+0000 mgr.gibba044.wflcwh (mgr.34466) 321 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:13:42.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: audit 2021-03-10T20:13:41.331107+0000 mon.a (mon.0) 596 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:42.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: audit 2021-03-10T20:13:41.333130+0000 mon.a (mon.0) 597 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:42.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: cephadm 2021-03-10T20:13:41.333265+0000 mgr.gibba044.wflcwh (mgr.34466) 322 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:13:42.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: cephadm 2021-03-10T20:13:41.335212+0000 mgr.gibba044.wflcwh (mgr.34466) 323 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:13:42.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: cephadm 2021-03-10T20:13:41.335279+0000 mgr.gibba044.wflcwh (mgr.34466) 324 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:13:42.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: audit 2021-03-10T20:13:41.335657+0000 mon.a (mon.0) 598 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:42.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: cephadm 2021-03-10T20:13:41.337808+0000 mgr.gibba044.wflcwh (mgr.34466) 325 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:13:42.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: cephadm 2021-03-10T20:13:41.337892+0000 mgr.gibba044.wflcwh (mgr.34466) 326 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:13:42.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: audit 2021-03-10T20:13:41.339649+0000 mon.a (mon.0) 599 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:42.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: cephadm 2021-03-10T20:13:41.339762+0000 mgr.gibba044.wflcwh (mgr.34466) 327 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:13:42.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: cephadm 2021-03-10T20:13:41.341315+0000 mgr.gibba044.wflcwh (mgr.34466) 328 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:13:42.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: cephadm 2021-03-10T20:13:41.341410+0000 mgr.gibba044.wflcwh (mgr.34466) 329 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:13:42.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: cephadm 2021-03-10T20:13:41.343983+0000 mgr.gibba044.wflcwh (mgr.34466) 330 : cephadm [INF] Upgrade: Setting container_image for all osd 2021-03-10T20:13:42.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: audit 2021-03-10T20:13:41.345988+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:42.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: audit 2021-03-10T20:13:41.347470+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-03-10T20:13:42.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: audit 2021-03-10T20:13:41.351837+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2021-03-10T20:13:42.685 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: audit 2021-03-10T20:13:41.353438+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-03-10T20:13:42.685 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: audit 2021-03-10T20:13:41.364512+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2021-03-10T20:13:42.686 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: audit 2021-03-10T20:13:41.366607+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-03-10T20:13:42.686 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: audit 2021-03-10T20:13:41.370170+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2021-03-10T20:13:42.686 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: audit 2021-03-10T20:13:41.371953+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-03-10T20:13:42.687 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: audit 2021-03-10T20:13:41.380951+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2021-03-10T20:13:42.687 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: audit 2021-03-10T20:13:41.383379+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-03-10T20:13:42.687 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: audit 2021-03-10T20:13:41.392088+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2021-03-10T20:13:42.688 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: audit 2021-03-10T20:13:41.394551+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-03-10T20:13:42.688 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: cluster 2021-03-10T20:13:41.402831+0000 mgr.gibba044.wflcwh (mgr.34466) 331 : cluster [DBG] pgmap v168: 129 pgs: 26 active+undersized+degraded, 31 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 35/195 objects degraded (17.949%) 2021-03-10T20:13:42.688 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: audit 2021-03-10T20:13:41.403870+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2021-03-10T20:13:42.688 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: audit 2021-03-10T20:13:41.406542+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-03-10T20:13:42.688 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: audit 2021-03-10T20:13:41.415695+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2021-03-10T20:13:42.689 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: audit 2021-03-10T20:13:41.418082+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-03-10T20:13:42.689 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: audit 2021-03-10T20:13:41.427283+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2021-03-10T20:13:42.689 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: audit 2021-03-10T20:13:41.353438+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-03-10T20:13:42.690 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: audit 2021-03-10T20:13:41.364512+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2021-03-10T20:13:42.690 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: audit 2021-03-10T20:13:41.366607+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-03-10T20:13:42.690 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: audit 2021-03-10T20:13:41.370170+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2021-03-10T20:13:42.690 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: audit 2021-03-10T20:13:41.371953+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-03-10T20:13:42.691 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: audit 2021-03-10T20:13:41.380951+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2021-03-10T20:13:42.691 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: audit 2021-03-10T20:13:41.383379+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-03-10T20:13:42.691 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: audit 2021-03-10T20:13:41.392088+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2021-03-10T20:13:42.691 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: audit 2021-03-10T20:13:41.394551+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-03-10T20:13:42.692 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: cluster 2021-03-10T20:13:41.402831+0000 mgr.gibba044.wflcwh (mgr.34466) 331 : cluster [DBG] pgmap v168: 129 pgs: 26 active+undersized+degraded, 31 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 35/195 objects degraded (17.949%) 2021-03-10T20:13:42.692 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: audit 2021-03-10T20:13:41.403870+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2021-03-10T20:13:42.692 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: audit 2021-03-10T20:13:41.406542+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-03-10T20:13:42.692 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: audit 2021-03-10T20:13:41.415695+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2021-03-10T20:13:42.692 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: audit 2021-03-10T20:13:41.418082+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-03-10T20:13:42.693 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: audit 2021-03-10T20:13:41.427283+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2021-03-10T20:13:42.693 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: cephadm 2021-03-10T20:13:41.432188+0000 mgr.gibba044.wflcwh (mgr.34466) 332 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:13:42.693 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: audit 2021-03-10T20:13:41.432383+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-03-10T20:13:42.694 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[31815]: cephadm 2021-03-10T20:13:41.434354+0000 mgr.gibba044.wflcwh (mgr.34466) 333 : cephadm [INF] Upgrade: Setting require_osd_release to 17 quincy 2021-03-10T20:13:42.694 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: cephadm 2021-03-10T20:13:41.432188+0000 mgr.gibba044.wflcwh (mgr.34466) 332 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:13:42.694 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: audit 2021-03-10T20:13:41.432383+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-03-10T20:13:42.695 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:42 gibba023 bash[30844]: cephadm 2021-03-10T20:13:41.434354+0000 mgr.gibba044.wflcwh (mgr.34466) 333 : cephadm [INF] Upgrade: Setting require_osd_release to 17 quincy 2021-03-10T20:13:42.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: audit 2021-03-10T20:13:41.319492+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:42.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: audit 2021-03-10T20:13:41.323298+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:42.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: audit 2021-03-10T20:13:41.328925+0000 mon.a (mon.0) 595 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:13:42.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: cephadm 2021-03-10T20:13:41.330498+0000 mgr.gibba044.wflcwh (mgr.34466) 321 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:13:42.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: audit 2021-03-10T20:13:41.331107+0000 mon.a (mon.0) 596 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:42.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: audit 2021-03-10T20:13:41.333130+0000 mon.a (mon.0) 597 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:42.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: cephadm 2021-03-10T20:13:41.333265+0000 mgr.gibba044.wflcwh (mgr.34466) 322 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:13:42.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: cephadm 2021-03-10T20:13:41.335212+0000 mgr.gibba044.wflcwh (mgr.34466) 323 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:13:42.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: cephadm 2021-03-10T20:13:41.335279+0000 mgr.gibba044.wflcwh (mgr.34466) 324 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:13:42.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: audit 2021-03-10T20:13:41.335657+0000 mon.a (mon.0) 598 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:42.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: cephadm 2021-03-10T20:13:41.337808+0000 mgr.gibba044.wflcwh (mgr.34466) 325 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:13:42.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: cephadm 2021-03-10T20:13:41.337892+0000 mgr.gibba044.wflcwh (mgr.34466) 326 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:13:42.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: audit 2021-03-10T20:13:41.339649+0000 mon.a (mon.0) 599 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:42.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: cephadm 2021-03-10T20:13:41.339762+0000 mgr.gibba044.wflcwh (mgr.34466) 327 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:13:42.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: cephadm 2021-03-10T20:13:41.341315+0000 mgr.gibba044.wflcwh (mgr.34466) 328 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:13:42.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: cephadm 2021-03-10T20:13:41.341410+0000 mgr.gibba044.wflcwh (mgr.34466) 329 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:13:42.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: cephadm 2021-03-10T20:13:41.343983+0000 mgr.gibba044.wflcwh (mgr.34466) 330 : cephadm [INF] Upgrade: Setting container_image for all osd 2021-03-10T20:13:42.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: audit 2021-03-10T20:13:41.345988+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:42.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: audit 2021-03-10T20:13:41.347470+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-03-10T20:13:42.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: audit 2021-03-10T20:13:41.351837+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2021-03-10T20:13:42.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: audit 2021-03-10T20:13:41.353438+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-03-10T20:13:42.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: audit 2021-03-10T20:13:41.364512+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2021-03-10T20:13:42.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: audit 2021-03-10T20:13:41.366607+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-03-10T20:13:42.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: audit 2021-03-10T20:13:41.370170+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2021-03-10T20:13:42.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: audit 2021-03-10T20:13:41.371953+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-03-10T20:13:42.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: audit 2021-03-10T20:13:41.380951+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2021-03-10T20:13:42.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: audit 2021-03-10T20:13:41.383379+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-03-10T20:13:42.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: audit 2021-03-10T20:13:41.392088+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2021-03-10T20:13:42.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: audit 2021-03-10T20:13:41.394551+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-03-10T20:13:42.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: cluster 2021-03-10T20:13:41.402831+0000 mgr.gibba044.wflcwh (mgr.34466) 331 : cluster [DBG] pgmap v168: 129 pgs: 26 active+undersized+degraded, 31 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 35/195 objects degraded (17.949%) 2021-03-10T20:13:42.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: audit 2021-03-10T20:13:41.403870+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2021-03-10T20:13:42.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: audit 2021-03-10T20:13:41.406542+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-03-10T20:13:42.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: audit 2021-03-10T20:13:41.415695+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2021-03-10T20:13:42.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: audit 2021-03-10T20:13:41.418082+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-03-10T20:13:42.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: audit 2021-03-10T20:13:41.427283+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2021-03-10T20:13:42.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: cephadm 2021-03-10T20:13:41.432188+0000 mgr.gibba044.wflcwh (mgr.34466) 332 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:13:42.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: audit 2021-03-10T20:13:41.432383+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-03-10T20:13:42.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:42 gibba044 bash[25485]: cephadm 2021-03-10T20:13:41.434354+0000 mgr.gibba044.wflcwh (mgr.34466) 333 : cephadm [INF] Upgrade: Setting require_osd_release to 17 quincy 2021-03-10T20:13:43.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:43 gibba023 bash[30844]: cluster 2021-03-10T20:13:42.390176+0000 mon.a (mon.0) 618 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T20:13:43.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:43 gibba023 bash[30844]: audit 2021-03-10T20:13:42.427593+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "osd require-osd-release", "release": "quincy"}]': finished 2021-03-10T20:13:43.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:43 gibba023 bash[30844]: cluster 2021-03-10T20:13:42.427646+0000 mon.a (mon.0) 620 : cluster [DBG] osdmap e100: 8 total, 7 up, 8 in 2021-03-10T20:13:43.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:43 gibba023 bash[30844]: audit 2021-03-10T20:13:42.432345+0000 mon.a (mon.0) 621 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:43.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:43 gibba023 bash[30844]: cephadm 2021-03-10T20:13:42.434299+0000 mgr.gibba044.wflcwh (mgr.34466) 334 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:13:43.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:43 gibba023 bash[30844]: cephadm 2021-03-10T20:13:42.436398+0000 mgr.gibba044.wflcwh (mgr.34466) 335 : cephadm [INF] Upgrade: Setting container_image for all mds 2021-03-10T20:13:43.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:43 gibba023 bash[30844]: audit 2021-03-10T20:13:42.437817+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:43.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:43 gibba023 bash[30844]: cephadm 2021-03-10T20:13:42.441477+0000 mgr.gibba044.wflcwh (mgr.34466) 336 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:13:43.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:43 gibba023 bash[30844]: cephadm 2021-03-10T20:13:42.441518+0000 mgr.gibba044.wflcwh (mgr.34466) 337 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:13:43.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:43 gibba023 bash[30844]: cephadm 2021-03-10T20:13:42.441664+0000 mgr.gibba044.wflcwh (mgr.34466) 338 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:13:43.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:43 gibba023 bash[31815]: cluster 2021-03-10T20:13:42.390176+0000 mon.a (mon.0) 618 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T20:13:43.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:43 gibba023 bash[31815]: audit 2021-03-10T20:13:42.427593+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "osd require-osd-release", "release": "quincy"}]': finished 2021-03-10T20:13:43.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:43 gibba023 bash[31815]: cluster 2021-03-10T20:13:42.427646+0000 mon.a (mon.0) 620 : cluster [DBG] osdmap e100: 8 total, 7 up, 8 in 2021-03-10T20:13:43.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:43 gibba023 bash[31815]: audit 2021-03-10T20:13:42.432345+0000 mon.a (mon.0) 621 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:43.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:43 gibba023 bash[31815]: cephadm 2021-03-10T20:13:42.434299+0000 mgr.gibba044.wflcwh (mgr.34466) 334 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:13:43.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:43 gibba023 bash[31815]: cephadm 2021-03-10T20:13:42.436398+0000 mgr.gibba044.wflcwh (mgr.34466) 335 : cephadm [INF] Upgrade: Setting container_image for all mds 2021-03-10T20:13:43.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:43 gibba023 bash[31815]: audit 2021-03-10T20:13:42.437817+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:43.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:43 gibba023 bash[31815]: cephadm 2021-03-10T20:13:42.441477+0000 mgr.gibba044.wflcwh (mgr.34466) 336 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:13:43.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:43 gibba023 bash[31815]: cephadm 2021-03-10T20:13:42.441518+0000 mgr.gibba044.wflcwh (mgr.34466) 337 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:13:43.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:43 gibba023 bash[31815]: cephadm 2021-03-10T20:13:42.441664+0000 mgr.gibba044.wflcwh (mgr.34466) 338 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:13:43.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:43 gibba044 bash[25485]: cluster 2021-03-10T20:13:42.390176+0000 mon.a (mon.0) 618 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-03-10T20:13:43.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:43 gibba044 bash[25485]: audit 2021-03-10T20:13:42.427593+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd='[{"prefix": "osd require-osd-release", "release": "quincy"}]': finished 2021-03-10T20:13:43.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:43 gibba044 bash[25485]: cluster 2021-03-10T20:13:42.427646+0000 mon.a (mon.0) 620 : cluster [DBG] osdmap e100: 8 total, 7 up, 8 in 2021-03-10T20:13:43.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:43 gibba044 bash[25485]: audit 2021-03-10T20:13:42.432345+0000 mon.a (mon.0) 621 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:43.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:43 gibba044 bash[25485]: cephadm 2021-03-10T20:13:42.434299+0000 mgr.gibba044.wflcwh (mgr.34466) 334 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:13:43.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:43 gibba044 bash[25485]: cephadm 2021-03-10T20:13:42.436398+0000 mgr.gibba044.wflcwh (mgr.34466) 335 : cephadm [INF] Upgrade: Setting container_image for all mds 2021-03-10T20:13:43.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:43 gibba044 bash[25485]: audit 2021-03-10T20:13:42.437817+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:43.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:43 gibba044 bash[25485]: cephadm 2021-03-10T20:13:42.441477+0000 mgr.gibba044.wflcwh (mgr.34466) 336 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:13:43.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:43 gibba044 bash[25485]: cephadm 2021-03-10T20:13:42.441518+0000 mgr.gibba044.wflcwh (mgr.34466) 337 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:13:43.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:43 gibba044 bash[25485]: cephadm 2021-03-10T20:13:42.441664+0000 mgr.gibba044.wflcwh (mgr.34466) 338 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:13:44.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:44 gibba044 bash[25485]: cluster 2021-03-10T20:13:43.404233+0000 mgr.gibba044.wflcwh (mgr.34466) 339 : cluster [DBG] pgmap v170: 129 pgs: 26 active+undersized+degraded, 31 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 35/195 objects degraded (17.949%) 2021-03-10T20:13:44.498 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:13:44 gibba044 bash[30979]: debug 2021-03-10T20:13:44.206+0000 7f1b88fa8080 -1 bluestore(/var/lib/ceph/osd/ceph-7) fsck warning: store not yet converted to per-pg omap 2021-03-10T20:13:44.499 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:13:44 gibba044 bash[30979]: debug 2021-03-10T20:13:44.206+0000 7f1b72a6a700 -1 bluestore(/var/lib/ceph/osd/ceph-7) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2021-03-10T20:13:44.499 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:13:44 gibba044 bash[30979]: debug 2021-03-10T20:13:44.206+0000 7f1b72a6a700 -1 bluestore(/var/lib/ceph/osd/ceph-7) fsck warning: #1:e49187f3:::INTEL_SSDPEL1K375GA_PHKM913400CL375A:head# has omap that is not per-pg or pgmeta 2021-03-10T20:13:44.499 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:13:44 gibba044 bash[30979]: debug 2021-03-10T20:13:44.338+0000 7f1b88fa8080 -1 osd.7 97 log_to_monitors {default=true} 2021-03-10T20:13:44.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:44 gibba023 bash[30844]: cluster 2021-03-10T20:13:43.404233+0000 mgr.gibba044.wflcwh (mgr.34466) 339 : cluster [DBG] pgmap v170: 129 pgs: 26 active+undersized+degraded, 31 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 35/195 objects degraded (17.949%) 2021-03-10T20:13:44.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:44 gibba023 bash[31815]: cluster 2021-03-10T20:13:43.404233+0000 mgr.gibba044.wflcwh (mgr.34466) 339 : cluster [DBG] pgmap v170: 129 pgs: 26 active+undersized+degraded, 31 active+undersized, 72 active+clean; 7.0 KiB data, 48 MiB used, 671 GiB / 672 GiB avail; 35/195 objects degraded (17.949%) 2021-03-10T20:13:45.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:45 gibba023 bash[30844]: audit 2021-03-10T20:13:44.339912+0000 mon.a (mon.0) 623 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T20:13:45.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:45 gibba023 bash[30844]: audit 2021-03-10T20:13:44.342053+0000 mon.b (mon.2) 9 : audit [INF] from='osd.7 [v2:172.21.2.144:6824/539474994,v1:172.21.2.144:6825/539474994]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T20:13:45.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:45 gibba023 bash[31815]: audit 2021-03-10T20:13:44.339912+0000 mon.a (mon.0) 623 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T20:13:45.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:45 gibba023 bash[31815]: audit 2021-03-10T20:13:44.342053+0000 mon.b (mon.2) 9 : audit [INF] from='osd.7 [v2:172.21.2.144:6824/539474994,v1:172.21.2.144:6825/539474994]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T20:13:45.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:45 gibba044 bash[25485]: audit 2021-03-10T20:13:44.339912+0000 mon.a (mon.0) 623 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T20:13:45.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:45 gibba044 bash[25485]: audit 2021-03-10T20:13:44.342053+0000 mon.b (mon.2) 9 : audit [INF] from='osd.7 [v2:172.21.2.144:6824/539474994,v1:172.21.2.144:6825/539474994]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-03-10T20:13:45.749 INFO:journalctl@ceph.osd.7.gibba044.stdout:Mar 10 20:13:45 gibba044 bash[30979]: debug 2021-03-10T20:13:45.362+0000 7f1b78c85700 -1 osd.7 97 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-03-10T20:13:46.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:46 gibba023 bash[30844]: audit 2021-03-10T20:13:45.353732+0000 mon.a (mon.0) 624 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T20:13:46.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:46 gibba023 bash[30844]: cluster 2021-03-10T20:13:45.353779+0000 mon.a (mon.0) 625 : cluster [DBG] osdmap e101: 8 total, 7 up, 8 in 2021-03-10T20:13:46.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:46 gibba023 bash[30844]: audit 2021-03-10T20:13:45.354714+0000 mon.a (mon.0) 626 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:13:46.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:46 gibba023 bash[30844]: audit 2021-03-10T20:13:45.357252+0000 mon.b (mon.2) 10 : audit [INF] from='osd.7 [v2:172.21.2.144:6824/539474994,v1:172.21.2.144:6825/539474994]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:13:46.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:46 gibba023 bash[30844]: cluster 2021-03-10T20:13:45.404763+0000 mgr.gibba044.wflcwh (mgr.34466) 340 : cluster [DBG] pgmap v172: 129 pgs: 26 active+undersized+degraded, 31 active+undersized, 72 active+clean; 7.0 KiB data, 53 MiB used, 672 GiB / 672 GiB avail; 35/195 objects degraded (17.949%) 2021-03-10T20:13:46.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:46 gibba023 bash[30844]: cluster 2021-03-10T20:13:46.021868+0000 mon.a (mon.0) 627 : cluster [WRN] Health check update: Degraded data redundancy: 35/195 objects degraded (17.949%), 26 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:46.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:46 gibba023 bash[31815]: audit 2021-03-10T20:13:45.353732+0000 mon.a (mon.0) 624 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T20:13:46.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:46 gibba023 bash[31815]: cluster 2021-03-10T20:13:45.353779+0000 mon.a (mon.0) 625 : cluster [DBG] osdmap e101: 8 total, 7 up, 8 in 2021-03-10T20:13:46.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:46 gibba023 bash[31815]: audit 2021-03-10T20:13:45.354714+0000 mon.a (mon.0) 626 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:13:46.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:46 gibba023 bash[31815]: audit 2021-03-10T20:13:45.357252+0000 mon.b (mon.2) 10 : audit [INF] from='osd.7 [v2:172.21.2.144:6824/539474994,v1:172.21.2.144:6825/539474994]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:13:46.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:46 gibba023 bash[31815]: cluster 2021-03-10T20:13:45.404763+0000 mgr.gibba044.wflcwh (mgr.34466) 340 : cluster [DBG] pgmap v172: 129 pgs: 26 active+undersized+degraded, 31 active+undersized, 72 active+clean; 7.0 KiB data, 53 MiB used, 672 GiB / 672 GiB avail; 35/195 objects degraded (17.949%) 2021-03-10T20:13:46.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:46 gibba023 bash[31815]: cluster 2021-03-10T20:13:46.021868+0000 mon.a (mon.0) 627 : cluster [WRN] Health check update: Degraded data redundancy: 35/195 objects degraded (17.949%), 26 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:46.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:46 gibba044 bash[25485]: audit 2021-03-10T20:13:45.353732+0000 mon.a (mon.0) 624 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-03-10T20:13:46.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:46 gibba044 bash[25485]: cluster 2021-03-10T20:13:45.353779+0000 mon.a (mon.0) 625 : cluster [DBG] osdmap e101: 8 total, 7 up, 8 in 2021-03-10T20:13:46.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:46 gibba044 bash[25485]: audit 2021-03-10T20:13:45.354714+0000 mon.a (mon.0) 626 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:13:46.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:46 gibba044 bash[25485]: audit 2021-03-10T20:13:45.357252+0000 mon.b (mon.2) 10 : audit [INF] from='osd.7 [v2:172.21.2.144:6824/539474994,v1:172.21.2.144:6825/539474994]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0820, "args": ["host=gibba044", "root=default"]}]: dispatch 2021-03-10T20:13:46.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:46 gibba044 bash[25485]: cluster 2021-03-10T20:13:45.404763+0000 mgr.gibba044.wflcwh (mgr.34466) 340 : cluster [DBG] pgmap v172: 129 pgs: 26 active+undersized+degraded, 31 active+undersized, 72 active+clean; 7.0 KiB data, 53 MiB used, 672 GiB / 672 GiB avail; 35/195 objects degraded (17.949%) 2021-03-10T20:13:46.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:46 gibba044 bash[25485]: cluster 2021-03-10T20:13:46.021868+0000 mon.a (mon.0) 627 : cluster [WRN] Health check update: Degraded data redundancy: 35/195 objects degraded (17.949%), 26 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:47.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:47 gibba023 bash[30844]: cluster 2021-03-10T20:13:46.347647+0000 mon.a (mon.0) 628 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:13:47.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:47 gibba023 bash[30844]: cluster 2021-03-10T20:13:46.352455+0000 mon.a (mon.0) 629 : cluster [INF] osd.7 [v2:172.21.2.144:6824/539474994,v1:172.21.2.144:6825/539474994] boot 2021-03-10T20:13:47.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:47 gibba023 bash[30844]: cluster 2021-03-10T20:13:46.352494+0000 mon.a (mon.0) 630 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2021-03-10T20:13:47.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:47 gibba023 bash[30844]: audit 2021-03-10T20:13:46.352910+0000 mon.a (mon.0) 631 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:13:47.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:47 gibba023 bash[31815]: cluster 2021-03-10T20:13:46.347647+0000 mon.a (mon.0) 628 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:13:47.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:47 gibba023 bash[31815]: cluster 2021-03-10T20:13:46.352455+0000 mon.a (mon.0) 629 : cluster [INF] osd.7 [v2:172.21.2.144:6824/539474994,v1:172.21.2.144:6825/539474994] boot 2021-03-10T20:13:47.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:47 gibba023 bash[31815]: cluster 2021-03-10T20:13:46.352494+0000 mon.a (mon.0) 630 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2021-03-10T20:13:47.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:47 gibba023 bash[31815]: audit 2021-03-10T20:13:46.352910+0000 mon.a (mon.0) 631 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:13:47.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:47 gibba044 bash[25485]: cluster 2021-03-10T20:13:46.347647+0000 mon.a (mon.0) 628 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-03-10T20:13:47.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:47 gibba044 bash[25485]: cluster 2021-03-10T20:13:46.352455+0000 mon.a (mon.0) 629 : cluster [INF] osd.7 [v2:172.21.2.144:6824/539474994,v1:172.21.2.144:6825/539474994] boot 2021-03-10T20:13:47.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:47 gibba044 bash[25485]: cluster 2021-03-10T20:13:46.352494+0000 mon.a (mon.0) 630 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2021-03-10T20:13:47.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:47 gibba044 bash[25485]: audit 2021-03-10T20:13:46.352910+0000 mon.a (mon.0) 631 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-03-10T20:13:48.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:48 gibba023 bash[30844]: cluster 2021-03-10T20:13:47.377132+0000 mon.a (mon.0) 632 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2021-03-10T20:13:48.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:48 gibba023 bash[30844]: cluster 2021-03-10T20:13:47.405255+0000 mgr.gibba044.wflcwh (mgr.34466) 341 : cluster [DBG] pgmap v175: 129 pgs: 16 peering, 17 active+undersized+degraded, 24 active+undersized, 72 active+clean; 7.0 KiB data, 53 MiB used, 672 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:13:48.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:48 gibba023 bash[31815]: cluster 2021-03-10T20:13:47.377132+0000 mon.a (mon.0) 632 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2021-03-10T20:13:48.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:48 gibba023 bash[31815]: cluster 2021-03-10T20:13:47.405255+0000 mgr.gibba044.wflcwh (mgr.34466) 341 : cluster [DBG] pgmap v175: 129 pgs: 16 peering, 17 active+undersized+degraded, 24 active+undersized, 72 active+clean; 7.0 KiB data, 53 MiB used, 672 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:13:48.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:48 gibba044 bash[25485]: cluster 2021-03-10T20:13:47.377132+0000 mon.a (mon.0) 632 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2021-03-10T20:13:48.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:48 gibba044 bash[25485]: cluster 2021-03-10T20:13:47.405255+0000 mgr.gibba044.wflcwh (mgr.34466) 341 : cluster [DBG] pgmap v175: 129 pgs: 16 peering, 17 active+undersized+degraded, 24 active+undersized, 72 active+clean; 7.0 KiB data, 53 MiB used, 672 GiB / 672 GiB avail; 20/195 objects degraded (10.256%) 2021-03-10T20:13:50.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:50 gibba044 bash[25485]: cluster 2021-03-10T20:13:49.406695+0000 mgr.gibba044.wflcwh (mgr.34466) 342 : cluster [DBG] pgmap v176: 129 pgs: 16 peering, 11 active+undersized+degraded, 13 active+undersized, 89 active+clean; 7.0 KiB data, 53 MiB used, 672 GiB / 672 GiB avail; 13/195 objects degraded (6.667%) 2021-03-10T20:13:50.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:50 gibba023 bash[30844]: cluster 2021-03-10T20:13:49.406695+0000 mgr.gibba044.wflcwh (mgr.34466) 342 : cluster [DBG] pgmap v176: 129 pgs: 16 peering, 11 active+undersized+degraded, 13 active+undersized, 89 active+clean; 7.0 KiB data, 53 MiB used, 672 GiB / 672 GiB avail; 13/195 objects degraded (6.667%) 2021-03-10T20:13:50.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:50 gibba023 bash[31815]: cluster 2021-03-10T20:13:49.406695+0000 mgr.gibba044.wflcwh (mgr.34466) 342 : cluster [DBG] pgmap v176: 129 pgs: 16 peering, 11 active+undersized+degraded, 13 active+undersized, 89 active+clean; 7.0 KiB data, 53 MiB used, 672 GiB / 672 GiB avail; 13/195 objects degraded (6.667%) 2021-03-10T20:13:51.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:51 gibba044 bash[25485]: cluster 2021-03-10T20:13:51.024561+0000 mon.a (mon.0) 633 : cluster [WRN] Health check update: Degraded data redundancy: 13/195 objects degraded (6.667%), 11 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:51.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:51 gibba023 bash[30844]: cluster 2021-03-10T20:13:51.024561+0000 mon.a (mon.0) 633 : cluster [WRN] Health check update: Degraded data redundancy: 13/195 objects degraded (6.667%), 11 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:51.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:51 gibba023 bash[31815]: cluster 2021-03-10T20:13:51.024561+0000 mon.a (mon.0) 633 : cluster [WRN] Health check update: Degraded data redundancy: 13/195 objects degraded (6.667%), 11 pgs degraded (PG_DEGRADED) 2021-03-10T20:13:52.219 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:13:52.481 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:13:52.481 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (5m) 114s ago 10m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:13:52.481 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (10m) 11s ago 10m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:13:52.482 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (5m) 11s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:13:52.482 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (5m) 11s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:13:52.482 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (4m) 114s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:13:52.482 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (4m) 114s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:13:52.483 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (4m) 11s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:13:52.483 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (4m) 114s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:13:52.483 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (10m) 114s ago 10m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:13:52.483 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (10m) 11s ago 10m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:13:52.483 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (3m) 114s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:13:52.484 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (2m) 114s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:13:52.484 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (2m) 114s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:13:52.484 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (116s) 114s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:13:52.485 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (90s) 11s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:13:52.485 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (65s) 11s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:13:52.485 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (38s) 11s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:13:52.485 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (12s) 11s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:13:52.485 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (10m) 11s ago 10m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:13:52.486 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 114s ago 8m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:13:52.486 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 11s ago 8m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:13:52.740 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:13:52.740 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:13:52.740 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:13:52.741 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:13:52.741 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:13:52.741 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:13:52.741 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:13:52.741 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:13:52.742 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:13:52.742 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:13:52.742 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:13:52.742 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:13:52.743 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:13:52.743 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:13:52.743 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:13:52.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:52 gibba044 bash[25485]: cluster 2021-03-10T20:13:51.408113+0000 mgr.gibba044.wflcwh (mgr.34466) 343 : cluster [DBG] pgmap v177: 129 pgs: 17 active+clean+wait, 16 peering, 96 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:13:52.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:52 gibba044 bash[25485]: cluster 2021-03-10T20:13:52.029757+0000 mon.a (mon.0) 634 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/195 objects degraded (6.667%), 11 pgs degraded) 2021-03-10T20:13:52.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:52 gibba023 bash[30844]: cluster 2021-03-10T20:13:51.408113+0000 mgr.gibba044.wflcwh (mgr.34466) 343 : cluster [DBG] pgmap v177: 129 pgs: 17 active+clean+wait, 16 peering, 96 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:13:52.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:52 gibba023 bash[30844]: cluster 2021-03-10T20:13:52.029757+0000 mon.a (mon.0) 634 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/195 objects degraded (6.667%), 11 pgs degraded) 2021-03-10T20:13:52.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:52 gibba023 bash[31815]: cluster 2021-03-10T20:13:51.408113+0000 mgr.gibba044.wflcwh (mgr.34466) 343 : cluster [DBG] pgmap v177: 129 pgs: 17 active+clean+wait, 16 peering, 96 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:13:52.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:52 gibba023 bash[31815]: cluster 2021-03-10T20:13:52.029757+0000 mon.a (mon.0) 634 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/195 objects degraded (6.667%), 11 pgs degraded) 2021-03-10T20:13:53.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:53 gibba044 bash[25485]: audit 2021-03-10T20:13:52.213433+0000 mgr.gibba044.wflcwh (mgr.34466) 344 : audit [DBG] from='client.44292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:13:53.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:53 gibba044 bash[25485]: audit 2021-03-10T20:13:52.442087+0000 mgr.gibba044.wflcwh (mgr.34466) 345 : audit [DBG] from='client.44298 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:13:53.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:53 gibba044 bash[25485]: audit 2021-03-10T20:13:52.740355+0000 mon.a (mon.0) 635 : audit [DBG] from='client.? 172.21.2.123:0/3149386365' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:53.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:53 gibba023 bash[30844]: audit 2021-03-10T20:13:52.213433+0000 mgr.gibba044.wflcwh (mgr.34466) 344 : audit [DBG] from='client.44292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:13:53.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:53 gibba023 bash[30844]: audit 2021-03-10T20:13:52.442087+0000 mgr.gibba044.wflcwh (mgr.34466) 345 : audit [DBG] from='client.44298 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:13:53.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:53 gibba023 bash[30844]: audit 2021-03-10T20:13:52.740355+0000 mon.a (mon.0) 635 : audit [DBG] from='client.? 172.21.2.123:0/3149386365' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:53.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:53 gibba023 bash[31815]: audit 2021-03-10T20:13:52.213433+0000 mgr.gibba044.wflcwh (mgr.34466) 344 : audit [DBG] from='client.44292 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:13:53.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:53 gibba023 bash[31815]: audit 2021-03-10T20:13:52.442087+0000 mgr.gibba044.wflcwh (mgr.34466) 345 : audit [DBG] from='client.44298 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:13:53.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:53 gibba023 bash[31815]: audit 2021-03-10T20:13:52.740355+0000 mon.a (mon.0) 635 : audit [DBG] from='client.? 172.21.2.123:0/3149386365' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:13:54.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:54 gibba044 bash[25485]: cluster 2021-03-10T20:13:53.409600+0000 mgr.gibba044.wflcwh (mgr.34466) 346 : cluster [DBG] pgmap v178: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:13:54.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:54 gibba023 bash[30844]: cluster 2021-03-10T20:13:53.409600+0000 mgr.gibba044.wflcwh (mgr.34466) 346 : cluster [DBG] pgmap v178: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:13:54.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:54 gibba023 bash[31815]: cluster 2021-03-10T20:13:53.409600+0000 mgr.gibba044.wflcwh (mgr.34466) 346 : cluster [DBG] pgmap v178: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:13:55.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:55 gibba023 bash[30844]: cluster 2021-03-10T20:13:55.410234+0000 mgr.gibba044.wflcwh (mgr.34466) 347 : cluster [DBG] pgmap v179: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:13:55.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:55 gibba023 bash[31815]: cluster 2021-03-10T20:13:55.410234+0000 mgr.gibba044.wflcwh (mgr.34466) 347 : cluster [DBG] pgmap v179: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:13:55.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:55 gibba044 bash[25485]: cluster 2021-03-10T20:13:55.410234+0000 mgr.gibba044.wflcwh (mgr.34466) 347 : cluster [DBG] pgmap v179: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:13:58.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:58 gibba023 bash[30844]: audit 2021-03-10T20:13:57.162486+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:58.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:58 gibba023 bash[30844]: cluster 2021-03-10T20:13:57.411710+0000 mgr.gibba044.wflcwh (mgr.34466) 348 : cluster [DBG] pgmap v180: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:13:58.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:13:58 gibba023 bash[30844]: cephadm 2021-03-10T20:13:57.457460+0000 mgr.gibba044.wflcwh (mgr.34466) 349 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:13:58.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:58 gibba023 bash[31815]: audit 2021-03-10T20:13:57.162486+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:58.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:58 gibba023 bash[31815]: cluster 2021-03-10T20:13:57.411710+0000 mgr.gibba044.wflcwh (mgr.34466) 348 : cluster [DBG] pgmap v180: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:13:58.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:13:58 gibba023 bash[31815]: cephadm 2021-03-10T20:13:57.457460+0000 mgr.gibba044.wflcwh (mgr.34466) 349 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:13:58.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:58 gibba044 bash[25485]: audit 2021-03-10T20:13:57.162486+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:13:58.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:58 gibba044 bash[25485]: cluster 2021-03-10T20:13:57.411710+0000 mgr.gibba044.wflcwh (mgr.34466) 348 : cluster [DBG] pgmap v180: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:13:58.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:13:58 gibba044 bash[25485]: cephadm 2021-03-10T20:13:57.457460+0000 mgr.gibba044.wflcwh (mgr.34466) 349 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:14:00.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:00 gibba044 bash[25485]: cluster 2021-03-10T20:13:59.413083+0000 mgr.gibba044.wflcwh (mgr.34466) 350 : cluster [DBG] pgmap v181: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:00.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:00 gibba023 bash[30844]: cluster 2021-03-10T20:13:59.413083+0000 mgr.gibba044.wflcwh (mgr.34466) 350 : cluster [DBG] pgmap v181: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:00.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:00 gibba023 bash[31815]: cluster 2021-03-10T20:13:59.413083+0000 mgr.gibba044.wflcwh (mgr.34466) 350 : cluster [DBG] pgmap v181: 129 pgs: 17 active+clean+wait, 112 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:02.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:02 gibba023 bash[30844]: cluster 2021-03-10T20:14:01.414510+0000 mgr.gibba044.wflcwh (mgr.34466) 351 : cluster [DBG] pgmap v182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:02.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:02 gibba023 bash[31815]: cluster 2021-03-10T20:14:01.414510+0000 mgr.gibba044.wflcwh (mgr.34466) 351 : cluster [DBG] pgmap v182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:02.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:02 gibba044 bash[25485]: cluster 2021-03-10T20:14:01.414510+0000 mgr.gibba044.wflcwh (mgr.34466) 351 : cluster [DBG] pgmap v182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:04.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:04 gibba044 bash[25485]: cluster 2021-03-10T20:14:03.415098+0000 mgr.gibba044.wflcwh (mgr.34466) 352 : cluster [DBG] pgmap v183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:04.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:04 gibba023 bash[30844]: cluster 2021-03-10T20:14:03.415098+0000 mgr.gibba044.wflcwh (mgr.34466) 352 : cluster [DBG] pgmap v183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:04.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:04 gibba023 bash[31815]: cluster 2021-03-10T20:14:03.415098+0000 mgr.gibba044.wflcwh (mgr.34466) 352 : cluster [DBG] pgmap v183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:06.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:06 gibba044 bash[25485]: cluster 2021-03-10T20:14:05.416438+0000 mgr.gibba044.wflcwh (mgr.34466) 353 : cluster [DBG] pgmap v184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:06.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:06 gibba023 bash[30844]: cluster 2021-03-10T20:14:05.416438+0000 mgr.gibba044.wflcwh (mgr.34466) 353 : cluster [DBG] pgmap v184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:06.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:06 gibba023 bash[31815]: cluster 2021-03-10T20:14:05.416438+0000 mgr.gibba044.wflcwh (mgr.34466) 353 : cluster [DBG] pgmap v184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:08.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:08 gibba044 bash[25485]: cluster 2021-03-10T20:14:07.417872+0000 mgr.gibba044.wflcwh (mgr.34466) 354 : cluster [DBG] pgmap v185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:08.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:08 gibba023 bash[30844]: cluster 2021-03-10T20:14:07.417872+0000 mgr.gibba044.wflcwh (mgr.34466) 354 : cluster [DBG] pgmap v185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:08.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:08 gibba023 bash[31815]: cluster 2021-03-10T20:14:07.417872+0000 mgr.gibba044.wflcwh (mgr.34466) 354 : cluster [DBG] pgmap v185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:09.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:09 gibba023 bash[30844]: cluster 2021-03-10T20:14:09.419230+0000 mgr.gibba044.wflcwh (mgr.34466) 355 : cluster [DBG] pgmap v186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:09.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:09 gibba023 bash[31815]: cluster 2021-03-10T20:14:09.419230+0000 mgr.gibba044.wflcwh (mgr.34466) 355 : cluster [DBG] pgmap v186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:09.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:09 gibba044 bash[25485]: cluster 2021-03-10T20:14:09.419230+0000 mgr.gibba044.wflcwh (mgr.34466) 355 : cluster [DBG] pgmap v186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:12.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:12 gibba023 bash[30844]: cluster 2021-03-10T20:14:11.419813+0000 mgr.gibba044.wflcwh (mgr.34466) 356 : cluster [DBG] pgmap v187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:12.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:12 gibba023 bash[31815]: cluster 2021-03-10T20:14:11.419813+0000 mgr.gibba044.wflcwh (mgr.34466) 356 : cluster [DBG] pgmap v187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:12.470 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:12 gibba044 bash[25485]: cluster 2021-03-10T20:14:11.419813+0000 mgr.gibba044.wflcwh (mgr.34466) 356 : cluster [DBG] pgmap v187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:13.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:13 gibba023 bash[30844]: cephadm 2021-03-10T20:14:12.473362+0000 mgr.gibba044.wflcwh (mgr.34466) 357 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:14:13.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:13 gibba023 bash[31815]: cephadm 2021-03-10T20:14:12.473362+0000 mgr.gibba044.wflcwh (mgr.34466) 357 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:14:13.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:13 gibba044 bash[25485]: cephadm 2021-03-10T20:14:12.473362+0000 mgr.gibba044.wflcwh (mgr.34466) 357 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:14:14.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:14 gibba023 bash[30844]: cluster 2021-03-10T20:14:13.421101+0000 mgr.gibba044.wflcwh (mgr.34466) 358 : cluster [DBG] pgmap v188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:14.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:14 gibba023 bash[31815]: cluster 2021-03-10T20:14:13.421101+0000 mgr.gibba044.wflcwh (mgr.34466) 358 : cluster [DBG] pgmap v188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:14.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:14 gibba044 bash[25485]: cluster 2021-03-10T20:14:13.421101+0000 mgr.gibba044.wflcwh (mgr.34466) 358 : cluster [DBG] pgmap v188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:16.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:16 gibba044 bash[25485]: cluster 2021-03-10T20:14:15.422639+0000 mgr.gibba044.wflcwh (mgr.34466) 359 : cluster [DBG] pgmap v189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:16.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:16 gibba023 bash[30844]: cluster 2021-03-10T20:14:15.422639+0000 mgr.gibba044.wflcwh (mgr.34466) 359 : cluster [DBG] pgmap v189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:16.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:16 gibba023 bash[31815]: cluster 2021-03-10T20:14:15.422639+0000 mgr.gibba044.wflcwh (mgr.34466) 359 : cluster [DBG] pgmap v189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:18.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:18 gibba044 bash[25485]: cluster 2021-03-10T20:14:17.424362+0000 mgr.gibba044.wflcwh (mgr.34466) 360 : cluster [DBG] pgmap v190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:18.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:18 gibba023 bash[30844]: cluster 2021-03-10T20:14:17.424362+0000 mgr.gibba044.wflcwh (mgr.34466) 360 : cluster [DBG] pgmap v190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:18.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:18 gibba023 bash[31815]: cluster 2021-03-10T20:14:17.424362+0000 mgr.gibba044.wflcwh (mgr.34466) 360 : cluster [DBG] pgmap v190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:20.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:20 gibba023 bash[30844]: cluster 2021-03-10T20:14:19.425120+0000 mgr.gibba044.wflcwh (mgr.34466) 361 : cluster [DBG] pgmap v191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:20.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:20 gibba023 bash[31815]: cluster 2021-03-10T20:14:19.425120+0000 mgr.gibba044.wflcwh (mgr.34466) 361 : cluster [DBG] pgmap v191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:20.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:20 gibba044 bash[25485]: cluster 2021-03-10T20:14:19.425120+0000 mgr.gibba044.wflcwh (mgr.34466) 361 : cluster [DBG] pgmap v191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:22.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:22 gibba023 bash[30844]: cluster 2021-03-10T20:14:21.426430+0000 mgr.gibba044.wflcwh (mgr.34466) 362 : cluster [DBG] pgmap v192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:22.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:22 gibba023 bash[31815]: cluster 2021-03-10T20:14:21.426430+0000 mgr.gibba044.wflcwh (mgr.34466) 362 : cluster [DBG] pgmap v192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:22.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:22 gibba044 bash[25485]: cluster 2021-03-10T20:14:21.426430+0000 mgr.gibba044.wflcwh (mgr.34466) 362 : cluster [DBG] pgmap v192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:22.980 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:14:23.207 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:14:23.208 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (5m) 2m ago 11m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:14:23.208 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (10m) 41s ago 10m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:14:23.208 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (5m) 41s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:14:23.208 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (6m) 41s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:14:23.208 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (5m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:14:23.209 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (5m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:14:23.209 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (4m) 41s ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:14:23.209 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (4m) 2m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:14:23.209 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (11m) 2m ago 11m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:14:23.210 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (11m) 41s ago 11m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:14:23.210 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (3m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:14:23.210 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (3m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:14:23.210 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (2m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:14:23.210 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (2m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:14:23.211 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (2m) 41s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:14:23.211 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (96s) 41s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:14:23.211 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (69s) 41s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:14:23.211 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (43s) 41s ago 11m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:14:23.211 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (10m) 41s ago 11m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:14:23.212 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 2m ago 8m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:14:23.212 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 41s ago 9m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:14:23.456 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:14:23.456 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:14:23.457 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:14:23.457 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:14:23.457 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:14:23.457 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:14:23.457 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:14:23.458 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:14:23.458 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:14:23.458 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:14:23.458 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:14:23.459 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:14:23.459 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:14:23.459 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:14:23.459 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:14:23.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:23 gibba023 bash[31815]: audit 2021-03-10T20:14:22.975818+0000 mgr.gibba044.wflcwh (mgr.34466) 363 : audit [DBG] from='client.54289 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:14:23.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:23 gibba023 bash[31815]: audit 2021-03-10T20:14:23.200413+0000 mgr.gibba044.wflcwh (mgr.34466) 364 : audit [DBG] from='client.44316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:14:23.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:23 gibba023 bash[31815]: cluster 2021-03-10T20:14:23.427969+0000 mgr.gibba044.wflcwh (mgr.34466) 365 : cluster [DBG] pgmap v193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:23.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:23 gibba023 bash[31815]: audit 2021-03-10T20:14:23.456911+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.2.123:0/1655824480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:23.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:23 gibba023 bash[30844]: audit 2021-03-10T20:14:22.975818+0000 mgr.gibba044.wflcwh (mgr.34466) 363 : audit [DBG] from='client.54289 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:14:23.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:23 gibba023 bash[30844]: audit 2021-03-10T20:14:23.200413+0000 mgr.gibba044.wflcwh (mgr.34466) 364 : audit [DBG] from='client.44316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:14:23.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:23 gibba023 bash[30844]: cluster 2021-03-10T20:14:23.427969+0000 mgr.gibba044.wflcwh (mgr.34466) 365 : cluster [DBG] pgmap v193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:23.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:23 gibba023 bash[30844]: audit 2021-03-10T20:14:23.456911+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.2.123:0/1655824480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:23.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:23 gibba044 bash[25485]: audit 2021-03-10T20:14:22.975818+0000 mgr.gibba044.wflcwh (mgr.34466) 363 : audit [DBG] from='client.54289 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:14:23.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:23 gibba044 bash[25485]: audit 2021-03-10T20:14:23.200413+0000 mgr.gibba044.wflcwh (mgr.34466) 364 : audit [DBG] from='client.44316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:14:23.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:23 gibba044 bash[25485]: cluster 2021-03-10T20:14:23.427969+0000 mgr.gibba044.wflcwh (mgr.34466) 365 : cluster [DBG] pgmap v193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:23.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:23 gibba044 bash[25485]: audit 2021-03-10T20:14:23.456911+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.2.123:0/1655824480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:26.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:26 gibba044 bash[25485]: cluster 2021-03-10T20:14:25.429699+0000 mgr.gibba044.wflcwh (mgr.34466) 366 : cluster [DBG] pgmap v194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:26.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:26 gibba023 bash[30844]: cluster 2021-03-10T20:14:25.429699+0000 mgr.gibba044.wflcwh (mgr.34466) 366 : cluster [DBG] pgmap v194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:26.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:26 gibba023 bash[31815]: cluster 2021-03-10T20:14:25.429699+0000 mgr.gibba044.wflcwh (mgr.34466) 366 : cluster [DBG] pgmap v194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:27.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:27 gibba044 bash[25485]: audit 2021-03-10T20:14:26.973103+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:14:27.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:27 gibba044 bash[25485]: audit 2021-03-10T20:14:26.973954+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:14:27.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:27 gibba044 bash[25485]: audit 2021-03-10T20:14:26.974758+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T20:14:27.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:27 gibba044 bash[25485]: audit 2021-03-10T20:14:26.975595+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:14:27.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:27 gibba044 bash[25485]: audit 2021-03-10T20:14:27.079064+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:14:27.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:27 gibba044 bash[25485]: audit 2021-03-10T20:14:27.085151+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:14:27.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:27 gibba023 bash[30844]: audit 2021-03-10T20:14:26.973103+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:14:27.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:27 gibba023 bash[30844]: audit 2021-03-10T20:14:26.973954+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:14:27.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:27 gibba023 bash[30844]: audit 2021-03-10T20:14:26.974758+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T20:14:27.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:27 gibba023 bash[30844]: audit 2021-03-10T20:14:26.975595+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:14:27.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:27 gibba023 bash[30844]: audit 2021-03-10T20:14:27.079064+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:14:27.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:27 gibba023 bash[30844]: audit 2021-03-10T20:14:27.085151+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:14:27.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:27 gibba023 bash[31815]: audit 2021-03-10T20:14:26.973103+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:14:27.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:27 gibba023 bash[31815]: audit 2021-03-10T20:14:26.973954+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:14:27.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:27 gibba023 bash[31815]: audit 2021-03-10T20:14:26.974758+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T20:14:27.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:27 gibba023 bash[31815]: audit 2021-03-10T20:14:26.975595+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:14:27.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:27 gibba023 bash[31815]: audit 2021-03-10T20:14:27.079064+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:14:27.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:27 gibba023 bash[31815]: audit 2021-03-10T20:14:27.085151+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:14:28.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:28 gibba023 bash[30844]: cluster 2021-03-10T20:14:27.430391+0000 mgr.gibba044.wflcwh (mgr.34466) 367 : cluster [DBG] pgmap v195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:28.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:28 gibba023 bash[30844]: cephadm 2021-03-10T20:14:27.482388+0000 mgr.gibba044.wflcwh (mgr.34466) 368 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:14:28.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:28 gibba023 bash[31815]: cluster 2021-03-10T20:14:27.430391+0000 mgr.gibba044.wflcwh (mgr.34466) 367 : cluster [DBG] pgmap v195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:28.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:28 gibba023 bash[31815]: cephadm 2021-03-10T20:14:27.482388+0000 mgr.gibba044.wflcwh (mgr.34466) 368 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:14:28.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:28 gibba044 bash[25485]: cluster 2021-03-10T20:14:27.430391+0000 mgr.gibba044.wflcwh (mgr.34466) 367 : cluster [DBG] pgmap v195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:28.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:28 gibba044 bash[25485]: cephadm 2021-03-10T20:14:27.482388+0000 mgr.gibba044.wflcwh (mgr.34466) 368 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:14:29.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:29 gibba023 bash[30844]: cluster 2021-03-10T20:14:29.431874+0000 mgr.gibba044.wflcwh (mgr.34466) 369 : cluster [DBG] pgmap v196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:29.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:29 gibba023 bash[31815]: cluster 2021-03-10T20:14:29.431874+0000 mgr.gibba044.wflcwh (mgr.34466) 369 : cluster [DBG] pgmap v196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:29.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:29 gibba044 bash[25485]: cluster 2021-03-10T20:14:29.431874+0000 mgr.gibba044.wflcwh (mgr.34466) 369 : cluster [DBG] pgmap v196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:32.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:32 gibba023 bash[30844]: cluster 2021-03-10T20:14:31.433187+0000 mgr.gibba044.wflcwh (mgr.34466) 370 : cluster [DBG] pgmap v197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:32.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:32 gibba023 bash[31815]: cluster 2021-03-10T20:14:31.433187+0000 mgr.gibba044.wflcwh (mgr.34466) 370 : cluster [DBG] pgmap v197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:32.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:32 gibba044 bash[25485]: cluster 2021-03-10T20:14:31.433187+0000 mgr.gibba044.wflcwh (mgr.34466) 370 : cluster [DBG] pgmap v197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:34.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:34 gibba044 bash[25485]: cluster 2021-03-10T20:14:33.434742+0000 mgr.gibba044.wflcwh (mgr.34466) 371 : cluster [DBG] pgmap v198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:34.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:34 gibba023 bash[30844]: cluster 2021-03-10T20:14:33.434742+0000 mgr.gibba044.wflcwh (mgr.34466) 371 : cluster [DBG] pgmap v198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:34.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:34 gibba023 bash[31815]: cluster 2021-03-10T20:14:33.434742+0000 mgr.gibba044.wflcwh (mgr.34466) 371 : cluster [DBG] pgmap v198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:36.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:36 gibba023 bash[30844]: cluster 2021-03-10T20:14:35.435855+0000 mgr.gibba044.wflcwh (mgr.34466) 372 : cluster [DBG] pgmap v199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:36.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:36 gibba023 bash[31815]: cluster 2021-03-10T20:14:35.435855+0000 mgr.gibba044.wflcwh (mgr.34466) 372 : cluster [DBG] pgmap v199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:36.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:36 gibba044 bash[25485]: cluster 2021-03-10T20:14:35.435855+0000 mgr.gibba044.wflcwh (mgr.34466) 372 : cluster [DBG] pgmap v199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:37.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:37 gibba023 bash[30844]: cluster 2021-03-10T20:14:37.437043+0000 mgr.gibba044.wflcwh (mgr.34466) 373 : cluster [DBG] pgmap v200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:37.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:37 gibba023 bash[31815]: cluster 2021-03-10T20:14:37.437043+0000 mgr.gibba044.wflcwh (mgr.34466) 373 : cluster [DBG] pgmap v200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:37.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:37 gibba044 bash[25485]: cluster 2021-03-10T20:14:37.437043+0000 mgr.gibba044.wflcwh (mgr.34466) 373 : cluster [DBG] pgmap v200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:40.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:40 gibba023 bash[30844]: cluster 2021-03-10T20:14:39.438631+0000 mgr.gibba044.wflcwh (mgr.34466) 374 : cluster [DBG] pgmap v201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:40.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:40 gibba023 bash[31815]: cluster 2021-03-10T20:14:39.438631+0000 mgr.gibba044.wflcwh (mgr.34466) 374 : cluster [DBG] pgmap v201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:40.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:40 gibba044 bash[25485]: cluster 2021-03-10T20:14:39.438631+0000 mgr.gibba044.wflcwh (mgr.34466) 374 : cluster [DBG] pgmap v201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:42.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:42 gibba023 bash[30844]: cluster 2021-03-10T20:14:41.440272+0000 mgr.gibba044.wflcwh (mgr.34466) 375 : cluster [DBG] pgmap v202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:42.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:42 gibba023 bash[31815]: cluster 2021-03-10T20:14:41.440272+0000 mgr.gibba044.wflcwh (mgr.34466) 375 : cluster [DBG] pgmap v202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:42.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:42 gibba044 bash[25485]: cluster 2021-03-10T20:14:41.440272+0000 mgr.gibba044.wflcwh (mgr.34466) 375 : cluster [DBG] pgmap v202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:43.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:43 gibba023 bash[30844]: cephadm 2021-03-10T20:14:42.499043+0000 mgr.gibba044.wflcwh (mgr.34466) 376 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:14:43.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:43 gibba023 bash[30844]: cephadm 2021-03-10T20:14:42.500734+0000 mgr.gibba044.wflcwh (mgr.34466) 377 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:14:43.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:43 gibba023 bash[30844]: audit 2021-03-10T20:14:42.699846+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:14:43.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:43 gibba023 bash[30844]: audit 2021-03-10T20:14:42.703376+0000 mon.a (mon.0) 644 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:14:43.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:43 gibba023 bash[30844]: audit 2021-03-10T20:14:42.705107+0000 mon.a (mon.0) 645 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:43.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:43 gibba023 bash[30844]: audit 2021-03-10T20:14:42.706459+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:43.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:43 gibba023 bash[30844]: audit 2021-03-10T20:14:42.707512+0000 mon.a (mon.0) 647 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:43.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:43 gibba023 bash[30844]: audit 2021-03-10T20:14:42.709731+0000 mon.a (mon.0) 648 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:43.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:43 gibba023 bash[30844]: audit 2021-03-10T20:14:42.710935+0000 mon.a (mon.0) 649 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:43.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:43 gibba023 bash[31815]: cephadm 2021-03-10T20:14:42.499043+0000 mgr.gibba044.wflcwh (mgr.34466) 376 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:14:43.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:43 gibba023 bash[31815]: cephadm 2021-03-10T20:14:42.500734+0000 mgr.gibba044.wflcwh (mgr.34466) 377 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:14:43.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:43 gibba023 bash[31815]: audit 2021-03-10T20:14:42.699846+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:14:43.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:43 gibba023 bash[31815]: audit 2021-03-10T20:14:42.703376+0000 mon.a (mon.0) 644 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:14:43.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:43 gibba023 bash[31815]: audit 2021-03-10T20:14:42.705107+0000 mon.a (mon.0) 645 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:43.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:43 gibba023 bash[31815]: audit 2021-03-10T20:14:42.706459+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:43.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:43 gibba023 bash[31815]: audit 2021-03-10T20:14:42.707512+0000 mon.a (mon.0) 647 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:43.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:43 gibba023 bash[31815]: audit 2021-03-10T20:14:42.709731+0000 mon.a (mon.0) 648 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:43.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:43 gibba023 bash[31815]: audit 2021-03-10T20:14:42.710935+0000 mon.a (mon.0) 649 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:43.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:43 gibba044 bash[25485]: cephadm 2021-03-10T20:14:42.499043+0000 mgr.gibba044.wflcwh (mgr.34466) 376 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:14:43.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:43 gibba044 bash[25485]: cephadm 2021-03-10T20:14:42.500734+0000 mgr.gibba044.wflcwh (mgr.34466) 377 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:14:43.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:43 gibba044 bash[25485]: audit 2021-03-10T20:14:42.699846+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:14:43.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:43 gibba044 bash[25485]: audit 2021-03-10T20:14:42.703376+0000 mon.a (mon.0) 644 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:14:43.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:43 gibba044 bash[25485]: audit 2021-03-10T20:14:42.705107+0000 mon.a (mon.0) 645 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:43.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:43 gibba044 bash[25485]: audit 2021-03-10T20:14:42.706459+0000 mon.a (mon.0) 646 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:43.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:43 gibba044 bash[25485]: audit 2021-03-10T20:14:42.707512+0000 mon.a (mon.0) 647 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:43.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:43 gibba044 bash[25485]: audit 2021-03-10T20:14:42.709731+0000 mon.a (mon.0) 648 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:43.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:43 gibba044 bash[25485]: audit 2021-03-10T20:14:42.710935+0000 mon.a (mon.0) 649 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:44.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[30844]: cephadm 2021-03-10T20:14:42.705498+0000 mgr.gibba044.wflcwh (mgr.34466) 378 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:14:44.515 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[30844]: cephadm 2021-03-10T20:14:42.707623+0000 mgr.gibba044.wflcwh (mgr.34466) 379 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:14:44.515 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[30844]: cephadm 2021-03-10T20:14:42.709029+0000 mgr.gibba044.wflcwh (mgr.34466) 380 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:14:44.515 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[30844]: cephadm 2021-03-10T20:14:42.709092+0000 mgr.gibba044.wflcwh (mgr.34466) 381 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:14:44.516 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[30844]: cephadm 2021-03-10T20:14:42.710223+0000 mgr.gibba044.wflcwh (mgr.34466) 382 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:14:44.516 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[30844]: cephadm 2021-03-10T20:14:42.710261+0000 mgr.gibba044.wflcwh (mgr.34466) 383 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:14:44.516 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[30844]: cephadm 2021-03-10T20:14:42.711252+0000 mgr.gibba044.wflcwh (mgr.34466) 384 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:14:44.516 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[30844]: cephadm 2021-03-10T20:14:42.712256+0000 mgr.gibba044.wflcwh (mgr.34466) 385 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:14:44.516 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[30844]: cephadm 2021-03-10T20:14:42.712344+0000 mgr.gibba044.wflcwh (mgr.34466) 386 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:14:44.517 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[30844]: cephadm 2021-03-10T20:14:42.713373+0000 mgr.gibba044.wflcwh (mgr.34466) 387 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:14:44.517 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[30844]: cephadm 2021-03-10T20:14:42.713684+0000 mgr.gibba044.wflcwh (mgr.34466) 388 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:14:44.517 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[30844]: cephadm 2021-03-10T20:14:42.714670+0000 mgr.gibba044.wflcwh (mgr.34466) 389 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:14:44.517 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[30844]: cephadm 2021-03-10T20:14:42.714709+0000 mgr.gibba044.wflcwh (mgr.34466) 390 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:14:44.518 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[30844]: cephadm 2021-03-10T20:14:42.714836+0000 mgr.gibba044.wflcwh (mgr.34466) 391 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:14:44.518 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[30844]: cluster 2021-03-10T20:14:43.441678+0000 mgr.gibba044.wflcwh (mgr.34466) 392 : cluster [DBG] pgmap v203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:44.518 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[31815]: cephadm 2021-03-10T20:14:42.705498+0000 mgr.gibba044.wflcwh (mgr.34466) 378 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:14:44.519 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[31815]: cephadm 2021-03-10T20:14:42.707623+0000 mgr.gibba044.wflcwh (mgr.34466) 379 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:14:44.519 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[31815]: cephadm 2021-03-10T20:14:42.709029+0000 mgr.gibba044.wflcwh (mgr.34466) 380 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:14:44.519 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[31815]: cephadm 2021-03-10T20:14:42.709092+0000 mgr.gibba044.wflcwh (mgr.34466) 381 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:14:44.519 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[31815]: cephadm 2021-03-10T20:14:42.710223+0000 mgr.gibba044.wflcwh (mgr.34466) 382 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:14:44.519 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[31815]: cephadm 2021-03-10T20:14:42.710261+0000 mgr.gibba044.wflcwh (mgr.34466) 383 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:14:44.520 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[31815]: cephadm 2021-03-10T20:14:42.711252+0000 mgr.gibba044.wflcwh (mgr.34466) 384 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:14:44.520 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[31815]: cephadm 2021-03-10T20:14:42.712256+0000 mgr.gibba044.wflcwh (mgr.34466) 385 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:14:44.520 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[31815]: cephadm 2021-03-10T20:14:42.712344+0000 mgr.gibba044.wflcwh (mgr.34466) 386 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:14:44.521 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[31815]: cephadm 2021-03-10T20:14:42.713373+0000 mgr.gibba044.wflcwh (mgr.34466) 387 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:14:44.521 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[31815]: cephadm 2021-03-10T20:14:42.713684+0000 mgr.gibba044.wflcwh (mgr.34466) 388 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:14:44.521 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[31815]: cephadm 2021-03-10T20:14:42.714670+0000 mgr.gibba044.wflcwh (mgr.34466) 389 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:14:44.521 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[31815]: cephadm 2021-03-10T20:14:42.714709+0000 mgr.gibba044.wflcwh (mgr.34466) 390 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:14:44.521 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[31815]: cephadm 2021-03-10T20:14:42.714836+0000 mgr.gibba044.wflcwh (mgr.34466) 391 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:14:44.522 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:44 gibba023 bash[31815]: cluster 2021-03-10T20:14:43.441678+0000 mgr.gibba044.wflcwh (mgr.34466) 392 : cluster [DBG] pgmap v203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:44.523 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:44 gibba044 bash[25485]: cephadm 2021-03-10T20:14:42.705498+0000 mgr.gibba044.wflcwh (mgr.34466) 378 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:14:44.523 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:44 gibba044 bash[25485]: cephadm 2021-03-10T20:14:42.707623+0000 mgr.gibba044.wflcwh (mgr.34466) 379 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:14:44.523 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:44 gibba044 bash[25485]: cephadm 2021-03-10T20:14:42.709029+0000 mgr.gibba044.wflcwh (mgr.34466) 380 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:14:44.523 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:44 gibba044 bash[25485]: cephadm 2021-03-10T20:14:42.709092+0000 mgr.gibba044.wflcwh (mgr.34466) 381 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:14:44.523 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:44 gibba044 bash[25485]: cephadm 2021-03-10T20:14:42.710223+0000 mgr.gibba044.wflcwh (mgr.34466) 382 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:14:44.524 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:44 gibba044 bash[25485]: cephadm 2021-03-10T20:14:42.710261+0000 mgr.gibba044.wflcwh (mgr.34466) 383 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:14:44.524 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:44 gibba044 bash[25485]: cephadm 2021-03-10T20:14:42.711252+0000 mgr.gibba044.wflcwh (mgr.34466) 384 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:14:44.524 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:44 gibba044 bash[25485]: cephadm 2021-03-10T20:14:42.712256+0000 mgr.gibba044.wflcwh (mgr.34466) 385 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:14:44.524 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:44 gibba044 bash[25485]: cephadm 2021-03-10T20:14:42.712344+0000 mgr.gibba044.wflcwh (mgr.34466) 386 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:14:44.525 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:44 gibba044 bash[25485]: cephadm 2021-03-10T20:14:42.713373+0000 mgr.gibba044.wflcwh (mgr.34466) 387 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:14:44.525 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:44 gibba044 bash[25485]: cephadm 2021-03-10T20:14:42.713684+0000 mgr.gibba044.wflcwh (mgr.34466) 388 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:14:44.525 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:44 gibba044 bash[25485]: cephadm 2021-03-10T20:14:42.714670+0000 mgr.gibba044.wflcwh (mgr.34466) 389 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:14:44.525 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:44 gibba044 bash[25485]: cephadm 2021-03-10T20:14:42.714709+0000 mgr.gibba044.wflcwh (mgr.34466) 390 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:14:44.525 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:44 gibba044 bash[25485]: cephadm 2021-03-10T20:14:42.714836+0000 mgr.gibba044.wflcwh (mgr.34466) 391 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:14:44.526 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:44 gibba044 bash[25485]: cluster 2021-03-10T20:14:43.441678+0000 mgr.gibba044.wflcwh (mgr.34466) 392 : cluster [DBG] pgmap v203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:46.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:46 gibba023 bash[30844]: cluster 2021-03-10T20:14:45.443566+0000 mgr.gibba044.wflcwh (mgr.34466) 393 : cluster [DBG] pgmap v204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:46.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:46 gibba023 bash[31815]: cluster 2021-03-10T20:14:45.443566+0000 mgr.gibba044.wflcwh (mgr.34466) 393 : cluster [DBG] pgmap v204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:46.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:46 gibba044 bash[25485]: cluster 2021-03-10T20:14:45.443566+0000 mgr.gibba044.wflcwh (mgr.34466) 393 : cluster [DBG] pgmap v204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:47.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:47 gibba023 bash[30844]: cluster 2021-03-10T20:14:47.444905+0000 mgr.gibba044.wflcwh (mgr.34466) 394 : cluster [DBG] pgmap v205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:47.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:47 gibba023 bash[31815]: cluster 2021-03-10T20:14:47.444905+0000 mgr.gibba044.wflcwh (mgr.34466) 394 : cluster [DBG] pgmap v205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:47.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:47 gibba044 bash[25485]: cluster 2021-03-10T20:14:47.444905+0000 mgr.gibba044.wflcwh (mgr.34466) 394 : cluster [DBG] pgmap v205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:50.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:50 gibba023 bash[30844]: cluster 2021-03-10T20:14:49.446282+0000 mgr.gibba044.wflcwh (mgr.34466) 395 : cluster [DBG] pgmap v206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:50.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:50 gibba023 bash[31815]: cluster 2021-03-10T20:14:49.446282+0000 mgr.gibba044.wflcwh (mgr.34466) 395 : cluster [DBG] pgmap v206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:50.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:50 gibba044 bash[25485]: cluster 2021-03-10T20:14:49.446282+0000 mgr.gibba044.wflcwh (mgr.34466) 395 : cluster [DBG] pgmap v206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:52.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:52 gibba023 bash[30844]: cluster 2021-03-10T20:14:51.447235+0000 mgr.gibba044.wflcwh (mgr.34466) 396 : cluster [DBG] pgmap v207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:52.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:52 gibba023 bash[31815]: cluster 2021-03-10T20:14:51.447235+0000 mgr.gibba044.wflcwh (mgr.34466) 396 : cluster [DBG] pgmap v207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:52.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:52 gibba044 bash[25485]: cluster 2021-03-10T20:14:51.447235+0000 mgr.gibba044.wflcwh (mgr.34466) 396 : cluster [DBG] pgmap v207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:53.703 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:14:53.927 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:14:53.928 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (6m) 2m ago 11m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:14:53.928 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (11m) 72s ago 11m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:14:53.928 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (6m) 72s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:14:53.928 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (6m) 72s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:14:53.929 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (5m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:14:53.929 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (5m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:14:53.929 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (5m) 72s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:14:53.929 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (5m) 2m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:14:53.930 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (11m) 2m ago 11m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:14:53.930 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (11m) 72s ago 11m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:14:53.930 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (4m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:14:53.930 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (3m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:14:53.931 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (3m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:14:53.931 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (2m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:14:53.931 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (2m) 72s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:14:53.931 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (2m) 72s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:14:53.931 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (100s) 72s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:14:53.932 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (74s) 72s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:14:53.932 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (11m) 72s ago 11m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:14:53.932 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 2m ago 9m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:14:53.932 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 72s ago 9m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:14:54.180 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:14:54.180 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:14:54.180 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:14:54.181 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:14:54.181 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:14:54.181 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:14:54.181 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:14:54.182 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:14:54.182 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:14:54.182 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:14:54.182 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:14:54.183 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:14:54.183 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:14:54.183 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:14:54.183 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:14:54.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:54 gibba023 bash[30844]: cluster 2021-03-10T20:14:53.448734+0000 mgr.gibba044.wflcwh (mgr.34466) 397 : cluster [DBG] pgmap v208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:54.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:54 gibba023 bash[30844]: audit 2021-03-10T20:14:54.180862+0000 mon.a (mon.0) 650 : audit [DBG] from='client.? 172.21.2.123:0/2970081244' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:54.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:54 gibba023 bash[31815]: cluster 2021-03-10T20:14:53.448734+0000 mgr.gibba044.wflcwh (mgr.34466) 397 : cluster [DBG] pgmap v208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:54.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:54 gibba023 bash[31815]: audit 2021-03-10T20:14:54.180862+0000 mon.a (mon.0) 650 : audit [DBG] from='client.? 172.21.2.123:0/2970081244' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:54.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:54 gibba044 bash[25485]: cluster 2021-03-10T20:14:53.448734+0000 mgr.gibba044.wflcwh (mgr.34466) 397 : cluster [DBG] pgmap v208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:54.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:54 gibba044 bash[25485]: audit 2021-03-10T20:14:54.180862+0000 mon.a (mon.0) 650 : audit [DBG] from='client.? 172.21.2.123:0/2970081244' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:14:55.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:55 gibba023 bash[30844]: audit 2021-03-10T20:14:53.697897+0000 mgr.gibba044.wflcwh (mgr.34466) 398 : audit [DBG] from='client.54307 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:14:55.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:55 gibba023 bash[30844]: audit 2021-03-10T20:14:53.922893+0000 mgr.gibba044.wflcwh (mgr.34466) 399 : audit [DBG] from='client.44334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:14:55.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:55 gibba023 bash[30844]: cluster 2021-03-10T20:14:55.450404+0000 mgr.gibba044.wflcwh (mgr.34466) 400 : cluster [DBG] pgmap v209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:55.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:55 gibba023 bash[31815]: audit 2021-03-10T20:14:53.697897+0000 mgr.gibba044.wflcwh (mgr.34466) 398 : audit [DBG] from='client.54307 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:14:55.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:55 gibba023 bash[31815]: audit 2021-03-10T20:14:53.922893+0000 mgr.gibba044.wflcwh (mgr.34466) 399 : audit [DBG] from='client.44334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:14:55.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:55 gibba023 bash[31815]: cluster 2021-03-10T20:14:55.450404+0000 mgr.gibba044.wflcwh (mgr.34466) 400 : cluster [DBG] pgmap v209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:55.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:55 gibba044 bash[25485]: audit 2021-03-10T20:14:53.697897+0000 mgr.gibba044.wflcwh (mgr.34466) 398 : audit [DBG] from='client.54307 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:14:55.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:55 gibba044 bash[25485]: audit 2021-03-10T20:14:53.922893+0000 mgr.gibba044.wflcwh (mgr.34466) 399 : audit [DBG] from='client.44334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:14:55.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:55 gibba044 bash[25485]: cluster 2021-03-10T20:14:55.450404+0000 mgr.gibba044.wflcwh (mgr.34466) 400 : cluster [DBG] pgmap v209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:58.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:58 gibba023 bash[30844]: cluster 2021-03-10T20:14:57.451843+0000 mgr.gibba044.wflcwh (mgr.34466) 401 : cluster [DBG] pgmap v210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:58.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:58 gibba023 bash[31815]: cluster 2021-03-10T20:14:57.451843+0000 mgr.gibba044.wflcwh (mgr.34466) 401 : cluster [DBG] pgmap v210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:58.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:58 gibba044 bash[25485]: cluster 2021-03-10T20:14:57.451843+0000 mgr.gibba044.wflcwh (mgr.34466) 401 : cluster [DBG] pgmap v210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:59.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:59 gibba023 bash[30844]: cephadm 2021-03-10T20:14:57.730845+0000 mgr.gibba044.wflcwh (mgr.34466) 402 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:14:59.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:14:59 gibba023 bash[30844]: cluster 2021-03-10T20:14:59.453052+0000 mgr.gibba044.wflcwh (mgr.34466) 403 : cluster [DBG] pgmap v211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:59.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:59 gibba023 bash[31815]: cephadm 2021-03-10T20:14:57.730845+0000 mgr.gibba044.wflcwh (mgr.34466) 402 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:14:59.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:14:59 gibba023 bash[31815]: cluster 2021-03-10T20:14:59.453052+0000 mgr.gibba044.wflcwh (mgr.34466) 403 : cluster [DBG] pgmap v211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:14:59.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:59 gibba044 bash[25485]: cephadm 2021-03-10T20:14:57.730845+0000 mgr.gibba044.wflcwh (mgr.34466) 402 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:14:59.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:14:59 gibba044 bash[25485]: cluster 2021-03-10T20:14:59.453052+0000 mgr.gibba044.wflcwh (mgr.34466) 403 : cluster [DBG] pgmap v211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:02.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:02 gibba044 bash[25485]: cluster 2021-03-10T20:15:01.454454+0000 mgr.gibba044.wflcwh (mgr.34466) 404 : cluster [DBG] pgmap v212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:02.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:02 gibba023 bash[30844]: cluster 2021-03-10T20:15:01.454454+0000 mgr.gibba044.wflcwh (mgr.34466) 404 : cluster [DBG] pgmap v212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:02.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:02 gibba023 bash[31815]: cluster 2021-03-10T20:15:01.454454+0000 mgr.gibba044.wflcwh (mgr.34466) 404 : cluster [DBG] pgmap v212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:03.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:03 gibba023 bash[30844]: cluster 2021-03-10T20:15:03.456157+0000 mgr.gibba044.wflcwh (mgr.34466) 405 : cluster [DBG] pgmap v213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:03.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:03 gibba023 bash[31815]: cluster 2021-03-10T20:15:03.456157+0000 mgr.gibba044.wflcwh (mgr.34466) 405 : cluster [DBG] pgmap v213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:03.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:03 gibba044 bash[25485]: cluster 2021-03-10T20:15:03.456157+0000 mgr.gibba044.wflcwh (mgr.34466) 405 : cluster [DBG] pgmap v213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:05.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:05 gibba023 bash[30844]: cluster 2021-03-10T20:15:05.457764+0000 mgr.gibba044.wflcwh (mgr.34466) 406 : cluster [DBG] pgmap v214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:05.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:05 gibba023 bash[31815]: cluster 2021-03-10T20:15:05.457764+0000 mgr.gibba044.wflcwh (mgr.34466) 406 : cluster [DBG] pgmap v214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:05.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:05 gibba044 bash[25485]: cluster 2021-03-10T20:15:05.457764+0000 mgr.gibba044.wflcwh (mgr.34466) 406 : cluster [DBG] pgmap v214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:07.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:07 gibba023 bash[30844]: cluster 2021-03-10T20:15:07.458930+0000 mgr.gibba044.wflcwh (mgr.34466) 407 : cluster [DBG] pgmap v215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:07.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:07 gibba023 bash[31815]: cluster 2021-03-10T20:15:07.458930+0000 mgr.gibba044.wflcwh (mgr.34466) 407 : cluster [DBG] pgmap v215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:07.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:07 gibba044 bash[25485]: cluster 2021-03-10T20:15:07.458930+0000 mgr.gibba044.wflcwh (mgr.34466) 407 : cluster [DBG] pgmap v215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:09.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:09 gibba023 bash[30844]: cluster 2021-03-10T20:15:09.460403+0000 mgr.gibba044.wflcwh (mgr.34466) 408 : cluster [DBG] pgmap v216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:09.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:09 gibba023 bash[31815]: cluster 2021-03-10T20:15:09.460403+0000 mgr.gibba044.wflcwh (mgr.34466) 408 : cluster [DBG] pgmap v216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:09.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:09 gibba044 bash[25485]: cluster 2021-03-10T20:15:09.460403+0000 mgr.gibba044.wflcwh (mgr.34466) 408 : cluster [DBG] pgmap v216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:12.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:12 gibba023 bash[30844]: cluster 2021-03-10T20:15:11.461937+0000 mgr.gibba044.wflcwh (mgr.34466) 409 : cluster [DBG] pgmap v217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:12.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:12 gibba023 bash[31815]: cluster 2021-03-10T20:15:11.461937+0000 mgr.gibba044.wflcwh (mgr.34466) 409 : cluster [DBG] pgmap v217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:12.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:12 gibba044 bash[25485]: cluster 2021-03-10T20:15:11.461937+0000 mgr.gibba044.wflcwh (mgr.34466) 409 : cluster [DBG] pgmap v217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:13.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:13 gibba023 bash[30844]: cephadm 2021-03-10T20:15:12.746901+0000 mgr.gibba044.wflcwh (mgr.34466) 410 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:15:13.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:13 gibba023 bash[30844]: cluster 2021-03-10T20:15:13.463464+0000 mgr.gibba044.wflcwh (mgr.34466) 411 : cluster [DBG] pgmap v218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:13.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:13 gibba023 bash[31815]: cephadm 2021-03-10T20:15:12.746901+0000 mgr.gibba044.wflcwh (mgr.34466) 410 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:15:13.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:13 gibba023 bash[31815]: cluster 2021-03-10T20:15:13.463464+0000 mgr.gibba044.wflcwh (mgr.34466) 411 : cluster [DBG] pgmap v218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:13.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:13 gibba044 bash[25485]: cephadm 2021-03-10T20:15:12.746901+0000 mgr.gibba044.wflcwh (mgr.34466) 410 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:15:13.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:13 gibba044 bash[25485]: cluster 2021-03-10T20:15:13.463464+0000 mgr.gibba044.wflcwh (mgr.34466) 411 : cluster [DBG] pgmap v218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:15.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:15 gibba023 bash[30844]: cluster 2021-03-10T20:15:15.465041+0000 mgr.gibba044.wflcwh (mgr.34466) 412 : cluster [DBG] pgmap v219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:15.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:15 gibba023 bash[31815]: cluster 2021-03-10T20:15:15.465041+0000 mgr.gibba044.wflcwh (mgr.34466) 412 : cluster [DBG] pgmap v219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:15.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:15 gibba044 bash[25485]: cluster 2021-03-10T20:15:15.465041+0000 mgr.gibba044.wflcwh (mgr.34466) 412 : cluster [DBG] pgmap v219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:17.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:17 gibba023 bash[30844]: cluster 2021-03-10T20:15:17.466508+0000 mgr.gibba044.wflcwh (mgr.34466) 413 : cluster [DBG] pgmap v220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:17.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:17 gibba023 bash[31815]: cluster 2021-03-10T20:15:17.466508+0000 mgr.gibba044.wflcwh (mgr.34466) 413 : cluster [DBG] pgmap v220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:17.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:17 gibba044 bash[25485]: cluster 2021-03-10T20:15:17.466508+0000 mgr.gibba044.wflcwh (mgr.34466) 413 : cluster [DBG] pgmap v220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:19.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:19 gibba023 bash[30844]: cluster 2021-03-10T20:15:19.468019+0000 mgr.gibba044.wflcwh (mgr.34466) 414 : cluster [DBG] pgmap v221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:19.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:19 gibba023 bash[31815]: cluster 2021-03-10T20:15:19.468019+0000 mgr.gibba044.wflcwh (mgr.34466) 414 : cluster [DBG] pgmap v221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:19.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:19 gibba044 bash[25485]: cluster 2021-03-10T20:15:19.468019+0000 mgr.gibba044.wflcwh (mgr.34466) 414 : cluster [DBG] pgmap v221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:22.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:22 gibba023 bash[30844]: cluster 2021-03-10T20:15:21.469513+0000 mgr.gibba044.wflcwh (mgr.34466) 415 : cluster [DBG] pgmap v222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:22.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:22 gibba023 bash[31815]: cluster 2021-03-10T20:15:21.469513+0000 mgr.gibba044.wflcwh (mgr.34466) 415 : cluster [DBG] pgmap v222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:22.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:22 gibba044 bash[25485]: cluster 2021-03-10T20:15:21.469513+0000 mgr.gibba044.wflcwh (mgr.34466) 415 : cluster [DBG] pgmap v222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:23.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:23 gibba023 bash[30844]: cluster 2021-03-10T20:15:23.471322+0000 mgr.gibba044.wflcwh (mgr.34466) 416 : cluster [DBG] pgmap v223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:23.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:23 gibba023 bash[31815]: cluster 2021-03-10T20:15:23.471322+0000 mgr.gibba044.wflcwh (mgr.34466) 416 : cluster [DBG] pgmap v223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:23.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:23 gibba044 bash[25485]: cluster 2021-03-10T20:15:23.471322+0000 mgr.gibba044.wflcwh (mgr.34466) 416 : cluster [DBG] pgmap v223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:24.427 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:15:24.653 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:15:24.654 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (6m) 3m ago 12m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:15:24.654 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (11m) 103s ago 11m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:15:24.654 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (6m) 103s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:15:24.654 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (7m) 103s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:15:24.655 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (6m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:15:24.655 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (6m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:15:24.655 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (5m) 103s ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:15:24.661 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (5m) 3m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:15:24.662 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (12m) 3m ago 12m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:15:24.662 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (12m) 103s ago 12m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:15:24.663 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (4m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:15:24.663 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (4m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:15:24.663 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (3m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:15:24.664 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (3m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:15:24.664 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (3m) 103s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:15:24.664 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (2m) 103s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:15:24.664 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (2m) 103s ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:15:24.665 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (105s) 103s ago 12m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:15:24.665 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (11m) 103s ago 12m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:15:24.665 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 3m ago 10m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:15:24.665 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 103s ago 10m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:15:24.905 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:15:24.906 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:15:24.906 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:15:24.906 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:15:24.907 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:15:24.907 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:15:24.907 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:15:24.907 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:15:24.907 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:15:24.908 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:15:24.908 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:15:24.908 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:15:24.908 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:15:24.909 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:15:24.909 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:15:24.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:24 gibba023 bash[30844]: audit 2021-03-10T20:15:24.420969+0000 mgr.gibba044.wflcwh (mgr.34466) 417 : audit [DBG] from='client.54325 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:15:24.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:24 gibba023 bash[31815]: audit 2021-03-10T20:15:24.420969+0000 mgr.gibba044.wflcwh (mgr.34466) 417 : audit [DBG] from='client.54325 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:15:25.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:24 gibba044 bash[25485]: audit 2021-03-10T20:15:24.420969+0000 mgr.gibba044.wflcwh (mgr.34466) 417 : audit [DBG] from='client.54325 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:15:25.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:25 gibba023 bash[30844]: audit 2021-03-10T20:15:24.645988+0000 mgr.gibba044.wflcwh (mgr.34466) 418 : audit [DBG] from='client.54331 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:15:25.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:25 gibba023 bash[30844]: audit 2021-03-10T20:15:24.906715+0000 mon.a (mon.0) 651 : audit [DBG] from='client.? 172.21.2.123:0/1287055910' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:25.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:25 gibba023 bash[30844]: cluster 2021-03-10T20:15:25.473030+0000 mgr.gibba044.wflcwh (mgr.34466) 419 : cluster [DBG] pgmap v224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:25.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:25 gibba023 bash[31815]: audit 2021-03-10T20:15:24.645988+0000 mgr.gibba044.wflcwh (mgr.34466) 418 : audit [DBG] from='client.54331 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:15:25.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:25 gibba023 bash[31815]: audit 2021-03-10T20:15:24.906715+0000 mon.a (mon.0) 651 : audit [DBG] from='client.? 172.21.2.123:0/1287055910' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:25.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:25 gibba023 bash[31815]: cluster 2021-03-10T20:15:25.473030+0000 mgr.gibba044.wflcwh (mgr.34466) 419 : cluster [DBG] pgmap v224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:25.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:25 gibba044 bash[25485]: audit 2021-03-10T20:15:24.645988+0000 mgr.gibba044.wflcwh (mgr.34466) 418 : audit [DBG] from='client.54331 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:15:25.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:25 gibba044 bash[25485]: audit 2021-03-10T20:15:24.906715+0000 mon.a (mon.0) 651 : audit [DBG] from='client.? 172.21.2.123:0/1287055910' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:25.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:25 gibba044 bash[25485]: cluster 2021-03-10T20:15:25.473030+0000 mgr.gibba044.wflcwh (mgr.34466) 419 : cluster [DBG] pgmap v224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:27.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:27 gibba023 bash[30844]: audit 2021-03-10T20:15:26.984597+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:15:27.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:27 gibba023 bash[30844]: audit 2021-03-10T20:15:26.985435+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:15:27.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:27 gibba023 bash[30844]: audit 2021-03-10T20:15:26.986121+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:15:27.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:27 gibba023 bash[30844]: audit 2021-03-10T20:15:26.986824+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:15:27.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:27 gibba023 bash[31815]: audit 2021-03-10T20:15:26.984597+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:15:27.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:27 gibba023 bash[31815]: audit 2021-03-10T20:15:26.985435+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:15:27.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:27 gibba023 bash[31815]: audit 2021-03-10T20:15:26.986121+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:15:27.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:27 gibba023 bash[31815]: audit 2021-03-10T20:15:26.986824+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:15:27.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:27 gibba044 bash[25485]: audit 2021-03-10T20:15:26.984597+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:15:27.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:27 gibba044 bash[25485]: audit 2021-03-10T20:15:26.985435+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:15:27.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:27 gibba044 bash[25485]: audit 2021-03-10T20:15:26.986121+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:15:27.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:27 gibba044 bash[25485]: audit 2021-03-10T20:15:26.986824+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:15:28.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:28 gibba023 bash[30844]: audit 2021-03-10T20:15:27.087333+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:15:28.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:28 gibba023 bash[30844]: audit 2021-03-10T20:15:27.088099+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:15:28.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:28 gibba023 bash[30844]: cluster 2021-03-10T20:15:27.474373+0000 mgr.gibba044.wflcwh (mgr.34466) 420 : cluster [DBG] pgmap v225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:28.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:28 gibba023 bash[31815]: audit 2021-03-10T20:15:27.087333+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:15:28.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:28 gibba023 bash[31815]: audit 2021-03-10T20:15:27.088099+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:15:28.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:28 gibba023 bash[31815]: cluster 2021-03-10T20:15:27.474373+0000 mgr.gibba044.wflcwh (mgr.34466) 420 : cluster [DBG] pgmap v225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:28.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:28 gibba044 bash[25485]: audit 2021-03-10T20:15:27.087333+0000 mon.a (mon.0) 656 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:15:28.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:28 gibba044 bash[25485]: audit 2021-03-10T20:15:27.088099+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:15:28.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:28 gibba044 bash[25485]: cluster 2021-03-10T20:15:27.474373+0000 mgr.gibba044.wflcwh (mgr.34466) 420 : cluster [DBG] pgmap v225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:29.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:29 gibba023 bash[30844]: cephadm 2021-03-10T20:15:27.762958+0000 mgr.gibba044.wflcwh (mgr.34466) 421 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:15:29.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:29 gibba023 bash[31815]: cephadm 2021-03-10T20:15:27.762958+0000 mgr.gibba044.wflcwh (mgr.34466) 421 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:15:29.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:29 gibba044 bash[25485]: cephadm 2021-03-10T20:15:27.762958+0000 mgr.gibba044.wflcwh (mgr.34466) 421 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:15:30.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:30 gibba023 bash[30844]: cluster 2021-03-10T20:15:29.475889+0000 mgr.gibba044.wflcwh (mgr.34466) 422 : cluster [DBG] pgmap v226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:30.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:30 gibba023 bash[31815]: cluster 2021-03-10T20:15:29.475889+0000 mgr.gibba044.wflcwh (mgr.34466) 422 : cluster [DBG] pgmap v226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:30.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:30 gibba044 bash[25485]: cluster 2021-03-10T20:15:29.475889+0000 mgr.gibba044.wflcwh (mgr.34466) 422 : cluster [DBG] pgmap v226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:32.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:32 gibba023 bash[30844]: cluster 2021-03-10T20:15:31.477406+0000 mgr.gibba044.wflcwh (mgr.34466) 423 : cluster [DBG] pgmap v227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:32.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:32 gibba023 bash[31815]: cluster 2021-03-10T20:15:31.477406+0000 mgr.gibba044.wflcwh (mgr.34466) 423 : cluster [DBG] pgmap v227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:32.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:32 gibba044 bash[25485]: cluster 2021-03-10T20:15:31.477406+0000 mgr.gibba044.wflcwh (mgr.34466) 423 : cluster [DBG] pgmap v227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:33.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:33 gibba023 bash[30844]: cluster 2021-03-10T20:15:33.478938+0000 mgr.gibba044.wflcwh (mgr.34466) 424 : cluster [DBG] pgmap v228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:33.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:33 gibba023 bash[31815]: cluster 2021-03-10T20:15:33.478938+0000 mgr.gibba044.wflcwh (mgr.34466) 424 : cluster [DBG] pgmap v228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:33.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:33 gibba044 bash[25485]: cluster 2021-03-10T20:15:33.478938+0000 mgr.gibba044.wflcwh (mgr.34466) 424 : cluster [DBG] pgmap v228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:35.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:35 gibba023 bash[30844]: cluster 2021-03-10T20:15:35.480570+0000 mgr.gibba044.wflcwh (mgr.34466) 425 : cluster [DBG] pgmap v229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:35.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:35 gibba023 bash[31815]: cluster 2021-03-10T20:15:35.480570+0000 mgr.gibba044.wflcwh (mgr.34466) 425 : cluster [DBG] pgmap v229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:35.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:35 gibba044 bash[25485]: cluster 2021-03-10T20:15:35.480570+0000 mgr.gibba044.wflcwh (mgr.34466) 425 : cluster [DBG] pgmap v229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:37.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:37 gibba023 bash[30844]: cluster 2021-03-10T20:15:37.481927+0000 mgr.gibba044.wflcwh (mgr.34466) 426 : cluster [DBG] pgmap v230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:37.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:37 gibba023 bash[31815]: cluster 2021-03-10T20:15:37.481927+0000 mgr.gibba044.wflcwh (mgr.34466) 426 : cluster [DBG] pgmap v230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:37.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:37 gibba044 bash[25485]: cluster 2021-03-10T20:15:37.481927+0000 mgr.gibba044.wflcwh (mgr.34466) 426 : cluster [DBG] pgmap v230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:39.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:39 gibba023 bash[30844]: cluster 2021-03-10T20:15:39.483528+0000 mgr.gibba044.wflcwh (mgr.34466) 427 : cluster [DBG] pgmap v231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:39.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:39 gibba023 bash[31815]: cluster 2021-03-10T20:15:39.483528+0000 mgr.gibba044.wflcwh (mgr.34466) 427 : cluster [DBG] pgmap v231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:39.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:39 gibba044 bash[25485]: cluster 2021-03-10T20:15:39.483528+0000 mgr.gibba044.wflcwh (mgr.34466) 427 : cluster [DBG] pgmap v231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:42.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:42 gibba023 bash[30844]: cluster 2021-03-10T20:15:41.485062+0000 mgr.gibba044.wflcwh (mgr.34466) 428 : cluster [DBG] pgmap v232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:42.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:42 gibba023 bash[31815]: cluster 2021-03-10T20:15:41.485062+0000 mgr.gibba044.wflcwh (mgr.34466) 428 : cluster [DBG] pgmap v232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:42.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:42 gibba044 bash[25485]: cluster 2021-03-10T20:15:41.485062+0000 mgr.gibba044.wflcwh (mgr.34466) 428 : cluster [DBG] pgmap v232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:44.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:43 gibba044 bash[25485]: cephadm 2021-03-10T20:15:42.779651+0000 mgr.gibba044.wflcwh (mgr.34466) 429 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:15:44.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:43 gibba044 bash[25485]: cephadm 2021-03-10T20:15:42.781210+0000 mgr.gibba044.wflcwh (mgr.34466) 430 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:15:44.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:43 gibba044 bash[25485]: audit 2021-03-10T20:15:42.986331+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:15:44.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:43 gibba044 bash[25485]: audit 2021-03-10T20:15:42.989754+0000 mon.a (mon.0) 659 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:15:44.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:43 gibba044 bash[25485]: audit 2021-03-10T20:15:42.990970+0000 mon.a (mon.0) 660 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:44.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:43 gibba044 bash[25485]: cephadm 2021-03-10T20:15:42.991943+0000 mgr.gibba044.wflcwh (mgr.34466) 431 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:15:44.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:43 gibba044 bash[25485]: audit 2021-03-10T20:15:42.992003+0000 mon.a (mon.0) 661 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:44.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:43 gibba044 bash[25485]: audit 2021-03-10T20:15:42.993193+0000 mon.a (mon.0) 662 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:44.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:43 gibba044 bash[25485]: cephadm 2021-03-10T20:15:42.993591+0000 mgr.gibba044.wflcwh (mgr.34466) 432 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:15:44.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:43 gibba044 bash[25485]: cephadm 2021-03-10T20:15:42.994522+0000 mgr.gibba044.wflcwh (mgr.34466) 433 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:15:44.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:43 gibba044 bash[25485]: cephadm 2021-03-10T20:15:42.994560+0000 mgr.gibba044.wflcwh (mgr.34466) 434 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:15:44.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:43 gibba044 bash[25485]: audit 2021-03-10T20:15:42.994968+0000 mon.a (mon.0) 663 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:44.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:43 gibba044 bash[25485]: cephadm 2021-03-10T20:15:42.995697+0000 mgr.gibba044.wflcwh (mgr.34466) 435 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:15:44.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:43 gibba044 bash[25485]: cephadm 2021-03-10T20:15:42.995822+0000 mgr.gibba044.wflcwh (mgr.34466) 436 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:15:44.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:43 gibba044 bash[25485]: audit 2021-03-10T20:15:42.995931+0000 mon.a (mon.0) 664 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:44.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:43 gibba044 bash[25485]: cephadm 2021-03-10T20:15:42.996727+0000 mgr.gibba044.wflcwh (mgr.34466) 437 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:15:44.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:43 gibba044 bash[25485]: cephadm 2021-03-10T20:15:42.997449+0000 mgr.gibba044.wflcwh (mgr.34466) 438 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:15:44.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:43 gibba044 bash[25485]: cephadm 2021-03-10T20:15:42.997487+0000 mgr.gibba044.wflcwh (mgr.34466) 439 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:15:44.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:43 gibba044 bash[25485]: cephadm 2021-03-10T20:15:42.998313+0000 mgr.gibba044.wflcwh (mgr.34466) 440 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:15:44.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:43 gibba044 bash[25485]: cephadm 2021-03-10T20:15:42.998630+0000 mgr.gibba044.wflcwh (mgr.34466) 441 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:15:44.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:43 gibba044 bash[25485]: cephadm 2021-03-10T20:15:42.999318+0000 mgr.gibba044.wflcwh (mgr.34466) 442 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:15:44.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:43 gibba044 bash[25485]: cephadm 2021-03-10T20:15:42.999357+0000 mgr.gibba044.wflcwh (mgr.34466) 443 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:15:44.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:43 gibba044 bash[25485]: cephadm 2021-03-10T20:15:42.999486+0000 mgr.gibba044.wflcwh (mgr.34466) 444 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:15:44.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:43 gibba044 bash[25485]: cluster 2021-03-10T20:15:43.486565+0000 mgr.gibba044.wflcwh (mgr.34466) 445 : cluster [DBG] pgmap v233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:44.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[30844]: cephadm 2021-03-10T20:15:42.779651+0000 mgr.gibba044.wflcwh (mgr.34466) 429 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:15:44.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[30844]: cephadm 2021-03-10T20:15:42.781210+0000 mgr.gibba044.wflcwh (mgr.34466) 430 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:15:44.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[30844]: audit 2021-03-10T20:15:42.986331+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:15:44.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[30844]: audit 2021-03-10T20:15:42.989754+0000 mon.a (mon.0) 659 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:15:44.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[30844]: audit 2021-03-10T20:15:42.990970+0000 mon.a (mon.0) 660 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:44.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[30844]: cephadm 2021-03-10T20:15:42.991943+0000 mgr.gibba044.wflcwh (mgr.34466) 431 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:15:44.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[30844]: audit 2021-03-10T20:15:42.992003+0000 mon.a (mon.0) 661 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:44.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[30844]: audit 2021-03-10T20:15:42.993193+0000 mon.a (mon.0) 662 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:44.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[30844]: cephadm 2021-03-10T20:15:42.993591+0000 mgr.gibba044.wflcwh (mgr.34466) 432 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:15:44.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[30844]: cephadm 2021-03-10T20:15:42.994522+0000 mgr.gibba044.wflcwh (mgr.34466) 433 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:15:44.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[30844]: cephadm 2021-03-10T20:15:42.994560+0000 mgr.gibba044.wflcwh (mgr.34466) 434 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:15:44.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[30844]: audit 2021-03-10T20:15:42.994968+0000 mon.a (mon.0) 663 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:44.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[30844]: cephadm 2021-03-10T20:15:42.995697+0000 mgr.gibba044.wflcwh (mgr.34466) 435 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:15:44.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[30844]: cephadm 2021-03-10T20:15:42.995822+0000 mgr.gibba044.wflcwh (mgr.34466) 436 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:15:44.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[30844]: audit 2021-03-10T20:15:42.995931+0000 mon.a (mon.0) 664 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:44.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[30844]: cephadm 2021-03-10T20:15:42.996727+0000 mgr.gibba044.wflcwh (mgr.34466) 437 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:15:44.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[30844]: cephadm 2021-03-10T20:15:42.997449+0000 mgr.gibba044.wflcwh (mgr.34466) 438 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:15:44.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[30844]: cephadm 2021-03-10T20:15:42.997487+0000 mgr.gibba044.wflcwh (mgr.34466) 439 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:15:44.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[30844]: cephadm 2021-03-10T20:15:42.998313+0000 mgr.gibba044.wflcwh (mgr.34466) 440 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:15:44.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[30844]: cephadm 2021-03-10T20:15:42.998630+0000 mgr.gibba044.wflcwh (mgr.34466) 441 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:15:44.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[30844]: cephadm 2021-03-10T20:15:42.999318+0000 mgr.gibba044.wflcwh (mgr.34466) 442 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:15:44.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[31815]: cephadm 2021-03-10T20:15:42.779651+0000 mgr.gibba044.wflcwh (mgr.34466) 429 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:15:44.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[31815]: cephadm 2021-03-10T20:15:42.781210+0000 mgr.gibba044.wflcwh (mgr.34466) 430 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:15:44.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[31815]: audit 2021-03-10T20:15:42.986331+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:15:44.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[31815]: audit 2021-03-10T20:15:42.989754+0000 mon.a (mon.0) 659 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:15:44.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[31815]: audit 2021-03-10T20:15:42.990970+0000 mon.a (mon.0) 660 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:44.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[31815]: cephadm 2021-03-10T20:15:42.991943+0000 mgr.gibba044.wflcwh (mgr.34466) 431 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:15:44.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[31815]: audit 2021-03-10T20:15:42.992003+0000 mon.a (mon.0) 661 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:44.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[31815]: audit 2021-03-10T20:15:42.993193+0000 mon.a (mon.0) 662 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:44.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[31815]: cephadm 2021-03-10T20:15:42.993591+0000 mgr.gibba044.wflcwh (mgr.34466) 432 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:15:44.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[31815]: cephadm 2021-03-10T20:15:42.994522+0000 mgr.gibba044.wflcwh (mgr.34466) 433 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:15:44.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[31815]: cephadm 2021-03-10T20:15:42.994560+0000 mgr.gibba044.wflcwh (mgr.34466) 434 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:15:44.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[31815]: audit 2021-03-10T20:15:42.994968+0000 mon.a (mon.0) 663 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:44.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[31815]: cephadm 2021-03-10T20:15:42.995697+0000 mgr.gibba044.wflcwh (mgr.34466) 435 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:15:44.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[31815]: cephadm 2021-03-10T20:15:42.995822+0000 mgr.gibba044.wflcwh (mgr.34466) 436 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:15:44.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[31815]: audit 2021-03-10T20:15:42.995931+0000 mon.a (mon.0) 664 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:44.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[31815]: cephadm 2021-03-10T20:15:42.996727+0000 mgr.gibba044.wflcwh (mgr.34466) 437 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:15:44.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[31815]: cephadm 2021-03-10T20:15:42.997449+0000 mgr.gibba044.wflcwh (mgr.34466) 438 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:15:44.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[31815]: cephadm 2021-03-10T20:15:42.997487+0000 mgr.gibba044.wflcwh (mgr.34466) 439 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:15:44.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[31815]: cephadm 2021-03-10T20:15:42.998313+0000 mgr.gibba044.wflcwh (mgr.34466) 440 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:15:44.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[31815]: cephadm 2021-03-10T20:15:42.998630+0000 mgr.gibba044.wflcwh (mgr.34466) 441 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:15:44.436 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[31815]: cephadm 2021-03-10T20:15:42.999318+0000 mgr.gibba044.wflcwh (mgr.34466) 442 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:15:44.436 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[30844]: cephadm 2021-03-10T20:15:42.999357+0000 mgr.gibba044.wflcwh (mgr.34466) 443 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:15:44.436 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[30844]: cephadm 2021-03-10T20:15:42.999486+0000 mgr.gibba044.wflcwh (mgr.34466) 444 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:15:44.437 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[30844]: cluster 2021-03-10T20:15:43.486565+0000 mgr.gibba044.wflcwh (mgr.34466) 445 : cluster [DBG] pgmap v233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:44.437 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[31815]: cephadm 2021-03-10T20:15:42.999357+0000 mgr.gibba044.wflcwh (mgr.34466) 443 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:15:44.437 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[31815]: cephadm 2021-03-10T20:15:42.999486+0000 mgr.gibba044.wflcwh (mgr.34466) 444 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:15:44.437 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:43 gibba023 bash[31815]: cluster 2021-03-10T20:15:43.486565+0000 mgr.gibba044.wflcwh (mgr.34466) 445 : cluster [DBG] pgmap v233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:45.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:45 gibba023 bash[30844]: cluster 2021-03-10T20:15:45.488470+0000 mgr.gibba044.wflcwh (mgr.34466) 446 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:45.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:45 gibba023 bash[31815]: cluster 2021-03-10T20:15:45.488470+0000 mgr.gibba044.wflcwh (mgr.34466) 446 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:45.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:45 gibba044 bash[25485]: cluster 2021-03-10T20:15:45.488470+0000 mgr.gibba044.wflcwh (mgr.34466) 446 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:47.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:47 gibba023 bash[30844]: cluster 2021-03-10T20:15:47.489928+0000 mgr.gibba044.wflcwh (mgr.34466) 447 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:47.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:47 gibba023 bash[31815]: cluster 2021-03-10T20:15:47.489928+0000 mgr.gibba044.wflcwh (mgr.34466) 447 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:47.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:47 gibba044 bash[25485]: cluster 2021-03-10T20:15:47.489928+0000 mgr.gibba044.wflcwh (mgr.34466) 447 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:49.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:49 gibba023 bash[30844]: cluster 2021-03-10T20:15:49.491422+0000 mgr.gibba044.wflcwh (mgr.34466) 448 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:49.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:49 gibba023 bash[31815]: cluster 2021-03-10T20:15:49.491422+0000 mgr.gibba044.wflcwh (mgr.34466) 448 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:49.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:49 gibba044 bash[25485]: cluster 2021-03-10T20:15:49.491422+0000 mgr.gibba044.wflcwh (mgr.34466) 448 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:52.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:52 gibba023 bash[30844]: cluster 2021-03-10T20:15:51.493121+0000 mgr.gibba044.wflcwh (mgr.34466) 449 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:52.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:52 gibba023 bash[31815]: cluster 2021-03-10T20:15:51.493121+0000 mgr.gibba044.wflcwh (mgr.34466) 449 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:52.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:52 gibba044 bash[25485]: cluster 2021-03-10T20:15:51.493121+0000 mgr.gibba044.wflcwh (mgr.34466) 449 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:53.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:53 gibba023 bash[30844]: cluster 2021-03-10T20:15:53.494968+0000 mgr.gibba044.wflcwh (mgr.34466) 450 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:53.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:53 gibba023 bash[31815]: cluster 2021-03-10T20:15:53.494968+0000 mgr.gibba044.wflcwh (mgr.34466) 450 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:53.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:53 gibba044 bash[25485]: cluster 2021-03-10T20:15:53.494968+0000 mgr.gibba044.wflcwh (mgr.34466) 450 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:55.148 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:15:55.375 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:15:55.493 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (7m) 3m ago 12m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:15:55.493 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (12m) 2m ago 12m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:15:55.494 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (7m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:15:55.494 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (7m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:15:55.494 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (6m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:15:55.494 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (6m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:15:55.494 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (6m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:15:55.495 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (6m) 3m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:15:55.495 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (12m) 3m ago 12m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:15:55.495 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (12m) 2m ago 12m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:15:55.495 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (5m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:15:55.496 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (4m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:15:55.496 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (4m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:15:55.496 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (3m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:15:55.496 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (3m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:15:55.496 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (3m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:15:55.497 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (2m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:15:55.497 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (2m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:15:55.497 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (12m) 2m ago 12m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:15:55.498 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 3m ago 10m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:15:55.498 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 2m ago 10m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:15:55.641 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:15:55.641 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:15:55.641 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:15:55.642 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:15:55.642 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:15:55.642 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:15:55.642 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:15:55.643 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:15:55.643 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:15:55.643 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:15:55.643 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:15:55.643 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:15:55.644 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:15:55.644 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:15:55.644 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:15:55.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:55 gibba023 bash[30844]: audit 2021-03-10T20:15:55.142426+0000 mgr.gibba044.wflcwh (mgr.34466) 451 : audit [DBG] from='client.44364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:15:55.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:55 gibba023 bash[30844]: audit 2021-03-10T20:15:55.366452+0000 mgr.gibba044.wflcwh (mgr.34466) 452 : audit [DBG] from='client.44370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:15:55.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:55 gibba023 bash[30844]: cluster 2021-03-10T20:15:55.496606+0000 mgr.gibba044.wflcwh (mgr.34466) 453 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:55.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:55 gibba023 bash[31815]: audit 2021-03-10T20:15:55.142426+0000 mgr.gibba044.wflcwh (mgr.34466) 451 : audit [DBG] from='client.44364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:15:55.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:55 gibba023 bash[31815]: audit 2021-03-10T20:15:55.366452+0000 mgr.gibba044.wflcwh (mgr.34466) 452 : audit [DBG] from='client.44370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:15:55.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:55 gibba023 bash[31815]: cluster 2021-03-10T20:15:55.496606+0000 mgr.gibba044.wflcwh (mgr.34466) 453 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:55.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:55 gibba044 bash[25485]: audit 2021-03-10T20:15:55.142426+0000 mgr.gibba044.wflcwh (mgr.34466) 451 : audit [DBG] from='client.44364 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:15:55.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:55 gibba044 bash[25485]: audit 2021-03-10T20:15:55.366452+0000 mgr.gibba044.wflcwh (mgr.34466) 452 : audit [DBG] from='client.44370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:15:55.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:55 gibba044 bash[25485]: cluster 2021-03-10T20:15:55.496606+0000 mgr.gibba044.wflcwh (mgr.34466) 453 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:56.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:56 gibba023 bash[30844]: audit 2021-03-10T20:15:55.642306+0000 mon.a (mon.0) 665 : audit [DBG] from='client.? 172.21.2.123:0/2852828979' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:56.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:56 gibba023 bash[31815]: audit 2021-03-10T20:15:55.642306+0000 mon.a (mon.0) 665 : audit [DBG] from='client.? 172.21.2.123:0/2852828979' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:56.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:56 gibba044 bash[25485]: audit 2021-03-10T20:15:55.642306+0000 mon.a (mon.0) 665 : audit [DBG] from='client.? 172.21.2.123:0/2852828979' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:15:57.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:57 gibba023 bash[30844]: cluster 2021-03-10T20:15:57.497962+0000 mgr.gibba044.wflcwh (mgr.34466) 454 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:57.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:57 gibba023 bash[31815]: cluster 2021-03-10T20:15:57.497962+0000 mgr.gibba044.wflcwh (mgr.34466) 454 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:57.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:57 gibba044 bash[25485]: cluster 2021-03-10T20:15:57.497962+0000 mgr.gibba044.wflcwh (mgr.34466) 454 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:58.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:58 gibba023 bash[30844]: cephadm 2021-03-10T20:15:58.000351+0000 mgr.gibba044.wflcwh (mgr.34466) 455 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:15:58.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:58 gibba023 bash[31815]: cephadm 2021-03-10T20:15:58.000351+0000 mgr.gibba044.wflcwh (mgr.34466) 455 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:15:58.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:58 gibba044 bash[25485]: cephadm 2021-03-10T20:15:58.000351+0000 mgr.gibba044.wflcwh (mgr.34466) 455 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:15:59.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:15:59 gibba023 bash[30844]: cluster 2021-03-10T20:15:59.499556+0000 mgr.gibba044.wflcwh (mgr.34466) 456 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:59.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:15:59 gibba023 bash[31815]: cluster 2021-03-10T20:15:59.499556+0000 mgr.gibba044.wflcwh (mgr.34466) 456 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:15:59.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:15:59 gibba044 bash[25485]: cluster 2021-03-10T20:15:59.499556+0000 mgr.gibba044.wflcwh (mgr.34466) 456 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:02.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:02 gibba023 bash[30844]: cluster 2021-03-10T20:16:01.501191+0000 mgr.gibba044.wflcwh (mgr.34466) 457 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:02.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:02 gibba023 bash[31815]: cluster 2021-03-10T20:16:01.501191+0000 mgr.gibba044.wflcwh (mgr.34466) 457 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:02.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:02 gibba044 bash[25485]: cluster 2021-03-10T20:16:01.501191+0000 mgr.gibba044.wflcwh (mgr.34466) 457 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:03.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:03 gibba023 bash[30844]: cluster 2021-03-10T20:16:03.502942+0000 mgr.gibba044.wflcwh (mgr.34466) 458 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:03.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:03 gibba023 bash[31815]: cluster 2021-03-10T20:16:03.502942+0000 mgr.gibba044.wflcwh (mgr.34466) 458 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:03.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:03 gibba044 bash[25485]: cluster 2021-03-10T20:16:03.502942+0000 mgr.gibba044.wflcwh (mgr.34466) 458 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:05.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:05 gibba023 bash[30844]: cluster 2021-03-10T20:16:05.504566+0000 mgr.gibba044.wflcwh (mgr.34466) 459 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:05.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:05 gibba023 bash[31815]: cluster 2021-03-10T20:16:05.504566+0000 mgr.gibba044.wflcwh (mgr.34466) 459 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:05.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:05 gibba044 bash[25485]: cluster 2021-03-10T20:16:05.504566+0000 mgr.gibba044.wflcwh (mgr.34466) 459 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:07.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:07 gibba023 bash[30844]: cluster 2021-03-10T20:16:07.505964+0000 mgr.gibba044.wflcwh (mgr.34466) 460 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:07.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:07 gibba023 bash[31815]: cluster 2021-03-10T20:16:07.505964+0000 mgr.gibba044.wflcwh (mgr.34466) 460 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:07.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:07 gibba044 bash[25485]: cluster 2021-03-10T20:16:07.505964+0000 mgr.gibba044.wflcwh (mgr.34466) 460 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:09.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:09 gibba023 bash[30844]: cluster 2021-03-10T20:16:09.507880+0000 mgr.gibba044.wflcwh (mgr.34466) 461 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:09.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:09 gibba023 bash[31815]: cluster 2021-03-10T20:16:09.507880+0000 mgr.gibba044.wflcwh (mgr.34466) 461 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:09.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:09 gibba044 bash[25485]: cluster 2021-03-10T20:16:09.507880+0000 mgr.gibba044.wflcwh (mgr.34466) 461 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:12.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:12 gibba023 bash[30844]: cluster 2021-03-10T20:16:11.509418+0000 mgr.gibba044.wflcwh (mgr.34466) 462 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:12.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:12 gibba023 bash[31815]: cluster 2021-03-10T20:16:11.509418+0000 mgr.gibba044.wflcwh (mgr.34466) 462 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:12.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:12 gibba044 bash[25485]: cluster 2021-03-10T20:16:11.509418+0000 mgr.gibba044.wflcwh (mgr.34466) 462 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:13.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:13 gibba023 bash[30844]: cephadm 2021-03-10T20:16:13.016395+0000 mgr.gibba044.wflcwh (mgr.34466) 463 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:16:13.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:13 gibba023 bash[30844]: cluster 2021-03-10T20:16:13.511023+0000 mgr.gibba044.wflcwh (mgr.34466) 464 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:13.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:13 gibba023 bash[31815]: cephadm 2021-03-10T20:16:13.016395+0000 mgr.gibba044.wflcwh (mgr.34466) 463 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:16:13.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:13 gibba023 bash[31815]: cluster 2021-03-10T20:16:13.511023+0000 mgr.gibba044.wflcwh (mgr.34466) 464 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:13.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:13 gibba044 bash[25485]: cephadm 2021-03-10T20:16:13.016395+0000 mgr.gibba044.wflcwh (mgr.34466) 463 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:16:13.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:13 gibba044 bash[25485]: cluster 2021-03-10T20:16:13.511023+0000 mgr.gibba044.wflcwh (mgr.34466) 464 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:15.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:15 gibba023 bash[30844]: cluster 2021-03-10T20:16:15.512771+0000 mgr.gibba044.wflcwh (mgr.34466) 465 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:15.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:15 gibba023 bash[31815]: cluster 2021-03-10T20:16:15.512771+0000 mgr.gibba044.wflcwh (mgr.34466) 465 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:15.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:15 gibba044 bash[25485]: cluster 2021-03-10T20:16:15.512771+0000 mgr.gibba044.wflcwh (mgr.34466) 465 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:17.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:17 gibba023 bash[30844]: cluster 2021-03-10T20:16:17.514166+0000 mgr.gibba044.wflcwh (mgr.34466) 466 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:17.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:17 gibba023 bash[31815]: cluster 2021-03-10T20:16:17.514166+0000 mgr.gibba044.wflcwh (mgr.34466) 466 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:17.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:17 gibba044 bash[25485]: cluster 2021-03-10T20:16:17.514166+0000 mgr.gibba044.wflcwh (mgr.34466) 466 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:19.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:19 gibba023 bash[30844]: cluster 2021-03-10T20:16:19.515885+0000 mgr.gibba044.wflcwh (mgr.34466) 467 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:19.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:19 gibba023 bash[31815]: cluster 2021-03-10T20:16:19.515885+0000 mgr.gibba044.wflcwh (mgr.34466) 467 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:19.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:19 gibba044 bash[25485]: cluster 2021-03-10T20:16:19.515885+0000 mgr.gibba044.wflcwh (mgr.34466) 467 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:22.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:22 gibba023 bash[30844]: cluster 2021-03-10T20:16:21.517141+0000 mgr.gibba044.wflcwh (mgr.34466) 468 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:22.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:22 gibba023 bash[31815]: cluster 2021-03-10T20:16:21.517141+0000 mgr.gibba044.wflcwh (mgr.34466) 468 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:22.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:22 gibba044 bash[25485]: cluster 2021-03-10T20:16:21.517141+0000 mgr.gibba044.wflcwh (mgr.34466) 468 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:23.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:23 gibba023 bash[30844]: cluster 2021-03-10T20:16:23.518884+0000 mgr.gibba044.wflcwh (mgr.34466) 469 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:23.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:23 gibba023 bash[31815]: cluster 2021-03-10T20:16:23.518884+0000 mgr.gibba044.wflcwh (mgr.34466) 469 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:23.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:23 gibba044 bash[25485]: cluster 2021-03-10T20:16:23.518884+0000 mgr.gibba044.wflcwh (mgr.34466) 469 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:25.886 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:16:25.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:25 gibba023 bash[30844]: cluster 2021-03-10T20:16:25.520484+0000 mgr.gibba044.wflcwh (mgr.34466) 470 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:25.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:25 gibba023 bash[31815]: cluster 2021-03-10T20:16:25.520484+0000 mgr.gibba044.wflcwh (mgr.34466) 470 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:25.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:25 gibba044 bash[25485]: cluster 2021-03-10T20:16:25.520484+0000 mgr.gibba044.wflcwh (mgr.34466) 470 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:26.115 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:16:26.115 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (7m) 4m ago 13m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:16:26.116 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (12m) 2m ago 12m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:16:26.116 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (7m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:16:26.116 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (8m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:16:26.116 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (7m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:16:26.117 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (7m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:16:26.117 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (6m) 2m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:16:26.117 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (6m) 4m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:16:26.117 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (13m) 4m ago 13m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:16:26.118 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (13m) 2m ago 13m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:16:26.118 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (5m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:16:26.118 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (5m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:16:26.119 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (4m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:16:26.119 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (4m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:16:26.119 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (4m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:16:26.119 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (3m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:16:26.120 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (3m) 2m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:16:26.121 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (2m) 2m ago 13m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:16:26.121 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (12m) 2m ago 13m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:16:26.121 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 4m ago 11m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:16:26.122 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 2m ago 11m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:16:26.368 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:16:26.369 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:16:26.369 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:16:26.369 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:16:26.369 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:16:26.370 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:16:26.370 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:16:26.370 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:16:26.371 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:16:26.371 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:16:26.371 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:16:26.371 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:16:26.371 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:16:26.372 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:16:26.372 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:16:27.423 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:27 gibba023 bash[30844]: audit 2021-03-10T20:16:25.880963+0000 mgr.gibba044.wflcwh (mgr.34466) 471 : audit [DBG] from='client.44382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:16:27.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:27 gibba023 bash[30844]: audit 2021-03-10T20:16:26.106652+0000 mgr.gibba044.wflcwh (mgr.34466) 472 : audit [DBG] from='client.44388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:16:27.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:27 gibba023 bash[30844]: audit 2021-03-10T20:16:26.369652+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.2.123:0/2823614608' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:27.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:27 gibba023 bash[30844]: audit 2021-03-10T20:16:26.994937+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T20:16:27.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:27 gibba023 bash[30844]: audit 2021-03-10T20:16:26.995649+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:16:27.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:27 gibba023 bash[30844]: audit 2021-03-10T20:16:26.996358+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:16:27.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:27 gibba023 bash[30844]: audit 2021-03-10T20:16:26.997040+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:16:27.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:27 gibba023 bash[30844]: audit 2021-03-10T20:16:27.089996+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:16:27.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:27 gibba023 bash[30844]: audit 2021-03-10T20:16:27.090670+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:16:27.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:27 gibba023 bash[31815]: audit 2021-03-10T20:16:25.880963+0000 mgr.gibba044.wflcwh (mgr.34466) 471 : audit [DBG] from='client.44382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:16:27.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:27 gibba023 bash[31815]: audit 2021-03-10T20:16:26.106652+0000 mgr.gibba044.wflcwh (mgr.34466) 472 : audit [DBG] from='client.44388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:16:27.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:27 gibba023 bash[31815]: audit 2021-03-10T20:16:26.369652+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.2.123:0/2823614608' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:27.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:27 gibba023 bash[31815]: audit 2021-03-10T20:16:26.994937+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T20:16:27.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:27 gibba023 bash[31815]: audit 2021-03-10T20:16:26.995649+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:16:27.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:27 gibba023 bash[31815]: audit 2021-03-10T20:16:26.996358+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:16:27.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:27 gibba023 bash[31815]: audit 2021-03-10T20:16:26.997040+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:16:27.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:27 gibba023 bash[31815]: audit 2021-03-10T20:16:27.089996+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:16:27.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:27 gibba023 bash[31815]: audit 2021-03-10T20:16:27.090670+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:16:27.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:27 gibba044 bash[25485]: audit 2021-03-10T20:16:25.880963+0000 mgr.gibba044.wflcwh (mgr.34466) 471 : audit [DBG] from='client.44382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:16:27.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:27 gibba044 bash[25485]: audit 2021-03-10T20:16:26.106652+0000 mgr.gibba044.wflcwh (mgr.34466) 472 : audit [DBG] from='client.44388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:16:27.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:27 gibba044 bash[25485]: audit 2021-03-10T20:16:26.369652+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.2.123:0/2823614608' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:27.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:27 gibba044 bash[25485]: audit 2021-03-10T20:16:26.994937+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T20:16:27.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:27 gibba044 bash[25485]: audit 2021-03-10T20:16:26.995649+0000 mon.a (mon.0) 667 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:16:27.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:27 gibba044 bash[25485]: audit 2021-03-10T20:16:26.996358+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:16:27.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:27 gibba044 bash[25485]: audit 2021-03-10T20:16:26.997040+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:16:27.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:27 gibba044 bash[25485]: audit 2021-03-10T20:16:27.089996+0000 mon.a (mon.0) 670 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:16:27.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:27 gibba044 bash[25485]: audit 2021-03-10T20:16:27.090670+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:16:28.423 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:28 gibba023 bash[30844]: cluster 2021-03-10T20:16:27.521865+0000 mgr.gibba044.wflcwh (mgr.34466) 473 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:28.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:28 gibba023 bash[31815]: cluster 2021-03-10T20:16:27.521865+0000 mgr.gibba044.wflcwh (mgr.34466) 473 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:28.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:28 gibba044 bash[25485]: cluster 2021-03-10T20:16:27.521865+0000 mgr.gibba044.wflcwh (mgr.34466) 473 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:29.423 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:29 gibba023 bash[30844]: cephadm 2021-03-10T20:16:28.032454+0000 mgr.gibba044.wflcwh (mgr.34466) 474 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:16:29.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:29 gibba023 bash[31815]: cephadm 2021-03-10T20:16:28.032454+0000 mgr.gibba044.wflcwh (mgr.34466) 474 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:16:29.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:29 gibba044 bash[25485]: cephadm 2021-03-10T20:16:28.032454+0000 mgr.gibba044.wflcwh (mgr.34466) 474 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:16:30.423 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:30 gibba023 bash[30844]: cluster 2021-03-10T20:16:29.523039+0000 mgr.gibba044.wflcwh (mgr.34466) 475 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:30.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:30 gibba023 bash[31815]: cluster 2021-03-10T20:16:29.523039+0000 mgr.gibba044.wflcwh (mgr.34466) 475 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:30.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:30 gibba044 bash[25485]: cluster 2021-03-10T20:16:29.523039+0000 mgr.gibba044.wflcwh (mgr.34466) 475 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:32.423 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:32 gibba023 bash[30844]: cluster 2021-03-10T20:16:31.524678+0000 mgr.gibba044.wflcwh (mgr.34466) 476 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:32.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:32 gibba023 bash[31815]: cluster 2021-03-10T20:16:31.524678+0000 mgr.gibba044.wflcwh (mgr.34466) 476 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:32.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:32 gibba044 bash[25485]: cluster 2021-03-10T20:16:31.524678+0000 mgr.gibba044.wflcwh (mgr.34466) 476 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:33.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:33 gibba023 bash[30844]: cluster 2021-03-10T20:16:33.526383+0000 mgr.gibba044.wflcwh (mgr.34466) 477 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:33.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:33 gibba023 bash[31815]: cluster 2021-03-10T20:16:33.526383+0000 mgr.gibba044.wflcwh (mgr.34466) 477 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:33.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:33 gibba044 bash[25485]: cluster 2021-03-10T20:16:33.526383+0000 mgr.gibba044.wflcwh (mgr.34466) 477 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:35.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:35 gibba023 bash[30844]: cluster 2021-03-10T20:16:35.528094+0000 mgr.gibba044.wflcwh (mgr.34466) 478 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:35.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:35 gibba023 bash[31815]: cluster 2021-03-10T20:16:35.528094+0000 mgr.gibba044.wflcwh (mgr.34466) 478 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:35.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:35 gibba044 bash[25485]: cluster 2021-03-10T20:16:35.528094+0000 mgr.gibba044.wflcwh (mgr.34466) 478 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:37.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:37 gibba023 bash[30844]: cluster 2021-03-10T20:16:37.529710+0000 mgr.gibba044.wflcwh (mgr.34466) 479 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:37.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:37 gibba023 bash[31815]: cluster 2021-03-10T20:16:37.529710+0000 mgr.gibba044.wflcwh (mgr.34466) 479 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:37.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:37 gibba044 bash[25485]: cluster 2021-03-10T20:16:37.529710+0000 mgr.gibba044.wflcwh (mgr.34466) 479 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:39.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:39 gibba023 bash[30844]: cluster 2021-03-10T20:16:39.531069+0000 mgr.gibba044.wflcwh (mgr.34466) 480 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:39.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:39 gibba023 bash[31815]: cluster 2021-03-10T20:16:39.531069+0000 mgr.gibba044.wflcwh (mgr.34466) 480 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:39.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:39 gibba044 bash[25485]: cluster 2021-03-10T20:16:39.531069+0000 mgr.gibba044.wflcwh (mgr.34466) 480 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:42.423 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:42 gibba023 bash[30844]: cluster 2021-03-10T20:16:41.532687+0000 mgr.gibba044.wflcwh (mgr.34466) 481 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:42.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:42 gibba023 bash[31815]: cluster 2021-03-10T20:16:41.532687+0000 mgr.gibba044.wflcwh (mgr.34466) 481 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:42.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:42 gibba044 bash[25485]: cluster 2021-03-10T20:16:41.532687+0000 mgr.gibba044.wflcwh (mgr.34466) 481 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:44.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:44 gibba044 bash[25485]: cephadm 2021-03-10T20:16:43.041251+0000 mgr.gibba044.wflcwh (mgr.34466) 482 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:16:44.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:44 gibba044 bash[25485]: cephadm 2021-03-10T20:16:43.042778+0000 mgr.gibba044.wflcwh (mgr.34466) 483 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:16:44.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:44 gibba044 bash[25485]: audit 2021-03-10T20:16:43.231856+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:16:44.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:44 gibba044 bash[25485]: audit 2021-03-10T20:16:43.235437+0000 mon.a (mon.0) 673 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:16:44.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:44 gibba044 bash[25485]: cephadm 2021-03-10T20:16:43.237345+0000 mgr.gibba044.wflcwh (mgr.34466) 484 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:16:44.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:44 gibba044 bash[25485]: audit 2021-03-10T20:16:43.237383+0000 mon.a (mon.0) 674 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:44.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:44 gibba044 bash[25485]: audit 2021-03-10T20:16:43.239052+0000 mon.a (mon.0) 675 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:44.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:44 gibba044 bash[25485]: cephadm 2021-03-10T20:16:43.239760+0000 mgr.gibba044.wflcwh (mgr.34466) 485 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:16:44.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:44 gibba044 bash[25485]: audit 2021-03-10T20:16:43.240311+0000 mon.a (mon.0) 676 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:44.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:44 gibba044 bash[25485]: cephadm 2021-03-10T20:16:43.241240+0000 mgr.gibba044.wflcwh (mgr.34466) 486 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:16:44.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:44 gibba044 bash[25485]: cephadm 2021-03-10T20:16:43.241278+0000 mgr.gibba044.wflcwh (mgr.34466) 487 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:16:44.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:44 gibba044 bash[25485]: audit 2021-03-10T20:16:43.242501+0000 mon.a (mon.0) 677 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:44.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:44 gibba044 bash[25485]: cephadm 2021-03-10T20:16:43.242917+0000 mgr.gibba044.wflcwh (mgr.34466) 488 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:16:44.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:44 gibba044 bash[25485]: cephadm 2021-03-10T20:16:43.242954+0000 mgr.gibba044.wflcwh (mgr.34466) 489 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:16:44.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:44 gibba044 bash[25485]: cephadm 2021-03-10T20:16:43.243974+0000 mgr.gibba044.wflcwh (mgr.34466) 490 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:16:44.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:44 gibba044 bash[25485]: audit 2021-03-10T20:16:43.244217+0000 mon.a (mon.0) 678 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:44.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:44 gibba044 bash[25485]: cephadm 2021-03-10T20:16:43.244921+0000 mgr.gibba044.wflcwh (mgr.34466) 491 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:16:44.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:44 gibba044 bash[25485]: cephadm 2021-03-10T20:16:43.244956+0000 mgr.gibba044.wflcwh (mgr.34466) 492 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:16:44.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:44 gibba044 bash[25485]: cephadm 2021-03-10T20:16:43.246334+0000 mgr.gibba044.wflcwh (mgr.34466) 493 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:16:44.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:44 gibba044 bash[25485]: cephadm 2021-03-10T20:16:43.246656+0000 mgr.gibba044.wflcwh (mgr.34466) 494 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:16:44.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:44 gibba044 bash[25485]: cephadm 2021-03-10T20:16:43.248038+0000 mgr.gibba044.wflcwh (mgr.34466) 495 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:16:44.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:44 gibba044 bash[25485]: cephadm 2021-03-10T20:16:43.248077+0000 mgr.gibba044.wflcwh (mgr.34466) 496 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:16:44.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:44 gibba044 bash[25485]: cephadm 2021-03-10T20:16:43.248200+0000 mgr.gibba044.wflcwh (mgr.34466) 497 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:16:44.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:44 gibba044 bash[25485]: cluster 2021-03-10T20:16:43.534351+0000 mgr.gibba044.wflcwh (mgr.34466) 498 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:44.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[30844]: cephadm 2021-03-10T20:16:43.041251+0000 mgr.gibba044.wflcwh (mgr.34466) 482 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:16:44.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[30844]: cephadm 2021-03-10T20:16:43.042778+0000 mgr.gibba044.wflcwh (mgr.34466) 483 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:16:44.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[30844]: audit 2021-03-10T20:16:43.231856+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:16:44.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[30844]: audit 2021-03-10T20:16:43.235437+0000 mon.a (mon.0) 673 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:16:44.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[30844]: cephadm 2021-03-10T20:16:43.237345+0000 mgr.gibba044.wflcwh (mgr.34466) 484 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:16:44.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[30844]: audit 2021-03-10T20:16:43.237383+0000 mon.a (mon.0) 674 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:44.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[30844]: audit 2021-03-10T20:16:43.239052+0000 mon.a (mon.0) 675 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:44.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[30844]: cephadm 2021-03-10T20:16:43.239760+0000 mgr.gibba044.wflcwh (mgr.34466) 485 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:16:44.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[30844]: audit 2021-03-10T20:16:43.240311+0000 mon.a (mon.0) 676 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:44.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[30844]: cephadm 2021-03-10T20:16:43.241240+0000 mgr.gibba044.wflcwh (mgr.34466) 486 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:16:44.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[30844]: cephadm 2021-03-10T20:16:43.241278+0000 mgr.gibba044.wflcwh (mgr.34466) 487 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:16:44.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[30844]: audit 2021-03-10T20:16:43.242501+0000 mon.a (mon.0) 677 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:44.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[30844]: cephadm 2021-03-10T20:16:43.242917+0000 mgr.gibba044.wflcwh (mgr.34466) 488 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:16:44.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[30844]: cephadm 2021-03-10T20:16:43.242954+0000 mgr.gibba044.wflcwh (mgr.34466) 489 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:16:44.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[30844]: cephadm 2021-03-10T20:16:43.243974+0000 mgr.gibba044.wflcwh (mgr.34466) 490 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:16:44.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[30844]: audit 2021-03-10T20:16:43.244217+0000 mon.a (mon.0) 678 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:44.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[30844]: cephadm 2021-03-10T20:16:43.244921+0000 mgr.gibba044.wflcwh (mgr.34466) 491 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:16:44.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[30844]: cephadm 2021-03-10T20:16:43.244956+0000 mgr.gibba044.wflcwh (mgr.34466) 492 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:16:44.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[30844]: cephadm 2021-03-10T20:16:43.246334+0000 mgr.gibba044.wflcwh (mgr.34466) 493 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:16:44.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[30844]: cephadm 2021-03-10T20:16:43.246656+0000 mgr.gibba044.wflcwh (mgr.34466) 494 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:16:44.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[30844]: cephadm 2021-03-10T20:16:43.248038+0000 mgr.gibba044.wflcwh (mgr.34466) 495 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:16:44.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[30844]: cephadm 2021-03-10T20:16:43.248077+0000 mgr.gibba044.wflcwh (mgr.34466) 496 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:16:44.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[30844]: cephadm 2021-03-10T20:16:43.248200+0000 mgr.gibba044.wflcwh (mgr.34466) 497 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:16:44.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[30844]: cluster 2021-03-10T20:16:43.534351+0000 mgr.gibba044.wflcwh (mgr.34466) 498 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:44.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[31815]: cephadm 2021-03-10T20:16:43.041251+0000 mgr.gibba044.wflcwh (mgr.34466) 482 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:16:44.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[31815]: cephadm 2021-03-10T20:16:43.042778+0000 mgr.gibba044.wflcwh (mgr.34466) 483 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:16:44.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[31815]: audit 2021-03-10T20:16:43.231856+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:16:44.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[31815]: audit 2021-03-10T20:16:43.235437+0000 mon.a (mon.0) 673 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:16:44.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[31815]: cephadm 2021-03-10T20:16:43.237345+0000 mgr.gibba044.wflcwh (mgr.34466) 484 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:16:44.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[31815]: audit 2021-03-10T20:16:43.237383+0000 mon.a (mon.0) 674 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:44.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[31815]: audit 2021-03-10T20:16:43.239052+0000 mon.a (mon.0) 675 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:44.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[31815]: cephadm 2021-03-10T20:16:43.239760+0000 mgr.gibba044.wflcwh (mgr.34466) 485 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:16:44.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[31815]: audit 2021-03-10T20:16:43.240311+0000 mon.a (mon.0) 676 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:44.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[31815]: cephadm 2021-03-10T20:16:43.241240+0000 mgr.gibba044.wflcwh (mgr.34466) 486 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:16:44.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[31815]: cephadm 2021-03-10T20:16:43.241278+0000 mgr.gibba044.wflcwh (mgr.34466) 487 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:16:44.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[31815]: audit 2021-03-10T20:16:43.242501+0000 mon.a (mon.0) 677 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:44.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[31815]: cephadm 2021-03-10T20:16:43.242917+0000 mgr.gibba044.wflcwh (mgr.34466) 488 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:16:44.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[31815]: cephadm 2021-03-10T20:16:43.242954+0000 mgr.gibba044.wflcwh (mgr.34466) 489 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:16:44.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[31815]: cephadm 2021-03-10T20:16:43.243974+0000 mgr.gibba044.wflcwh (mgr.34466) 490 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:16:44.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[31815]: audit 2021-03-10T20:16:43.244217+0000 mon.a (mon.0) 678 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:44.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[31815]: cephadm 2021-03-10T20:16:43.244921+0000 mgr.gibba044.wflcwh (mgr.34466) 491 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:16:44.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[31815]: cephadm 2021-03-10T20:16:43.244956+0000 mgr.gibba044.wflcwh (mgr.34466) 492 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:16:44.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[31815]: cephadm 2021-03-10T20:16:43.246334+0000 mgr.gibba044.wflcwh (mgr.34466) 493 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:16:44.686 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[31815]: cephadm 2021-03-10T20:16:43.246656+0000 mgr.gibba044.wflcwh (mgr.34466) 494 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:16:44.686 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[31815]: cephadm 2021-03-10T20:16:43.248038+0000 mgr.gibba044.wflcwh (mgr.34466) 495 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:16:44.686 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[31815]: cephadm 2021-03-10T20:16:43.248077+0000 mgr.gibba044.wflcwh (mgr.34466) 496 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:16:44.687 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[31815]: cephadm 2021-03-10T20:16:43.248200+0000 mgr.gibba044.wflcwh (mgr.34466) 497 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:16:44.687 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:44 gibba023 bash[31815]: cluster 2021-03-10T20:16:43.534351+0000 mgr.gibba044.wflcwh (mgr.34466) 498 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:45.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:45 gibba023 bash[30844]: cluster 2021-03-10T20:16:45.535957+0000 mgr.gibba044.wflcwh (mgr.34466) 499 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:45.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:45 gibba023 bash[31815]: cluster 2021-03-10T20:16:45.535957+0000 mgr.gibba044.wflcwh (mgr.34466) 499 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:45.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:45 gibba044 bash[25485]: cluster 2021-03-10T20:16:45.535957+0000 mgr.gibba044.wflcwh (mgr.34466) 499 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:47.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:47 gibba023 bash[30844]: cluster 2021-03-10T20:16:47.537362+0000 mgr.gibba044.wflcwh (mgr.34466) 500 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:47.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:47 gibba023 bash[31815]: cluster 2021-03-10T20:16:47.537362+0000 mgr.gibba044.wflcwh (mgr.34466) 500 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:47.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:47 gibba044 bash[25485]: cluster 2021-03-10T20:16:47.537362+0000 mgr.gibba044.wflcwh (mgr.34466) 500 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:49.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:49 gibba023 bash[30844]: cluster 2021-03-10T20:16:49.538692+0000 mgr.gibba044.wflcwh (mgr.34466) 501 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:49.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:49 gibba023 bash[31815]: cluster 2021-03-10T20:16:49.538692+0000 mgr.gibba044.wflcwh (mgr.34466) 501 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:50.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:49 gibba044 bash[25485]: cluster 2021-03-10T20:16:49.538692+0000 mgr.gibba044.wflcwh (mgr.34466) 501 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:52.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:52 gibba023 bash[30844]: cluster 2021-03-10T20:16:51.540351+0000 mgr.gibba044.wflcwh (mgr.34466) 502 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:52.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:52 gibba023 bash[31815]: cluster 2021-03-10T20:16:51.540351+0000 mgr.gibba044.wflcwh (mgr.34466) 502 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:52.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:52 gibba044 bash[25485]: cluster 2021-03-10T20:16:51.540351+0000 mgr.gibba044.wflcwh (mgr.34466) 502 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:53.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:53 gibba023 bash[30844]: cluster 2021-03-10T20:16:53.542061+0000 mgr.gibba044.wflcwh (mgr.34466) 503 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:53.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:53 gibba023 bash[31815]: cluster 2021-03-10T20:16:53.542061+0000 mgr.gibba044.wflcwh (mgr.34466) 503 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:53.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:53 gibba044 bash[25485]: cluster 2021-03-10T20:16:53.542061+0000 mgr.gibba044.wflcwh (mgr.34466) 503 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:55.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:55 gibba023 bash[30844]: cluster 2021-03-10T20:16:55.543794+0000 mgr.gibba044.wflcwh (mgr.34466) 504 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:55.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:55 gibba023 bash[31815]: cluster 2021-03-10T20:16:55.543794+0000 mgr.gibba044.wflcwh (mgr.34466) 504 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:55.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:55 gibba044 bash[25485]: cluster 2021-03-10T20:16:55.543794+0000 mgr.gibba044.wflcwh (mgr.34466) 504 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:56.613 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:16:56.842 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:16:56.842 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (8m) 4m ago 13m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:16:56.842 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (13m) 3m ago 13m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:16:56.843 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (8m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:16:56.843 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (8m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:16:56.843 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (7m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:16:56.843 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (7m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:16:56.844 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (7m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:16:56.844 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (7m) 4m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:16:56.844 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (13m) 4m ago 13m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:16:56.844 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (13m) 3m ago 13m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:16:56.845 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (6m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:16:56.845 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (5m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:16:56.845 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (5m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:16:56.845 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (5m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:16:56.845 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (4m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:16:56.846 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (4m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:16:56.846 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (3m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:16:56.846 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (3m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:16:56.846 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (13m) 3m ago 13m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:16:56.847 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 4m ago 11m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:16:56.847 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 3m ago 11m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:16:57.101 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:16:57.101 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:16:57.101 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:16:57.102 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:16:57.102 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:16:57.102 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:16:57.102 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:16:57.103 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:16:57.103 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:16:57.103 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:16:57.103 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:16:57.104 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:16:57.104 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:16:57.104 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:16:57.104 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:16:57.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:57 gibba023 bash[30844]: audit 2021-03-10T20:16:57.102314+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.2.123:0/1320870997' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:57.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:57 gibba023 bash[31815]: audit 2021-03-10T20:16:57.102314+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.2.123:0/1320870997' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:57.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:57 gibba044 bash[25485]: audit 2021-03-10T20:16:57.102314+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.2.123:0/1320870997' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:16:58.423 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:58 gibba023 bash[30844]: audit 2021-03-10T20:16:56.608915+0000 mgr.gibba044.wflcwh (mgr.34466) 505 : audit [DBG] from='client.44400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:16:58.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:58 gibba023 bash[30844]: audit 2021-03-10T20:16:56.833517+0000 mgr.gibba044.wflcwh (mgr.34466) 506 : audit [DBG] from='client.54385 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:16:58.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:58 gibba023 bash[30844]: cluster 2021-03-10T20:16:57.545147+0000 mgr.gibba044.wflcwh (mgr.34466) 507 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:58.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:58 gibba023 bash[31815]: audit 2021-03-10T20:16:56.608915+0000 mgr.gibba044.wflcwh (mgr.34466) 505 : audit [DBG] from='client.44400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:16:58.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:58 gibba023 bash[31815]: audit 2021-03-10T20:16:56.833517+0000 mgr.gibba044.wflcwh (mgr.34466) 506 : audit [DBG] from='client.54385 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:16:58.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:58 gibba023 bash[31815]: cluster 2021-03-10T20:16:57.545147+0000 mgr.gibba044.wflcwh (mgr.34466) 507 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:58.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:58 gibba044 bash[25485]: audit 2021-03-10T20:16:56.608915+0000 mgr.gibba044.wflcwh (mgr.34466) 505 : audit [DBG] from='client.44400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:16:58.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:58 gibba044 bash[25485]: audit 2021-03-10T20:16:56.833517+0000 mgr.gibba044.wflcwh (mgr.34466) 506 : audit [DBG] from='client.54385 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:16:58.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:58 gibba044 bash[25485]: cluster 2021-03-10T20:16:57.545147+0000 mgr.gibba044.wflcwh (mgr.34466) 507 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:16:59.423 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:16:59 gibba023 bash[30844]: cephadm 2021-03-10T20:16:58.264258+0000 mgr.gibba044.wflcwh (mgr.34466) 508 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:16:59.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:16:59 gibba023 bash[31815]: cephadm 2021-03-10T20:16:58.264258+0000 mgr.gibba044.wflcwh (mgr.34466) 508 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:16:59.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:16:59 gibba044 bash[25485]: cephadm 2021-03-10T20:16:58.264258+0000 mgr.gibba044.wflcwh (mgr.34466) 508 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:17:00.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:00 gibba023 bash[30844]: cluster 2021-03-10T20:16:59.546439+0000 mgr.gibba044.wflcwh (mgr.34466) 509 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:00.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:00 gibba023 bash[31815]: cluster 2021-03-10T20:16:59.546439+0000 mgr.gibba044.wflcwh (mgr.34466) 509 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:00.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:00 gibba044 bash[25485]: cluster 2021-03-10T20:16:59.546439+0000 mgr.gibba044.wflcwh (mgr.34466) 509 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:02.423 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:02 gibba023 bash[30844]: cluster 2021-03-10T20:17:01.548009+0000 mgr.gibba044.wflcwh (mgr.34466) 510 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:02.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:02 gibba023 bash[31815]: cluster 2021-03-10T20:17:01.548009+0000 mgr.gibba044.wflcwh (mgr.34466) 510 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:02.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:02 gibba044 bash[25485]: cluster 2021-03-10T20:17:01.548009+0000 mgr.gibba044.wflcwh (mgr.34466) 510 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:03.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:03 gibba023 bash[30844]: cluster 2021-03-10T20:17:03.549554+0000 mgr.gibba044.wflcwh (mgr.34466) 511 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:03.923 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:03 gibba023 bash[31815]: cluster 2021-03-10T20:17:03.549554+0000 mgr.gibba044.wflcwh (mgr.34466) 511 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:03.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:03 gibba044 bash[25485]: cluster 2021-03-10T20:17:03.549554+0000 mgr.gibba044.wflcwh (mgr.34466) 511 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:05.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:05 gibba023 bash[30844]: cluster 2021-03-10T20:17:05.551183+0000 mgr.gibba044.wflcwh (mgr.34466) 512 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:05.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:05 gibba023 bash[31815]: cluster 2021-03-10T20:17:05.551183+0000 mgr.gibba044.wflcwh (mgr.34466) 512 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:05.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:05 gibba044 bash[25485]: cluster 2021-03-10T20:17:05.551183+0000 mgr.gibba044.wflcwh (mgr.34466) 512 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:07.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:07 gibba023 bash[30844]: cluster 2021-03-10T20:17:07.552788+0000 mgr.gibba044.wflcwh (mgr.34466) 513 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:07.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:07 gibba023 bash[31815]: cluster 2021-03-10T20:17:07.552788+0000 mgr.gibba044.wflcwh (mgr.34466) 513 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:07.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:07 gibba044 bash[25485]: cluster 2021-03-10T20:17:07.552788+0000 mgr.gibba044.wflcwh (mgr.34466) 513 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:09.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:09 gibba023 bash[30844]: cluster 2021-03-10T20:17:09.554245+0000 mgr.gibba044.wflcwh (mgr.34466) 514 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:09.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:09 gibba023 bash[31815]: cluster 2021-03-10T20:17:09.554245+0000 mgr.gibba044.wflcwh (mgr.34466) 514 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:09.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:09 gibba044 bash[25485]: cluster 2021-03-10T20:17:09.554245+0000 mgr.gibba044.wflcwh (mgr.34466) 514 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:12.423 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:12 gibba023 bash[30844]: cluster 2021-03-10T20:17:11.555851+0000 mgr.gibba044.wflcwh (mgr.34466) 515 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:12.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:12 gibba023 bash[31815]: cluster 2021-03-10T20:17:11.555851+0000 mgr.gibba044.wflcwh (mgr.34466) 515 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:12.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:12 gibba044 bash[25485]: cluster 2021-03-10T20:17:11.555851+0000 mgr.gibba044.wflcwh (mgr.34466) 515 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:13.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:13 gibba023 bash[30844]: cephadm 2021-03-10T20:17:13.275462+0000 mgr.gibba044.wflcwh (mgr.34466) 516 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:17:13.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:13 gibba023 bash[30844]: cluster 2021-03-10T20:17:13.557499+0000 mgr.gibba044.wflcwh (mgr.34466) 517 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:13.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:13 gibba023 bash[31815]: cephadm 2021-03-10T20:17:13.275462+0000 mgr.gibba044.wflcwh (mgr.34466) 516 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:17:13.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:13 gibba023 bash[31815]: cluster 2021-03-10T20:17:13.557499+0000 mgr.gibba044.wflcwh (mgr.34466) 517 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:13.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:13 gibba044 bash[25485]: cephadm 2021-03-10T20:17:13.275462+0000 mgr.gibba044.wflcwh (mgr.34466) 516 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:17:13.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:13 gibba044 bash[25485]: cluster 2021-03-10T20:17:13.557499+0000 mgr.gibba044.wflcwh (mgr.34466) 517 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:15.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:15 gibba023 bash[30844]: cluster 2021-03-10T20:17:15.559257+0000 mgr.gibba044.wflcwh (mgr.34466) 518 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:15.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:15 gibba023 bash[31815]: cluster 2021-03-10T20:17:15.559257+0000 mgr.gibba044.wflcwh (mgr.34466) 518 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:15.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:15 gibba044 bash[25485]: cluster 2021-03-10T20:17:15.559257+0000 mgr.gibba044.wflcwh (mgr.34466) 518 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:17.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:17 gibba023 bash[30844]: cluster 2021-03-10T20:17:17.560826+0000 mgr.gibba044.wflcwh (mgr.34466) 519 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:17.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:17 gibba023 bash[31815]: cluster 2021-03-10T20:17:17.560826+0000 mgr.gibba044.wflcwh (mgr.34466) 519 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:17.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:17 gibba044 bash[25485]: cluster 2021-03-10T20:17:17.560826+0000 mgr.gibba044.wflcwh (mgr.34466) 519 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:19.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:19 gibba023 bash[30844]: cluster 2021-03-10T20:17:19.562216+0000 mgr.gibba044.wflcwh (mgr.34466) 520 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:19.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:19 gibba023 bash[31815]: cluster 2021-03-10T20:17:19.562216+0000 mgr.gibba044.wflcwh (mgr.34466) 520 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:19.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:19 gibba044 bash[25485]: cluster 2021-03-10T20:17:19.562216+0000 mgr.gibba044.wflcwh (mgr.34466) 520 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:22.423 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:22 gibba023 bash[30844]: cluster 2021-03-10T20:17:21.563833+0000 mgr.gibba044.wflcwh (mgr.34466) 521 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:22.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:22 gibba023 bash[31815]: cluster 2021-03-10T20:17:21.563833+0000 mgr.gibba044.wflcwh (mgr.34466) 521 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:22.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:22 gibba044 bash[25485]: cluster 2021-03-10T20:17:21.563833+0000 mgr.gibba044.wflcwh (mgr.34466) 521 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:23.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:23 gibba023 bash[30844]: cluster 2021-03-10T20:17:23.565379+0000 mgr.gibba044.wflcwh (mgr.34466) 522 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:23.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:23 gibba023 bash[31815]: cluster 2021-03-10T20:17:23.565379+0000 mgr.gibba044.wflcwh (mgr.34466) 522 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:23.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:23 gibba044 bash[25485]: cluster 2021-03-10T20:17:23.565379+0000 mgr.gibba044.wflcwh (mgr.34466) 522 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:27.348 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:17:27.423 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:27 gibba023 bash[30844]: cluster 2021-03-10T20:17:25.567274+0000 mgr.gibba044.wflcwh (mgr.34466) 523 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:27.423 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:27 gibba023 bash[30844]: audit 2021-03-10T20:17:27.004253+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T20:17:27.423 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:27 gibba023 bash[30844]: audit 2021-03-10T20:17:27.005078+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:17:27.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:27 gibba023 bash[30844]: audit 2021-03-10T20:17:27.005919+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:17:27.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:27 gibba023 bash[30844]: audit 2021-03-10T20:17:27.006744+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:17:27.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:27 gibba023 bash[30844]: audit 2021-03-10T20:17:27.092976+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:17:27.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:27 gibba023 bash[30844]: audit 2021-03-10T20:17:27.093692+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:17:27.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:27 gibba023 bash[31815]: cluster 2021-03-10T20:17:25.567274+0000 mgr.gibba044.wflcwh (mgr.34466) 523 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:27.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:27 gibba023 bash[31815]: audit 2021-03-10T20:17:27.004253+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T20:17:27.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:27 gibba023 bash[31815]: audit 2021-03-10T20:17:27.005078+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:17:27.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:27 gibba023 bash[31815]: audit 2021-03-10T20:17:27.005919+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:17:27.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:27 gibba023 bash[31815]: audit 2021-03-10T20:17:27.006744+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:17:27.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:27 gibba023 bash[31815]: audit 2021-03-10T20:17:27.092976+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:17:27.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:27 gibba023 bash[31815]: audit 2021-03-10T20:17:27.093692+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:17:27.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:27 gibba044 bash[25485]: cluster 2021-03-10T20:17:25.567274+0000 mgr.gibba044.wflcwh (mgr.34466) 523 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:27.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:27 gibba044 bash[25485]: audit 2021-03-10T20:17:27.004253+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T20:17:27.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:27 gibba044 bash[25485]: audit 2021-03-10T20:17:27.005078+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:17:27.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:27 gibba044 bash[25485]: audit 2021-03-10T20:17:27.005919+0000 mon.a (mon.0) 681 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:17:27.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:27 gibba044 bash[25485]: audit 2021-03-10T20:17:27.006744+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:17:27.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:27 gibba044 bash[25485]: audit 2021-03-10T20:17:27.092976+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:17:27.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:27 gibba044 bash[25485]: audit 2021-03-10T20:17:27.093692+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:17:27.576 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:17:27.576 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (8m) 5m ago 14m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:17:27.576 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (13m) 3m ago 13m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:17:27.577 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (8m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:17:27.577 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (9m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:17:27.577 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (8m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:17:27.577 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (8m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:17:27.577 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (7m) 3m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:17:27.578 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (7m) 5m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:17:27.578 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (14m) 5m ago 14m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:17:27.578 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (14m) 3m ago 14m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:17:27.578 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (6m) 5m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:17:27.579 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (6m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:17:27.579 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (5m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:17:27.579 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (5m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:17:27.579 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (5m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:17:27.579 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (4m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:17:27.580 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (4m) 3m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:17:27.580 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (3m) 3m ago 14m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:17:27.580 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (13m) 3m ago 14m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:17:27.580 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 5m ago 12m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:17:27.580 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 3m ago 12m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:17:27.822 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:17:27.823 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:17:27.823 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:17:27.823 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:17:27.824 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:17:27.824 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:17:27.824 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:17:27.824 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:17:27.824 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:17:27.825 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:17:27.825 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:17:27.825 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:17:27.825 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:17:27.826 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:17:27.826 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:17:28.423 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:28 gibba023 bash[30844]: audit 2021-03-10T20:17:27.342541+0000 mgr.gibba044.wflcwh (mgr.34466) 524 : audit [DBG] from='client.44418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:17:28.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:28 gibba023 bash[30844]: audit 2021-03-10T20:17:27.824039+0000 mon.a (mon.0) 685 : audit [DBG] from='client.? 172.21.2.123:0/4194586095' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:28.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:28 gibba023 bash[31815]: audit 2021-03-10T20:17:27.342541+0000 mgr.gibba044.wflcwh (mgr.34466) 524 : audit [DBG] from='client.44418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:17:28.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:28 gibba023 bash[31815]: audit 2021-03-10T20:17:27.824039+0000 mon.a (mon.0) 685 : audit [DBG] from='client.? 172.21.2.123:0/4194586095' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:28.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:28 gibba044 bash[25485]: audit 2021-03-10T20:17:27.342541+0000 mgr.gibba044.wflcwh (mgr.34466) 524 : audit [DBG] from='client.44418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:17:28.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:28 gibba044 bash[25485]: audit 2021-03-10T20:17:27.824039+0000 mon.a (mon.0) 685 : audit [DBG] from='client.? 172.21.2.123:0/4194586095' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:29.423 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:29 gibba023 bash[30844]: audit 2021-03-10T20:17:27.567032+0000 mgr.gibba044.wflcwh (mgr.34466) 525 : audit [DBG] from='client.44424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:17:29.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:29 gibba023 bash[30844]: cluster 2021-03-10T20:17:27.568627+0000 mgr.gibba044.wflcwh (mgr.34466) 526 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:29.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:29 gibba023 bash[30844]: cephadm 2021-03-10T20:17:28.291599+0000 mgr.gibba044.wflcwh (mgr.34466) 527 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:17:29.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:29 gibba023 bash[31815]: audit 2021-03-10T20:17:27.567032+0000 mgr.gibba044.wflcwh (mgr.34466) 525 : audit [DBG] from='client.44424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:17:29.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:29 gibba023 bash[31815]: cluster 2021-03-10T20:17:27.568627+0000 mgr.gibba044.wflcwh (mgr.34466) 526 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:29.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:29 gibba023 bash[31815]: cephadm 2021-03-10T20:17:28.291599+0000 mgr.gibba044.wflcwh (mgr.34466) 527 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:17:29.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:29 gibba044 bash[25485]: audit 2021-03-10T20:17:27.567032+0000 mgr.gibba044.wflcwh (mgr.34466) 525 : audit [DBG] from='client.44424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:17:29.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:29 gibba044 bash[25485]: cluster 2021-03-10T20:17:27.568627+0000 mgr.gibba044.wflcwh (mgr.34466) 526 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:29.498 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:29 gibba044 bash[25485]: cephadm 2021-03-10T20:17:28.291599+0000 mgr.gibba044.wflcwh (mgr.34466) 527 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:17:31.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:31 gibba044 bash[25485]: cluster 2021-03-10T20:17:29.569832+0000 mgr.gibba044.wflcwh (mgr.34466) 528 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:31.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:31 gibba023 bash[30844]: cluster 2021-03-10T20:17:29.569832+0000 mgr.gibba044.wflcwh (mgr.34466) 528 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:31.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:31 gibba023 bash[31815]: cluster 2021-03-10T20:17:29.569832+0000 mgr.gibba044.wflcwh (mgr.34466) 528 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:33.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:33 gibba044 bash[25485]: cluster 2021-03-10T20:17:31.571305+0000 mgr.gibba044.wflcwh (mgr.34466) 529 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:33.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:33 gibba023 bash[30844]: cluster 2021-03-10T20:17:31.571305+0000 mgr.gibba044.wflcwh (mgr.34466) 529 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:33.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:33 gibba023 bash[31815]: cluster 2021-03-10T20:17:31.571305+0000 mgr.gibba044.wflcwh (mgr.34466) 529 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:35.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:35 gibba044 bash[25485]: cluster 2021-03-10T20:17:33.573051+0000 mgr.gibba044.wflcwh (mgr.34466) 530 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:35.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:35 gibba023 bash[30844]: cluster 2021-03-10T20:17:33.573051+0000 mgr.gibba044.wflcwh (mgr.34466) 530 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:35.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:35 gibba023 bash[31815]: cluster 2021-03-10T20:17:33.573051+0000 mgr.gibba044.wflcwh (mgr.34466) 530 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:37.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:37 gibba044 bash[25485]: cluster 2021-03-10T20:17:35.574620+0000 mgr.gibba044.wflcwh (mgr.34466) 531 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:37.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:37 gibba023 bash[30844]: cluster 2021-03-10T20:17:35.574620+0000 mgr.gibba044.wflcwh (mgr.34466) 531 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:37.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:37 gibba023 bash[31815]: cluster 2021-03-10T20:17:35.574620+0000 mgr.gibba044.wflcwh (mgr.34466) 531 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:39.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:39 gibba044 bash[25485]: cluster 2021-03-10T20:17:37.576030+0000 mgr.gibba044.wflcwh (mgr.34466) 532 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:39.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:39 gibba023 bash[30844]: cluster 2021-03-10T20:17:37.576030+0000 mgr.gibba044.wflcwh (mgr.34466) 532 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:39.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:39 gibba023 bash[31815]: cluster 2021-03-10T20:17:37.576030+0000 mgr.gibba044.wflcwh (mgr.34466) 532 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:41.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:41 gibba044 bash[25485]: cluster 2021-03-10T20:17:39.577345+0000 mgr.gibba044.wflcwh (mgr.34466) 533 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:41.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:41 gibba023 bash[30844]: cluster 2021-03-10T20:17:39.577345+0000 mgr.gibba044.wflcwh (mgr.34466) 533 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:41.673 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:41 gibba023 bash[31815]: cluster 2021-03-10T20:17:39.577345+0000 mgr.gibba044.wflcwh (mgr.34466) 533 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:43.496 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:43 gibba044 bash[25485]: cluster 2021-03-10T20:17:41.578809+0000 mgr.gibba044.wflcwh (mgr.34466) 534 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:43.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:43 gibba023 bash[30844]: cluster 2021-03-10T20:17:41.578809+0000 mgr.gibba044.wflcwh (mgr.34466) 534 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:43.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:43 gibba023 bash[31815]: cluster 2021-03-10T20:17:41.578809+0000 mgr.gibba044.wflcwh (mgr.34466) 534 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:44.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[30844]: cephadm 2021-03-10T20:17:43.304940+0000 mgr.gibba044.wflcwh (mgr.34466) 535 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:17:44.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[30844]: cephadm 2021-03-10T20:17:43.306311+0000 mgr.gibba044.wflcwh (mgr.34466) 536 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:17:44.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[30844]: audit 2021-03-10T20:17:43.520760+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:17:44.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[30844]: audit 2021-03-10T20:17:43.524114+0000 mon.a (mon.0) 687 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:17:44.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[30844]: audit 2021-03-10T20:17:43.525444+0000 mon.a (mon.0) 688 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:44.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[30844]: cephadm 2021-03-10T20:17:43.526300+0000 mgr.gibba044.wflcwh (mgr.34466) 537 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:17:44.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[30844]: audit 2021-03-10T20:17:43.527028+0000 mon.a (mon.0) 689 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:44.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[30844]: cephadm 2021-03-10T20:17:43.527922+0000 mgr.gibba044.wflcwh (mgr.34466) 538 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:17:44.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[30844]: audit 2021-03-10T20:17:43.528461+0000 mon.a (mon.0) 690 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:44.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[30844]: cephadm 2021-03-10T20:17:43.529412+0000 mgr.gibba044.wflcwh (mgr.34466) 539 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:17:44.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[30844]: cephadm 2021-03-10T20:17:43.529449+0000 mgr.gibba044.wflcwh (mgr.34466) 540 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:17:44.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[30844]: cephadm 2021-03-10T20:17:43.530985+0000 mgr.gibba044.wflcwh (mgr.34466) 541 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:17:44.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[30844]: cephadm 2021-03-10T20:17:43.531022+0000 mgr.gibba044.wflcwh (mgr.34466) 542 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:17:44.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[30844]: audit 2021-03-10T20:17:43.531595+0000 mon.a (mon.0) 691 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:44.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[30844]: cephadm 2021-03-10T20:17:43.532614+0000 mgr.gibba044.wflcwh (mgr.34466) 543 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:17:44.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[30844]: audit 2021-03-10T20:17:43.533319+0000 mon.a (mon.0) 692 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:44.932 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[30844]: cephadm 2021-03-10T20:17:43.533986+0000 mgr.gibba044.wflcwh (mgr.34466) 544 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:17:44.932 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[30844]: cephadm 2021-03-10T20:17:43.534024+0000 mgr.gibba044.wflcwh (mgr.34466) 545 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:17:44.932 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[30844]: cephadm 2021-03-10T20:17:43.535513+0000 mgr.gibba044.wflcwh (mgr.34466) 546 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:17:44.933 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[30844]: cephadm 2021-03-10T20:17:43.535891+0000 mgr.gibba044.wflcwh (mgr.34466) 547 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:17:44.933 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[30844]: cephadm 2021-03-10T20:17:43.537407+0000 mgr.gibba044.wflcwh (mgr.34466) 548 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:17:44.934 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[30844]: cephadm 2021-03-10T20:17:43.537445+0000 mgr.gibba044.wflcwh (mgr.34466) 549 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:17:44.934 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[30844]: cephadm 2021-03-10T20:17:43.537654+0000 mgr.gibba044.wflcwh (mgr.34466) 550 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:17:44.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[31815]: cephadm 2021-03-10T20:17:43.304940+0000 mgr.gibba044.wflcwh (mgr.34466) 535 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:17:44.936 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[31815]: cephadm 2021-03-10T20:17:43.306311+0000 mgr.gibba044.wflcwh (mgr.34466) 536 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:17:44.936 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[31815]: audit 2021-03-10T20:17:43.520760+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:17:44.937 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[31815]: audit 2021-03-10T20:17:43.524114+0000 mon.a (mon.0) 687 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:17:44.937 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[31815]: audit 2021-03-10T20:17:43.525444+0000 mon.a (mon.0) 688 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:44.937 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[31815]: cephadm 2021-03-10T20:17:43.526300+0000 mgr.gibba044.wflcwh (mgr.34466) 537 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:17:44.938 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[31815]: audit 2021-03-10T20:17:43.527028+0000 mon.a (mon.0) 689 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:44.938 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[31815]: cephadm 2021-03-10T20:17:43.527922+0000 mgr.gibba044.wflcwh (mgr.34466) 538 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:17:44.939 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[31815]: audit 2021-03-10T20:17:43.528461+0000 mon.a (mon.0) 690 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:44.939 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[31815]: cephadm 2021-03-10T20:17:43.529412+0000 mgr.gibba044.wflcwh (mgr.34466) 539 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:17:44.940 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[31815]: cephadm 2021-03-10T20:17:43.529449+0000 mgr.gibba044.wflcwh (mgr.34466) 540 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:17:44.940 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[31815]: cephadm 2021-03-10T20:17:43.530985+0000 mgr.gibba044.wflcwh (mgr.34466) 541 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:17:44.940 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[31815]: cephadm 2021-03-10T20:17:43.531022+0000 mgr.gibba044.wflcwh (mgr.34466) 542 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:17:44.940 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[31815]: audit 2021-03-10T20:17:43.531595+0000 mon.a (mon.0) 691 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:44.941 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[31815]: cephadm 2021-03-10T20:17:43.532614+0000 mgr.gibba044.wflcwh (mgr.34466) 543 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:17:44.941 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[31815]: audit 2021-03-10T20:17:43.533319+0000 mon.a (mon.0) 692 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:44.941 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[31815]: cephadm 2021-03-10T20:17:43.533986+0000 mgr.gibba044.wflcwh (mgr.34466) 544 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:17:44.942 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[31815]: cephadm 2021-03-10T20:17:43.534024+0000 mgr.gibba044.wflcwh (mgr.34466) 545 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:17:44.942 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[31815]: cephadm 2021-03-10T20:17:43.535513+0000 mgr.gibba044.wflcwh (mgr.34466) 546 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:17:44.942 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[31815]: cephadm 2021-03-10T20:17:43.535891+0000 mgr.gibba044.wflcwh (mgr.34466) 547 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:17:44.943 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[31815]: cephadm 2021-03-10T20:17:43.537407+0000 mgr.gibba044.wflcwh (mgr.34466) 548 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:17:44.943 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[31815]: cephadm 2021-03-10T20:17:43.537445+0000 mgr.gibba044.wflcwh (mgr.34466) 549 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:17:44.943 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:44 gibba023 bash[31815]: cephadm 2021-03-10T20:17:43.537654+0000 mgr.gibba044.wflcwh (mgr.34466) 550 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:17:44.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:44 gibba044 bash[25485]: cephadm 2021-03-10T20:17:43.304940+0000 mgr.gibba044.wflcwh (mgr.34466) 535 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:17:44.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:44 gibba044 bash[25485]: cephadm 2021-03-10T20:17:43.306311+0000 mgr.gibba044.wflcwh (mgr.34466) 536 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:17:44.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:44 gibba044 bash[25485]: audit 2021-03-10T20:17:43.520760+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:17:44.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:44 gibba044 bash[25485]: audit 2021-03-10T20:17:43.524114+0000 mon.a (mon.0) 687 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:17:44.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:44 gibba044 bash[25485]: audit 2021-03-10T20:17:43.525444+0000 mon.a (mon.0) 688 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:44.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:44 gibba044 bash[25485]: cephadm 2021-03-10T20:17:43.526300+0000 mgr.gibba044.wflcwh (mgr.34466) 537 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:17:44.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:44 gibba044 bash[25485]: audit 2021-03-10T20:17:43.527028+0000 mon.a (mon.0) 689 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:45.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:44 gibba044 bash[25485]: cephadm 2021-03-10T20:17:43.527922+0000 mgr.gibba044.wflcwh (mgr.34466) 538 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:17:45.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:44 gibba044 bash[25485]: audit 2021-03-10T20:17:43.528461+0000 mon.a (mon.0) 690 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:45.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:44 gibba044 bash[25485]: cephadm 2021-03-10T20:17:43.529412+0000 mgr.gibba044.wflcwh (mgr.34466) 539 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:17:45.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:44 gibba044 bash[25485]: cephadm 2021-03-10T20:17:43.529449+0000 mgr.gibba044.wflcwh (mgr.34466) 540 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:17:45.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:44 gibba044 bash[25485]: cephadm 2021-03-10T20:17:43.530985+0000 mgr.gibba044.wflcwh (mgr.34466) 541 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:17:45.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:44 gibba044 bash[25485]: cephadm 2021-03-10T20:17:43.531022+0000 mgr.gibba044.wflcwh (mgr.34466) 542 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:17:45.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:44 gibba044 bash[25485]: audit 2021-03-10T20:17:43.531595+0000 mon.a (mon.0) 691 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:45.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:44 gibba044 bash[25485]: cephadm 2021-03-10T20:17:43.532614+0000 mgr.gibba044.wflcwh (mgr.34466) 543 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:17:45.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:44 gibba044 bash[25485]: audit 2021-03-10T20:17:43.533319+0000 mon.a (mon.0) 692 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:45.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:44 gibba044 bash[25485]: cephadm 2021-03-10T20:17:43.533986+0000 mgr.gibba044.wflcwh (mgr.34466) 544 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:17:45.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:44 gibba044 bash[25485]: cephadm 2021-03-10T20:17:43.534024+0000 mgr.gibba044.wflcwh (mgr.34466) 545 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:17:45.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:44 gibba044 bash[25485]: cephadm 2021-03-10T20:17:43.535513+0000 mgr.gibba044.wflcwh (mgr.34466) 546 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:17:45.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:44 gibba044 bash[25485]: cephadm 2021-03-10T20:17:43.535891+0000 mgr.gibba044.wflcwh (mgr.34466) 547 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:17:45.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:44 gibba044 bash[25485]: cephadm 2021-03-10T20:17:43.537407+0000 mgr.gibba044.wflcwh (mgr.34466) 548 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:17:45.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:44 gibba044 bash[25485]: cephadm 2021-03-10T20:17:43.537445+0000 mgr.gibba044.wflcwh (mgr.34466) 549 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:17:45.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:44 gibba044 bash[25485]: cephadm 2021-03-10T20:17:43.537654+0000 mgr.gibba044.wflcwh (mgr.34466) 550 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:17:45.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:45 gibba023 bash[30844]: cluster 2021-03-10T20:17:43.580536+0000 mgr.gibba044.wflcwh (mgr.34466) 551 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:45.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:45 gibba023 bash[31815]: cluster 2021-03-10T20:17:43.580536+0000 mgr.gibba044.wflcwh (mgr.34466) 551 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:45.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:45 gibba044 bash[25485]: cluster 2021-03-10T20:17:43.580536+0000 mgr.gibba044.wflcwh (mgr.34466) 551 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:47.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:47 gibba023 bash[30844]: cluster 2021-03-10T20:17:45.581937+0000 mgr.gibba044.wflcwh (mgr.34466) 552 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:47.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:47 gibba023 bash[31815]: cluster 2021-03-10T20:17:45.581937+0000 mgr.gibba044.wflcwh (mgr.34466) 552 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:47.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:47 gibba044 bash[25485]: cluster 2021-03-10T20:17:45.581937+0000 mgr.gibba044.wflcwh (mgr.34466) 552 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:49.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:49 gibba023 bash[30844]: cluster 2021-03-10T20:17:47.583554+0000 mgr.gibba044.wflcwh (mgr.34466) 553 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:49.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:49 gibba023 bash[31815]: cluster 2021-03-10T20:17:47.583554+0000 mgr.gibba044.wflcwh (mgr.34466) 553 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:49.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:49 gibba044 bash[25485]: cluster 2021-03-10T20:17:47.583554+0000 mgr.gibba044.wflcwh (mgr.34466) 553 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:51.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:51 gibba023 bash[30844]: cluster 2021-03-10T20:17:49.584130+0000 mgr.gibba044.wflcwh (mgr.34466) 554 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:51.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:51 gibba023 bash[31815]: cluster 2021-03-10T20:17:49.584130+0000 mgr.gibba044.wflcwh (mgr.34466) 554 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:51.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:51 gibba044 bash[25485]: cluster 2021-03-10T20:17:49.584130+0000 mgr.gibba044.wflcwh (mgr.34466) 554 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:53.922 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:53 gibba023 bash[30844]: cluster 2021-03-10T20:17:51.584497+0000 mgr.gibba044.wflcwh (mgr.34466) 555 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:53.923 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:53 gibba023 bash[31815]: cluster 2021-03-10T20:17:51.584497+0000 mgr.gibba044.wflcwh (mgr.34466) 555 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:53.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:53 gibba044 bash[25485]: cluster 2021-03-10T20:17:51.584497+0000 mgr.gibba044.wflcwh (mgr.34466) 555 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:54.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:54 gibba023 bash[30844]: cluster 2021-03-10T20:17:53.585111+0000 mgr.gibba044.wflcwh (mgr.34466) 556 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:54.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:54 gibba023 bash[31815]: cluster 2021-03-10T20:17:53.585111+0000 mgr.gibba044.wflcwh (mgr.34466) 556 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:54.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:54 gibba044 bash[25485]: cluster 2021-03-10T20:17:53.585111+0000 mgr.gibba044.wflcwh (mgr.34466) 556 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:57.423 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:57 gibba023 bash[30844]: cluster 2021-03-10T20:17:55.586687+0000 mgr.gibba044.wflcwh (mgr.34466) 557 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:57.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:57 gibba023 bash[31815]: cluster 2021-03-10T20:17:55.586687+0000 mgr.gibba044.wflcwh (mgr.34466) 557 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:57.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:57 gibba044 bash[25485]: cluster 2021-03-10T20:17:55.586687+0000 mgr.gibba044.wflcwh (mgr.34466) 557 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:58.069 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:17:58.300 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:17:58.301 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (9m) 6m ago 14m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:17:58.301 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (14m) 4m ago 14m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:17:58.301 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (9m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:17:58.301 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (9m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:17:58.302 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (8m) 6m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:17:58.302 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (8m) 6m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:17:58.302 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (8m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:17:58.302 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (8m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:17:58.303 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (14m) 6m ago 14m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:17:58.303 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (14m) 4m ago 14m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:17:58.303 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (7m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:17:58.303 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (6m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:17:58.303 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (6m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:17:58.304 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (6m) 6m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:17:58.304 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (5m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:17:58.304 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (5m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:17:58.304 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (4m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:17:58.305 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (4m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:17:58.305 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (14m) 4m ago 14m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:17:58.305 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 6m ago 12m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:17:58.305 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 4m ago 12m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:17:58.553 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:17:58.553 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:17:58.553 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:17:58.553 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:17:58.554 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:17:58.554 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:17:58.554 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:17:58.554 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:17:58.555 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:17:58.555 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:17:58.555 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:17:58.555 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:17:58.556 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:17:58.556 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:17:58.556 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:17:59.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:59 gibba044 bash[25485]: cluster 2021-03-10T20:17:57.588183+0000 mgr.gibba044.wflcwh (mgr.34466) 558 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:59.603 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:59 gibba044 bash[25485]: audit 2021-03-10T20:17:58.064362+0000 mgr.gibba044.wflcwh (mgr.34466) 559 : audit [DBG] from='client.54415 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:17:59.604 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:59 gibba044 bash[25485]: audit 2021-03-10T20:17:58.294875+0000 mgr.gibba044.wflcwh (mgr.34466) 560 : audit [DBG] from='client.54421 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:17:59.604 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:59 gibba044 bash[25485]: cephadm 2021-03-10T20:17:58.548324+0000 mgr.gibba044.wflcwh (mgr.34466) 561 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:17:59.604 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:17:59 gibba044 bash[25485]: audit 2021-03-10T20:17:58.554084+0000 mon.a (mon.0) 693 : audit [DBG] from='client.? 172.21.2.123:0/3178692596' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:59.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:59 gibba023 bash[30844]: cluster 2021-03-10T20:17:57.588183+0000 mgr.gibba044.wflcwh (mgr.34466) 558 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:59.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:59 gibba023 bash[30844]: audit 2021-03-10T20:17:58.064362+0000 mgr.gibba044.wflcwh (mgr.34466) 559 : audit [DBG] from='client.54415 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:17:59.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:59 gibba023 bash[30844]: audit 2021-03-10T20:17:58.294875+0000 mgr.gibba044.wflcwh (mgr.34466) 560 : audit [DBG] from='client.54421 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:17:59.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:59 gibba023 bash[30844]: cephadm 2021-03-10T20:17:58.548324+0000 mgr.gibba044.wflcwh (mgr.34466) 561 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:17:59.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:17:59 gibba023 bash[30844]: audit 2021-03-10T20:17:58.554084+0000 mon.a (mon.0) 693 : audit [DBG] from='client.? 172.21.2.123:0/3178692596' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:17:59.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:59 gibba023 bash[31815]: cluster 2021-03-10T20:17:57.588183+0000 mgr.gibba044.wflcwh (mgr.34466) 558 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:17:59.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:59 gibba023 bash[31815]: audit 2021-03-10T20:17:58.064362+0000 mgr.gibba044.wflcwh (mgr.34466) 559 : audit [DBG] from='client.54415 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:17:59.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:59 gibba023 bash[31815]: audit 2021-03-10T20:17:58.294875+0000 mgr.gibba044.wflcwh (mgr.34466) 560 : audit [DBG] from='client.54421 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:17:59.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:59 gibba023 bash[31815]: cephadm 2021-03-10T20:17:58.548324+0000 mgr.gibba044.wflcwh (mgr.34466) 561 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:17:59.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:17:59 gibba023 bash[31815]: audit 2021-03-10T20:17:58.554084+0000 mon.a (mon.0) 693 : audit [DBG] from='client.? 172.21.2.123:0/3178692596' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:01.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:01 gibba044 bash[25485]: cluster 2021-03-10T20:17:59.589499+0000 mgr.gibba044.wflcwh (mgr.34466) 562 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:01.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:01 gibba023 bash[30844]: cluster 2021-03-10T20:17:59.589499+0000 mgr.gibba044.wflcwh (mgr.34466) 562 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:01.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:01 gibba023 bash[31815]: cluster 2021-03-10T20:17:59.589499+0000 mgr.gibba044.wflcwh (mgr.34466) 562 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:03.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:03 gibba044 bash[25485]: cluster 2021-03-10T20:18:01.590961+0000 mgr.gibba044.wflcwh (mgr.34466) 563 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:03.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:03 gibba023 bash[30844]: cluster 2021-03-10T20:18:01.590961+0000 mgr.gibba044.wflcwh (mgr.34466) 563 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:03.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:03 gibba023 bash[31815]: cluster 2021-03-10T20:18:01.590961+0000 mgr.gibba044.wflcwh (mgr.34466) 563 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:05.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:05 gibba044 bash[25485]: cluster 2021-03-10T20:18:03.592803+0000 mgr.gibba044.wflcwh (mgr.34466) 564 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:05.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:05 gibba023 bash[30844]: cluster 2021-03-10T20:18:03.592803+0000 mgr.gibba044.wflcwh (mgr.34466) 564 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:05.673 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:05 gibba023 bash[31815]: cluster 2021-03-10T20:18:03.592803+0000 mgr.gibba044.wflcwh (mgr.34466) 564 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:07.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:07 gibba044 bash[25485]: cluster 2021-03-10T20:18:05.594407+0000 mgr.gibba044.wflcwh (mgr.34466) 565 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:07.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:07 gibba023 bash[30844]: cluster 2021-03-10T20:18:05.594407+0000 mgr.gibba044.wflcwh (mgr.34466) 565 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:07.673 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:07 gibba023 bash[31815]: cluster 2021-03-10T20:18:05.594407+0000 mgr.gibba044.wflcwh (mgr.34466) 565 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:09.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:09 gibba044 bash[25485]: cluster 2021-03-10T20:18:07.596099+0000 mgr.gibba044.wflcwh (mgr.34466) 566 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:09.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:09 gibba023 bash[30844]: cluster 2021-03-10T20:18:07.596099+0000 mgr.gibba044.wflcwh (mgr.34466) 566 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:09.673 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:09 gibba023 bash[31815]: cluster 2021-03-10T20:18:07.596099+0000 mgr.gibba044.wflcwh (mgr.34466) 566 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:11.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:11 gibba044 bash[25485]: cluster 2021-03-10T20:18:09.597423+0000 mgr.gibba044.wflcwh (mgr.34466) 567 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:11.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:11 gibba023 bash[30844]: cluster 2021-03-10T20:18:09.597423+0000 mgr.gibba044.wflcwh (mgr.34466) 567 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:11.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:11 gibba023 bash[31815]: cluster 2021-03-10T20:18:09.597423+0000 mgr.gibba044.wflcwh (mgr.34466) 567 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:13.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:13 gibba044 bash[25485]: cluster 2021-03-10T20:18:11.599005+0000 mgr.gibba044.wflcwh (mgr.34466) 568 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:13.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:13 gibba023 bash[30844]: cluster 2021-03-10T20:18:11.599005+0000 mgr.gibba044.wflcwh (mgr.34466) 568 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:13.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:13 gibba023 bash[31815]: cluster 2021-03-10T20:18:11.599005+0000 mgr.gibba044.wflcwh (mgr.34466) 568 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:14.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:14 gibba023 bash[30844]: cephadm 2021-03-10T20:18:13.564148+0000 mgr.gibba044.wflcwh (mgr.34466) 569 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:18:14.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:14 gibba023 bash[31815]: cephadm 2021-03-10T20:18:13.564148+0000 mgr.gibba044.wflcwh (mgr.34466) 569 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:18:14.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:14 gibba044 bash[25485]: cephadm 2021-03-10T20:18:13.564148+0000 mgr.gibba044.wflcwh (mgr.34466) 569 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:18:15.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:15 gibba023 bash[30844]: cluster 2021-03-10T20:18:13.600855+0000 mgr.gibba044.wflcwh (mgr.34466) 570 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:15.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:15 gibba023 bash[31815]: cluster 2021-03-10T20:18:13.600855+0000 mgr.gibba044.wflcwh (mgr.34466) 570 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:15.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:15 gibba044 bash[25485]: cluster 2021-03-10T20:18:13.600855+0000 mgr.gibba044.wflcwh (mgr.34466) 570 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:17.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:17 gibba023 bash[30844]: cluster 2021-03-10T20:18:15.602486+0000 mgr.gibba044.wflcwh (mgr.34466) 571 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:17.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:17 gibba023 bash[31815]: cluster 2021-03-10T20:18:15.602486+0000 mgr.gibba044.wflcwh (mgr.34466) 571 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:17.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:17 gibba044 bash[25485]: cluster 2021-03-10T20:18:15.602486+0000 mgr.gibba044.wflcwh (mgr.34466) 571 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:19.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:19 gibba023 bash[30844]: cluster 2021-03-10T20:18:17.604203+0000 mgr.gibba044.wflcwh (mgr.34466) 572 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:19.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:19 gibba023 bash[31815]: cluster 2021-03-10T20:18:17.604203+0000 mgr.gibba044.wflcwh (mgr.34466) 572 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:19.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:19 gibba044 bash[25485]: cluster 2021-03-10T20:18:17.604203+0000 mgr.gibba044.wflcwh (mgr.34466) 572 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:21.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:21 gibba023 bash[30844]: cluster 2021-03-10T20:18:19.605431+0000 mgr.gibba044.wflcwh (mgr.34466) 573 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:21.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:21 gibba023 bash[31815]: cluster 2021-03-10T20:18:19.605431+0000 mgr.gibba044.wflcwh (mgr.34466) 573 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:21.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:21 gibba044 bash[25485]: cluster 2021-03-10T20:18:19.605431+0000 mgr.gibba044.wflcwh (mgr.34466) 573 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:23.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:23 gibba023 bash[30844]: cluster 2021-03-10T20:18:21.606899+0000 mgr.gibba044.wflcwh (mgr.34466) 574 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:23.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:23 gibba023 bash[31815]: cluster 2021-03-10T20:18:21.606899+0000 mgr.gibba044.wflcwh (mgr.34466) 574 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:23.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:23 gibba044 bash[25485]: cluster 2021-03-10T20:18:21.606899+0000 mgr.gibba044.wflcwh (mgr.34466) 574 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:25.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:25 gibba023 bash[30844]: cluster 2021-03-10T20:18:23.608610+0000 mgr.gibba044.wflcwh (mgr.34466) 575 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:25.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:25 gibba023 bash[31815]: cluster 2021-03-10T20:18:23.608610+0000 mgr.gibba044.wflcwh (mgr.34466) 575 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:25.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:25 gibba044 bash[25485]: cluster 2021-03-10T20:18:23.608610+0000 mgr.gibba044.wflcwh (mgr.34466) 575 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:27.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:27 gibba023 bash[30844]: cluster 2021-03-10T20:18:25.610303+0000 mgr.gibba044.wflcwh (mgr.34466) 576 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:27.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:27 gibba023 bash[30844]: audit 2021-03-10T20:18:27.012573+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T20:18:27.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:27 gibba023 bash[30844]: audit 2021-03-10T20:18:27.013415+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T20:18:27.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:27 gibba023 bash[30844]: audit 2021-03-10T20:18:27.014104+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:18:27.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:27 gibba023 bash[30844]: audit 2021-03-10T20:18:27.014826+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:18:27.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:27 gibba023 bash[30844]: audit 2021-03-10T20:18:27.096268+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:18:27.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:27 gibba023 bash[30844]: audit 2021-03-10T20:18:27.096899+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:18:27.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:27 gibba023 bash[31815]: cluster 2021-03-10T20:18:25.610303+0000 mgr.gibba044.wflcwh (mgr.34466) 576 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:27.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:27 gibba023 bash[31815]: audit 2021-03-10T20:18:27.012573+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T20:18:27.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:27 gibba023 bash[31815]: audit 2021-03-10T20:18:27.013415+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T20:18:27.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:27 gibba023 bash[31815]: audit 2021-03-10T20:18:27.014104+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:18:27.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:27 gibba023 bash[31815]: audit 2021-03-10T20:18:27.014826+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:18:27.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:27 gibba023 bash[31815]: audit 2021-03-10T20:18:27.096268+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:18:27.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:27 gibba023 bash[31815]: audit 2021-03-10T20:18:27.096899+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:18:27.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:27 gibba044 bash[25485]: cluster 2021-03-10T20:18:25.610303+0000 mgr.gibba044.wflcwh (mgr.34466) 576 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:27.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:27 gibba044 bash[25485]: audit 2021-03-10T20:18:27.012573+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T20:18:27.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:27 gibba044 bash[25485]: audit 2021-03-10T20:18:27.013415+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 5]}]: dispatch 2021-03-10T20:18:27.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:27 gibba044 bash[25485]: audit 2021-03-10T20:18:27.014104+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:18:27.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:27 gibba044 bash[25485]: audit 2021-03-10T20:18:27.014826+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:18:27.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:27 gibba044 bash[25485]: audit 2021-03-10T20:18:27.096268+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:18:27.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:27 gibba044 bash[25485]: audit 2021-03-10T20:18:27.096899+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:18:28.800 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:18:29.030 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:18:29.030 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (9m) 6m ago 15m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:18:29.031 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (14m) 4m ago 14m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:18:29.031 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (9m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:18:29.031 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (10m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:18:29.031 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (9m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:18:29.032 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (9m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:18:29.032 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (8m) 4m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:18:29.032 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (8m) 6m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:18:29.032 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (15m) 6m ago 15m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:18:29.032 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (15m) 4m ago 15m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:18:29.033 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (7m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:18:29.033 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (7m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:18:29.033 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (6m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:18:29.033 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (6m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:18:29.034 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (6m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:18:29.034 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (5m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:18:29.034 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (5m) 4m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:18:29.034 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (4m) 4m ago 15m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:18:29.034 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (14m) 4m ago 15m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:18:29.035 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 6m ago 13m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:18:29.035 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 4m ago 13m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:18:29.280 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:18:29.280 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:18:29.280 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:18:29.280 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:18:29.281 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:18:29.281 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:18:29.281 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:18:29.281 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:18:29.282 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:18:29.282 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:18:29.282 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:18:29.282 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:18:29.282 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:18:29.283 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:18:29.283 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:18:29.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:29 gibba023 bash[30844]: cluster 2021-03-10T20:18:27.612017+0000 mgr.gibba044.wflcwh (mgr.34466) 577 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:29.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:29 gibba023 bash[30844]: cephadm 2021-03-10T20:18:28.580110+0000 mgr.gibba044.wflcwh (mgr.34466) 578 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:18:29.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:29 gibba023 bash[30844]: audit 2021-03-10T20:18:29.281046+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.2.123:0/4135015655' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:29.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:29 gibba023 bash[31815]: cluster 2021-03-10T20:18:27.612017+0000 mgr.gibba044.wflcwh (mgr.34466) 577 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:29.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:29 gibba023 bash[31815]: cephadm 2021-03-10T20:18:28.580110+0000 mgr.gibba044.wflcwh (mgr.34466) 578 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:18:29.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:29 gibba023 bash[31815]: audit 2021-03-10T20:18:29.281046+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.2.123:0/4135015655' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:29.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:29 gibba044 bash[25485]: cluster 2021-03-10T20:18:27.612017+0000 mgr.gibba044.wflcwh (mgr.34466) 577 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:29.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:29 gibba044 bash[25485]: cephadm 2021-03-10T20:18:28.580110+0000 mgr.gibba044.wflcwh (mgr.34466) 578 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:18:29.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:29 gibba044 bash[25485]: audit 2021-03-10T20:18:29.281046+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.2.123:0/4135015655' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:30.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:30 gibba023 bash[30844]: audit 2021-03-10T20:18:28.795257+0000 mgr.gibba044.wflcwh (mgr.34466) 579 : audit [DBG] from='client.54433 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:18:30.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:30 gibba023 bash[30844]: audit 2021-03-10T20:18:29.022422+0000 mgr.gibba044.wflcwh (mgr.34466) 580 : audit [DBG] from='client.44460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:18:30.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:30 gibba023 bash[31815]: audit 2021-03-10T20:18:28.795257+0000 mgr.gibba044.wflcwh (mgr.34466) 579 : audit [DBG] from='client.54433 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:18:30.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:30 gibba023 bash[31815]: audit 2021-03-10T20:18:29.022422+0000 mgr.gibba044.wflcwh (mgr.34466) 580 : audit [DBG] from='client.44460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:18:30.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:30 gibba044 bash[25485]: audit 2021-03-10T20:18:28.795257+0000 mgr.gibba044.wflcwh (mgr.34466) 579 : audit [DBG] from='client.54433 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:18:30.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:30 gibba044 bash[25485]: audit 2021-03-10T20:18:29.022422+0000 mgr.gibba044.wflcwh (mgr.34466) 580 : audit [DBG] from='client.44460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:18:31.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:31 gibba023 bash[30844]: cluster 2021-03-10T20:18:29.613261+0000 mgr.gibba044.wflcwh (mgr.34466) 581 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:31.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:31 gibba023 bash[31815]: cluster 2021-03-10T20:18:29.613261+0000 mgr.gibba044.wflcwh (mgr.34466) 581 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:31.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:31 gibba044 bash[25485]: cluster 2021-03-10T20:18:29.613261+0000 mgr.gibba044.wflcwh (mgr.34466) 581 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:33.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:33 gibba023 bash[30844]: cluster 2021-03-10T20:18:31.614788+0000 mgr.gibba044.wflcwh (mgr.34466) 582 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:33.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:33 gibba023 bash[31815]: cluster 2021-03-10T20:18:31.614788+0000 mgr.gibba044.wflcwh (mgr.34466) 582 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:33.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:33 gibba044 bash[25485]: cluster 2021-03-10T20:18:31.614788+0000 mgr.gibba044.wflcwh (mgr.34466) 582 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:35.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:35 gibba023 bash[30844]: cluster 2021-03-10T20:18:33.616569+0000 mgr.gibba044.wflcwh (mgr.34466) 583 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:35.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:35 gibba023 bash[31815]: cluster 2021-03-10T20:18:33.616569+0000 mgr.gibba044.wflcwh (mgr.34466) 583 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:35.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:35 gibba044 bash[25485]: cluster 2021-03-10T20:18:33.616569+0000 mgr.gibba044.wflcwh (mgr.34466) 583 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:37.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:37 gibba023 bash[30844]: cluster 2021-03-10T20:18:35.618033+0000 mgr.gibba044.wflcwh (mgr.34466) 584 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:37.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:37 gibba023 bash[31815]: cluster 2021-03-10T20:18:35.618033+0000 mgr.gibba044.wflcwh (mgr.34466) 584 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:37.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:37 gibba044 bash[25485]: cluster 2021-03-10T20:18:35.618033+0000 mgr.gibba044.wflcwh (mgr.34466) 584 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:39.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:39 gibba023 bash[30844]: cluster 2021-03-10T20:18:37.619437+0000 mgr.gibba044.wflcwh (mgr.34466) 585 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:39.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:39 gibba023 bash[31815]: cluster 2021-03-10T20:18:37.619437+0000 mgr.gibba044.wflcwh (mgr.34466) 585 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:39.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:39 gibba044 bash[25485]: cluster 2021-03-10T20:18:37.619437+0000 mgr.gibba044.wflcwh (mgr.34466) 585 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:41.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:41 gibba023 bash[30844]: cluster 2021-03-10T20:18:39.620753+0000 mgr.gibba044.wflcwh (mgr.34466) 586 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:41.673 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:41 gibba023 bash[31815]: cluster 2021-03-10T20:18:39.620753+0000 mgr.gibba044.wflcwh (mgr.34466) 586 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:41.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:41 gibba044 bash[25485]: cluster 2021-03-10T20:18:39.620753+0000 mgr.gibba044.wflcwh (mgr.34466) 586 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:43.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:43 gibba023 bash[30844]: cluster 2021-03-10T20:18:41.622314+0000 mgr.gibba044.wflcwh (mgr.34466) 587 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:43.673 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:43 gibba023 bash[31815]: cluster 2021-03-10T20:18:41.622314+0000 mgr.gibba044.wflcwh (mgr.34466) 587 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:43.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:43 gibba044 bash[25485]: cluster 2021-03-10T20:18:41.622314+0000 mgr.gibba044.wflcwh (mgr.34466) 587 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:45.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[30844]: cephadm 2021-03-10T20:18:43.593816+0000 mgr.gibba044.wflcwh (mgr.34466) 588 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:18:45.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[30844]: cluster 2021-03-10T20:18:43.622875+0000 mgr.gibba044.wflcwh (mgr.34466) 589 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:45.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[30844]: audit 2021-03-10T20:18:43.795278+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:18:45.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[30844]: cephadm 2021-03-10T20:18:43.799148+0000 mgr.gibba044.wflcwh (mgr.34466) 590 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:18:45.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[30844]: audit 2021-03-10T20:18:44.036402+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:18:45.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[30844]: audit 2021-03-10T20:18:44.049301+0000 mon.a (mon.0) 702 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:18:45.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[30844]: cephadm 2021-03-10T20:18:44.051652+0000 mgr.gibba044.wflcwh (mgr.34466) 591 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:18:45.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[30844]: audit 2021-03-10T20:18:44.052017+0000 mon.a (mon.0) 703 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:45.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[30844]: audit 2021-03-10T20:18:44.054440+0000 mon.a (mon.0) 704 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:45.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[30844]: cephadm 2021-03-10T20:18:44.054763+0000 mgr.gibba044.wflcwh (mgr.34466) 592 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:18:45.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[30844]: audit 2021-03-10T20:18:44.056733+0000 mon.a (mon.0) 705 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:45.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[30844]: cephadm 2021-03-10T20:18:44.057060+0000 mgr.gibba044.wflcwh (mgr.34466) 593 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:18:45.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[30844]: cephadm 2021-03-10T20:18:44.057097+0000 mgr.gibba044.wflcwh (mgr.34466) 594 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:18:45.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[30844]: cephadm 2021-03-10T20:18:44.059405+0000 mgr.gibba044.wflcwh (mgr.34466) 595 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:18:45.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[30844]: cephadm 2021-03-10T20:18:44.059443+0000 mgr.gibba044.wflcwh (mgr.34466) 596 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:18:45.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[30844]: audit 2021-03-10T20:18:44.061073+0000 mon.a (mon.0) 706 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:45.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[30844]: cephadm 2021-03-10T20:18:44.061695+0000 mgr.gibba044.wflcwh (mgr.34466) 597 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:18:45.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[30844]: cephadm 2021-03-10T20:18:44.063579+0000 mgr.gibba044.wflcwh (mgr.34466) 598 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:18:45.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[30844]: audit 2021-03-10T20:18:44.063649+0000 mon.a (mon.0) 707 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:45.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[30844]: cephadm 2021-03-10T20:18:44.063664+0000 mgr.gibba044.wflcwh (mgr.34466) 599 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:18:45.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[31815]: cephadm 2021-03-10T20:18:43.593816+0000 mgr.gibba044.wflcwh (mgr.34466) 588 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:18:45.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[31815]: cluster 2021-03-10T20:18:43.622875+0000 mgr.gibba044.wflcwh (mgr.34466) 589 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:45.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[31815]: audit 2021-03-10T20:18:43.795278+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:18:45.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[31815]: cephadm 2021-03-10T20:18:43.799148+0000 mgr.gibba044.wflcwh (mgr.34466) 590 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:18:45.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[31815]: audit 2021-03-10T20:18:44.036402+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:18:45.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[31815]: audit 2021-03-10T20:18:44.049301+0000 mon.a (mon.0) 702 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:18:45.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[31815]: cephadm 2021-03-10T20:18:44.051652+0000 mgr.gibba044.wflcwh (mgr.34466) 591 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:18:45.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[31815]: audit 2021-03-10T20:18:44.052017+0000 mon.a (mon.0) 703 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:45.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[31815]: audit 2021-03-10T20:18:44.054440+0000 mon.a (mon.0) 704 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:45.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[31815]: cephadm 2021-03-10T20:18:44.054763+0000 mgr.gibba044.wflcwh (mgr.34466) 592 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:18:45.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[31815]: audit 2021-03-10T20:18:44.056733+0000 mon.a (mon.0) 705 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:45.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[31815]: cephadm 2021-03-10T20:18:44.057060+0000 mgr.gibba044.wflcwh (mgr.34466) 593 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:18:45.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[31815]: cephadm 2021-03-10T20:18:44.057097+0000 mgr.gibba044.wflcwh (mgr.34466) 594 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:18:45.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[31815]: cephadm 2021-03-10T20:18:44.059405+0000 mgr.gibba044.wflcwh (mgr.34466) 595 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:18:45.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[31815]: cephadm 2021-03-10T20:18:44.059443+0000 mgr.gibba044.wflcwh (mgr.34466) 596 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:18:45.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[31815]: audit 2021-03-10T20:18:44.061073+0000 mon.a (mon.0) 706 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:45.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[31815]: cephadm 2021-03-10T20:18:44.061695+0000 mgr.gibba044.wflcwh (mgr.34466) 597 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:18:45.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[31815]: cephadm 2021-03-10T20:18:44.063579+0000 mgr.gibba044.wflcwh (mgr.34466) 598 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:18:45.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[31815]: audit 2021-03-10T20:18:44.063649+0000 mon.a (mon.0) 707 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:45.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[31815]: cephadm 2021-03-10T20:18:44.063664+0000 mgr.gibba044.wflcwh (mgr.34466) 599 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:18:45.184 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[30844]: cephadm 2021-03-10T20:18:44.066036+0000 mgr.gibba044.wflcwh (mgr.34466) 600 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:18:45.184 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[30844]: cephadm 2021-03-10T20:18:44.066398+0000 mgr.gibba044.wflcwh (mgr.34466) 601 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:18:45.184 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[30844]: cephadm 2021-03-10T20:18:44.068583+0000 mgr.gibba044.wflcwh (mgr.34466) 602 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:18:45.185 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[30844]: cephadm 2021-03-10T20:18:44.068633+0000 mgr.gibba044.wflcwh (mgr.34466) 603 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:18:45.185 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[30844]: cephadm 2021-03-10T20:18:44.068812+0000 mgr.gibba044.wflcwh (mgr.34466) 604 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:18:45.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[31815]: cephadm 2021-03-10T20:18:44.066036+0000 mgr.gibba044.wflcwh (mgr.34466) 600 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:18:45.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[31815]: cephadm 2021-03-10T20:18:44.066398+0000 mgr.gibba044.wflcwh (mgr.34466) 601 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:18:45.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[31815]: cephadm 2021-03-10T20:18:44.068583+0000 mgr.gibba044.wflcwh (mgr.34466) 602 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:18:45.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[31815]: cephadm 2021-03-10T20:18:44.068633+0000 mgr.gibba044.wflcwh (mgr.34466) 603 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:18:45.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:44 gibba023 bash[31815]: cephadm 2021-03-10T20:18:44.068812+0000 mgr.gibba044.wflcwh (mgr.34466) 604 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:18:45.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:44 gibba044 bash[25485]: cephadm 2021-03-10T20:18:43.593816+0000 mgr.gibba044.wflcwh (mgr.34466) 588 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:18:45.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:44 gibba044 bash[25485]: cluster 2021-03-10T20:18:43.622875+0000 mgr.gibba044.wflcwh (mgr.34466) 589 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:45.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:44 gibba044 bash[25485]: audit 2021-03-10T20:18:43.795278+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:18:45.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:44 gibba044 bash[25485]: cephadm 2021-03-10T20:18:43.799148+0000 mgr.gibba044.wflcwh (mgr.34466) 590 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:18:45.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:44 gibba044 bash[25485]: audit 2021-03-10T20:18:44.036402+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:18:45.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:44 gibba044 bash[25485]: audit 2021-03-10T20:18:44.049301+0000 mon.a (mon.0) 702 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:18:45.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:44 gibba044 bash[25485]: cephadm 2021-03-10T20:18:44.051652+0000 mgr.gibba044.wflcwh (mgr.34466) 591 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:18:45.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:44 gibba044 bash[25485]: audit 2021-03-10T20:18:44.052017+0000 mon.a (mon.0) 703 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:45.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:44 gibba044 bash[25485]: audit 2021-03-10T20:18:44.054440+0000 mon.a (mon.0) 704 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:45.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:44 gibba044 bash[25485]: cephadm 2021-03-10T20:18:44.054763+0000 mgr.gibba044.wflcwh (mgr.34466) 592 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:18:45.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:44 gibba044 bash[25485]: audit 2021-03-10T20:18:44.056733+0000 mon.a (mon.0) 705 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:45.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:44 gibba044 bash[25485]: cephadm 2021-03-10T20:18:44.057060+0000 mgr.gibba044.wflcwh (mgr.34466) 593 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:18:45.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:44 gibba044 bash[25485]: cephadm 2021-03-10T20:18:44.057097+0000 mgr.gibba044.wflcwh (mgr.34466) 594 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:18:45.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:44 gibba044 bash[25485]: cephadm 2021-03-10T20:18:44.059405+0000 mgr.gibba044.wflcwh (mgr.34466) 595 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:18:45.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:44 gibba044 bash[25485]: cephadm 2021-03-10T20:18:44.059443+0000 mgr.gibba044.wflcwh (mgr.34466) 596 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:18:45.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:44 gibba044 bash[25485]: audit 2021-03-10T20:18:44.061073+0000 mon.a (mon.0) 706 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:45.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:44 gibba044 bash[25485]: cephadm 2021-03-10T20:18:44.061695+0000 mgr.gibba044.wflcwh (mgr.34466) 597 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:18:45.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:44 gibba044 bash[25485]: cephadm 2021-03-10T20:18:44.063579+0000 mgr.gibba044.wflcwh (mgr.34466) 598 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:18:45.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:44 gibba044 bash[25485]: audit 2021-03-10T20:18:44.063649+0000 mon.a (mon.0) 707 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:18:45.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:44 gibba044 bash[25485]: cephadm 2021-03-10T20:18:44.063664+0000 mgr.gibba044.wflcwh (mgr.34466) 599 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:18:45.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:44 gibba044 bash[25485]: cephadm 2021-03-10T20:18:44.066036+0000 mgr.gibba044.wflcwh (mgr.34466) 600 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:18:45.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:44 gibba044 bash[25485]: cephadm 2021-03-10T20:18:44.066398+0000 mgr.gibba044.wflcwh (mgr.34466) 601 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:18:45.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:44 gibba044 bash[25485]: cephadm 2021-03-10T20:18:44.068583+0000 mgr.gibba044.wflcwh (mgr.34466) 602 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:18:45.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:44 gibba044 bash[25485]: cephadm 2021-03-10T20:18:44.068633+0000 mgr.gibba044.wflcwh (mgr.34466) 603 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:18:45.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:44 gibba044 bash[25485]: cephadm 2021-03-10T20:18:44.068812+0000 mgr.gibba044.wflcwh (mgr.34466) 604 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:18:47.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:47 gibba044 bash[25485]: cluster 2021-03-10T20:18:45.624398+0000 mgr.gibba044.wflcwh (mgr.34466) 605 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:47.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:47 gibba023 bash[30844]: cluster 2021-03-10T20:18:45.624398+0000 mgr.gibba044.wflcwh (mgr.34466) 605 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:47.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:47 gibba023 bash[31815]: cluster 2021-03-10T20:18:45.624398+0000 mgr.gibba044.wflcwh (mgr.34466) 605 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:49.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:49 gibba044 bash[25485]: cluster 2021-03-10T20:18:47.626075+0000 mgr.gibba044.wflcwh (mgr.34466) 606 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:49.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:49 gibba023 bash[30844]: cluster 2021-03-10T20:18:47.626075+0000 mgr.gibba044.wflcwh (mgr.34466) 606 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:49.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:49 gibba023 bash[31815]: cluster 2021-03-10T20:18:47.626075+0000 mgr.gibba044.wflcwh (mgr.34466) 606 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:51.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:51 gibba044 bash[25485]: cluster 2021-03-10T20:18:49.627429+0000 mgr.gibba044.wflcwh (mgr.34466) 607 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:51.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:51 gibba023 bash[30844]: cluster 2021-03-10T20:18:49.627429+0000 mgr.gibba044.wflcwh (mgr.34466) 607 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:51.673 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:51 gibba023 bash[31815]: cluster 2021-03-10T20:18:49.627429+0000 mgr.gibba044.wflcwh (mgr.34466) 607 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:53.496 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:53 gibba044 bash[25485]: cluster 2021-03-10T20:18:51.629006+0000 mgr.gibba044.wflcwh (mgr.34466) 608 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:53.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:53 gibba023 bash[30844]: cluster 2021-03-10T20:18:51.629006+0000 mgr.gibba044.wflcwh (mgr.34466) 608 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:53.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:53 gibba023 bash[31815]: cluster 2021-03-10T20:18:51.629006+0000 mgr.gibba044.wflcwh (mgr.34466) 608 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:55.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:55 gibba044 bash[25485]: cluster 2021-03-10T20:18:53.630794+0000 mgr.gibba044.wflcwh (mgr.34466) 609 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:55.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:55 gibba023 bash[30844]: cluster 2021-03-10T20:18:53.630794+0000 mgr.gibba044.wflcwh (mgr.34466) 609 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:55.673 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:55 gibba023 bash[31815]: cluster 2021-03-10T20:18:53.630794+0000 mgr.gibba044.wflcwh (mgr.34466) 609 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:57.496 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:57 gibba044 bash[25485]: cluster 2021-03-10T20:18:55.632596+0000 mgr.gibba044.wflcwh (mgr.34466) 610 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:57.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:57 gibba023 bash[30844]: cluster 2021-03-10T20:18:55.632596+0000 mgr.gibba044.wflcwh (mgr.34466) 610 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:57.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:57 gibba023 bash[31815]: cluster 2021-03-10T20:18:55.632596+0000 mgr.gibba044.wflcwh (mgr.34466) 610 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:59.497 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:18:59 gibba044 bash[25485]: cluster 2021-03-10T20:18:57.634211+0000 mgr.gibba044.wflcwh (mgr.34466) 611 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:59.525 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:18:59.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:18:59 gibba023 bash[30844]: cluster 2021-03-10T20:18:57.634211+0000 mgr.gibba044.wflcwh (mgr.34466) 611 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:59.673 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:18:59 gibba023 bash[31815]: cluster 2021-03-10T20:18:57.634211+0000 mgr.gibba044.wflcwh (mgr.34466) 611 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:18:59.782 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:18:59.782 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (10m) 7m ago 15m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:18:59.782 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (15m) 5m ago 15m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:18:59.782 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (10m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:18:59.783 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (10m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:18:59.783 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (9m) 7m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:18:59.783 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (9m) 7m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:18:59.783 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (9m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:18:59.784 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (9m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:18:59.784 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (15m) 7m ago 15m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:18:59.784 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (15m) 5m ago 15m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:18:59.784 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (8m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:18:59.784 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (7m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:18:59.785 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (7m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:18:59.785 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (7m) 7m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:18:59.785 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (6m) 5m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:18:59.785 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (6m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:18:59.785 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (5m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:18:59.786 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (5m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:18:59.786 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (15m) 5m ago 15m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:18:59.786 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 7m ago 13m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:18:59.786 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 5m ago 13m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:19:00.038 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:19:00.038 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:19:00.038 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:19:00.039 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:19:00.039 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:19:00.039 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:19:00.039 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:19:00.039 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:19:00.040 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:19:00.040 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:19:00.040 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:19:00.040 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:19:00.040 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:19:00.041 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:19:00.041 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:19:00.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:00 gibba023 bash[30844]: cephadm 2021-03-10T20:18:59.075122+0000 mgr.gibba044.wflcwh (mgr.34466) 612 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:19:00.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:00 gibba023 bash[30844]: audit 2021-03-10T20:18:59.521454+0000 mgr.gibba044.wflcwh (mgr.34466) 613 : audit [DBG] from='client.44472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:19:00.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:00 gibba023 bash[30844]: audit 2021-03-10T20:19:00.039209+0000 mon.a (mon.0) 708 : audit [DBG] from='client.? 172.21.2.123:0/2504369566' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:00.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:00 gibba023 bash[31815]: cephadm 2021-03-10T20:18:59.075122+0000 mgr.gibba044.wflcwh (mgr.34466) 612 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:19:00.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:00 gibba023 bash[31815]: audit 2021-03-10T20:18:59.521454+0000 mgr.gibba044.wflcwh (mgr.34466) 613 : audit [DBG] from='client.44472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:19:00.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:00 gibba023 bash[31815]: audit 2021-03-10T20:19:00.039209+0000 mon.a (mon.0) 708 : audit [DBG] from='client.? 172.21.2.123:0/2504369566' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:00.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:00 gibba044 bash[25485]: cephadm 2021-03-10T20:18:59.075122+0000 mgr.gibba044.wflcwh (mgr.34466) 612 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:19:00.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:00 gibba044 bash[25485]: audit 2021-03-10T20:18:59.521454+0000 mgr.gibba044.wflcwh (mgr.34466) 613 : audit [DBG] from='client.44472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:19:00.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:00 gibba044 bash[25485]: audit 2021-03-10T20:19:00.039209+0000 mon.a (mon.0) 708 : audit [DBG] from='client.? 172.21.2.123:0/2504369566' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:01.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:01 gibba023 bash[30844]: cluster 2021-03-10T20:18:59.635479+0000 mgr.gibba044.wflcwh (mgr.34466) 614 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:01.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:01 gibba023 bash[30844]: audit 2021-03-10T20:18:59.746634+0000 mgr.gibba044.wflcwh (mgr.34466) 615 : audit [DBG] from='client.44478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:19:01.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:01 gibba023 bash[31815]: cluster 2021-03-10T20:18:59.635479+0000 mgr.gibba044.wflcwh (mgr.34466) 614 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:01.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:01 gibba023 bash[31815]: audit 2021-03-10T20:18:59.746634+0000 mgr.gibba044.wflcwh (mgr.34466) 615 : audit [DBG] from='client.44478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:19:01.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:01 gibba044 bash[25485]: cluster 2021-03-10T20:18:59.635479+0000 mgr.gibba044.wflcwh (mgr.34466) 614 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:01.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:01 gibba044 bash[25485]: audit 2021-03-10T20:18:59.746634+0000 mgr.gibba044.wflcwh (mgr.34466) 615 : audit [DBG] from='client.44478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:19:03.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:03 gibba023 bash[30844]: cluster 2021-03-10T20:19:01.636913+0000 mgr.gibba044.wflcwh (mgr.34466) 616 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:03.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:03 gibba023 bash[31815]: cluster 2021-03-10T20:19:01.636913+0000 mgr.gibba044.wflcwh (mgr.34466) 616 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:03.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:03 gibba044 bash[25485]: cluster 2021-03-10T20:19:01.636913+0000 mgr.gibba044.wflcwh (mgr.34466) 616 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:05.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:05 gibba023 bash[30844]: cluster 2021-03-10T20:19:03.638726+0000 mgr.gibba044.wflcwh (mgr.34466) 617 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:05.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:05 gibba023 bash[31815]: cluster 2021-03-10T20:19:03.638726+0000 mgr.gibba044.wflcwh (mgr.34466) 617 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:05.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:05 gibba044 bash[25485]: cluster 2021-03-10T20:19:03.638726+0000 mgr.gibba044.wflcwh (mgr.34466) 617 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:07.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:07 gibba023 bash[30844]: cluster 2021-03-10T20:19:05.640343+0000 mgr.gibba044.wflcwh (mgr.34466) 618 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:07.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:07 gibba023 bash[31815]: cluster 2021-03-10T20:19:05.640343+0000 mgr.gibba044.wflcwh (mgr.34466) 618 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:07.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:07 gibba044 bash[25485]: cluster 2021-03-10T20:19:05.640343+0000 mgr.gibba044.wflcwh (mgr.34466) 618 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:09.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:09 gibba023 bash[30844]: cluster 2021-03-10T20:19:07.641994+0000 mgr.gibba044.wflcwh (mgr.34466) 619 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:09.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:09 gibba023 bash[31815]: cluster 2021-03-10T20:19:07.641994+0000 mgr.gibba044.wflcwh (mgr.34466) 619 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:09.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:09 gibba044 bash[25485]: cluster 2021-03-10T20:19:07.641994+0000 mgr.gibba044.wflcwh (mgr.34466) 619 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:11.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:11 gibba023 bash[30844]: cluster 2021-03-10T20:19:09.643405+0000 mgr.gibba044.wflcwh (mgr.34466) 620 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:11.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:11 gibba023 bash[31815]: cluster 2021-03-10T20:19:09.643405+0000 mgr.gibba044.wflcwh (mgr.34466) 620 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:11.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:11 gibba044 bash[25485]: cluster 2021-03-10T20:19:09.643405+0000 mgr.gibba044.wflcwh (mgr.34466) 620 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:13.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:13 gibba023 bash[30844]: cluster 2021-03-10T20:19:11.644978+0000 mgr.gibba044.wflcwh (mgr.34466) 621 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:13.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:13 gibba023 bash[31815]: cluster 2021-03-10T20:19:11.644978+0000 mgr.gibba044.wflcwh (mgr.34466) 621 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:13.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:13 gibba044 bash[25485]: cluster 2021-03-10T20:19:11.644978+0000 mgr.gibba044.wflcwh (mgr.34466) 621 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:15.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:15 gibba023 bash[30844]: cluster 2021-03-10T20:19:13.646785+0000 mgr.gibba044.wflcwh (mgr.34466) 622 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:15.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:15 gibba023 bash[30844]: cephadm 2021-03-10T20:19:14.091174+0000 mgr.gibba044.wflcwh (mgr.34466) 623 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:19:15.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:15 gibba023 bash[31815]: cluster 2021-03-10T20:19:13.646785+0000 mgr.gibba044.wflcwh (mgr.34466) 622 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:15.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:15 gibba023 bash[31815]: cephadm 2021-03-10T20:19:14.091174+0000 mgr.gibba044.wflcwh (mgr.34466) 623 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:19:15.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:15 gibba044 bash[25485]: cluster 2021-03-10T20:19:13.646785+0000 mgr.gibba044.wflcwh (mgr.34466) 622 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:15.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:15 gibba044 bash[25485]: cephadm 2021-03-10T20:19:14.091174+0000 mgr.gibba044.wflcwh (mgr.34466) 623 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:19:17.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:17 gibba023 bash[30844]: cluster 2021-03-10T20:19:15.648334+0000 mgr.gibba044.wflcwh (mgr.34466) 624 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:17.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:17 gibba023 bash[31815]: cluster 2021-03-10T20:19:15.648334+0000 mgr.gibba044.wflcwh (mgr.34466) 624 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:17.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:17 gibba044 bash[25485]: cluster 2021-03-10T20:19:15.648334+0000 mgr.gibba044.wflcwh (mgr.34466) 624 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:19.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:19 gibba023 bash[30844]: cluster 2021-03-10T20:19:17.649783+0000 mgr.gibba044.wflcwh (mgr.34466) 625 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:19.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:19 gibba023 bash[31815]: cluster 2021-03-10T20:19:17.649783+0000 mgr.gibba044.wflcwh (mgr.34466) 625 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:19.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:19 gibba044 bash[25485]: cluster 2021-03-10T20:19:17.649783+0000 mgr.gibba044.wflcwh (mgr.34466) 625 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:21.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:21 gibba023 bash[30844]: cluster 2021-03-10T20:19:19.651194+0000 mgr.gibba044.wflcwh (mgr.34466) 626 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:21.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:21 gibba023 bash[31815]: cluster 2021-03-10T20:19:19.651194+0000 mgr.gibba044.wflcwh (mgr.34466) 626 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:21.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:21 gibba044 bash[25485]: cluster 2021-03-10T20:19:19.651194+0000 mgr.gibba044.wflcwh (mgr.34466) 626 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:23.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:23 gibba023 bash[30844]: cluster 2021-03-10T20:19:21.652947+0000 mgr.gibba044.wflcwh (mgr.34466) 627 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:23.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:23 gibba023 bash[31815]: cluster 2021-03-10T20:19:21.652947+0000 mgr.gibba044.wflcwh (mgr.34466) 627 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:23.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:23 gibba044 bash[25485]: cluster 2021-03-10T20:19:21.652947+0000 mgr.gibba044.wflcwh (mgr.34466) 627 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:25.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:25 gibba023 bash[30844]: cluster 2021-03-10T20:19:23.654790+0000 mgr.gibba044.wflcwh (mgr.34466) 628 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:25.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:25 gibba023 bash[31815]: cluster 2021-03-10T20:19:23.654790+0000 mgr.gibba044.wflcwh (mgr.34466) 628 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:25.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:25 gibba044 bash[25485]: cluster 2021-03-10T20:19:23.654790+0000 mgr.gibba044.wflcwh (mgr.34466) 628 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:27.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:27 gibba023 bash[30844]: cluster 2021-03-10T20:19:25.656712+0000 mgr.gibba044.wflcwh (mgr.34466) 629 : cluster [DBG] pgmap v344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:27.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:27 gibba023 bash[30844]: audit 2021-03-10T20:19:27.020288+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:19:27.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:27 gibba023 bash[30844]: audit 2021-03-10T20:19:27.021045+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:19:27.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:27 gibba023 bash[30844]: audit 2021-03-10T20:19:27.021791+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:19:27.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:27 gibba023 bash[30844]: audit 2021-03-10T20:19:27.022518+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:19:27.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:27 gibba023 bash[30844]: audit 2021-03-10T20:19:27.099890+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:19:27.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:27 gibba023 bash[30844]: audit 2021-03-10T20:19:27.103339+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:19:27.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:27 gibba023 bash[31815]: cluster 2021-03-10T20:19:25.656712+0000 mgr.gibba044.wflcwh (mgr.34466) 629 : cluster [DBG] pgmap v344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:27.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:27 gibba023 bash[31815]: audit 2021-03-10T20:19:27.020288+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:19:27.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:27 gibba023 bash[31815]: audit 2021-03-10T20:19:27.021045+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:19:27.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:27 gibba023 bash[31815]: audit 2021-03-10T20:19:27.021791+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:19:27.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:27 gibba023 bash[31815]: audit 2021-03-10T20:19:27.022518+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:19:27.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:27 gibba023 bash[31815]: audit 2021-03-10T20:19:27.099890+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:19:27.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:27 gibba023 bash[31815]: audit 2021-03-10T20:19:27.103339+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:19:27.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:27 gibba044 bash[25485]: cluster 2021-03-10T20:19:25.656712+0000 mgr.gibba044.wflcwh (mgr.34466) 629 : cluster [DBG] pgmap v344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:27.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:27 gibba044 bash[25485]: audit 2021-03-10T20:19:27.020288+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:19:27.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:27 gibba044 bash[25485]: audit 2021-03-10T20:19:27.021045+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:19:27.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:27 gibba044 bash[25485]: audit 2021-03-10T20:19:27.021791+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:19:27.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:27 gibba044 bash[25485]: audit 2021-03-10T20:19:27.022518+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:19:27.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:27 gibba044 bash[25485]: audit 2021-03-10T20:19:27.099890+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:19:27.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:27 gibba044 bash[25485]: audit 2021-03-10T20:19:27.103339+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:19:29.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:29 gibba023 bash[30844]: cluster 2021-03-10T20:19:27.658177+0000 mgr.gibba044.wflcwh (mgr.34466) 630 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:29.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:29 gibba023 bash[31815]: cluster 2021-03-10T20:19:27.658177+0000 mgr.gibba044.wflcwh (mgr.34466) 630 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:29.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:29 gibba044 bash[25485]: cluster 2021-03-10T20:19:27.658177+0000 mgr.gibba044.wflcwh (mgr.34466) 630 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:30.278 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:19:30.512 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:19:30.513 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (10m) 7m ago 16m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:19:30.513 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (15m) 5m ago 15m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:19:30.513 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (11m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:19:30.514 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (11m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:19:30.514 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (10m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:19:30.514 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (10m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:19:30.514 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (9m) 5m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:19:30.515 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (9m) 7m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:19:30.515 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (16m) 7m ago 16m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:19:30.515 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (16m) 5m ago 16m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:19:30.515 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (8m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:19:30.515 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (8m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:19:30.516 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (8m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:19:30.516 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (7m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:19:30.516 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (7m) 5m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:19:30.516 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (6m) 5m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:19:30.517 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (6m) 5m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:19:30.517 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (5m) 5m ago 16m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:19:30.517 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (15m) 5m ago 16m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:19:30.517 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 7m ago 14m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:19:30.517 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 5m ago 14m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:19:30.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:30 gibba023 bash[30844]: cephadm 2021-03-10T20:19:29.104888+0000 mgr.gibba044.wflcwh (mgr.34466) 631 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:19:30.673 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:30 gibba023 bash[31815]: cephadm 2021-03-10T20:19:29.104888+0000 mgr.gibba044.wflcwh (mgr.34466) 631 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:19:30.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:30 gibba044 bash[25485]: cephadm 2021-03-10T20:19:29.104888+0000 mgr.gibba044.wflcwh (mgr.34466) 631 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:19:30.759 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:19:30.760 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:19:30.760 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:19:30.760 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:19:30.761 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:19:30.761 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:19:30.761 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:19:30.761 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:19:30.762 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:19:30.762 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:19:30.762 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:19:30.762 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:19:30.762 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:19:30.763 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:19:30.763 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:19:31.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:31 gibba023 bash[30844]: cluster 2021-03-10T20:19:29.659478+0000 mgr.gibba044.wflcwh (mgr.34466) 632 : cluster [DBG] pgmap v346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:31.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:31 gibba023 bash[30844]: audit 2021-03-10T20:19:30.273960+0000 mgr.gibba044.wflcwh (mgr.34466) 633 : audit [DBG] from='client.44490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:19:31.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:31 gibba023 bash[30844]: audit 2021-03-10T20:19:30.505436+0000 mgr.gibba044.wflcwh (mgr.34466) 634 : audit [DBG] from='client.54475 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:19:31.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:31 gibba023 bash[30844]: audit 2021-03-10T20:19:30.761176+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.2.123:0/4132177602' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:31.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:31 gibba023 bash[31815]: cluster 2021-03-10T20:19:29.659478+0000 mgr.gibba044.wflcwh (mgr.34466) 632 : cluster [DBG] pgmap v346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:31.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:31 gibba023 bash[31815]: audit 2021-03-10T20:19:30.273960+0000 mgr.gibba044.wflcwh (mgr.34466) 633 : audit [DBG] from='client.44490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:19:31.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:31 gibba023 bash[31815]: audit 2021-03-10T20:19:30.505436+0000 mgr.gibba044.wflcwh (mgr.34466) 634 : audit [DBG] from='client.54475 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:19:31.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:31 gibba023 bash[31815]: audit 2021-03-10T20:19:30.761176+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.2.123:0/4132177602' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:31.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:31 gibba044 bash[25485]: cluster 2021-03-10T20:19:29.659478+0000 mgr.gibba044.wflcwh (mgr.34466) 632 : cluster [DBG] pgmap v346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:31.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:31 gibba044 bash[25485]: audit 2021-03-10T20:19:30.273960+0000 mgr.gibba044.wflcwh (mgr.34466) 633 : audit [DBG] from='client.44490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:19:31.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:31 gibba044 bash[25485]: audit 2021-03-10T20:19:30.505436+0000 mgr.gibba044.wflcwh (mgr.34466) 634 : audit [DBG] from='client.54475 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:19:31.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:31 gibba044 bash[25485]: audit 2021-03-10T20:19:30.761176+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.2.123:0/4132177602' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:33.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:33 gibba023 bash[30844]: cluster 2021-03-10T20:19:31.661100+0000 mgr.gibba044.wflcwh (mgr.34466) 635 : cluster [DBG] pgmap v347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:33.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:33 gibba023 bash[31815]: cluster 2021-03-10T20:19:31.661100+0000 mgr.gibba044.wflcwh (mgr.34466) 635 : cluster [DBG] pgmap v347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:33.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:33 gibba044 bash[25485]: cluster 2021-03-10T20:19:31.661100+0000 mgr.gibba044.wflcwh (mgr.34466) 635 : cluster [DBG] pgmap v347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:35.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:35 gibba023 bash[30844]: cluster 2021-03-10T20:19:33.662728+0000 mgr.gibba044.wflcwh (mgr.34466) 636 : cluster [DBG] pgmap v348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:35.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:35 gibba023 bash[31815]: cluster 2021-03-10T20:19:33.662728+0000 mgr.gibba044.wflcwh (mgr.34466) 636 : cluster [DBG] pgmap v348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:35.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:35 gibba044 bash[25485]: cluster 2021-03-10T20:19:33.662728+0000 mgr.gibba044.wflcwh (mgr.34466) 636 : cluster [DBG] pgmap v348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:37.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:37 gibba044 bash[25485]: cluster 2021-03-10T20:19:35.664400+0000 mgr.gibba044.wflcwh (mgr.34466) 637 : cluster [DBG] pgmap v349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:37.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:37 gibba023 bash[30844]: cluster 2021-03-10T20:19:35.664400+0000 mgr.gibba044.wflcwh (mgr.34466) 637 : cluster [DBG] pgmap v349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:37.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:37 gibba023 bash[31815]: cluster 2021-03-10T20:19:35.664400+0000 mgr.gibba044.wflcwh (mgr.34466) 637 : cluster [DBG] pgmap v349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:39.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:39 gibba044 bash[25485]: cluster 2021-03-10T20:19:37.666046+0000 mgr.gibba044.wflcwh (mgr.34466) 638 : cluster [DBG] pgmap v350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:39.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:39 gibba023 bash[30844]: cluster 2021-03-10T20:19:37.666046+0000 mgr.gibba044.wflcwh (mgr.34466) 638 : cluster [DBG] pgmap v350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:39.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:39 gibba023 bash[31815]: cluster 2021-03-10T20:19:37.666046+0000 mgr.gibba044.wflcwh (mgr.34466) 638 : cluster [DBG] pgmap v350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:41.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:41 gibba044 bash[25485]: cluster 2021-03-10T20:19:39.667527+0000 mgr.gibba044.wflcwh (mgr.34466) 639 : cluster [DBG] pgmap v351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:41.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:41 gibba023 bash[30844]: cluster 2021-03-10T20:19:39.667527+0000 mgr.gibba044.wflcwh (mgr.34466) 639 : cluster [DBG] pgmap v351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:41.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:41 gibba023 bash[31815]: cluster 2021-03-10T20:19:39.667527+0000 mgr.gibba044.wflcwh (mgr.34466) 639 : cluster [DBG] pgmap v351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:43.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:43 gibba044 bash[25485]: cluster 2021-03-10T20:19:41.668973+0000 mgr.gibba044.wflcwh (mgr.34466) 640 : cluster [DBG] pgmap v352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:43.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:43 gibba023 bash[30844]: cluster 2021-03-10T20:19:41.668973+0000 mgr.gibba044.wflcwh (mgr.34466) 640 : cluster [DBG] pgmap v352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:43.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:43 gibba023 bash[31815]: cluster 2021-03-10T20:19:41.668973+0000 mgr.gibba044.wflcwh (mgr.34466) 640 : cluster [DBG] pgmap v352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:45.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[30844]: cluster 2021-03-10T20:19:43.670663+0000 mgr.gibba044.wflcwh (mgr.34466) 641 : cluster [DBG] pgmap v353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:45.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[30844]: cephadm 2021-03-10T20:19:44.121664+0000 mgr.gibba044.wflcwh (mgr.34466) 642 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:19:45.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[30844]: audit 2021-03-10T20:19:44.314254+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:19:45.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[30844]: cephadm 2021-03-10T20:19:44.318767+0000 mgr.gibba044.wflcwh (mgr.34466) 643 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:19:45.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[30844]: audit 2021-03-10T20:19:44.498506+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:19:45.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[30844]: audit 2021-03-10T20:19:44.501886+0000 mon.a (mon.0) 717 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:19:45.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[30844]: audit 2021-03-10T20:19:44.503815+0000 mon.a (mon.0) 718 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:45.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[30844]: cephadm 2021-03-10T20:19:44.504888+0000 mgr.gibba044.wflcwh (mgr.34466) 644 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:19:45.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[30844]: audit 2021-03-10T20:19:44.505641+0000 mon.a (mon.0) 719 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:45.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[30844]: cephadm 2021-03-10T20:19:44.506927+0000 mgr.gibba044.wflcwh (mgr.34466) 645 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:19:45.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[30844]: audit 2021-03-10T20:19:44.507020+0000 mon.a (mon.0) 720 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:45.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[30844]: cephadm 2021-03-10T20:19:44.508778+0000 mgr.gibba044.wflcwh (mgr.34466) 646 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:19:45.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[30844]: cephadm 2021-03-10T20:19:44.508817+0000 mgr.gibba044.wflcwh (mgr.34466) 647 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:19:45.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[30844]: audit 2021-03-10T20:19:44.510111+0000 mon.a (mon.0) 721 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:45.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[30844]: cephadm 2021-03-10T20:19:44.510265+0000 mgr.gibba044.wflcwh (mgr.34466) 648 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:19:45.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[30844]: cephadm 2021-03-10T20:19:44.510303+0000 mgr.gibba044.wflcwh (mgr.34466) 649 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:19:45.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[30844]: audit 2021-03-10T20:19:44.511614+0000 mon.a (mon.0) 722 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:45.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[30844]: cephadm 2021-03-10T20:19:44.511638+0000 mgr.gibba044.wflcwh (mgr.34466) 650 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:19:45.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[30844]: cephadm 2021-03-10T20:19:44.513151+0000 mgr.gibba044.wflcwh (mgr.34466) 651 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:19:45.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[30844]: cephadm 2021-03-10T20:19:44.513190+0000 mgr.gibba044.wflcwh (mgr.34466) 652 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:19:45.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[30844]: cephadm 2021-03-10T20:19:44.514700+0000 mgr.gibba044.wflcwh (mgr.34466) 653 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:19:45.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[30844]: cephadm 2021-03-10T20:19:44.515027+0000 mgr.gibba044.wflcwh (mgr.34466) 654 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:19:45.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[30844]: cephadm 2021-03-10T20:19:44.516592+0000 mgr.gibba044.wflcwh (mgr.34466) 655 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:19:45.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[30844]: cephadm 2021-03-10T20:19:44.516631+0000 mgr.gibba044.wflcwh (mgr.34466) 656 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:19:45.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[30844]: cephadm 2021-03-10T20:19:44.516763+0000 mgr.gibba044.wflcwh (mgr.34466) 657 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:19:45.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[31815]: cluster 2021-03-10T20:19:43.670663+0000 mgr.gibba044.wflcwh (mgr.34466) 641 : cluster [DBG] pgmap v353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:45.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[31815]: cephadm 2021-03-10T20:19:44.121664+0000 mgr.gibba044.wflcwh (mgr.34466) 642 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:19:45.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[31815]: audit 2021-03-10T20:19:44.314254+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:19:45.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[31815]: cephadm 2021-03-10T20:19:44.318767+0000 mgr.gibba044.wflcwh (mgr.34466) 643 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:19:45.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[31815]: audit 2021-03-10T20:19:44.498506+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:19:45.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[31815]: audit 2021-03-10T20:19:44.501886+0000 mon.a (mon.0) 717 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:19:45.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[31815]: audit 2021-03-10T20:19:44.503815+0000 mon.a (mon.0) 718 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:45.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[31815]: cephadm 2021-03-10T20:19:44.504888+0000 mgr.gibba044.wflcwh (mgr.34466) 644 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:19:45.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[31815]: audit 2021-03-10T20:19:44.505641+0000 mon.a (mon.0) 719 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:45.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[31815]: cephadm 2021-03-10T20:19:44.506927+0000 mgr.gibba044.wflcwh (mgr.34466) 645 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:19:45.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[31815]: audit 2021-03-10T20:19:44.507020+0000 mon.a (mon.0) 720 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:45.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[31815]: cephadm 2021-03-10T20:19:44.508778+0000 mgr.gibba044.wflcwh (mgr.34466) 646 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:19:45.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[31815]: cephadm 2021-03-10T20:19:44.508817+0000 mgr.gibba044.wflcwh (mgr.34466) 647 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:19:45.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[31815]: audit 2021-03-10T20:19:44.510111+0000 mon.a (mon.0) 721 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:45.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[31815]: cephadm 2021-03-10T20:19:44.510265+0000 mgr.gibba044.wflcwh (mgr.34466) 648 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:19:45.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[31815]: cephadm 2021-03-10T20:19:44.510303+0000 mgr.gibba044.wflcwh (mgr.34466) 649 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:19:45.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[31815]: audit 2021-03-10T20:19:44.511614+0000 mon.a (mon.0) 722 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:45.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[31815]: cephadm 2021-03-10T20:19:44.511638+0000 mgr.gibba044.wflcwh (mgr.34466) 650 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:19:45.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[31815]: cephadm 2021-03-10T20:19:44.513151+0000 mgr.gibba044.wflcwh (mgr.34466) 651 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:19:45.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[31815]: cephadm 2021-03-10T20:19:44.513190+0000 mgr.gibba044.wflcwh (mgr.34466) 652 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:19:45.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[31815]: cephadm 2021-03-10T20:19:44.514700+0000 mgr.gibba044.wflcwh (mgr.34466) 653 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:19:45.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[31815]: cephadm 2021-03-10T20:19:44.515027+0000 mgr.gibba044.wflcwh (mgr.34466) 654 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:19:45.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[31815]: cephadm 2021-03-10T20:19:44.516592+0000 mgr.gibba044.wflcwh (mgr.34466) 655 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:19:45.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[31815]: cephadm 2021-03-10T20:19:44.516631+0000 mgr.gibba044.wflcwh (mgr.34466) 656 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:19:45.686 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:45 gibba023 bash[31815]: cephadm 2021-03-10T20:19:44.516763+0000 mgr.gibba044.wflcwh (mgr.34466) 657 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:19:45.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:45 gibba044 bash[25485]: cluster 2021-03-10T20:19:43.670663+0000 mgr.gibba044.wflcwh (mgr.34466) 641 : cluster [DBG] pgmap v353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:45.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:45 gibba044 bash[25485]: cephadm 2021-03-10T20:19:44.121664+0000 mgr.gibba044.wflcwh (mgr.34466) 642 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:19:45.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:45 gibba044 bash[25485]: audit 2021-03-10T20:19:44.314254+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:19:45.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:45 gibba044 bash[25485]: cephadm 2021-03-10T20:19:44.318767+0000 mgr.gibba044.wflcwh (mgr.34466) 643 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:19:45.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:45 gibba044 bash[25485]: audit 2021-03-10T20:19:44.498506+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:19:45.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:45 gibba044 bash[25485]: audit 2021-03-10T20:19:44.501886+0000 mon.a (mon.0) 717 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:19:45.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:45 gibba044 bash[25485]: audit 2021-03-10T20:19:44.503815+0000 mon.a (mon.0) 718 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:45.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:45 gibba044 bash[25485]: cephadm 2021-03-10T20:19:44.504888+0000 mgr.gibba044.wflcwh (mgr.34466) 644 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:19:45.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:45 gibba044 bash[25485]: audit 2021-03-10T20:19:44.505641+0000 mon.a (mon.0) 719 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:45.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:45 gibba044 bash[25485]: cephadm 2021-03-10T20:19:44.506927+0000 mgr.gibba044.wflcwh (mgr.34466) 645 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:19:45.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:45 gibba044 bash[25485]: audit 2021-03-10T20:19:44.507020+0000 mon.a (mon.0) 720 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:45.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:45 gibba044 bash[25485]: cephadm 2021-03-10T20:19:44.508778+0000 mgr.gibba044.wflcwh (mgr.34466) 646 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:19:45.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:45 gibba044 bash[25485]: cephadm 2021-03-10T20:19:44.508817+0000 mgr.gibba044.wflcwh (mgr.34466) 647 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:19:45.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:45 gibba044 bash[25485]: audit 2021-03-10T20:19:44.510111+0000 mon.a (mon.0) 721 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:45.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:45 gibba044 bash[25485]: cephadm 2021-03-10T20:19:44.510265+0000 mgr.gibba044.wflcwh (mgr.34466) 648 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:19:45.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:45 gibba044 bash[25485]: cephadm 2021-03-10T20:19:44.510303+0000 mgr.gibba044.wflcwh (mgr.34466) 649 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:19:45.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:45 gibba044 bash[25485]: audit 2021-03-10T20:19:44.511614+0000 mon.a (mon.0) 722 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:19:45.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:45 gibba044 bash[25485]: cephadm 2021-03-10T20:19:44.511638+0000 mgr.gibba044.wflcwh (mgr.34466) 650 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:19:45.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:45 gibba044 bash[25485]: cephadm 2021-03-10T20:19:44.513151+0000 mgr.gibba044.wflcwh (mgr.34466) 651 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:19:45.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:45 gibba044 bash[25485]: cephadm 2021-03-10T20:19:44.513190+0000 mgr.gibba044.wflcwh (mgr.34466) 652 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:19:45.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:45 gibba044 bash[25485]: cephadm 2021-03-10T20:19:44.514700+0000 mgr.gibba044.wflcwh (mgr.34466) 653 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:19:45.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:45 gibba044 bash[25485]: cephadm 2021-03-10T20:19:44.515027+0000 mgr.gibba044.wflcwh (mgr.34466) 654 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:19:45.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:45 gibba044 bash[25485]: cephadm 2021-03-10T20:19:44.516592+0000 mgr.gibba044.wflcwh (mgr.34466) 655 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:19:45.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:45 gibba044 bash[25485]: cephadm 2021-03-10T20:19:44.516631+0000 mgr.gibba044.wflcwh (mgr.34466) 656 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:19:45.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:45 gibba044 bash[25485]: cephadm 2021-03-10T20:19:44.516763+0000 mgr.gibba044.wflcwh (mgr.34466) 657 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:19:47.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:47 gibba023 bash[30844]: cluster 2021-03-10T20:19:45.672399+0000 mgr.gibba044.wflcwh (mgr.34466) 658 : cluster [DBG] pgmap v354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:47.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:47 gibba023 bash[31815]: cluster 2021-03-10T20:19:45.672399+0000 mgr.gibba044.wflcwh (mgr.34466) 658 : cluster [DBG] pgmap v354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:47.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:47 gibba044 bash[25485]: cluster 2021-03-10T20:19:45.672399+0000 mgr.gibba044.wflcwh (mgr.34466) 658 : cluster [DBG] pgmap v354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:49.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:49 gibba023 bash[30844]: cluster 2021-03-10T20:19:47.673993+0000 mgr.gibba044.wflcwh (mgr.34466) 659 : cluster [DBG] pgmap v355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:49.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:49 gibba023 bash[31815]: cluster 2021-03-10T20:19:47.673993+0000 mgr.gibba044.wflcwh (mgr.34466) 659 : cluster [DBG] pgmap v355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:49.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:49 gibba044 bash[25485]: cluster 2021-03-10T20:19:47.673993+0000 mgr.gibba044.wflcwh (mgr.34466) 659 : cluster [DBG] pgmap v355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:51.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:51 gibba023 bash[30844]: cluster 2021-03-10T20:19:49.675395+0000 mgr.gibba044.wflcwh (mgr.34466) 660 : cluster [DBG] pgmap v356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:51.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:51 gibba023 bash[31815]: cluster 2021-03-10T20:19:49.675395+0000 mgr.gibba044.wflcwh (mgr.34466) 660 : cluster [DBG] pgmap v356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:51.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:51 gibba044 bash[25485]: cluster 2021-03-10T20:19:49.675395+0000 mgr.gibba044.wflcwh (mgr.34466) 660 : cluster [DBG] pgmap v356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:53.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:53 gibba023 bash[30844]: cluster 2021-03-10T20:19:51.676983+0000 mgr.gibba044.wflcwh (mgr.34466) 661 : cluster [DBG] pgmap v357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:53.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:53 gibba023 bash[31815]: cluster 2021-03-10T20:19:51.676983+0000 mgr.gibba044.wflcwh (mgr.34466) 661 : cluster [DBG] pgmap v357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:53.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:53 gibba044 bash[25485]: cluster 2021-03-10T20:19:51.676983+0000 mgr.gibba044.wflcwh (mgr.34466) 661 : cluster [DBG] pgmap v357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:55.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:55 gibba023 bash[30844]: cluster 2021-03-10T20:19:53.678662+0000 mgr.gibba044.wflcwh (mgr.34466) 662 : cluster [DBG] pgmap v358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:55.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:55 gibba023 bash[31815]: cluster 2021-03-10T20:19:53.678662+0000 mgr.gibba044.wflcwh (mgr.34466) 662 : cluster [DBG] pgmap v358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:55.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:55 gibba044 bash[25485]: cluster 2021-03-10T20:19:53.678662+0000 mgr.gibba044.wflcwh (mgr.34466) 662 : cluster [DBG] pgmap v358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:57.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:57 gibba023 bash[30844]: cluster 2021-03-10T20:19:55.680290+0000 mgr.gibba044.wflcwh (mgr.34466) 663 : cluster [DBG] pgmap v359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:57.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:57 gibba023 bash[31815]: cluster 2021-03-10T20:19:55.680290+0000 mgr.gibba044.wflcwh (mgr.34466) 663 : cluster [DBG] pgmap v359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:57.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:57 gibba044 bash[25485]: cluster 2021-03-10T20:19:55.680290+0000 mgr.gibba044.wflcwh (mgr.34466) 663 : cluster [DBG] pgmap v359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:59.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:19:59 gibba023 bash[30844]: cluster 2021-03-10T20:19:57.681834+0000 mgr.gibba044.wflcwh (mgr.34466) 664 : cluster [DBG] pgmap v360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:59.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:19:59 gibba023 bash[31815]: cluster 2021-03-10T20:19:57.681834+0000 mgr.gibba044.wflcwh (mgr.34466) 664 : cluster [DBG] pgmap v360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:19:59.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:19:59 gibba044 bash[25485]: cluster 2021-03-10T20:19:57.681834+0000 mgr.gibba044.wflcwh (mgr.34466) 664 : cluster [DBG] pgmap v360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:00.389 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:00 gibba023 bash[30844]: debug 2021-03-10T20:19:59.997+0000 7fa7fde59700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:20:00.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:00 gibba023 bash[30844]: cephadm 2021-03-10T20:19:59.523091+0000 mgr.gibba044.wflcwh (mgr.34466) 665 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:20:00.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:00 gibba023 bash[30844]: cluster 2021-03-10T20:20:00.000170+0000 mon.a (mon.0) 723 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:20:00.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:00 gibba023 bash[31815]: cephadm 2021-03-10T20:19:59.523091+0000 mgr.gibba044.wflcwh (mgr.34466) 665 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:20:00.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:00 gibba023 bash[31815]: cluster 2021-03-10T20:20:00.000170+0000 mon.a (mon.0) 723 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:20:00.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:00 gibba044 bash[25485]: cephadm 2021-03-10T20:19:59.523091+0000 mgr.gibba044.wflcwh (mgr.34466) 665 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:20:00.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:00 gibba044 bash[25485]: cluster 2021-03-10T20:20:00.000170+0000 mon.a (mon.0) 723 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:20:01.003 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:20:01.235 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:20:01.235 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (11m) 8m ago 16m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:20:01.235 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (16m) 6m ago 16m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:20:01.235 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (11m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:20:01.236 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (11m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:20:01.236 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (10m) 8m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:20:01.236 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (10m) 8m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:20:01.236 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (10m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:20:01.237 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (10m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:20:01.237 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (16m) 8m ago 16m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:20:01.237 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (16m) 6m ago 16m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:20:01.237 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (9m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:20:01.238 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (8m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:20:01.238 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (8m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:20:01.238 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (8m) 8m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:20:01.238 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (7m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:20:01.238 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (7m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:20:01.239 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (6m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:20:01.239 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (6m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:20:01.239 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (16m) 6m ago 16m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:20:01.239 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 8m ago 14m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:20:01.240 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 6m ago 14m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:20:01.487 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:20:01.488 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:20:01.488 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:20:01.488 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:20:01.489 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:20:01.489 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:20:01.489 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:20:01.489 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:20:01.489 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:20:01.490 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:20:01.490 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:20:01.490 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:20:01.490 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:20:01.491 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:20:01.491 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:20:01.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:01 gibba023 bash[30844]: cluster 2021-03-10T20:19:59.682307+0000 mgr.gibba044.wflcwh (mgr.34466) 666 : cluster [DBG] pgmap v361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:01.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:01 gibba023 bash[31815]: cluster 2021-03-10T20:19:59.682307+0000 mgr.gibba044.wflcwh (mgr.34466) 666 : cluster [DBG] pgmap v361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:01.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:01 gibba044 bash[25485]: cluster 2021-03-10T20:19:59.682307+0000 mgr.gibba044.wflcwh (mgr.34466) 666 : cluster [DBG] pgmap v361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:02.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:02 gibba023 bash[30844]: audit 2021-03-10T20:20:00.999702+0000 mgr.gibba044.wflcwh (mgr.34466) 667 : audit [DBG] from='client.54487 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:20:02.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:02 gibba023 bash[30844]: audit 2021-03-10T20:20:01.227676+0000 mgr.gibba044.wflcwh (mgr.34466) 668 : audit [DBG] from='client.54493 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:20:02.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:02 gibba023 bash[30844]: audit 2021-03-10T20:20:01.489220+0000 mon.a (mon.0) 724 : audit [DBG] from='client.? 172.21.2.123:0/806558276' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:02.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:02 gibba023 bash[31815]: audit 2021-03-10T20:20:00.999702+0000 mgr.gibba044.wflcwh (mgr.34466) 667 : audit [DBG] from='client.54487 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:20:02.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:02 gibba023 bash[31815]: audit 2021-03-10T20:20:01.227676+0000 mgr.gibba044.wflcwh (mgr.34466) 668 : audit [DBG] from='client.54493 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:20:02.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:02 gibba023 bash[31815]: audit 2021-03-10T20:20:01.489220+0000 mon.a (mon.0) 724 : audit [DBG] from='client.? 172.21.2.123:0/806558276' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:02.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:02 gibba044 bash[25485]: audit 2021-03-10T20:20:00.999702+0000 mgr.gibba044.wflcwh (mgr.34466) 667 : audit [DBG] from='client.54487 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:20:02.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:02 gibba044 bash[25485]: audit 2021-03-10T20:20:01.227676+0000 mgr.gibba044.wflcwh (mgr.34466) 668 : audit [DBG] from='client.54493 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:20:02.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:02 gibba044 bash[25485]: audit 2021-03-10T20:20:01.489220+0000 mon.a (mon.0) 724 : audit [DBG] from='client.? 172.21.2.123:0/806558276' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:03.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:03 gibba023 bash[30844]: cluster 2021-03-10T20:20:01.683819+0000 mgr.gibba044.wflcwh (mgr.34466) 669 : cluster [DBG] pgmap v362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:03.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:03 gibba023 bash[31815]: cluster 2021-03-10T20:20:01.683819+0000 mgr.gibba044.wflcwh (mgr.34466) 669 : cluster [DBG] pgmap v362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:03.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:03 gibba044 bash[25485]: cluster 2021-03-10T20:20:01.683819+0000 mgr.gibba044.wflcwh (mgr.34466) 669 : cluster [DBG] pgmap v362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:05.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:05 gibba023 bash[30844]: cluster 2021-03-10T20:20:03.685662+0000 mgr.gibba044.wflcwh (mgr.34466) 670 : cluster [DBG] pgmap v363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:05.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:05 gibba023 bash[31815]: cluster 2021-03-10T20:20:03.685662+0000 mgr.gibba044.wflcwh (mgr.34466) 670 : cluster [DBG] pgmap v363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:05.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:05 gibba044 bash[25485]: cluster 2021-03-10T20:20:03.685662+0000 mgr.gibba044.wflcwh (mgr.34466) 670 : cluster [DBG] pgmap v363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:07.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:07 gibba044 bash[25485]: cluster 2021-03-10T20:20:05.687422+0000 mgr.gibba044.wflcwh (mgr.34466) 671 : cluster [DBG] pgmap v364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:07.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:07 gibba023 bash[30844]: cluster 2021-03-10T20:20:05.687422+0000 mgr.gibba044.wflcwh (mgr.34466) 671 : cluster [DBG] pgmap v364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:07.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:07 gibba023 bash[31815]: cluster 2021-03-10T20:20:05.687422+0000 mgr.gibba044.wflcwh (mgr.34466) 671 : cluster [DBG] pgmap v364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:09.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:09 gibba044 bash[25485]: cluster 2021-03-10T20:20:07.689085+0000 mgr.gibba044.wflcwh (mgr.34466) 672 : cluster [DBG] pgmap v365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:09.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:09 gibba023 bash[30844]: cluster 2021-03-10T20:20:07.689085+0000 mgr.gibba044.wflcwh (mgr.34466) 672 : cluster [DBG] pgmap v365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:09.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:09 gibba023 bash[31815]: cluster 2021-03-10T20:20:07.689085+0000 mgr.gibba044.wflcwh (mgr.34466) 672 : cluster [DBG] pgmap v365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:11.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:11 gibba044 bash[25485]: cluster 2021-03-10T20:20:09.689644+0000 mgr.gibba044.wflcwh (mgr.34466) 673 : cluster [DBG] pgmap v366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:11.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:11 gibba023 bash[30844]: cluster 2021-03-10T20:20:09.689644+0000 mgr.gibba044.wflcwh (mgr.34466) 673 : cluster [DBG] pgmap v366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:11.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:11 gibba023 bash[31815]: cluster 2021-03-10T20:20:09.689644+0000 mgr.gibba044.wflcwh (mgr.34466) 673 : cluster [DBG] pgmap v366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:13.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:13 gibba044 bash[25485]: cluster 2021-03-10T20:20:11.691187+0000 mgr.gibba044.wflcwh (mgr.34466) 674 : cluster [DBG] pgmap v367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:13.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:13 gibba023 bash[30844]: cluster 2021-03-10T20:20:11.691187+0000 mgr.gibba044.wflcwh (mgr.34466) 674 : cluster [DBG] pgmap v367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:13.923 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:13 gibba023 bash[31815]: cluster 2021-03-10T20:20:11.691187+0000 mgr.gibba044.wflcwh (mgr.34466) 674 : cluster [DBG] pgmap v367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:15.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:15 gibba044 bash[25485]: cluster 2021-03-10T20:20:13.692820+0000 mgr.gibba044.wflcwh (mgr.34466) 675 : cluster [DBG] pgmap v368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:15.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:15 gibba044 bash[25485]: cephadm 2021-03-10T20:20:14.528778+0000 mgr.gibba044.wflcwh (mgr.34466) 676 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:20:15.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:15 gibba023 bash[30844]: cluster 2021-03-10T20:20:13.692820+0000 mgr.gibba044.wflcwh (mgr.34466) 675 : cluster [DBG] pgmap v368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:15.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:15 gibba023 bash[30844]: cephadm 2021-03-10T20:20:14.528778+0000 mgr.gibba044.wflcwh (mgr.34466) 676 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:20:15.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:15 gibba023 bash[31815]: cluster 2021-03-10T20:20:13.692820+0000 mgr.gibba044.wflcwh (mgr.34466) 675 : cluster [DBG] pgmap v368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:15.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:15 gibba023 bash[31815]: cephadm 2021-03-10T20:20:14.528778+0000 mgr.gibba044.wflcwh (mgr.34466) 676 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:20:17.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:17 gibba044 bash[25485]: cluster 2021-03-10T20:20:15.694292+0000 mgr.gibba044.wflcwh (mgr.34466) 677 : cluster [DBG] pgmap v369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:17.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:17 gibba023 bash[30844]: cluster 2021-03-10T20:20:15.694292+0000 mgr.gibba044.wflcwh (mgr.34466) 677 : cluster [DBG] pgmap v369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:17.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:17 gibba023 bash[31815]: cluster 2021-03-10T20:20:15.694292+0000 mgr.gibba044.wflcwh (mgr.34466) 677 : cluster [DBG] pgmap v369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:19.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:19 gibba044 bash[25485]: cluster 2021-03-10T20:20:17.695988+0000 mgr.gibba044.wflcwh (mgr.34466) 678 : cluster [DBG] pgmap v370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:19.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:19 gibba023 bash[30844]: cluster 2021-03-10T20:20:17.695988+0000 mgr.gibba044.wflcwh (mgr.34466) 678 : cluster [DBG] pgmap v370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:19.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:19 gibba023 bash[31815]: cluster 2021-03-10T20:20:17.695988+0000 mgr.gibba044.wflcwh (mgr.34466) 678 : cluster [DBG] pgmap v370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:21.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:21 gibba044 bash[25485]: cluster 2021-03-10T20:20:19.697196+0000 mgr.gibba044.wflcwh (mgr.34466) 679 : cluster [DBG] pgmap v371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:21.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:21 gibba023 bash[30844]: cluster 2021-03-10T20:20:19.697196+0000 mgr.gibba044.wflcwh (mgr.34466) 679 : cluster [DBG] pgmap v371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:21.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:21 gibba023 bash[31815]: cluster 2021-03-10T20:20:19.697196+0000 mgr.gibba044.wflcwh (mgr.34466) 679 : cluster [DBG] pgmap v371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:23.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:23 gibba023 bash[30844]: cluster 2021-03-10T20:20:21.698630+0000 mgr.gibba044.wflcwh (mgr.34466) 680 : cluster [DBG] pgmap v372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:23.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:23 gibba023 bash[31815]: cluster 2021-03-10T20:20:21.698630+0000 mgr.gibba044.wflcwh (mgr.34466) 680 : cluster [DBG] pgmap v372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:23.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:23 gibba044 bash[25485]: cluster 2021-03-10T20:20:21.698630+0000 mgr.gibba044.wflcwh (mgr.34466) 680 : cluster [DBG] pgmap v372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:25.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:25 gibba023 bash[30844]: cluster 2021-03-10T20:20:23.700382+0000 mgr.gibba044.wflcwh (mgr.34466) 681 : cluster [DBG] pgmap v373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:25.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:25 gibba023 bash[31815]: cluster 2021-03-10T20:20:23.700382+0000 mgr.gibba044.wflcwh (mgr.34466) 681 : cluster [DBG] pgmap v373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:25.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:25 gibba044 bash[25485]: cluster 2021-03-10T20:20:23.700382+0000 mgr.gibba044.wflcwh (mgr.34466) 681 : cluster [DBG] pgmap v373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:27.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:27 gibba023 bash[30844]: cluster 2021-03-10T20:20:25.702047+0000 mgr.gibba044.wflcwh (mgr.34466) 682 : cluster [DBG] pgmap v374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:27.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:27 gibba023 bash[30844]: audit 2021-03-10T20:20:27.028111+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:20:27.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:27 gibba023 bash[30844]: audit 2021-03-10T20:20:27.028951+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:20:27.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:27 gibba023 bash[30844]: audit 2021-03-10T20:20:27.029686+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:20:27.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:27 gibba023 bash[30844]: audit 2021-03-10T20:20:27.030426+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:20:27.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:27 gibba023 bash[30844]: audit 2021-03-10T20:20:27.104887+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:20:27.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:27 gibba023 bash[30844]: audit 2021-03-10T20:20:27.105527+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:20:27.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:27 gibba023 bash[31815]: cluster 2021-03-10T20:20:25.702047+0000 mgr.gibba044.wflcwh (mgr.34466) 682 : cluster [DBG] pgmap v374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:27.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:27 gibba023 bash[31815]: audit 2021-03-10T20:20:27.028111+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:20:27.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:27 gibba023 bash[31815]: audit 2021-03-10T20:20:27.028951+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:20:27.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:27 gibba023 bash[31815]: audit 2021-03-10T20:20:27.029686+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:20:27.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:27 gibba023 bash[31815]: audit 2021-03-10T20:20:27.030426+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:20:27.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:27 gibba023 bash[31815]: audit 2021-03-10T20:20:27.104887+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:20:27.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:27 gibba023 bash[31815]: audit 2021-03-10T20:20:27.105527+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:20:27.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:27 gibba044 bash[25485]: cluster 2021-03-10T20:20:25.702047+0000 mgr.gibba044.wflcwh (mgr.34466) 682 : cluster [DBG] pgmap v374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:27.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:27 gibba044 bash[25485]: audit 2021-03-10T20:20:27.028111+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:20:27.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:27 gibba044 bash[25485]: audit 2021-03-10T20:20:27.028951+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:20:27.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:27 gibba044 bash[25485]: audit 2021-03-10T20:20:27.029686+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:20:27.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:27 gibba044 bash[25485]: audit 2021-03-10T20:20:27.030426+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:20:27.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:27 gibba044 bash[25485]: audit 2021-03-10T20:20:27.104887+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:20:27.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:27 gibba044 bash[25485]: audit 2021-03-10T20:20:27.105527+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:20:29.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:29 gibba023 bash[30844]: cluster 2021-03-10T20:20:27.703736+0000 mgr.gibba044.wflcwh (mgr.34466) 683 : cluster [DBG] pgmap v375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:29.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:29 gibba023 bash[31815]: cluster 2021-03-10T20:20:27.703736+0000 mgr.gibba044.wflcwh (mgr.34466) 683 : cluster [DBG] pgmap v375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:29.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:29 gibba044 bash[25485]: cluster 2021-03-10T20:20:27.703736+0000 mgr.gibba044.wflcwh (mgr.34466) 683 : cluster [DBG] pgmap v375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:30.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:30 gibba023 bash[30844]: cephadm 2021-03-10T20:20:29.543999+0000 mgr.gibba044.wflcwh (mgr.34466) 684 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:20:30.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:30 gibba023 bash[31815]: cephadm 2021-03-10T20:20:29.543999+0000 mgr.gibba044.wflcwh (mgr.34466) 684 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:20:30.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:30 gibba044 bash[25485]: cephadm 2021-03-10T20:20:29.543999+0000 mgr.gibba044.wflcwh (mgr.34466) 684 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:20:31.734 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:20:31.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:31 gibba023 bash[30844]: cluster 2021-03-10T20:20:29.704381+0000 mgr.gibba044.wflcwh (mgr.34466) 685 : cluster [DBG] pgmap v376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:31.923 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:31 gibba023 bash[31815]: cluster 2021-03-10T20:20:29.704381+0000 mgr.gibba044.wflcwh (mgr.34466) 685 : cluster [DBG] pgmap v376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:31.963 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:20:31.963 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (11m) 8m ago 17m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:20:31.963 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (16m) 6m ago 16m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:20:31.963 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (12m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:20:31.964 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (12m) 6m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:20:31.964 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (11m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:20:31.964 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (11m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:20:31.964 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (10m) 6m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:20:31.964 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (10m) 8m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:20:31.965 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (17m) 8m ago 17m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:20:31.965 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (17m) 6m ago 17m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:20:31.965 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (9m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:20:31.965 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (9m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:20:31.966 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (9m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:20:31.966 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (8m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:20:31.966 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (8m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:20:31.966 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (7m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:20:31.967 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (7m) 6m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:20:31.967 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (6m) 6m ago 17m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:20:31.967 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (16m) 6m ago 17m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:20:31.967 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 8m ago 15m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:20:31.967 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 6m ago 15m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:20:31.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:31 gibba044 bash[25485]: cluster 2021-03-10T20:20:29.704381+0000 mgr.gibba044.wflcwh (mgr.34466) 685 : cluster [DBG] pgmap v376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:32.211 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:20:32.211 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:20:32.212 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:20:32.212 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:20:32.212 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:20:32.212 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:20:32.213 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:20:32.213 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:20:32.213 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:20:32.213 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:20:32.213 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:20:32.214 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:20:32.214 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:20:32.214 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:20:32.214 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:20:32.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:32 gibba023 bash[30844]: audit 2021-03-10T20:20:32.212602+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.2.123:0/769201160' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:32.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:32 gibba023 bash[31815]: audit 2021-03-10T20:20:32.212602+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.2.123:0/769201160' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:32.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:32 gibba044 bash[25485]: audit 2021-03-10T20:20:32.212602+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.2.123:0/769201160' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:33.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:33 gibba023 bash[30844]: cluster 2021-03-10T20:20:31.705874+0000 mgr.gibba044.wflcwh (mgr.34466) 686 : cluster [DBG] pgmap v377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:33.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:33 gibba023 bash[30844]: audit 2021-03-10T20:20:31.730059+0000 mgr.gibba044.wflcwh (mgr.34466) 687 : audit [DBG] from='client.44526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:20:33.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:33 gibba023 bash[30844]: audit 2021-03-10T20:20:31.955979+0000 mgr.gibba044.wflcwh (mgr.34466) 688 : audit [DBG] from='client.44532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:20:33.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:33 gibba023 bash[31815]: cluster 2021-03-10T20:20:31.705874+0000 mgr.gibba044.wflcwh (mgr.34466) 686 : cluster [DBG] pgmap v377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:33.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:33 gibba023 bash[31815]: audit 2021-03-10T20:20:31.730059+0000 mgr.gibba044.wflcwh (mgr.34466) 687 : audit [DBG] from='client.44526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:20:33.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:33 gibba023 bash[31815]: audit 2021-03-10T20:20:31.955979+0000 mgr.gibba044.wflcwh (mgr.34466) 688 : audit [DBG] from='client.44532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:20:33.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:33 gibba044 bash[25485]: cluster 2021-03-10T20:20:31.705874+0000 mgr.gibba044.wflcwh (mgr.34466) 686 : cluster [DBG] pgmap v377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:33.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:33 gibba044 bash[25485]: audit 2021-03-10T20:20:31.730059+0000 mgr.gibba044.wflcwh (mgr.34466) 687 : audit [DBG] from='client.44526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:20:33.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:33 gibba044 bash[25485]: audit 2021-03-10T20:20:31.955979+0000 mgr.gibba044.wflcwh (mgr.34466) 688 : audit [DBG] from='client.44532 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:20:35.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:35 gibba023 bash[30844]: cluster 2021-03-10T20:20:33.707402+0000 mgr.gibba044.wflcwh (mgr.34466) 689 : cluster [DBG] pgmap v378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:35.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:35 gibba023 bash[31815]: cluster 2021-03-10T20:20:33.707402+0000 mgr.gibba044.wflcwh (mgr.34466) 689 : cluster [DBG] pgmap v378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:35.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:35 gibba044 bash[25485]: cluster 2021-03-10T20:20:33.707402+0000 mgr.gibba044.wflcwh (mgr.34466) 689 : cluster [DBG] pgmap v378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:37.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:37 gibba023 bash[30844]: cluster 2021-03-10T20:20:35.709199+0000 mgr.gibba044.wflcwh (mgr.34466) 690 : cluster [DBG] pgmap v379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:37.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:37 gibba023 bash[31815]: cluster 2021-03-10T20:20:35.709199+0000 mgr.gibba044.wflcwh (mgr.34466) 690 : cluster [DBG] pgmap v379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:37.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:37 gibba044 bash[25485]: cluster 2021-03-10T20:20:35.709199+0000 mgr.gibba044.wflcwh (mgr.34466) 690 : cluster [DBG] pgmap v379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:39.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:39 gibba023 bash[30844]: cluster 2021-03-10T20:20:37.710869+0000 mgr.gibba044.wflcwh (mgr.34466) 691 : cluster [DBG] pgmap v380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:39.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:39 gibba023 bash[31815]: cluster 2021-03-10T20:20:37.710869+0000 mgr.gibba044.wflcwh (mgr.34466) 691 : cluster [DBG] pgmap v380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:39.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:39 gibba044 bash[25485]: cluster 2021-03-10T20:20:37.710869+0000 mgr.gibba044.wflcwh (mgr.34466) 691 : cluster [DBG] pgmap v380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:41.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:41 gibba023 bash[30844]: cluster 2021-03-10T20:20:39.712164+0000 mgr.gibba044.wflcwh (mgr.34466) 692 : cluster [DBG] pgmap v381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:41.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:41 gibba023 bash[31815]: cluster 2021-03-10T20:20:39.712164+0000 mgr.gibba044.wflcwh (mgr.34466) 692 : cluster [DBG] pgmap v381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:41.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:41 gibba044 bash[25485]: cluster 2021-03-10T20:20:39.712164+0000 mgr.gibba044.wflcwh (mgr.34466) 692 : cluster [DBG] pgmap v381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:43.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:43 gibba023 bash[30844]: cluster 2021-03-10T20:20:41.713693+0000 mgr.gibba044.wflcwh (mgr.34466) 693 : cluster [DBG] pgmap v382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:43.923 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:43 gibba023 bash[31815]: cluster 2021-03-10T20:20:41.713693+0000 mgr.gibba044.wflcwh (mgr.34466) 693 : cluster [DBG] pgmap v382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:43.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:43 gibba044 bash[25485]: cluster 2021-03-10T20:20:41.713693+0000 mgr.gibba044.wflcwh (mgr.34466) 693 : cluster [DBG] pgmap v382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:45.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:45 gibba023 bash[30844]: cluster 2021-03-10T20:20:43.715489+0000 mgr.gibba044.wflcwh (mgr.34466) 694 : cluster [DBG] pgmap v383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:45.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:45 gibba023 bash[30844]: cephadm 2021-03-10T20:20:44.560739+0000 mgr.gibba044.wflcwh (mgr.34466) 695 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:20:45.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:45 gibba023 bash[30844]: cephadm 2021-03-10T20:20:44.562278+0000 mgr.gibba044.wflcwh (mgr.34466) 696 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:20:45.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:45 gibba023 bash[30844]: audit 2021-03-10T20:20:44.766570+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:20:45.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:45 gibba023 bash[30844]: audit 2021-03-10T20:20:44.770097+0000 mon.a (mon.0) 732 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:20:45.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:45 gibba023 bash[30844]: audit 2021-03-10T20:20:44.771289+0000 mon.a (mon.0) 733 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:45.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:45 gibba023 bash[30844]: audit 2021-03-10T20:20:44.772806+0000 mon.a (mon.0) 734 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:45.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:45 gibba023 bash[30844]: audit 2021-03-10T20:20:44.773976+0000 mon.a (mon.0) 735 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:45.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:45 gibba023 bash[30844]: audit 2021-03-10T20:20:44.776054+0000 mon.a (mon.0) 736 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:45.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:45 gibba023 bash[30844]: audit 2021-03-10T20:20:44.777216+0000 mon.a (mon.0) 737 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:45.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:45 gibba023 bash[31815]: cluster 2021-03-10T20:20:43.715489+0000 mgr.gibba044.wflcwh (mgr.34466) 694 : cluster [DBG] pgmap v383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:45.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:45 gibba023 bash[31815]: cephadm 2021-03-10T20:20:44.560739+0000 mgr.gibba044.wflcwh (mgr.34466) 695 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:20:45.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:45 gibba023 bash[31815]: cephadm 2021-03-10T20:20:44.562278+0000 mgr.gibba044.wflcwh (mgr.34466) 696 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:20:45.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:45 gibba023 bash[31815]: audit 2021-03-10T20:20:44.766570+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:20:45.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:45 gibba023 bash[31815]: audit 2021-03-10T20:20:44.770097+0000 mon.a (mon.0) 732 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:20:45.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:45 gibba023 bash[31815]: audit 2021-03-10T20:20:44.771289+0000 mon.a (mon.0) 733 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:45.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:45 gibba023 bash[31815]: audit 2021-03-10T20:20:44.772806+0000 mon.a (mon.0) 734 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:45.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:45 gibba023 bash[31815]: audit 2021-03-10T20:20:44.773976+0000 mon.a (mon.0) 735 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:45.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:45 gibba023 bash[31815]: audit 2021-03-10T20:20:44.776054+0000 mon.a (mon.0) 736 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:45.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:45 gibba023 bash[31815]: audit 2021-03-10T20:20:44.777216+0000 mon.a (mon.0) 737 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:45.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:45 gibba044 bash[25485]: cluster 2021-03-10T20:20:43.715489+0000 mgr.gibba044.wflcwh (mgr.34466) 694 : cluster [DBG] pgmap v383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:45.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:45 gibba044 bash[25485]: cephadm 2021-03-10T20:20:44.560739+0000 mgr.gibba044.wflcwh (mgr.34466) 695 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:20:45.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:45 gibba044 bash[25485]: cephadm 2021-03-10T20:20:44.562278+0000 mgr.gibba044.wflcwh (mgr.34466) 696 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:20:45.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:45 gibba044 bash[25485]: audit 2021-03-10T20:20:44.766570+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:20:45.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:45 gibba044 bash[25485]: audit 2021-03-10T20:20:44.770097+0000 mon.a (mon.0) 732 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:20:45.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:45 gibba044 bash[25485]: audit 2021-03-10T20:20:44.771289+0000 mon.a (mon.0) 733 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:45.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:45 gibba044 bash[25485]: audit 2021-03-10T20:20:44.772806+0000 mon.a (mon.0) 734 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:45.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:45 gibba044 bash[25485]: audit 2021-03-10T20:20:44.773976+0000 mon.a (mon.0) 735 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:45.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:45 gibba044 bash[25485]: audit 2021-03-10T20:20:44.776054+0000 mon.a (mon.0) 736 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:45.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:45 gibba044 bash[25485]: audit 2021-03-10T20:20:44.777216+0000 mon.a (mon.0) 737 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:20:46.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:46 gibba023 bash[30844]: cephadm 2021-03-10T20:20:44.773464+0000 mgr.gibba044.wflcwh (mgr.34466) 697 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:20:46.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:46 gibba023 bash[30844]: cephadm 2021-03-10T20:20:44.775218+0000 mgr.gibba044.wflcwh (mgr.34466) 698 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:20:46.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:46 gibba023 bash[30844]: cephadm 2021-03-10T20:20:44.776520+0000 mgr.gibba044.wflcwh (mgr.34466) 699 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:20:46.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:46 gibba023 bash[30844]: cephadm 2021-03-10T20:20:44.776559+0000 mgr.gibba044.wflcwh (mgr.34466) 700 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:20:46.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:46 gibba023 bash[30844]: cephadm 2021-03-10T20:20:44.777871+0000 mgr.gibba044.wflcwh (mgr.34466) 701 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:20:46.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:46 gibba023 bash[30844]: cephadm 2021-03-10T20:20:44.777910+0000 mgr.gibba044.wflcwh (mgr.34466) 702 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:20:46.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:46 gibba023 bash[30844]: cephadm 2021-03-10T20:20:44.778979+0000 mgr.gibba044.wflcwh (mgr.34466) 703 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:20:46.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:46 gibba023 bash[30844]: cephadm 2021-03-10T20:20:44.779886+0000 mgr.gibba044.wflcwh (mgr.34466) 704 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:20:46.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:46 gibba023 bash[30844]: cephadm 2021-03-10T20:20:44.779923+0000 mgr.gibba044.wflcwh (mgr.34466) 705 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:20:46.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:46 gibba023 bash[30844]: cephadm 2021-03-10T20:20:44.780911+0000 mgr.gibba044.wflcwh (mgr.34466) 706 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:20:46.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:46 gibba023 bash[30844]: cephadm 2021-03-10T20:20:44.781231+0000 mgr.gibba044.wflcwh (mgr.34466) 707 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:20:46.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:46 gibba023 bash[30844]: cephadm 2021-03-10T20:20:44.782083+0000 mgr.gibba044.wflcwh (mgr.34466) 708 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:20:46.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:46 gibba023 bash[30844]: cephadm 2021-03-10T20:20:44.782120+0000 mgr.gibba044.wflcwh (mgr.34466) 709 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:20:46.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:46 gibba023 bash[30844]: cephadm 2021-03-10T20:20:44.782250+0000 mgr.gibba044.wflcwh (mgr.34466) 710 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:20:46.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:46 gibba023 bash[31815]: cephadm 2021-03-10T20:20:44.773464+0000 mgr.gibba044.wflcwh (mgr.34466) 697 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:20:46.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:46 gibba023 bash[31815]: cephadm 2021-03-10T20:20:44.775218+0000 mgr.gibba044.wflcwh (mgr.34466) 698 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:20:46.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:46 gibba023 bash[31815]: cephadm 2021-03-10T20:20:44.776520+0000 mgr.gibba044.wflcwh (mgr.34466) 699 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:20:46.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:46 gibba023 bash[31815]: cephadm 2021-03-10T20:20:44.776559+0000 mgr.gibba044.wflcwh (mgr.34466) 700 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:20:46.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:46 gibba023 bash[31815]: cephadm 2021-03-10T20:20:44.777871+0000 mgr.gibba044.wflcwh (mgr.34466) 701 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:20:46.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:46 gibba023 bash[31815]: cephadm 2021-03-10T20:20:44.777910+0000 mgr.gibba044.wflcwh (mgr.34466) 702 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:20:46.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:46 gibba023 bash[31815]: cephadm 2021-03-10T20:20:44.778979+0000 mgr.gibba044.wflcwh (mgr.34466) 703 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:20:46.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:46 gibba023 bash[31815]: cephadm 2021-03-10T20:20:44.779886+0000 mgr.gibba044.wflcwh (mgr.34466) 704 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:20:46.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:46 gibba023 bash[31815]: cephadm 2021-03-10T20:20:44.779923+0000 mgr.gibba044.wflcwh (mgr.34466) 705 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:20:46.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:46 gibba023 bash[31815]: cephadm 2021-03-10T20:20:44.780911+0000 mgr.gibba044.wflcwh (mgr.34466) 706 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:20:46.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:46 gibba023 bash[31815]: cephadm 2021-03-10T20:20:44.781231+0000 mgr.gibba044.wflcwh (mgr.34466) 707 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:20:46.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:46 gibba023 bash[31815]: cephadm 2021-03-10T20:20:44.782083+0000 mgr.gibba044.wflcwh (mgr.34466) 708 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:20:46.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:46 gibba023 bash[31815]: cephadm 2021-03-10T20:20:44.782120+0000 mgr.gibba044.wflcwh (mgr.34466) 709 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:20:46.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:46 gibba023 bash[31815]: cephadm 2021-03-10T20:20:44.782250+0000 mgr.gibba044.wflcwh (mgr.34466) 710 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:20:46.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:46 gibba044 bash[25485]: cephadm 2021-03-10T20:20:44.773464+0000 mgr.gibba044.wflcwh (mgr.34466) 697 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:20:46.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:46 gibba044 bash[25485]: cephadm 2021-03-10T20:20:44.775218+0000 mgr.gibba044.wflcwh (mgr.34466) 698 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:20:46.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:46 gibba044 bash[25485]: cephadm 2021-03-10T20:20:44.776520+0000 mgr.gibba044.wflcwh (mgr.34466) 699 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:20:46.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:46 gibba044 bash[25485]: cephadm 2021-03-10T20:20:44.776559+0000 mgr.gibba044.wflcwh (mgr.34466) 700 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:20:46.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:46 gibba044 bash[25485]: cephadm 2021-03-10T20:20:44.777871+0000 mgr.gibba044.wflcwh (mgr.34466) 701 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:20:46.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:46 gibba044 bash[25485]: cephadm 2021-03-10T20:20:44.777910+0000 mgr.gibba044.wflcwh (mgr.34466) 702 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:20:46.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:46 gibba044 bash[25485]: cephadm 2021-03-10T20:20:44.778979+0000 mgr.gibba044.wflcwh (mgr.34466) 703 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:20:46.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:46 gibba044 bash[25485]: cephadm 2021-03-10T20:20:44.779886+0000 mgr.gibba044.wflcwh (mgr.34466) 704 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:20:46.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:46 gibba044 bash[25485]: cephadm 2021-03-10T20:20:44.779923+0000 mgr.gibba044.wflcwh (mgr.34466) 705 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:20:46.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:46 gibba044 bash[25485]: cephadm 2021-03-10T20:20:44.780911+0000 mgr.gibba044.wflcwh (mgr.34466) 706 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:20:46.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:46 gibba044 bash[25485]: cephadm 2021-03-10T20:20:44.781231+0000 mgr.gibba044.wflcwh (mgr.34466) 707 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:20:46.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:46 gibba044 bash[25485]: cephadm 2021-03-10T20:20:44.782083+0000 mgr.gibba044.wflcwh (mgr.34466) 708 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:20:46.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:46 gibba044 bash[25485]: cephadm 2021-03-10T20:20:44.782120+0000 mgr.gibba044.wflcwh (mgr.34466) 709 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:20:47.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:46 gibba044 bash[25485]: cephadm 2021-03-10T20:20:44.782250+0000 mgr.gibba044.wflcwh (mgr.34466) 710 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:20:47.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:47 gibba023 bash[30844]: cluster 2021-03-10T20:20:45.717002+0000 mgr.gibba044.wflcwh (mgr.34466) 711 : cluster [DBG] pgmap v384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:47.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:47 gibba023 bash[31815]: cluster 2021-03-10T20:20:45.717002+0000 mgr.gibba044.wflcwh (mgr.34466) 711 : cluster [DBG] pgmap v384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:47.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:47 gibba044 bash[25485]: cluster 2021-03-10T20:20:45.717002+0000 mgr.gibba044.wflcwh (mgr.34466) 711 : cluster [DBG] pgmap v384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:49.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:49 gibba023 bash[30844]: cluster 2021-03-10T20:20:47.718152+0000 mgr.gibba044.wflcwh (mgr.34466) 712 : cluster [DBG] pgmap v385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:49.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:49 gibba023 bash[31815]: cluster 2021-03-10T20:20:47.718152+0000 mgr.gibba044.wflcwh (mgr.34466) 712 : cluster [DBG] pgmap v385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:49.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:49 gibba044 bash[25485]: cluster 2021-03-10T20:20:47.718152+0000 mgr.gibba044.wflcwh (mgr.34466) 712 : cluster [DBG] pgmap v385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:51.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:51 gibba023 bash[30844]: cluster 2021-03-10T20:20:49.719294+0000 mgr.gibba044.wflcwh (mgr.34466) 713 : cluster [DBG] pgmap v386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:51.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:51 gibba023 bash[31815]: cluster 2021-03-10T20:20:49.719294+0000 mgr.gibba044.wflcwh (mgr.34466) 713 : cluster [DBG] pgmap v386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:51.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:51 gibba044 bash[25485]: cluster 2021-03-10T20:20:49.719294+0000 mgr.gibba044.wflcwh (mgr.34466) 713 : cluster [DBG] pgmap v386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:52.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:52 gibba023 bash[30844]: cluster 2021-03-10T20:20:51.720291+0000 mgr.gibba044.wflcwh (mgr.34466) 714 : cluster [DBG] pgmap v387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:52.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:52 gibba023 bash[31815]: cluster 2021-03-10T20:20:51.720291+0000 mgr.gibba044.wflcwh (mgr.34466) 714 : cluster [DBG] pgmap v387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:52.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:52 gibba044 bash[25485]: cluster 2021-03-10T20:20:51.720291+0000 mgr.gibba044.wflcwh (mgr.34466) 714 : cluster [DBG] pgmap v387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:55.173 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:54 gibba023 bash[30844]: cluster 2021-03-10T20:20:53.722054+0000 mgr.gibba044.wflcwh (mgr.34466) 715 : cluster [DBG] pgmap v388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:55.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:54 gibba023 bash[31815]: cluster 2021-03-10T20:20:53.722054+0000 mgr.gibba044.wflcwh (mgr.34466) 715 : cluster [DBG] pgmap v388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:55.246 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:54 gibba044 bash[25485]: cluster 2021-03-10T20:20:53.722054+0000 mgr.gibba044.wflcwh (mgr.34466) 715 : cluster [DBG] pgmap v388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:57.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:57 gibba023 bash[30844]: cluster 2021-03-10T20:20:55.723783+0000 mgr.gibba044.wflcwh (mgr.34466) 716 : cluster [DBG] pgmap v389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:57.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:57 gibba023 bash[31815]: cluster 2021-03-10T20:20:55.723783+0000 mgr.gibba044.wflcwh (mgr.34466) 716 : cluster [DBG] pgmap v389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:57.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:57 gibba044 bash[25485]: cluster 2021-03-10T20:20:55.723783+0000 mgr.gibba044.wflcwh (mgr.34466) 716 : cluster [DBG] pgmap v389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:59.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:20:59 gibba023 bash[30844]: cluster 2021-03-10T20:20:57.725196+0000 mgr.gibba044.wflcwh (mgr.34466) 717 : cluster [DBG] pgmap v390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:59.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:20:59 gibba023 bash[31815]: cluster 2021-03-10T20:20:57.725196+0000 mgr.gibba044.wflcwh (mgr.34466) 717 : cluster [DBG] pgmap v390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:20:59.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:20:59 gibba044 bash[25485]: cluster 2021-03-10T20:20:57.725196+0000 mgr.gibba044.wflcwh (mgr.34466) 717 : cluster [DBG] pgmap v390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:01.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:01 gibba023 bash[30844]: cluster 2021-03-10T20:20:59.726398+0000 mgr.gibba044.wflcwh (mgr.34466) 718 : cluster [DBG] pgmap v391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:01.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:01 gibba023 bash[30844]: cephadm 2021-03-10T20:20:59.798003+0000 mgr.gibba044.wflcwh (mgr.34466) 719 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:21:01.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:01 gibba023 bash[31815]: cluster 2021-03-10T20:20:59.726398+0000 mgr.gibba044.wflcwh (mgr.34466) 718 : cluster [DBG] pgmap v391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:01.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:01 gibba023 bash[31815]: cephadm 2021-03-10T20:20:59.798003+0000 mgr.gibba044.wflcwh (mgr.34466) 719 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:21:01.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:01 gibba044 bash[25485]: cluster 2021-03-10T20:20:59.726398+0000 mgr.gibba044.wflcwh (mgr.34466) 718 : cluster [DBG] pgmap v391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:01.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:01 gibba044 bash[25485]: cephadm 2021-03-10T20:20:59.798003+0000 mgr.gibba044.wflcwh (mgr.34466) 719 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:21:02.461 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:21:02.688 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:21:02.688 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (12m) 9m ago 17m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:21:02.689 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (17m) 7m ago 17m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:21:02.689 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (12m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:21:02.689 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (12m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:21:02.689 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (11m) 9m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:21:02.690 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (11m) 9m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:21:02.690 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (11m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:21:02.690 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (11m) 9m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:21:02.690 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (17m) 9m ago 17m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:21:02.691 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (17m) 7m ago 17m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:21:02.691 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (10m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:21:02.691 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (9m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:21:02.691 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (9m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:21:02.691 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (9m) 9m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:21:02.692 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (8m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:21:02.692 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (8m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:21:02.692 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (7m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:21:02.692 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (7m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:21:02.692 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (17m) 7m ago 17m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:21:02.693 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 9m ago 15m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:21:02.693 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 7m ago 15m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:21:02.937 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:21:02.937 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:21:02.937 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:21:02.938 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:21:02.938 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:21:02.938 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:21:02.938 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:21:02.938 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:21:02.939 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:21:02.939 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:21:02.939 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:21:02.939 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:21:02.940 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:21:02.940 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:21:02.940 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:21:03.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:03 gibba023 bash[30844]: cluster 2021-03-10T20:21:01.728061+0000 mgr.gibba044.wflcwh (mgr.34466) 720 : cluster [DBG] pgmap v392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:03.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:03 gibba023 bash[30844]: audit 2021-03-10T20:21:02.456986+0000 mgr.gibba044.wflcwh (mgr.34466) 721 : audit [DBG] from='client.44544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:21:03.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:03 gibba023 bash[30844]: audit 2021-03-10T20:21:02.938024+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.2.123:0/1089262878' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:03.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:03 gibba023 bash[31815]: cluster 2021-03-10T20:21:01.728061+0000 mgr.gibba044.wflcwh (mgr.34466) 720 : cluster [DBG] pgmap v392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:03.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:03 gibba023 bash[31815]: audit 2021-03-10T20:21:02.456986+0000 mgr.gibba044.wflcwh (mgr.34466) 721 : audit [DBG] from='client.44544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:21:03.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:03 gibba023 bash[31815]: audit 2021-03-10T20:21:02.938024+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.2.123:0/1089262878' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:03.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:03 gibba044 bash[25485]: cluster 2021-03-10T20:21:01.728061+0000 mgr.gibba044.wflcwh (mgr.34466) 720 : cluster [DBG] pgmap v392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:03.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:03 gibba044 bash[25485]: audit 2021-03-10T20:21:02.456986+0000 mgr.gibba044.wflcwh (mgr.34466) 721 : audit [DBG] from='client.44544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:21:03.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:03 gibba044 bash[25485]: audit 2021-03-10T20:21:02.938024+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.2.123:0/1089262878' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:04.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:04 gibba023 bash[30844]: audit 2021-03-10T20:21:02.681768+0000 mgr.gibba044.wflcwh (mgr.34466) 722 : audit [DBG] from='client.44550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:21:04.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:04 gibba023 bash[31815]: audit 2021-03-10T20:21:02.681768+0000 mgr.gibba044.wflcwh (mgr.34466) 722 : audit [DBG] from='client.44550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:21:04.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:04 gibba044 bash[25485]: audit 2021-03-10T20:21:02.681768+0000 mgr.gibba044.wflcwh (mgr.34466) 722 : audit [DBG] from='client.44550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:21:05.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:05 gibba023 bash[30844]: cluster 2021-03-10T20:21:03.729879+0000 mgr.gibba044.wflcwh (mgr.34466) 723 : cluster [DBG] pgmap v393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:05.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:05 gibba023 bash[31815]: cluster 2021-03-10T20:21:03.729879+0000 mgr.gibba044.wflcwh (mgr.34466) 723 : cluster [DBG] pgmap v393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:05.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:05 gibba044 bash[25485]: cluster 2021-03-10T20:21:03.729879+0000 mgr.gibba044.wflcwh (mgr.34466) 723 : cluster [DBG] pgmap v393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:07.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:07 gibba023 bash[30844]: cluster 2021-03-10T20:21:05.731471+0000 mgr.gibba044.wflcwh (mgr.34466) 724 : cluster [DBG] pgmap v394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:07.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:07 gibba023 bash[31815]: cluster 2021-03-10T20:21:05.731471+0000 mgr.gibba044.wflcwh (mgr.34466) 724 : cluster [DBG] pgmap v394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:07.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:07 gibba044 bash[25485]: cluster 2021-03-10T20:21:05.731471+0000 mgr.gibba044.wflcwh (mgr.34466) 724 : cluster [DBG] pgmap v394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:09.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:09 gibba023 bash[30844]: cluster 2021-03-10T20:21:07.733196+0000 mgr.gibba044.wflcwh (mgr.34466) 725 : cluster [DBG] pgmap v395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:09.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:09 gibba023 bash[31815]: cluster 2021-03-10T20:21:07.733196+0000 mgr.gibba044.wflcwh (mgr.34466) 725 : cluster [DBG] pgmap v395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:09.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:09 gibba044 bash[25485]: cluster 2021-03-10T20:21:07.733196+0000 mgr.gibba044.wflcwh (mgr.34466) 725 : cluster [DBG] pgmap v395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:11.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:11 gibba023 bash[30844]: cluster 2021-03-10T20:21:09.734406+0000 mgr.gibba044.wflcwh (mgr.34466) 726 : cluster [DBG] pgmap v396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:11.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:11 gibba023 bash[31815]: cluster 2021-03-10T20:21:09.734406+0000 mgr.gibba044.wflcwh (mgr.34466) 726 : cluster [DBG] pgmap v396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:11.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:11 gibba044 bash[25485]: cluster 2021-03-10T20:21:09.734406+0000 mgr.gibba044.wflcwh (mgr.34466) 726 : cluster [DBG] pgmap v396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:13.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:13 gibba023 bash[30844]: cluster 2021-03-10T20:21:11.736136+0000 mgr.gibba044.wflcwh (mgr.34466) 727 : cluster [DBG] pgmap v397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:13.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:13 gibba023 bash[31815]: cluster 2021-03-10T20:21:11.736136+0000 mgr.gibba044.wflcwh (mgr.34466) 727 : cluster [DBG] pgmap v397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:13.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:13 gibba044 bash[25485]: cluster 2021-03-10T20:21:11.736136+0000 mgr.gibba044.wflcwh (mgr.34466) 727 : cluster [DBG] pgmap v397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:15.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:15 gibba023 bash[30844]: cluster 2021-03-10T20:21:13.737990+0000 mgr.gibba044.wflcwh (mgr.34466) 728 : cluster [DBG] pgmap v398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:15.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:15 gibba023 bash[31815]: cluster 2021-03-10T20:21:13.737990+0000 mgr.gibba044.wflcwh (mgr.34466) 728 : cluster [DBG] pgmap v398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:15.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:15 gibba044 bash[25485]: cluster 2021-03-10T20:21:13.737990+0000 mgr.gibba044.wflcwh (mgr.34466) 728 : cluster [DBG] pgmap v398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:16.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:16 gibba023 bash[30844]: cephadm 2021-03-10T20:21:14.813944+0000 mgr.gibba044.wflcwh (mgr.34466) 729 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:21:16.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:16 gibba023 bash[31815]: cephadm 2021-03-10T20:21:14.813944+0000 mgr.gibba044.wflcwh (mgr.34466) 729 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:21:16.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:16 gibba044 bash[25485]: cephadm 2021-03-10T20:21:14.813944+0000 mgr.gibba044.wflcwh (mgr.34466) 729 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:21:17.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:17 gibba023 bash[30844]: cluster 2021-03-10T20:21:15.739746+0000 mgr.gibba044.wflcwh (mgr.34466) 730 : cluster [DBG] pgmap v399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:17.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:17 gibba023 bash[31815]: cluster 2021-03-10T20:21:15.739746+0000 mgr.gibba044.wflcwh (mgr.34466) 730 : cluster [DBG] pgmap v399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:17.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:17 gibba044 bash[25485]: cluster 2021-03-10T20:21:15.739746+0000 mgr.gibba044.wflcwh (mgr.34466) 730 : cluster [DBG] pgmap v399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:19.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:19 gibba023 bash[30844]: cluster 2021-03-10T20:21:17.741186+0000 mgr.gibba044.wflcwh (mgr.34466) 731 : cluster [DBG] pgmap v400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:19.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:19 gibba023 bash[31815]: cluster 2021-03-10T20:21:17.741186+0000 mgr.gibba044.wflcwh (mgr.34466) 731 : cluster [DBG] pgmap v400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:19.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:19 gibba044 bash[25485]: cluster 2021-03-10T20:21:17.741186+0000 mgr.gibba044.wflcwh (mgr.34466) 731 : cluster [DBG] pgmap v400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:21.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:21 gibba023 bash[30844]: cluster 2021-03-10T20:21:19.742411+0000 mgr.gibba044.wflcwh (mgr.34466) 732 : cluster [DBG] pgmap v401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:21.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:21 gibba023 bash[31815]: cluster 2021-03-10T20:21:19.742411+0000 mgr.gibba044.wflcwh (mgr.34466) 732 : cluster [DBG] pgmap v401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:21.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:21 gibba044 bash[25485]: cluster 2021-03-10T20:21:19.742411+0000 mgr.gibba044.wflcwh (mgr.34466) 732 : cluster [DBG] pgmap v401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:23.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:23 gibba023 bash[30844]: cluster 2021-03-10T20:21:21.744074+0000 mgr.gibba044.wflcwh (mgr.34466) 733 : cluster [DBG] pgmap v402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:23.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:23 gibba023 bash[31815]: cluster 2021-03-10T20:21:21.744074+0000 mgr.gibba044.wflcwh (mgr.34466) 733 : cluster [DBG] pgmap v402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:23.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:23 gibba044 bash[25485]: cluster 2021-03-10T20:21:21.744074+0000 mgr.gibba044.wflcwh (mgr.34466) 733 : cluster [DBG] pgmap v402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:25.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:25 gibba023 bash[30844]: cluster 2021-03-10T20:21:23.745829+0000 mgr.gibba044.wflcwh (mgr.34466) 734 : cluster [DBG] pgmap v403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:25.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:25 gibba023 bash[31815]: cluster 2021-03-10T20:21:23.745829+0000 mgr.gibba044.wflcwh (mgr.34466) 734 : cluster [DBG] pgmap v403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:25.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:25 gibba044 bash[25485]: cluster 2021-03-10T20:21:23.745829+0000 mgr.gibba044.wflcwh (mgr.34466) 734 : cluster [DBG] pgmap v403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:27.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:27 gibba023 bash[30844]: cluster 2021-03-10T20:21:25.747444+0000 mgr.gibba044.wflcwh (mgr.34466) 735 : cluster [DBG] pgmap v404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:27.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:27 gibba023 bash[30844]: audit 2021-03-10T20:21:27.036614+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T20:21:27.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:27 gibba023 bash[30844]: audit 2021-03-10T20:21:27.037386+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:21:27.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:27 gibba023 bash[30844]: audit 2021-03-10T20:21:27.038121+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T20:21:27.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:27 gibba023 bash[30844]: audit 2021-03-10T20:21:27.038904+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:21:27.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:27 gibba023 bash[30844]: audit 2021-03-10T20:21:27.110470+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:21:27.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:27 gibba023 bash[30844]: audit 2021-03-10T20:21:27.111126+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:21:27.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:27 gibba023 bash[31815]: cluster 2021-03-10T20:21:25.747444+0000 mgr.gibba044.wflcwh (mgr.34466) 735 : cluster [DBG] pgmap v404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:27.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:27 gibba023 bash[31815]: audit 2021-03-10T20:21:27.036614+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T20:21:27.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:27 gibba023 bash[31815]: audit 2021-03-10T20:21:27.037386+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:21:27.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:27 gibba023 bash[31815]: audit 2021-03-10T20:21:27.038121+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T20:21:27.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:27 gibba023 bash[31815]: audit 2021-03-10T20:21:27.038904+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:21:27.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:27 gibba023 bash[31815]: audit 2021-03-10T20:21:27.110470+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:21:27.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:27 gibba023 bash[31815]: audit 2021-03-10T20:21:27.111126+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:21:27.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:27 gibba044 bash[25485]: cluster 2021-03-10T20:21:25.747444+0000 mgr.gibba044.wflcwh (mgr.34466) 735 : cluster [DBG] pgmap v404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:27.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:27 gibba044 bash[25485]: audit 2021-03-10T20:21:27.036614+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T20:21:27.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:27 gibba044 bash[25485]: audit 2021-03-10T20:21:27.037386+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:21:27.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:27 gibba044 bash[25485]: audit 2021-03-10T20:21:27.038121+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T20:21:27.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:27 gibba044 bash[25485]: audit 2021-03-10T20:21:27.038904+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:21:27.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:27 gibba044 bash[25485]: audit 2021-03-10T20:21:27.110470+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:21:27.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:27 gibba044 bash[25485]: audit 2021-03-10T20:21:27.111126+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:21:29.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:29 gibba023 bash[30844]: cluster 2021-03-10T20:21:27.748937+0000 mgr.gibba044.wflcwh (mgr.34466) 736 : cluster [DBG] pgmap v405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:29.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:29 gibba023 bash[31815]: cluster 2021-03-10T20:21:27.748937+0000 mgr.gibba044.wflcwh (mgr.34466) 736 : cluster [DBG] pgmap v405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:29.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:29 gibba044 bash[25485]: cluster 2021-03-10T20:21:27.748937+0000 mgr.gibba044.wflcwh (mgr.34466) 736 : cluster [DBG] pgmap v405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:31.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:31 gibba023 bash[30844]: cluster 2021-03-10T20:21:29.750181+0000 mgr.gibba044.wflcwh (mgr.34466) 737 : cluster [DBG] pgmap v406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:31.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:31 gibba023 bash[30844]: cephadm 2021-03-10T20:21:29.830000+0000 mgr.gibba044.wflcwh (mgr.34466) 738 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:21:31.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:31 gibba023 bash[31815]: cluster 2021-03-10T20:21:29.750181+0000 mgr.gibba044.wflcwh (mgr.34466) 737 : cluster [DBG] pgmap v406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:31.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:31 gibba023 bash[31815]: cephadm 2021-03-10T20:21:29.830000+0000 mgr.gibba044.wflcwh (mgr.34466) 738 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:21:31.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:31 gibba044 bash[25485]: cluster 2021-03-10T20:21:29.750181+0000 mgr.gibba044.wflcwh (mgr.34466) 737 : cluster [DBG] pgmap v406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:31.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:31 gibba044 bash[25485]: cephadm 2021-03-10T20:21:29.830000+0000 mgr.gibba044.wflcwh (mgr.34466) 738 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:21:33.178 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:21:33.407 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:21:33.408 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (12m) 9m ago 18m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:21:33.408 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (18m) 7m ago 18m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:21:33.408 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (13m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:21:33.408 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (13m) 7m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:21:33.408 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (12m) 9m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:21:33.409 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (12m) 9m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:21:33.409 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (11m) 7m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:21:33.409 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (11m) 9m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:21:33.409 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (18m) 9m ago 18m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:21:33.410 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (18m) 7m ago 18m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:21:33.410 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (10m) 9m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:21:33.410 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (10m) 9m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:21:33.410 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (10m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:21:33.410 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (9m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:21:33.411 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (9m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:21:33.411 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (8m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:21:33.411 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (8m) 7m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:21:33.411 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (7m) 7m ago 18m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:21:33.412 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (17m) 7m ago 18m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:21:33.412 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 9m ago 16m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:21:33.412 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 7m ago 16m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:21:33.658 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:21:33.659 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:21:33.659 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:21:33.659 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:21:33.659 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:21:33.660 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:21:33.660 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:21:33.660 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:21:33.660 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:21:33.660 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:21:33.661 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:21:33.661 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:21:33.661 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:21:33.661 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:21:33.662 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:21:33.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:33 gibba023 bash[30844]: cluster 2021-03-10T20:21:31.751676+0000 mgr.gibba044.wflcwh (mgr.34466) 739 : cluster [DBG] pgmap v407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:33.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:33 gibba023 bash[31815]: cluster 2021-03-10T20:21:31.751676+0000 mgr.gibba044.wflcwh (mgr.34466) 739 : cluster [DBG] pgmap v407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:33.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:33 gibba044 bash[25485]: cluster 2021-03-10T20:21:31.751676+0000 mgr.gibba044.wflcwh (mgr.34466) 739 : cluster [DBG] pgmap v407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:34.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:34 gibba044 bash[25485]: audit 2021-03-10T20:21:33.174877+0000 mgr.gibba044.wflcwh (mgr.34466) 740 : audit [DBG] from='client.44562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:21:34.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:34 gibba044 bash[25485]: audit 2021-03-10T20:21:33.401010+0000 mgr.gibba044.wflcwh (mgr.34466) 741 : audit [DBG] from='client.54547 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:21:34.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:34 gibba044 bash[25485]: audit 2021-03-10T20:21:33.659619+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.2.123:0/3176479045' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:34.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:34 gibba023 bash[30844]: audit 2021-03-10T20:21:33.174877+0000 mgr.gibba044.wflcwh (mgr.34466) 740 : audit [DBG] from='client.44562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:21:34.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:34 gibba023 bash[30844]: audit 2021-03-10T20:21:33.401010+0000 mgr.gibba044.wflcwh (mgr.34466) 741 : audit [DBG] from='client.54547 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:21:34.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:34 gibba023 bash[30844]: audit 2021-03-10T20:21:33.659619+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.2.123:0/3176479045' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:34.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:34 gibba023 bash[31815]: audit 2021-03-10T20:21:33.174877+0000 mgr.gibba044.wflcwh (mgr.34466) 740 : audit [DBG] from='client.44562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:21:34.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:34 gibba023 bash[31815]: audit 2021-03-10T20:21:33.401010+0000 mgr.gibba044.wflcwh (mgr.34466) 741 : audit [DBG] from='client.54547 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:21:34.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:34 gibba023 bash[31815]: audit 2021-03-10T20:21:33.659619+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.2.123:0/3176479045' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:35.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:35 gibba044 bash[25485]: cluster 2021-03-10T20:21:33.753288+0000 mgr.gibba044.wflcwh (mgr.34466) 742 : cluster [DBG] pgmap v408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:35.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:35 gibba023 bash[30844]: cluster 2021-03-10T20:21:33.753288+0000 mgr.gibba044.wflcwh (mgr.34466) 742 : cluster [DBG] pgmap v408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:35.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:35 gibba023 bash[31815]: cluster 2021-03-10T20:21:33.753288+0000 mgr.gibba044.wflcwh (mgr.34466) 742 : cluster [DBG] pgmap v408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:37.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:37 gibba044 bash[25485]: cluster 2021-03-10T20:21:35.754856+0000 mgr.gibba044.wflcwh (mgr.34466) 743 : cluster [DBG] pgmap v409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:37.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:37 gibba023 bash[30844]: cluster 2021-03-10T20:21:35.754856+0000 mgr.gibba044.wflcwh (mgr.34466) 743 : cluster [DBG] pgmap v409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:37.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:37 gibba023 bash[31815]: cluster 2021-03-10T20:21:35.754856+0000 mgr.gibba044.wflcwh (mgr.34466) 743 : cluster [DBG] pgmap v409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:39.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:39 gibba044 bash[25485]: cluster 2021-03-10T20:21:37.756439+0000 mgr.gibba044.wflcwh (mgr.34466) 744 : cluster [DBG] pgmap v410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:39.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:39 gibba023 bash[30844]: cluster 2021-03-10T20:21:37.756439+0000 mgr.gibba044.wflcwh (mgr.34466) 744 : cluster [DBG] pgmap v410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:39.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:39 gibba023 bash[31815]: cluster 2021-03-10T20:21:37.756439+0000 mgr.gibba044.wflcwh (mgr.34466) 744 : cluster [DBG] pgmap v410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:41.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:41 gibba044 bash[25485]: cluster 2021-03-10T20:21:39.757653+0000 mgr.gibba044.wflcwh (mgr.34466) 745 : cluster [DBG] pgmap v411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:41.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:41 gibba023 bash[30844]: cluster 2021-03-10T20:21:39.757653+0000 mgr.gibba044.wflcwh (mgr.34466) 745 : cluster [DBG] pgmap v411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:41.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:41 gibba023 bash[31815]: cluster 2021-03-10T20:21:39.757653+0000 mgr.gibba044.wflcwh (mgr.34466) 745 : cluster [DBG] pgmap v411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:43.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:43 gibba044 bash[25485]: cluster 2021-03-10T20:21:41.759111+0000 mgr.gibba044.wflcwh (mgr.34466) 746 : cluster [DBG] pgmap v412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:43.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:43 gibba023 bash[30844]: cluster 2021-03-10T20:21:41.759111+0000 mgr.gibba044.wflcwh (mgr.34466) 746 : cluster [DBG] pgmap v412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:43.923 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:43 gibba023 bash[31815]: cluster 2021-03-10T20:21:41.759111+0000 mgr.gibba044.wflcwh (mgr.34466) 746 : cluster [DBG] pgmap v412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:45.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:45 gibba044 bash[25485]: cluster 2021-03-10T20:21:43.760839+0000 mgr.gibba044.wflcwh (mgr.34466) 747 : cluster [DBG] pgmap v413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:45.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:45 gibba044 bash[25485]: audit 2021-03-10T20:21:45.052571+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:21:45.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:45 gibba044 bash[25485]: audit 2021-03-10T20:21:45.056625+0000 mon.a (mon.0) 745 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:21:45.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:45 gibba044 bash[25485]: audit 2021-03-10T20:21:45.057611+0000 mon.a (mon.0) 746 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:45.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:45 gibba044 bash[25485]: audit 2021-03-10T20:21:45.058592+0000 mon.a (mon.0) 747 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:45.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:45 gibba044 bash[25485]: audit 2021-03-10T20:21:45.059548+0000 mon.a (mon.0) 748 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:45.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:45 gibba044 bash[25485]: audit 2021-03-10T20:21:45.061348+0000 mon.a (mon.0) 749 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:45.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:45 gibba044 bash[25485]: audit 2021-03-10T20:21:45.062437+0000 mon.a (mon.0) 750 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:45.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:45 gibba023 bash[30844]: cluster 2021-03-10T20:21:43.760839+0000 mgr.gibba044.wflcwh (mgr.34466) 747 : cluster [DBG] pgmap v413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:45.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:45 gibba023 bash[30844]: audit 2021-03-10T20:21:45.052571+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:21:45.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:45 gibba023 bash[30844]: audit 2021-03-10T20:21:45.056625+0000 mon.a (mon.0) 745 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:21:45.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:45 gibba023 bash[30844]: audit 2021-03-10T20:21:45.057611+0000 mon.a (mon.0) 746 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:45.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:45 gibba023 bash[30844]: audit 2021-03-10T20:21:45.058592+0000 mon.a (mon.0) 747 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:45.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:45 gibba023 bash[30844]: audit 2021-03-10T20:21:45.059548+0000 mon.a (mon.0) 748 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:45.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:45 gibba023 bash[30844]: audit 2021-03-10T20:21:45.061348+0000 mon.a (mon.0) 749 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:45.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:45 gibba023 bash[30844]: audit 2021-03-10T20:21:45.062437+0000 mon.a (mon.0) 750 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:45.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:45 gibba023 bash[31815]: cluster 2021-03-10T20:21:43.760839+0000 mgr.gibba044.wflcwh (mgr.34466) 747 : cluster [DBG] pgmap v413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:45.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:45 gibba023 bash[31815]: audit 2021-03-10T20:21:45.052571+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:21:45.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:45 gibba023 bash[31815]: audit 2021-03-10T20:21:45.056625+0000 mon.a (mon.0) 745 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:21:45.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:45 gibba023 bash[31815]: audit 2021-03-10T20:21:45.057611+0000 mon.a (mon.0) 746 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:45.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:45 gibba023 bash[31815]: audit 2021-03-10T20:21:45.058592+0000 mon.a (mon.0) 747 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:45.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:45 gibba023 bash[31815]: audit 2021-03-10T20:21:45.059548+0000 mon.a (mon.0) 748 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:45.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:45 gibba023 bash[31815]: audit 2021-03-10T20:21:45.061348+0000 mon.a (mon.0) 749 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:45.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:45 gibba023 bash[31815]: audit 2021-03-10T20:21:45.062437+0000 mon.a (mon.0) 750 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:21:46.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:46 gibba044 bash[25485]: cephadm 2021-03-10T20:21:44.846825+0000 mgr.gibba044.wflcwh (mgr.34466) 748 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:21:46.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:46 gibba044 bash[25485]: cephadm 2021-03-10T20:21:44.848383+0000 mgr.gibba044.wflcwh (mgr.34466) 749 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:21:46.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:46 gibba044 bash[25485]: cephadm 2021-03-10T20:21:45.060807+0000 mgr.gibba044.wflcwh (mgr.34466) 750 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:21:46.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:46 gibba044 bash[25485]: cephadm 2021-03-10T20:21:45.062130+0000 mgr.gibba044.wflcwh (mgr.34466) 751 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:21:46.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:46 gibba044 bash[25485]: cephadm 2021-03-10T20:21:45.063059+0000 mgr.gibba044.wflcwh (mgr.34466) 752 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:21:46.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:46 gibba044 bash[25485]: cephadm 2021-03-10T20:21:45.063102+0000 mgr.gibba044.wflcwh (mgr.34466) 753 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:21:46.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:46 gibba044 bash[25485]: cephadm 2021-03-10T20:21:45.064133+0000 mgr.gibba044.wflcwh (mgr.34466) 754 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:21:46.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:46 gibba044 bash[25485]: cephadm 2021-03-10T20:21:45.064173+0000 mgr.gibba044.wflcwh (mgr.34466) 755 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:21:46.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:46 gibba044 bash[25485]: cephadm 2021-03-10T20:21:45.065044+0000 mgr.gibba044.wflcwh (mgr.34466) 756 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:21:46.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:46 gibba044 bash[25485]: cephadm 2021-03-10T20:21:45.065852+0000 mgr.gibba044.wflcwh (mgr.34466) 757 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:21:46.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:46 gibba044 bash[25485]: cephadm 2021-03-10T20:21:45.065889+0000 mgr.gibba044.wflcwh (mgr.34466) 758 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:21:46.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:46 gibba044 bash[25485]: cephadm 2021-03-10T20:21:45.066793+0000 mgr.gibba044.wflcwh (mgr.34466) 759 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:21:46.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:46 gibba044 bash[25485]: cephadm 2021-03-10T20:21:45.067124+0000 mgr.gibba044.wflcwh (mgr.34466) 760 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:21:46.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:46 gibba044 bash[25485]: cephadm 2021-03-10T20:21:45.068004+0000 mgr.gibba044.wflcwh (mgr.34466) 761 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:21:46.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:46 gibba044 bash[25485]: cephadm 2021-03-10T20:21:45.068044+0000 mgr.gibba044.wflcwh (mgr.34466) 762 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:21:46.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:46 gibba044 bash[25485]: cephadm 2021-03-10T20:21:45.068265+0000 mgr.gibba044.wflcwh (mgr.34466) 763 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:21:46.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[30844]: cephadm 2021-03-10T20:21:44.846825+0000 mgr.gibba044.wflcwh (mgr.34466) 748 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:21:46.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[30844]: cephadm 2021-03-10T20:21:44.848383+0000 mgr.gibba044.wflcwh (mgr.34466) 749 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:21:46.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[30844]: cephadm 2021-03-10T20:21:45.060807+0000 mgr.gibba044.wflcwh (mgr.34466) 750 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:21:46.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[30844]: cephadm 2021-03-10T20:21:45.062130+0000 mgr.gibba044.wflcwh (mgr.34466) 751 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:21:46.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[30844]: cephadm 2021-03-10T20:21:45.063059+0000 mgr.gibba044.wflcwh (mgr.34466) 752 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:21:46.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[30844]: cephadm 2021-03-10T20:21:45.063102+0000 mgr.gibba044.wflcwh (mgr.34466) 753 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:21:46.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[30844]: cephadm 2021-03-10T20:21:45.064133+0000 mgr.gibba044.wflcwh (mgr.34466) 754 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:21:46.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[30844]: cephadm 2021-03-10T20:21:45.064173+0000 mgr.gibba044.wflcwh (mgr.34466) 755 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:21:46.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[30844]: cephadm 2021-03-10T20:21:45.065044+0000 mgr.gibba044.wflcwh (mgr.34466) 756 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:21:46.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[30844]: cephadm 2021-03-10T20:21:45.065852+0000 mgr.gibba044.wflcwh (mgr.34466) 757 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:21:46.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[30844]: cephadm 2021-03-10T20:21:45.065889+0000 mgr.gibba044.wflcwh (mgr.34466) 758 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:21:46.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[30844]: cephadm 2021-03-10T20:21:45.066793+0000 mgr.gibba044.wflcwh (mgr.34466) 759 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:21:46.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[30844]: cephadm 2021-03-10T20:21:45.067124+0000 mgr.gibba044.wflcwh (mgr.34466) 760 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:21:46.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[30844]: cephadm 2021-03-10T20:21:45.068004+0000 mgr.gibba044.wflcwh (mgr.34466) 761 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:21:46.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[30844]: cephadm 2021-03-10T20:21:45.068044+0000 mgr.gibba044.wflcwh (mgr.34466) 762 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:21:46.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[30844]: cephadm 2021-03-10T20:21:45.068265+0000 mgr.gibba044.wflcwh (mgr.34466) 763 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:21:46.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[31815]: cephadm 2021-03-10T20:21:44.846825+0000 mgr.gibba044.wflcwh (mgr.34466) 748 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:21:46.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[31815]: cephadm 2021-03-10T20:21:44.848383+0000 mgr.gibba044.wflcwh (mgr.34466) 749 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:21:46.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[31815]: cephadm 2021-03-10T20:21:45.060807+0000 mgr.gibba044.wflcwh (mgr.34466) 750 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:21:46.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[31815]: cephadm 2021-03-10T20:21:45.062130+0000 mgr.gibba044.wflcwh (mgr.34466) 751 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:21:46.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[31815]: cephadm 2021-03-10T20:21:45.063059+0000 mgr.gibba044.wflcwh (mgr.34466) 752 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:21:46.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[31815]: cephadm 2021-03-10T20:21:45.063102+0000 mgr.gibba044.wflcwh (mgr.34466) 753 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:21:46.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[31815]: cephadm 2021-03-10T20:21:45.064133+0000 mgr.gibba044.wflcwh (mgr.34466) 754 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:21:46.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[31815]: cephadm 2021-03-10T20:21:45.064173+0000 mgr.gibba044.wflcwh (mgr.34466) 755 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:21:46.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[31815]: cephadm 2021-03-10T20:21:45.065044+0000 mgr.gibba044.wflcwh (mgr.34466) 756 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:21:46.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[31815]: cephadm 2021-03-10T20:21:45.065852+0000 mgr.gibba044.wflcwh (mgr.34466) 757 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:21:46.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[31815]: cephadm 2021-03-10T20:21:45.065889+0000 mgr.gibba044.wflcwh (mgr.34466) 758 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:21:46.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[31815]: cephadm 2021-03-10T20:21:45.066793+0000 mgr.gibba044.wflcwh (mgr.34466) 759 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:21:46.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[31815]: cephadm 2021-03-10T20:21:45.067124+0000 mgr.gibba044.wflcwh (mgr.34466) 760 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:21:46.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[31815]: cephadm 2021-03-10T20:21:45.068004+0000 mgr.gibba044.wflcwh (mgr.34466) 761 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:21:46.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[31815]: cephadm 2021-03-10T20:21:45.068044+0000 mgr.gibba044.wflcwh (mgr.34466) 762 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:21:46.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:46 gibba023 bash[31815]: cephadm 2021-03-10T20:21:45.068265+0000 mgr.gibba044.wflcwh (mgr.34466) 763 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:21:47.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:47 gibba023 bash[30844]: cluster 2021-03-10T20:21:45.762267+0000 mgr.gibba044.wflcwh (mgr.34466) 764 : cluster [DBG] pgmap v414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:47.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:47 gibba023 bash[31815]: cluster 2021-03-10T20:21:45.762267+0000 mgr.gibba044.wflcwh (mgr.34466) 764 : cluster [DBG] pgmap v414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:47.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:47 gibba044 bash[25485]: cluster 2021-03-10T20:21:45.762267+0000 mgr.gibba044.wflcwh (mgr.34466) 764 : cluster [DBG] pgmap v414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:49.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:49 gibba023 bash[30844]: cluster 2021-03-10T20:21:47.763776+0000 mgr.gibba044.wflcwh (mgr.34466) 765 : cluster [DBG] pgmap v415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:49.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:49 gibba023 bash[31815]: cluster 2021-03-10T20:21:47.763776+0000 mgr.gibba044.wflcwh (mgr.34466) 765 : cluster [DBG] pgmap v415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:49.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:49 gibba044 bash[25485]: cluster 2021-03-10T20:21:47.763776+0000 mgr.gibba044.wflcwh (mgr.34466) 765 : cluster [DBG] pgmap v415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:51.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:51 gibba023 bash[30844]: cluster 2021-03-10T20:21:49.765009+0000 mgr.gibba044.wflcwh (mgr.34466) 766 : cluster [DBG] pgmap v416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:51.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:51 gibba023 bash[31815]: cluster 2021-03-10T20:21:49.765009+0000 mgr.gibba044.wflcwh (mgr.34466) 766 : cluster [DBG] pgmap v416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:51.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:51 gibba044 bash[25485]: cluster 2021-03-10T20:21:49.765009+0000 mgr.gibba044.wflcwh (mgr.34466) 766 : cluster [DBG] pgmap v416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:53.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:53 gibba023 bash[30844]: cluster 2021-03-10T20:21:51.766678+0000 mgr.gibba044.wflcwh (mgr.34466) 767 : cluster [DBG] pgmap v417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:53.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:53 gibba023 bash[31815]: cluster 2021-03-10T20:21:51.766678+0000 mgr.gibba044.wflcwh (mgr.34466) 767 : cluster [DBG] pgmap v417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:53.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:53 gibba044 bash[25485]: cluster 2021-03-10T20:21:51.766678+0000 mgr.gibba044.wflcwh (mgr.34466) 767 : cluster [DBG] pgmap v417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:55.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:55 gibba023 bash[30844]: cluster 2021-03-10T20:21:53.768471+0000 mgr.gibba044.wflcwh (mgr.34466) 768 : cluster [DBG] pgmap v418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:55.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:55 gibba023 bash[31815]: cluster 2021-03-10T20:21:53.768471+0000 mgr.gibba044.wflcwh (mgr.34466) 768 : cluster [DBG] pgmap v418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:55.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:55 gibba044 bash[25485]: cluster 2021-03-10T20:21:53.768471+0000 mgr.gibba044.wflcwh (mgr.34466) 768 : cluster [DBG] pgmap v418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:57.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:57 gibba023 bash[30844]: cluster 2021-03-10T20:21:55.770171+0000 mgr.gibba044.wflcwh (mgr.34466) 769 : cluster [DBG] pgmap v419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:57.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:57 gibba023 bash[31815]: cluster 2021-03-10T20:21:55.770171+0000 mgr.gibba044.wflcwh (mgr.34466) 769 : cluster [DBG] pgmap v419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:57.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:57 gibba044 bash[25485]: cluster 2021-03-10T20:21:55.770171+0000 mgr.gibba044.wflcwh (mgr.34466) 769 : cluster [DBG] pgmap v419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:59.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:21:59 gibba023 bash[30844]: cluster 2021-03-10T20:21:57.771754+0000 mgr.gibba044.wflcwh (mgr.34466) 770 : cluster [DBG] pgmap v420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:59.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:21:59 gibba023 bash[31815]: cluster 2021-03-10T20:21:57.771754+0000 mgr.gibba044.wflcwh (mgr.34466) 770 : cluster [DBG] pgmap v420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:21:59.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:21:59 gibba044 bash[25485]: cluster 2021-03-10T20:21:57.771754+0000 mgr.gibba044.wflcwh (mgr.34466) 770 : cluster [DBG] pgmap v420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:01.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:01 gibba023 bash[30844]: cluster 2021-03-10T20:21:59.772951+0000 mgr.gibba044.wflcwh (mgr.34466) 771 : cluster [DBG] pgmap v421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:01.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:01 gibba023 bash[30844]: cephadm 2021-03-10T20:22:00.080365+0000 mgr.gibba044.wflcwh (mgr.34466) 772 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:22:01.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:01 gibba023 bash[31815]: cluster 2021-03-10T20:21:59.772951+0000 mgr.gibba044.wflcwh (mgr.34466) 771 : cluster [DBG] pgmap v421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:01.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:01 gibba023 bash[31815]: cephadm 2021-03-10T20:22:00.080365+0000 mgr.gibba044.wflcwh (mgr.34466) 772 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:22:01.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:01 gibba044 bash[25485]: cluster 2021-03-10T20:21:59.772951+0000 mgr.gibba044.wflcwh (mgr.34466) 771 : cluster [DBG] pgmap v421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:01.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:01 gibba044 bash[25485]: cephadm 2021-03-10T20:22:00.080365+0000 mgr.gibba044.wflcwh (mgr.34466) 772 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:22:03.906 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:22:03.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:03 gibba023 bash[30844]: cluster 2021-03-10T20:22:01.774362+0000 mgr.gibba044.wflcwh (mgr.34466) 773 : cluster [DBG] pgmap v422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:03.923 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:03 gibba023 bash[31815]: cluster 2021-03-10T20:22:01.774362+0000 mgr.gibba044.wflcwh (mgr.34466) 773 : cluster [DBG] pgmap v422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:03.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:03 gibba044 bash[25485]: cluster 2021-03-10T20:22:01.774362+0000 mgr.gibba044.wflcwh (mgr.34466) 773 : cluster [DBG] pgmap v422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:04.137 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:22:04.137 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (13m) 10m ago 18m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:22:04.137 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (18m) 8m ago 18m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:22:04.138 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (13m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:22:04.138 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (13m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:22:04.138 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (12m) 10m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:22:04.139 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (12m) 10m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:22:04.139 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (12m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:22:04.139 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (12m) 10m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:22:04.139 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (18m) 10m ago 18m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:22:04.140 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (18m) 8m ago 18m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:22:04.140 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (11m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:22:04.140 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (10m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:22:04.140 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (10m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:22:04.140 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (10m) 10m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:22:04.141 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (9m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:22:04.141 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (9m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:22:04.141 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (8m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:22:04.141 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (8m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:22:04.142 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (18m) 8m ago 18m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:22:04.142 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 10m ago 16m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:22:04.142 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 8m ago 16m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:22:04.385 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:22:04.385 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:22:04.386 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:22:04.386 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:22:04.386 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:22:04.386 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:22:04.386 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:22:04.387 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:22:04.387 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:22:04.387 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:22:04.387 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:22:04.387 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:22:04.388 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:22:04.388 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:22:04.388 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:22:04.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:04 gibba023 bash[30844]: audit 2021-03-10T20:22:04.386111+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.2.123:0/1457830187' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:04.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:04 gibba023 bash[31815]: audit 2021-03-10T20:22:04.386111+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.2.123:0/1457830187' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:04.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:04 gibba044 bash[25485]: audit 2021-03-10T20:22:04.386111+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.2.123:0/1457830187' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:05.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:05 gibba023 bash[30844]: cluster 2021-03-10T20:22:03.776066+0000 mgr.gibba044.wflcwh (mgr.34466) 774 : cluster [DBG] pgmap v423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:05.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:05 gibba023 bash[30844]: audit 2021-03-10T20:22:03.903423+0000 mgr.gibba044.wflcwh (mgr.34466) 775 : audit [DBG] from='client.44580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:22:05.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:05 gibba023 bash[30844]: audit 2021-03-10T20:22:04.130930+0000 mgr.gibba044.wflcwh (mgr.34466) 776 : audit [DBG] from='client.54565 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:22:05.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:05 gibba023 bash[31815]: cluster 2021-03-10T20:22:03.776066+0000 mgr.gibba044.wflcwh (mgr.34466) 774 : cluster [DBG] pgmap v423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:05.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:05 gibba023 bash[31815]: audit 2021-03-10T20:22:03.903423+0000 mgr.gibba044.wflcwh (mgr.34466) 775 : audit [DBG] from='client.44580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:22:05.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:05 gibba023 bash[31815]: audit 2021-03-10T20:22:04.130930+0000 mgr.gibba044.wflcwh (mgr.34466) 776 : audit [DBG] from='client.54565 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:22:05.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:05 gibba044 bash[25485]: cluster 2021-03-10T20:22:03.776066+0000 mgr.gibba044.wflcwh (mgr.34466) 774 : cluster [DBG] pgmap v423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:05.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:05 gibba044 bash[25485]: audit 2021-03-10T20:22:03.903423+0000 mgr.gibba044.wflcwh (mgr.34466) 775 : audit [DBG] from='client.44580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:22:05.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:05 gibba044 bash[25485]: audit 2021-03-10T20:22:04.130930+0000 mgr.gibba044.wflcwh (mgr.34466) 776 : audit [DBG] from='client.54565 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:22:07.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:07 gibba023 bash[30844]: cluster 2021-03-10T20:22:05.777548+0000 mgr.gibba044.wflcwh (mgr.34466) 777 : cluster [DBG] pgmap v424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:07.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:07 gibba023 bash[31815]: cluster 2021-03-10T20:22:05.777548+0000 mgr.gibba044.wflcwh (mgr.34466) 777 : cluster [DBG] pgmap v424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:07.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:07 gibba044 bash[25485]: cluster 2021-03-10T20:22:05.777548+0000 mgr.gibba044.wflcwh (mgr.34466) 777 : cluster [DBG] pgmap v424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:09.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:09 gibba023 bash[30844]: cluster 2021-03-10T20:22:07.779079+0000 mgr.gibba044.wflcwh (mgr.34466) 778 : cluster [DBG] pgmap v425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:09.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:09 gibba023 bash[31815]: cluster 2021-03-10T20:22:07.779079+0000 mgr.gibba044.wflcwh (mgr.34466) 778 : cluster [DBG] pgmap v425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:09.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:09 gibba044 bash[25485]: cluster 2021-03-10T20:22:07.779079+0000 mgr.gibba044.wflcwh (mgr.34466) 778 : cluster [DBG] pgmap v425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:11.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:11 gibba023 bash[30844]: cluster 2021-03-10T20:22:09.780453+0000 mgr.gibba044.wflcwh (mgr.34466) 779 : cluster [DBG] pgmap v426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:11.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:11 gibba023 bash[31815]: cluster 2021-03-10T20:22:09.780453+0000 mgr.gibba044.wflcwh (mgr.34466) 779 : cluster [DBG] pgmap v426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:11.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:11 gibba044 bash[25485]: cluster 2021-03-10T20:22:09.780453+0000 mgr.gibba044.wflcwh (mgr.34466) 779 : cluster [DBG] pgmap v426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:13.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:13 gibba023 bash[30844]: cluster 2021-03-10T20:22:11.782206+0000 mgr.gibba044.wflcwh (mgr.34466) 780 : cluster [DBG] pgmap v427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:13.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:13 gibba023 bash[31815]: cluster 2021-03-10T20:22:11.782206+0000 mgr.gibba044.wflcwh (mgr.34466) 780 : cluster [DBG] pgmap v427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:13.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:13 gibba044 bash[25485]: cluster 2021-03-10T20:22:11.782206+0000 mgr.gibba044.wflcwh (mgr.34466) 780 : cluster [DBG] pgmap v427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:15.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:15 gibba023 bash[30844]: cluster 2021-03-10T20:22:13.783962+0000 mgr.gibba044.wflcwh (mgr.34466) 781 : cluster [DBG] pgmap v428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:15.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:15 gibba023 bash[31815]: cluster 2021-03-10T20:22:13.783962+0000 mgr.gibba044.wflcwh (mgr.34466) 781 : cluster [DBG] pgmap v428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:15.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:15 gibba044 bash[25485]: cluster 2021-03-10T20:22:13.783962+0000 mgr.gibba044.wflcwh (mgr.34466) 781 : cluster [DBG] pgmap v428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:16.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:16 gibba023 bash[30844]: cephadm 2021-03-10T20:22:15.096389+0000 mgr.gibba044.wflcwh (mgr.34466) 782 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:22:16.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:16 gibba023 bash[31815]: cephadm 2021-03-10T20:22:15.096389+0000 mgr.gibba044.wflcwh (mgr.34466) 782 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:22:16.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:16 gibba044 bash[25485]: cephadm 2021-03-10T20:22:15.096389+0000 mgr.gibba044.wflcwh (mgr.34466) 782 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:22:17.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:17 gibba023 bash[30844]: cluster 2021-03-10T20:22:15.785385+0000 mgr.gibba044.wflcwh (mgr.34466) 783 : cluster [DBG] pgmap v429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:17.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:17 gibba023 bash[31815]: cluster 2021-03-10T20:22:15.785385+0000 mgr.gibba044.wflcwh (mgr.34466) 783 : cluster [DBG] pgmap v429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:17.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:17 gibba044 bash[25485]: cluster 2021-03-10T20:22:15.785385+0000 mgr.gibba044.wflcwh (mgr.34466) 783 : cluster [DBG] pgmap v429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:19.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:19 gibba023 bash[30844]: cluster 2021-03-10T20:22:17.786819+0000 mgr.gibba044.wflcwh (mgr.34466) 784 : cluster [DBG] pgmap v430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:19.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:19 gibba023 bash[31815]: cluster 2021-03-10T20:22:17.786819+0000 mgr.gibba044.wflcwh (mgr.34466) 784 : cluster [DBG] pgmap v430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:19.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:19 gibba044 bash[25485]: cluster 2021-03-10T20:22:17.786819+0000 mgr.gibba044.wflcwh (mgr.34466) 784 : cluster [DBG] pgmap v430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:21.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:21 gibba023 bash[30844]: cluster 2021-03-10T20:22:19.788153+0000 mgr.gibba044.wflcwh (mgr.34466) 785 : cluster [DBG] pgmap v431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:21.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:21 gibba023 bash[31815]: cluster 2021-03-10T20:22:19.788153+0000 mgr.gibba044.wflcwh (mgr.34466) 785 : cluster [DBG] pgmap v431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:21.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:21 gibba044 bash[25485]: cluster 2021-03-10T20:22:19.788153+0000 mgr.gibba044.wflcwh (mgr.34466) 785 : cluster [DBG] pgmap v431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:23.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:23 gibba044 bash[25485]: cluster 2021-03-10T20:22:21.789846+0000 mgr.gibba044.wflcwh (mgr.34466) 786 : cluster [DBG] pgmap v432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:24.173 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:23 gibba023 bash[30844]: cluster 2021-03-10T20:22:21.789846+0000 mgr.gibba044.wflcwh (mgr.34466) 786 : cluster [DBG] pgmap v432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:24.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:23 gibba023 bash[31815]: cluster 2021-03-10T20:22:21.789846+0000 mgr.gibba044.wflcwh (mgr.34466) 786 : cluster [DBG] pgmap v432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:24.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:24 gibba044 bash[25485]: cluster 2021-03-10T20:22:23.791816+0000 mgr.gibba044.wflcwh (mgr.34466) 787 : cluster [DBG] pgmap v433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:25.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:24 gibba023 bash[30844]: cluster 2021-03-10T20:22:23.791816+0000 mgr.gibba044.wflcwh (mgr.34466) 787 : cluster [DBG] pgmap v433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:25.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:24 gibba023 bash[31815]: cluster 2021-03-10T20:22:23.791816+0000 mgr.gibba044.wflcwh (mgr.34466) 787 : cluster [DBG] pgmap v433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:27.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:27 gibba023 bash[30844]: cluster 2021-03-10T20:22:25.793387+0000 mgr.gibba044.wflcwh (mgr.34466) 788 : cluster [DBG] pgmap v434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:27.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:27 gibba023 bash[30844]: audit 2021-03-10T20:22:27.046224+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:22:27.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:27 gibba023 bash[30844]: audit 2021-03-10T20:22:27.047074+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:22:27.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:27 gibba023 bash[30844]: audit 2021-03-10T20:22:27.047776+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:22:27.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:27 gibba023 bash[30844]: audit 2021-03-10T20:22:27.048453+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:22:27.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:27 gibba023 bash[30844]: audit 2021-03-10T20:22:27.111985+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:22:27.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:27 gibba023 bash[30844]: audit 2021-03-10T20:22:27.112650+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:22:27.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:27 gibba023 bash[31815]: cluster 2021-03-10T20:22:25.793387+0000 mgr.gibba044.wflcwh (mgr.34466) 788 : cluster [DBG] pgmap v434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:27.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:27 gibba023 bash[31815]: audit 2021-03-10T20:22:27.046224+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:22:27.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:27 gibba023 bash[31815]: audit 2021-03-10T20:22:27.047074+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:22:27.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:27 gibba023 bash[31815]: audit 2021-03-10T20:22:27.047776+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:22:27.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:27 gibba023 bash[31815]: audit 2021-03-10T20:22:27.048453+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:22:27.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:27 gibba023 bash[31815]: audit 2021-03-10T20:22:27.111985+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:22:27.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:27 gibba023 bash[31815]: audit 2021-03-10T20:22:27.112650+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:22:27.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:27 gibba044 bash[25485]: cluster 2021-03-10T20:22:25.793387+0000 mgr.gibba044.wflcwh (mgr.34466) 788 : cluster [DBG] pgmap v434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:27.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:27 gibba044 bash[25485]: audit 2021-03-10T20:22:27.046224+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:22:27.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:27 gibba044 bash[25485]: audit 2021-03-10T20:22:27.047074+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:22:27.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:27 gibba044 bash[25485]: audit 2021-03-10T20:22:27.047776+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:22:27.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:27 gibba044 bash[25485]: audit 2021-03-10T20:22:27.048453+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:22:27.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:27 gibba044 bash[25485]: audit 2021-03-10T20:22:27.111985+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:22:27.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:27 gibba044 bash[25485]: audit 2021-03-10T20:22:27.112650+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:22:29.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:29 gibba023 bash[30844]: cluster 2021-03-10T20:22:27.794918+0000 mgr.gibba044.wflcwh (mgr.34466) 789 : cluster [DBG] pgmap v435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:29.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:29 gibba023 bash[31815]: cluster 2021-03-10T20:22:27.794918+0000 mgr.gibba044.wflcwh (mgr.34466) 789 : cluster [DBG] pgmap v435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:29.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:29 gibba044 bash[25485]: cluster 2021-03-10T20:22:27.794918+0000 mgr.gibba044.wflcwh (mgr.34466) 789 : cluster [DBG] pgmap v435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:31.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:31 gibba023 bash[30844]: cluster 2021-03-10T20:22:29.796292+0000 mgr.gibba044.wflcwh (mgr.34466) 790 : cluster [DBG] pgmap v436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:31.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:31 gibba023 bash[30844]: cephadm 2021-03-10T20:22:30.109864+0000 mgr.gibba044.wflcwh (mgr.34466) 791 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:22:31.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:31 gibba023 bash[31815]: cluster 2021-03-10T20:22:29.796292+0000 mgr.gibba044.wflcwh (mgr.34466) 790 : cluster [DBG] pgmap v436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:31.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:31 gibba023 bash[31815]: cephadm 2021-03-10T20:22:30.109864+0000 mgr.gibba044.wflcwh (mgr.34466) 791 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:22:31.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:31 gibba044 bash[25485]: cluster 2021-03-10T20:22:29.796292+0000 mgr.gibba044.wflcwh (mgr.34466) 790 : cluster [DBG] pgmap v436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:31.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:31 gibba044 bash[25485]: cephadm 2021-03-10T20:22:30.109864+0000 mgr.gibba044.wflcwh (mgr.34466) 791 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:22:33.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:33 gibba023 bash[30844]: cluster 2021-03-10T20:22:31.797998+0000 mgr.gibba044.wflcwh (mgr.34466) 792 : cluster [DBG] pgmap v437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:33.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:33 gibba023 bash[31815]: cluster 2021-03-10T20:22:31.797998+0000 mgr.gibba044.wflcwh (mgr.34466) 792 : cluster [DBG] pgmap v437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:33.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:33 gibba044 bash[25485]: cluster 2021-03-10T20:22:31.797998+0000 mgr.gibba044.wflcwh (mgr.34466) 792 : cluster [DBG] pgmap v437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:34.634 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:22:34.890 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:22:34.890 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (13m) 10m ago 19m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:22:34.891 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (19m) 8m ago 19m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:22:34.891 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (14m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:22:34.891 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (14m) 8m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:22:34.891 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (13m) 10m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:22:34.892 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (13m) 10m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:22:34.892 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (12m) 8m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:22:34.892 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (12m) 10m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:22:34.892 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (19m) 10m ago 19m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:22:34.893 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (19m) 8m ago 19m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:22:34.893 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (11m) 10m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:22:34.893 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (11m) 10m ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:22:34.893 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (11m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:22:34.893 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (10m) 10m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:22:34.894 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (10m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:22:34.894 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (9m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:22:34.894 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (9m) 8m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:22:34.894 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (8m) 8m ago 19m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:22:34.895 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (18m) 8m ago 19m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:22:34.895 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 10m ago 17m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:22:34.896 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 8m ago 17m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:22:35.143 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:22:35.143 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:22:35.143 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:22:35.143 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:22:35.144 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:22:35.144 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:22:35.144 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:22:35.144 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:22:35.145 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:22:35.145 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:22:35.145 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:22:35.146 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:22:35.146 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:22:35.146 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:22:35.146 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:22:35.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:35 gibba023 bash[30844]: cluster 2021-03-10T20:22:33.799986+0000 mgr.gibba044.wflcwh (mgr.34466) 793 : cluster [DBG] pgmap v438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:35.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:35 gibba023 bash[30844]: audit 2021-03-10T20:22:34.630362+0000 mgr.gibba044.wflcwh (mgr.34466) 794 : audit [DBG] from='client.44598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:22:35.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:35 gibba023 bash[30844]: audit 2021-03-10T20:22:35.143655+0000 mon.a (mon.0) 757 : audit [DBG] from='client.? 172.21.2.123:0/3801276449' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:35.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:35 gibba023 bash[31815]: cluster 2021-03-10T20:22:33.799986+0000 mgr.gibba044.wflcwh (mgr.34466) 793 : cluster [DBG] pgmap v438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:35.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:35 gibba023 bash[31815]: audit 2021-03-10T20:22:34.630362+0000 mgr.gibba044.wflcwh (mgr.34466) 794 : audit [DBG] from='client.44598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:22:35.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:35 gibba023 bash[31815]: audit 2021-03-10T20:22:35.143655+0000 mon.a (mon.0) 757 : audit [DBG] from='client.? 172.21.2.123:0/3801276449' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:35.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:35 gibba044 bash[25485]: cluster 2021-03-10T20:22:33.799986+0000 mgr.gibba044.wflcwh (mgr.34466) 793 : cluster [DBG] pgmap v438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:35.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:35 gibba044 bash[25485]: audit 2021-03-10T20:22:34.630362+0000 mgr.gibba044.wflcwh (mgr.34466) 794 : audit [DBG] from='client.44598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:22:35.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:35 gibba044 bash[25485]: audit 2021-03-10T20:22:35.143655+0000 mon.a (mon.0) 757 : audit [DBG] from='client.? 172.21.2.123:0/3801276449' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:36.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:36 gibba023 bash[30844]: audit 2021-03-10T20:22:34.857256+0000 mgr.gibba044.wflcwh (mgr.34466) 795 : audit [DBG] from='client.44604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:22:36.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:36 gibba023 bash[31815]: audit 2021-03-10T20:22:34.857256+0000 mgr.gibba044.wflcwh (mgr.34466) 795 : audit [DBG] from='client.44604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:22:36.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:36 gibba044 bash[25485]: audit 2021-03-10T20:22:34.857256+0000 mgr.gibba044.wflcwh (mgr.34466) 795 : audit [DBG] from='client.44604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:22:37.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:37 gibba023 bash[30844]: cluster 2021-03-10T20:22:35.801544+0000 mgr.gibba044.wflcwh (mgr.34466) 796 : cluster [DBG] pgmap v439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:37.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:37 gibba023 bash[31815]: cluster 2021-03-10T20:22:35.801544+0000 mgr.gibba044.wflcwh (mgr.34466) 796 : cluster [DBG] pgmap v439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:37.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:37 gibba044 bash[25485]: cluster 2021-03-10T20:22:35.801544+0000 mgr.gibba044.wflcwh (mgr.34466) 796 : cluster [DBG] pgmap v439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:39.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:39 gibba023 bash[30844]: cluster 2021-03-10T20:22:37.803080+0000 mgr.gibba044.wflcwh (mgr.34466) 797 : cluster [DBG] pgmap v440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:39.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:39 gibba023 bash[31815]: cluster 2021-03-10T20:22:37.803080+0000 mgr.gibba044.wflcwh (mgr.34466) 797 : cluster [DBG] pgmap v440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:39.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:39 gibba044 bash[25485]: cluster 2021-03-10T20:22:37.803080+0000 mgr.gibba044.wflcwh (mgr.34466) 797 : cluster [DBG] pgmap v440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:41.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:41 gibba023 bash[30844]: cluster 2021-03-10T20:22:39.804493+0000 mgr.gibba044.wflcwh (mgr.34466) 798 : cluster [DBG] pgmap v441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:41.732 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:41 gibba023 bash[31815]: cluster 2021-03-10T20:22:39.804493+0000 mgr.gibba044.wflcwh (mgr.34466) 798 : cluster [DBG] pgmap v441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:41.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:41 gibba044 bash[25485]: cluster 2021-03-10T20:22:39.804493+0000 mgr.gibba044.wflcwh (mgr.34466) 798 : cluster [DBG] pgmap v441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:43.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:43 gibba023 bash[30844]: cluster 2021-03-10T20:22:41.806312+0000 mgr.gibba044.wflcwh (mgr.34466) 799 : cluster [DBG] pgmap v442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:43.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:43 gibba023 bash[31815]: cluster 2021-03-10T20:22:41.806312+0000 mgr.gibba044.wflcwh (mgr.34466) 799 : cluster [DBG] pgmap v442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:43.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:43 gibba044 bash[25485]: cluster 2021-03-10T20:22:41.806312+0000 mgr.gibba044.wflcwh (mgr.34466) 799 : cluster [DBG] pgmap v442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:45.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:45 gibba023 bash[30844]: cluster 2021-03-10T20:22:43.808071+0000 mgr.gibba044.wflcwh (mgr.34466) 800 : cluster [DBG] pgmap v443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:45.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:45 gibba023 bash[30844]: audit 2021-03-10T20:22:45.113314+0000 mon.a (mon.0) 758 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:22:45.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:45 gibba023 bash[31815]: cluster 2021-03-10T20:22:43.808071+0000 mgr.gibba044.wflcwh (mgr.34466) 800 : cluster [DBG] pgmap v443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:45.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:45 gibba023 bash[31815]: audit 2021-03-10T20:22:45.113314+0000 mon.a (mon.0) 758 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:22:45.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:45 gibba044 bash[25485]: cluster 2021-03-10T20:22:43.808071+0000 mgr.gibba044.wflcwh (mgr.34466) 800 : cluster [DBG] pgmap v443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:45.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:45 gibba044 bash[25485]: audit 2021-03-10T20:22:45.113314+0000 mon.a (mon.0) 758 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:22:46.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:46 gibba023 bash[30844]: cephadm 2021-03-10T20:22:45.118067+0000 mgr.gibba044.wflcwh (mgr.34466) 801 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:22:46.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:46 gibba023 bash[31815]: cephadm 2021-03-10T20:22:45.118067+0000 mgr.gibba044.wflcwh (mgr.34466) 801 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:22:46.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:46 gibba044 bash[25485]: cephadm 2021-03-10T20:22:45.118067+0000 mgr.gibba044.wflcwh (mgr.34466) 801 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:22:47.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:47 gibba023 bash[30844]: cluster 2021-03-10T20:22:45.809748+0000 mgr.gibba044.wflcwh (mgr.34466) 802 : cluster [DBG] pgmap v444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:47.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:47 gibba023 bash[31815]: cluster 2021-03-10T20:22:45.809748+0000 mgr.gibba044.wflcwh (mgr.34466) 802 : cluster [DBG] pgmap v444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:47.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:47 gibba044 bash[25485]: cluster 2021-03-10T20:22:45.809748+0000 mgr.gibba044.wflcwh (mgr.34466) 802 : cluster [DBG] pgmap v444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:49.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:49 gibba023 bash[30844]: cluster 2021-03-10T20:22:47.811439+0000 mgr.gibba044.wflcwh (mgr.34466) 803 : cluster [DBG] pgmap v445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:49.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:49 gibba023 bash[30844]: audit 2021-03-10T20:22:48.624969+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:22:49.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:49 gibba023 bash[30844]: cephadm 2021-03-10T20:22:48.630922+0000 mgr.gibba044.wflcwh (mgr.34466) 804 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:22:49.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:49 gibba023 bash[30844]: audit 2021-03-10T20:22:48.835317+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:22:49.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:49 gibba023 bash[30844]: audit 2021-03-10T20:22:48.842494+0000 mon.a (mon.0) 761 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:22:49.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:49 gibba023 bash[30844]: audit 2021-03-10T20:22:48.844136+0000 mon.a (mon.0) 762 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:49.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:49 gibba023 bash[30844]: audit 2021-03-10T20:22:48.845681+0000 mon.a (mon.0) 763 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:49.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:49 gibba023 bash[30844]: audit 2021-03-10T20:22:48.847383+0000 mon.a (mon.0) 764 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:49.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:49 gibba023 bash[30844]: audit 2021-03-10T20:22:48.850285+0000 mon.a (mon.0) 765 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:49.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:49 gibba023 bash[30844]: audit 2021-03-10T20:22:48.852719+0000 mon.a (mon.0) 766 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:49.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:49 gibba023 bash[31815]: cluster 2021-03-10T20:22:47.811439+0000 mgr.gibba044.wflcwh (mgr.34466) 803 : cluster [DBG] pgmap v445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:49.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:49 gibba023 bash[31815]: audit 2021-03-10T20:22:48.624969+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:22:49.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:49 gibba023 bash[31815]: cephadm 2021-03-10T20:22:48.630922+0000 mgr.gibba044.wflcwh (mgr.34466) 804 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:22:49.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:49 gibba023 bash[31815]: audit 2021-03-10T20:22:48.835317+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:22:49.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:49 gibba023 bash[31815]: audit 2021-03-10T20:22:48.842494+0000 mon.a (mon.0) 761 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:22:49.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:49 gibba023 bash[31815]: audit 2021-03-10T20:22:48.844136+0000 mon.a (mon.0) 762 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:49.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:49 gibba023 bash[31815]: audit 2021-03-10T20:22:48.845681+0000 mon.a (mon.0) 763 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:49.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:49 gibba023 bash[31815]: audit 2021-03-10T20:22:48.847383+0000 mon.a (mon.0) 764 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:49.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:49 gibba023 bash[31815]: audit 2021-03-10T20:22:48.850285+0000 mon.a (mon.0) 765 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:49.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:49 gibba023 bash[31815]: audit 2021-03-10T20:22:48.852719+0000 mon.a (mon.0) 766 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:49.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:49 gibba044 bash[25485]: cluster 2021-03-10T20:22:47.811439+0000 mgr.gibba044.wflcwh (mgr.34466) 803 : cluster [DBG] pgmap v445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:49.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:49 gibba044 bash[25485]: audit 2021-03-10T20:22:48.624969+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:22:49.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:49 gibba044 bash[25485]: cephadm 2021-03-10T20:22:48.630922+0000 mgr.gibba044.wflcwh (mgr.34466) 804 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:22:49.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:49 gibba044 bash[25485]: audit 2021-03-10T20:22:48.835317+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:22:49.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:49 gibba044 bash[25485]: audit 2021-03-10T20:22:48.842494+0000 mon.a (mon.0) 761 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:22:49.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:49 gibba044 bash[25485]: audit 2021-03-10T20:22:48.844136+0000 mon.a (mon.0) 762 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:49.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:49 gibba044 bash[25485]: audit 2021-03-10T20:22:48.845681+0000 mon.a (mon.0) 763 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:49.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:49 gibba044 bash[25485]: audit 2021-03-10T20:22:48.847383+0000 mon.a (mon.0) 764 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:49.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:49 gibba044 bash[25485]: audit 2021-03-10T20:22:48.850285+0000 mon.a (mon.0) 765 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:49.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:49 gibba044 bash[25485]: audit 2021-03-10T20:22:48.852719+0000 mon.a (mon.0) 766 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:22:50.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:50 gibba023 bash[30844]: cephadm 2021-03-10T20:22:48.847045+0000 mgr.gibba044.wflcwh (mgr.34466) 805 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:22:50.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:50 gibba023 bash[30844]: cephadm 2021-03-10T20:22:48.849017+0000 mgr.gibba044.wflcwh (mgr.34466) 806 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:22:50.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:50 gibba023 bash[30844]: cephadm 2021-03-10T20:22:48.850478+0000 mgr.gibba044.wflcwh (mgr.34466) 807 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:22:50.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:50 gibba023 bash[30844]: cephadm 2021-03-10T20:22:48.850574+0000 mgr.gibba044.wflcwh (mgr.34466) 808 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:22:50.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:50 gibba023 bash[30844]: cephadm 2021-03-10T20:22:48.852104+0000 mgr.gibba044.wflcwh (mgr.34466) 809 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:22:50.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:50 gibba023 bash[30844]: cephadm 2021-03-10T20:22:48.852166+0000 mgr.gibba044.wflcwh (mgr.34466) 810 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:22:50.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:50 gibba023 bash[30844]: cephadm 2021-03-10T20:22:48.853742+0000 mgr.gibba044.wflcwh (mgr.34466) 811 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:22:50.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:50 gibba023 bash[30844]: cephadm 2021-03-10T20:22:48.854974+0000 mgr.gibba044.wflcwh (mgr.34466) 812 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:22:50.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:50 gibba023 bash[30844]: cephadm 2021-03-10T20:22:48.855030+0000 mgr.gibba044.wflcwh (mgr.34466) 813 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:22:50.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:50 gibba023 bash[30844]: cephadm 2021-03-10T20:22:48.857098+0000 mgr.gibba044.wflcwh (mgr.34466) 814 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:22:50.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:50 gibba023 bash[30844]: cephadm 2021-03-10T20:22:48.857630+0000 mgr.gibba044.wflcwh (mgr.34466) 815 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:22:50.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:50 gibba023 bash[30844]: cephadm 2021-03-10T20:22:48.859020+0000 mgr.gibba044.wflcwh (mgr.34466) 816 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:22:50.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:50 gibba023 bash[30844]: cephadm 2021-03-10T20:22:48.859090+0000 mgr.gibba044.wflcwh (mgr.34466) 817 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:22:50.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:50 gibba023 bash[30844]: cephadm 2021-03-10T20:22:48.859263+0000 mgr.gibba044.wflcwh (mgr.34466) 818 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:22:50.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:50 gibba023 bash[31815]: cephadm 2021-03-10T20:22:48.847045+0000 mgr.gibba044.wflcwh (mgr.34466) 805 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:22:50.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:50 gibba023 bash[31815]: cephadm 2021-03-10T20:22:48.849017+0000 mgr.gibba044.wflcwh (mgr.34466) 806 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:22:50.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:50 gibba023 bash[31815]: cephadm 2021-03-10T20:22:48.850478+0000 mgr.gibba044.wflcwh (mgr.34466) 807 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:22:50.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:50 gibba023 bash[31815]: cephadm 2021-03-10T20:22:48.850574+0000 mgr.gibba044.wflcwh (mgr.34466) 808 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:22:50.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:50 gibba023 bash[31815]: cephadm 2021-03-10T20:22:48.852104+0000 mgr.gibba044.wflcwh (mgr.34466) 809 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:22:50.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:50 gibba023 bash[31815]: cephadm 2021-03-10T20:22:48.852166+0000 mgr.gibba044.wflcwh (mgr.34466) 810 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:22:50.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:50 gibba023 bash[31815]: cephadm 2021-03-10T20:22:48.853742+0000 mgr.gibba044.wflcwh (mgr.34466) 811 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:22:50.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:50 gibba023 bash[31815]: cephadm 2021-03-10T20:22:48.854974+0000 mgr.gibba044.wflcwh (mgr.34466) 812 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:22:50.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:50 gibba023 bash[31815]: cephadm 2021-03-10T20:22:48.855030+0000 mgr.gibba044.wflcwh (mgr.34466) 813 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:22:50.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:50 gibba023 bash[31815]: cephadm 2021-03-10T20:22:48.857098+0000 mgr.gibba044.wflcwh (mgr.34466) 814 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:22:50.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:50 gibba023 bash[31815]: cephadm 2021-03-10T20:22:48.857630+0000 mgr.gibba044.wflcwh (mgr.34466) 815 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:22:50.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:50 gibba023 bash[31815]: cephadm 2021-03-10T20:22:48.859020+0000 mgr.gibba044.wflcwh (mgr.34466) 816 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:22:50.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:50 gibba023 bash[31815]: cephadm 2021-03-10T20:22:48.859090+0000 mgr.gibba044.wflcwh (mgr.34466) 817 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:22:50.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:50 gibba023 bash[31815]: cephadm 2021-03-10T20:22:48.859263+0000 mgr.gibba044.wflcwh (mgr.34466) 818 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:22:50.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:50 gibba044 bash[25485]: cephadm 2021-03-10T20:22:48.847045+0000 mgr.gibba044.wflcwh (mgr.34466) 805 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:22:50.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:50 gibba044 bash[25485]: cephadm 2021-03-10T20:22:48.849017+0000 mgr.gibba044.wflcwh (mgr.34466) 806 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:22:50.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:50 gibba044 bash[25485]: cephadm 2021-03-10T20:22:48.850478+0000 mgr.gibba044.wflcwh (mgr.34466) 807 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:22:50.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:50 gibba044 bash[25485]: cephadm 2021-03-10T20:22:48.850574+0000 mgr.gibba044.wflcwh (mgr.34466) 808 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:22:50.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:50 gibba044 bash[25485]: cephadm 2021-03-10T20:22:48.852104+0000 mgr.gibba044.wflcwh (mgr.34466) 809 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:22:50.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:50 gibba044 bash[25485]: cephadm 2021-03-10T20:22:48.852166+0000 mgr.gibba044.wflcwh (mgr.34466) 810 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:22:50.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:50 gibba044 bash[25485]: cephadm 2021-03-10T20:22:48.853742+0000 mgr.gibba044.wflcwh (mgr.34466) 811 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:22:50.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:50 gibba044 bash[25485]: cephadm 2021-03-10T20:22:48.854974+0000 mgr.gibba044.wflcwh (mgr.34466) 812 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:22:50.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:50 gibba044 bash[25485]: cephadm 2021-03-10T20:22:48.855030+0000 mgr.gibba044.wflcwh (mgr.34466) 813 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:22:50.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:50 gibba044 bash[25485]: cephadm 2021-03-10T20:22:48.857098+0000 mgr.gibba044.wflcwh (mgr.34466) 814 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:22:50.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:50 gibba044 bash[25485]: cephadm 2021-03-10T20:22:48.857630+0000 mgr.gibba044.wflcwh (mgr.34466) 815 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:22:50.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:50 gibba044 bash[25485]: cephadm 2021-03-10T20:22:48.859020+0000 mgr.gibba044.wflcwh (mgr.34466) 816 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:22:50.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:50 gibba044 bash[25485]: cephadm 2021-03-10T20:22:48.859090+0000 mgr.gibba044.wflcwh (mgr.34466) 817 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:22:50.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:50 gibba044 bash[25485]: cephadm 2021-03-10T20:22:48.859263+0000 mgr.gibba044.wflcwh (mgr.34466) 818 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:22:51.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:51 gibba023 bash[30844]: cluster 2021-03-10T20:22:49.812608+0000 mgr.gibba044.wflcwh (mgr.34466) 819 : cluster [DBG] pgmap v446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:51.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:51 gibba023 bash[31815]: cluster 2021-03-10T20:22:49.812608+0000 mgr.gibba044.wflcwh (mgr.34466) 819 : cluster [DBG] pgmap v446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:51.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:51 gibba044 bash[25485]: cluster 2021-03-10T20:22:49.812608+0000 mgr.gibba044.wflcwh (mgr.34466) 819 : cluster [DBG] pgmap v446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:53.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:53 gibba023 bash[30844]: cluster 2021-03-10T20:22:51.814146+0000 mgr.gibba044.wflcwh (mgr.34466) 820 : cluster [DBG] pgmap v447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:53.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:53 gibba023 bash[31815]: cluster 2021-03-10T20:22:51.814146+0000 mgr.gibba044.wflcwh (mgr.34466) 820 : cluster [DBG] pgmap v447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:53.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:53 gibba044 bash[25485]: cluster 2021-03-10T20:22:51.814146+0000 mgr.gibba044.wflcwh (mgr.34466) 820 : cluster [DBG] pgmap v447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:55.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:55 gibba023 bash[30844]: cluster 2021-03-10T20:22:53.815898+0000 mgr.gibba044.wflcwh (mgr.34466) 821 : cluster [DBG] pgmap v448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:55.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:55 gibba023 bash[31815]: cluster 2021-03-10T20:22:53.815898+0000 mgr.gibba044.wflcwh (mgr.34466) 821 : cluster [DBG] pgmap v448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:55.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:55 gibba044 bash[25485]: cluster 2021-03-10T20:22:53.815898+0000 mgr.gibba044.wflcwh (mgr.34466) 821 : cluster [DBG] pgmap v448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:57.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:57 gibba023 bash[30844]: cluster 2021-03-10T20:22:55.817557+0000 mgr.gibba044.wflcwh (mgr.34466) 822 : cluster [DBG] pgmap v449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:57.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:57 gibba023 bash[31815]: cluster 2021-03-10T20:22:55.817557+0000 mgr.gibba044.wflcwh (mgr.34466) 822 : cluster [DBG] pgmap v449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:57.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:57 gibba044 bash[25485]: cluster 2021-03-10T20:22:55.817557+0000 mgr.gibba044.wflcwh (mgr.34466) 822 : cluster [DBG] pgmap v449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:22:59.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:22:59 gibba044 bash[25485]: cluster 2021-03-10T20:22:57.819202+0000 mgr.gibba044.wflcwh (mgr.34466) 823 : cluster [DBG] pgmap v450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:00.173 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:22:59 gibba023 bash[30844]: cluster 2021-03-10T20:22:57.819202+0000 mgr.gibba044.wflcwh (mgr.34466) 823 : cluster [DBG] pgmap v450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:00.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:22:59 gibba023 bash[31815]: cluster 2021-03-10T20:22:57.819202+0000 mgr.gibba044.wflcwh (mgr.34466) 823 : cluster [DBG] pgmap v450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:01.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:01 gibba044 bash[25485]: cluster 2021-03-10T20:22:59.820440+0000 mgr.gibba044.wflcwh (mgr.34466) 824 : cluster [DBG] pgmap v451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:02.173 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:01 gibba023 bash[30844]: cluster 2021-03-10T20:22:59.820440+0000 mgr.gibba044.wflcwh (mgr.34466) 824 : cluster [DBG] pgmap v451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:02.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:01 gibba023 bash[31815]: cluster 2021-03-10T20:22:59.820440+0000 mgr.gibba044.wflcwh (mgr.34466) 824 : cluster [DBG] pgmap v451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:02.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:02 gibba044 bash[25485]: cluster 2021-03-10T20:23:01.822129+0000 mgr.gibba044.wflcwh (mgr.34466) 825 : cluster [DBG] pgmap v452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:03.173 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:02 gibba023 bash[30844]: cluster 2021-03-10T20:23:01.822129+0000 mgr.gibba044.wflcwh (mgr.34466) 825 : cluster [DBG] pgmap v452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:03.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:02 gibba023 bash[31815]: cluster 2021-03-10T20:23:01.822129+0000 mgr.gibba044.wflcwh (mgr.34466) 825 : cluster [DBG] pgmap v452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:05.173 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:04 gibba023 bash[30844]: cluster 2021-03-10T20:23:03.823679+0000 mgr.gibba044.wflcwh (mgr.34466) 826 : cluster [DBG] pgmap v453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:05.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:04 gibba023 bash[30844]: cephadm 2021-03-10T20:23:03.863130+0000 mgr.gibba044.wflcwh (mgr.34466) 827 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:23:05.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:04 gibba023 bash[31815]: cluster 2021-03-10T20:23:03.823679+0000 mgr.gibba044.wflcwh (mgr.34466) 826 : cluster [DBG] pgmap v453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:05.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:04 gibba023 bash[31815]: cephadm 2021-03-10T20:23:03.863130+0000 mgr.gibba044.wflcwh (mgr.34466) 827 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:23:05.245 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:04 gibba044 bash[25485]: cluster 2021-03-10T20:23:03.823679+0000 mgr.gibba044.wflcwh (mgr.34466) 826 : cluster [DBG] pgmap v453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:05.246 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:04 gibba044 bash[25485]: cephadm 2021-03-10T20:23:03.863130+0000 mgr.gibba044.wflcwh (mgr.34466) 827 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:23:05.387 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:23:05.614 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:23:05.615 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (14m) 16s ago 19m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:23:05.615 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (19m) 9m ago 19m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:23:05.615 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (14m) 9m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:23:05.615 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (14m) 9m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:23:05.616 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (13m) 16s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:23:05.616 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (13m) 16s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:23:05.616 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (13m) 9m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:23:05.616 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (13m) 16s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:23:05.617 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (19m) 16s ago 19m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:23:05.617 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (19m) 9m ago 19m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:23:05.617 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (12m) 16s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:23:05.617 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (12m) 16s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:23:05.617 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (11m) 16s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:23:05.618 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (11m) 16s ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:23:05.618 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (10m) 9m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:23:05.618 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (10m) 9m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:23:05.618 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (9m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:23:05.618 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (9m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:23:05.619 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (19m) 9m ago 19m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:23:05.619 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 16s ago 17m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:23:05.619 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 9m ago 17m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:23:05.864 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:23:05.865 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:23:05.865 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:23:05.865 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:23:05.865 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:23:05.866 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:23:05.866 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:23:05.866 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:23:05.866 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:23:05.867 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:23:05.867 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:23:05.867 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:23:05.867 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:23:05.867 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:23:05.868 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:23:06.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:05 gibba023 bash[30844]: audit 2021-03-10T20:23:05.383739+0000 mgr.gibba044.wflcwh (mgr.34466) 828 : audit [DBG] from='client.44616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:23:06.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:05 gibba023 bash[30844]: audit 2021-03-10T20:23:05.609309+0000 mgr.gibba044.wflcwh (mgr.34466) 829 : audit [DBG] from='client.54601 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:23:06.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:05 gibba023 bash[30844]: audit 2021-03-10T20:23:05.865475+0000 mon.c (mon.1) 26 : audit [DBG] from='client.? 172.21.2.123:0/995440123' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:06.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:05 gibba023 bash[31815]: audit 2021-03-10T20:23:05.383739+0000 mgr.gibba044.wflcwh (mgr.34466) 828 : audit [DBG] from='client.44616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:23:06.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:05 gibba023 bash[31815]: audit 2021-03-10T20:23:05.609309+0000 mgr.gibba044.wflcwh (mgr.34466) 829 : audit [DBG] from='client.54601 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:23:06.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:05 gibba023 bash[31815]: audit 2021-03-10T20:23:05.865475+0000 mon.c (mon.1) 26 : audit [DBG] from='client.? 172.21.2.123:0/995440123' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:06.245 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:05 gibba044 bash[25485]: audit 2021-03-10T20:23:05.383739+0000 mgr.gibba044.wflcwh (mgr.34466) 828 : audit [DBG] from='client.44616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:23:06.246 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:05 gibba044 bash[25485]: audit 2021-03-10T20:23:05.609309+0000 mgr.gibba044.wflcwh (mgr.34466) 829 : audit [DBG] from='client.54601 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:23:06.246 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:05 gibba044 bash[25485]: audit 2021-03-10T20:23:05.865475+0000 mon.c (mon.1) 26 : audit [DBG] from='client.? 172.21.2.123:0/995440123' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:07.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:07 gibba023 bash[30844]: cluster 2021-03-10T20:23:05.825397+0000 mgr.gibba044.wflcwh (mgr.34466) 830 : cluster [DBG] pgmap v454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:07.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:07 gibba023 bash[31815]: cluster 2021-03-10T20:23:05.825397+0000 mgr.gibba044.wflcwh (mgr.34466) 830 : cluster [DBG] pgmap v454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:07.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:07 gibba044 bash[25485]: cluster 2021-03-10T20:23:05.825397+0000 mgr.gibba044.wflcwh (mgr.34466) 830 : cluster [DBG] pgmap v454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:09.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:09 gibba023 bash[30844]: cluster 2021-03-10T20:23:07.826805+0000 mgr.gibba044.wflcwh (mgr.34466) 831 : cluster [DBG] pgmap v455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:09.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:09 gibba023 bash[31815]: cluster 2021-03-10T20:23:07.826805+0000 mgr.gibba044.wflcwh (mgr.34466) 831 : cluster [DBG] pgmap v455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:09.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:09 gibba044 bash[25485]: cluster 2021-03-10T20:23:07.826805+0000 mgr.gibba044.wflcwh (mgr.34466) 831 : cluster [DBG] pgmap v455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:11.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:11 gibba023 bash[30844]: cluster 2021-03-10T20:23:09.827983+0000 mgr.gibba044.wflcwh (mgr.34466) 832 : cluster [DBG] pgmap v456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:11.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:11 gibba023 bash[31815]: cluster 2021-03-10T20:23:09.827983+0000 mgr.gibba044.wflcwh (mgr.34466) 832 : cluster [DBG] pgmap v456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:11.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:11 gibba044 bash[25485]: cluster 2021-03-10T20:23:09.827983+0000 mgr.gibba044.wflcwh (mgr.34466) 832 : cluster [DBG] pgmap v456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:13.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:13 gibba023 bash[30844]: cluster 2021-03-10T20:23:11.829575+0000 mgr.gibba044.wflcwh (mgr.34466) 833 : cluster [DBG] pgmap v457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:13.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:13 gibba023 bash[31815]: cluster 2021-03-10T20:23:11.829575+0000 mgr.gibba044.wflcwh (mgr.34466) 833 : cluster [DBG] pgmap v457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:13.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:13 gibba044 bash[25485]: cluster 2021-03-10T20:23:11.829575+0000 mgr.gibba044.wflcwh (mgr.34466) 833 : cluster [DBG] pgmap v457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:15.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:15 gibba023 bash[30844]: cluster 2021-03-10T20:23:13.831246+0000 mgr.gibba044.wflcwh (mgr.34466) 834 : cluster [DBG] pgmap v458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:15.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:15 gibba023 bash[31815]: cluster 2021-03-10T20:23:13.831246+0000 mgr.gibba044.wflcwh (mgr.34466) 834 : cluster [DBG] pgmap v458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:15.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:15 gibba044 bash[25485]: cluster 2021-03-10T20:23:13.831246+0000 mgr.gibba044.wflcwh (mgr.34466) 834 : cluster [DBG] pgmap v458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:17.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:17 gibba023 bash[30844]: cluster 2021-03-10T20:23:15.832991+0000 mgr.gibba044.wflcwh (mgr.34466) 835 : cluster [DBG] pgmap v459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:17.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:17 gibba023 bash[31815]: cluster 2021-03-10T20:23:15.832991+0000 mgr.gibba044.wflcwh (mgr.34466) 835 : cluster [DBG] pgmap v459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:17.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:17 gibba044 bash[25485]: cluster 2021-03-10T20:23:15.832991+0000 mgr.gibba044.wflcwh (mgr.34466) 835 : cluster [DBG] pgmap v459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:19.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:19 gibba023 bash[30844]: cluster 2021-03-10T20:23:17.834413+0000 mgr.gibba044.wflcwh (mgr.34466) 836 : cluster [DBG] pgmap v460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:19.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:19 gibba023 bash[31815]: cluster 2021-03-10T20:23:17.834413+0000 mgr.gibba044.wflcwh (mgr.34466) 836 : cluster [DBG] pgmap v460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:19.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:19 gibba044 bash[25485]: cluster 2021-03-10T20:23:17.834413+0000 mgr.gibba044.wflcwh (mgr.34466) 836 : cluster [DBG] pgmap v460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:20.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:20 gibba023 bash[30844]: cephadm 2021-03-10T20:23:18.865453+0000 mgr.gibba044.wflcwh (mgr.34466) 837 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:23:20.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:20 gibba023 bash[31815]: cephadm 2021-03-10T20:23:18.865453+0000 mgr.gibba044.wflcwh (mgr.34466) 837 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:23:20.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:20 gibba044 bash[25485]: cephadm 2021-03-10T20:23:18.865453+0000 mgr.gibba044.wflcwh (mgr.34466) 837 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:23:21.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:21 gibba023 bash[30844]: cluster 2021-03-10T20:23:19.835678+0000 mgr.gibba044.wflcwh (mgr.34466) 838 : cluster [DBG] pgmap v461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:21.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:21 gibba023 bash[31815]: cluster 2021-03-10T20:23:19.835678+0000 mgr.gibba044.wflcwh (mgr.34466) 838 : cluster [DBG] pgmap v461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:21.745 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:21 gibba044 bash[25485]: cluster 2021-03-10T20:23:19.835678+0000 mgr.gibba044.wflcwh (mgr.34466) 838 : cluster [DBG] pgmap v461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:23.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:23 gibba023 bash[30844]: cluster 2021-03-10T20:23:21.837300+0000 mgr.gibba044.wflcwh (mgr.34466) 839 : cluster [DBG] pgmap v462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:23.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:23 gibba023 bash[31815]: cluster 2021-03-10T20:23:21.837300+0000 mgr.gibba044.wflcwh (mgr.34466) 839 : cluster [DBG] pgmap v462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:23.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:23 gibba044 bash[25485]: cluster 2021-03-10T20:23:21.837300+0000 mgr.gibba044.wflcwh (mgr.34466) 839 : cluster [DBG] pgmap v462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:25.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:25 gibba023 bash[30844]: cluster 2021-03-10T20:23:23.839131+0000 mgr.gibba044.wflcwh (mgr.34466) 840 : cluster [DBG] pgmap v463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:25.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:25 gibba023 bash[31815]: cluster 2021-03-10T20:23:23.839131+0000 mgr.gibba044.wflcwh (mgr.34466) 840 : cluster [DBG] pgmap v463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:25.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:25 gibba044 bash[25485]: cluster 2021-03-10T20:23:23.839131+0000 mgr.gibba044.wflcwh (mgr.34466) 840 : cluster [DBG] pgmap v463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:27.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:27 gibba023 bash[30844]: cluster 2021-03-10T20:23:25.840875+0000 mgr.gibba044.wflcwh (mgr.34466) 841 : cluster [DBG] pgmap v464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:27.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:27 gibba023 bash[30844]: audit 2021-03-10T20:23:27.055080+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:23:27.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:27 gibba023 bash[30844]: audit 2021-03-10T20:23:27.055882+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:23:27.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:27 gibba023 bash[30844]: audit 2021-03-10T20:23:27.056588+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:23:27.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:27 gibba023 bash[30844]: audit 2021-03-10T20:23:27.057322+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:23:27.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:27 gibba023 bash[30844]: audit 2021-03-10T20:23:27.121237+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:23:27.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:27 gibba023 bash[30844]: audit 2021-03-10T20:23:27.125780+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:23:27.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:27 gibba023 bash[31815]: cluster 2021-03-10T20:23:25.840875+0000 mgr.gibba044.wflcwh (mgr.34466) 841 : cluster [DBG] pgmap v464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:27.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:27 gibba023 bash[31815]: audit 2021-03-10T20:23:27.055080+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:23:27.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:27 gibba023 bash[31815]: audit 2021-03-10T20:23:27.055882+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:23:27.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:27 gibba023 bash[31815]: audit 2021-03-10T20:23:27.056588+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:23:27.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:27 gibba023 bash[31815]: audit 2021-03-10T20:23:27.057322+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:23:27.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:27 gibba023 bash[31815]: audit 2021-03-10T20:23:27.121237+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:23:27.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:27 gibba023 bash[31815]: audit 2021-03-10T20:23:27.125780+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:23:27.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:27 gibba044 bash[25485]: cluster 2021-03-10T20:23:25.840875+0000 mgr.gibba044.wflcwh (mgr.34466) 841 : cluster [DBG] pgmap v464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:27.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:27 gibba044 bash[25485]: audit 2021-03-10T20:23:27.055080+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:23:27.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:27 gibba044 bash[25485]: audit 2021-03-10T20:23:27.055882+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:23:27.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:27 gibba044 bash[25485]: audit 2021-03-10T20:23:27.056588+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:23:27.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:27 gibba044 bash[25485]: audit 2021-03-10T20:23:27.057322+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:23:27.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:27 gibba044 bash[25485]: audit 2021-03-10T20:23:27.121237+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:23:27.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:27 gibba044 bash[25485]: audit 2021-03-10T20:23:27.125780+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:23:29.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:29 gibba023 bash[30844]: cluster 2021-03-10T20:23:27.842562+0000 mgr.gibba044.wflcwh (mgr.34466) 842 : cluster [DBG] pgmap v465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:29.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:29 gibba023 bash[31815]: cluster 2021-03-10T20:23:27.842562+0000 mgr.gibba044.wflcwh (mgr.34466) 842 : cluster [DBG] pgmap v465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:29.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:29 gibba044 bash[25485]: cluster 2021-03-10T20:23:27.842562+0000 mgr.gibba044.wflcwh (mgr.34466) 842 : cluster [DBG] pgmap v465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:31.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:31 gibba044 bash[25485]: cluster 2021-03-10T20:23:29.843834+0000 mgr.gibba044.wflcwh (mgr.34466) 843 : cluster [DBG] pgmap v466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:31.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:31 gibba023 bash[30844]: cluster 2021-03-10T20:23:29.843834+0000 mgr.gibba044.wflcwh (mgr.34466) 843 : cluster [DBG] pgmap v466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:31.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:31 gibba023 bash[31815]: cluster 2021-03-10T20:23:29.843834+0000 mgr.gibba044.wflcwh (mgr.34466) 843 : cluster [DBG] pgmap v466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:33.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:33 gibba044 bash[25485]: cluster 2021-03-10T20:23:31.845420+0000 mgr.gibba044.wflcwh (mgr.34466) 844 : cluster [DBG] pgmap v467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:33.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:33 gibba023 bash[30844]: cluster 2021-03-10T20:23:31.845420+0000 mgr.gibba044.wflcwh (mgr.34466) 844 : cluster [DBG] pgmap v467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:33.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:33 gibba023 bash[31815]: cluster 2021-03-10T20:23:31.845420+0000 mgr.gibba044.wflcwh (mgr.34466) 844 : cluster [DBG] pgmap v467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:35.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:35 gibba044 bash[25485]: cluster 2021-03-10T20:23:33.847277+0000 mgr.gibba044.wflcwh (mgr.34466) 845 : cluster [DBG] pgmap v468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:35.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:35 gibba044 bash[25485]: cephadm 2021-03-10T20:23:33.881218+0000 mgr.gibba044.wflcwh (mgr.34466) 846 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:23:35.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:35 gibba023 bash[30844]: cluster 2021-03-10T20:23:33.847277+0000 mgr.gibba044.wflcwh (mgr.34466) 845 : cluster [DBG] pgmap v468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:35.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:35 gibba023 bash[30844]: cephadm 2021-03-10T20:23:33.881218+0000 mgr.gibba044.wflcwh (mgr.34466) 846 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:23:35.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:35 gibba023 bash[31815]: cluster 2021-03-10T20:23:33.847277+0000 mgr.gibba044.wflcwh (mgr.34466) 845 : cluster [DBG] pgmap v468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:35.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:35 gibba023 bash[31815]: cephadm 2021-03-10T20:23:33.881218+0000 mgr.gibba044.wflcwh (mgr.34466) 846 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:23:36.111 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:23:36.338 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:23:36.339 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (14m) 47s ago 20m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:23:36.339 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (20m) 9m ago 20m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:23:36.339 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (15m) 9m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:23:36.340 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (15m) 9m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:23:36.340 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (14m) 47s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:23:36.340 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (14m) 47s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:23:36.340 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (13m) 9m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:23:36.341 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (13m) 47s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:23:36.341 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (20m) 47s ago 20m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:23:36.341 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (20m) 9m ago 20m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:23:36.341 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (12m) 47s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:23:36.341 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (12m) 47s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:23:36.342 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (12m) 47s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:23:36.342 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (11m) 47s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:23:36.342 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (11m) 9m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:23:36.342 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (10m) 9m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:23:36.343 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (10m) 9m ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:23:36.343 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (9m) 9m ago 20m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:23:36.345 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (19m) 9m ago 20m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:23:36.345 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 47s ago 18m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:23:36.346 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 9m ago 18m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:23:36.590 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:23:36.591 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:23:36.591 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:23:36.591 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:23:36.591 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:23:36.592 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:23:36.592 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:23:36.592 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:23:36.592 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:23:36.593 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:23:36.593 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:23:36.593 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:23:36.593 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:23:36.593 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:23:36.594 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:23:37.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:37 gibba044 bash[25485]: cluster 2021-03-10T20:23:35.848924+0000 mgr.gibba044.wflcwh (mgr.34466) 847 : cluster [DBG] pgmap v469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:37.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:37 gibba044 bash[25485]: audit 2021-03-10T20:23:36.108056+0000 mgr.gibba044.wflcwh (mgr.34466) 848 : audit [DBG] from='client.54613 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:23:37.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:37 gibba044 bash[25485]: audit 2021-03-10T20:23:36.331675+0000 mgr.gibba044.wflcwh (mgr.34466) 849 : audit [DBG] from='client.44640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:23:37.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:37 gibba044 bash[25485]: audit 2021-03-10T20:23:36.591579+0000 mon.a (mon.0) 773 : audit [DBG] from='client.? 172.21.2.123:0/956295636' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:37.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:37 gibba023 bash[30844]: cluster 2021-03-10T20:23:35.848924+0000 mgr.gibba044.wflcwh (mgr.34466) 847 : cluster [DBG] pgmap v469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:37.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:37 gibba023 bash[30844]: audit 2021-03-10T20:23:36.108056+0000 mgr.gibba044.wflcwh (mgr.34466) 848 : audit [DBG] from='client.54613 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:23:37.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:37 gibba023 bash[30844]: audit 2021-03-10T20:23:36.331675+0000 mgr.gibba044.wflcwh (mgr.34466) 849 : audit [DBG] from='client.44640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:23:37.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:37 gibba023 bash[30844]: audit 2021-03-10T20:23:36.591579+0000 mon.a (mon.0) 773 : audit [DBG] from='client.? 172.21.2.123:0/956295636' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:37.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:37 gibba023 bash[31815]: cluster 2021-03-10T20:23:35.848924+0000 mgr.gibba044.wflcwh (mgr.34466) 847 : cluster [DBG] pgmap v469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:37.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:37 gibba023 bash[31815]: audit 2021-03-10T20:23:36.108056+0000 mgr.gibba044.wflcwh (mgr.34466) 848 : audit [DBG] from='client.54613 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:23:37.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:37 gibba023 bash[31815]: audit 2021-03-10T20:23:36.331675+0000 mgr.gibba044.wflcwh (mgr.34466) 849 : audit [DBG] from='client.44640 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:23:37.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:37 gibba023 bash[31815]: audit 2021-03-10T20:23:36.591579+0000 mon.a (mon.0) 773 : audit [DBG] from='client.? 172.21.2.123:0/956295636' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:39.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:39 gibba044 bash[25485]: cluster 2021-03-10T20:23:37.850424+0000 mgr.gibba044.wflcwh (mgr.34466) 850 : cluster [DBG] pgmap v470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:39.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:39 gibba023 bash[30844]: cluster 2021-03-10T20:23:37.850424+0000 mgr.gibba044.wflcwh (mgr.34466) 850 : cluster [DBG] pgmap v470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:39.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:39 gibba023 bash[31815]: cluster 2021-03-10T20:23:37.850424+0000 mgr.gibba044.wflcwh (mgr.34466) 850 : cluster [DBG] pgmap v470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:41.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:41 gibba044 bash[25485]: cluster 2021-03-10T20:23:39.851824+0000 mgr.gibba044.wflcwh (mgr.34466) 851 : cluster [DBG] pgmap v471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:41.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:41 gibba023 bash[30844]: cluster 2021-03-10T20:23:39.851824+0000 mgr.gibba044.wflcwh (mgr.34466) 851 : cluster [DBG] pgmap v471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:41.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:41 gibba023 bash[31815]: cluster 2021-03-10T20:23:39.851824+0000 mgr.gibba044.wflcwh (mgr.34466) 851 : cluster [DBG] pgmap v471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:43.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:43 gibba044 bash[25485]: cluster 2021-03-10T20:23:41.853381+0000 mgr.gibba044.wflcwh (mgr.34466) 852 : cluster [DBG] pgmap v472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:43.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:43 gibba023 bash[30844]: cluster 2021-03-10T20:23:41.853381+0000 mgr.gibba044.wflcwh (mgr.34466) 852 : cluster [DBG] pgmap v472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:43.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:43 gibba023 bash[31815]: cluster 2021-03-10T20:23:41.853381+0000 mgr.gibba044.wflcwh (mgr.34466) 852 : cluster [DBG] pgmap v472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:45.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:45 gibba044 bash[25485]: cluster 2021-03-10T20:23:43.855244+0000 mgr.gibba044.wflcwh (mgr.34466) 853 : cluster [DBG] pgmap v473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:45.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:45 gibba023 bash[30844]: cluster 2021-03-10T20:23:43.855244+0000 mgr.gibba044.wflcwh (mgr.34466) 853 : cluster [DBG] pgmap v473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:45.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:45 gibba023 bash[31815]: cluster 2021-03-10T20:23:43.855244+0000 mgr.gibba044.wflcwh (mgr.34466) 853 : cluster [DBG] pgmap v473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:47.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:47 gibba044 bash[25485]: cluster 2021-03-10T20:23:45.856959+0000 mgr.gibba044.wflcwh (mgr.34466) 854 : cluster [DBG] pgmap v474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:47.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:47 gibba023 bash[30844]: cluster 2021-03-10T20:23:45.856959+0000 mgr.gibba044.wflcwh (mgr.34466) 854 : cluster [DBG] pgmap v474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:47.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:47 gibba023 bash[31815]: cluster 2021-03-10T20:23:45.856959+0000 mgr.gibba044.wflcwh (mgr.34466) 854 : cluster [DBG] pgmap v474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:49.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:49 gibba023 bash[30844]: cluster 2021-03-10T20:23:47.858504+0000 mgr.gibba044.wflcwh (mgr.34466) 855 : cluster [DBG] pgmap v475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:49.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:49 gibba023 bash[30844]: audit 2021-03-10T20:23:48.882316+0000 mon.a (mon.0) 774 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:23:49.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:49 gibba023 bash[31815]: cluster 2021-03-10T20:23:47.858504+0000 mgr.gibba044.wflcwh (mgr.34466) 855 : cluster [DBG] pgmap v475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:49.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:49 gibba023 bash[31815]: audit 2021-03-10T20:23:48.882316+0000 mon.a (mon.0) 774 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:23:49.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:49 gibba044 bash[25485]: cluster 2021-03-10T20:23:47.858504+0000 mgr.gibba044.wflcwh (mgr.34466) 855 : cluster [DBG] pgmap v475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:49.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:49 gibba044 bash[25485]: audit 2021-03-10T20:23:48.882316+0000 mon.a (mon.0) 774 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:23:50.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:50 gibba023 bash[30844]: cephadm 2021-03-10T20:23:48.885678+0000 mgr.gibba044.wflcwh (mgr.34466) 856 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:23:50.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:50 gibba023 bash[31815]: cephadm 2021-03-10T20:23:48.885678+0000 mgr.gibba044.wflcwh (mgr.34466) 856 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:23:50.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:50 gibba044 bash[25485]: cephadm 2021-03-10T20:23:48.885678+0000 mgr.gibba044.wflcwh (mgr.34466) 856 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:23:51.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:51 gibba023 bash[30844]: cluster 2021-03-10T20:23:49.859796+0000 mgr.gibba044.wflcwh (mgr.34466) 857 : cluster [DBG] pgmap v476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:51.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:51 gibba023 bash[31815]: cluster 2021-03-10T20:23:49.859796+0000 mgr.gibba044.wflcwh (mgr.34466) 857 : cluster [DBG] pgmap v476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:51.995 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:51 gibba044 bash[25485]: cluster 2021-03-10T20:23:49.859796+0000 mgr.gibba044.wflcwh (mgr.34466) 857 : cluster [DBG] pgmap v476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:53.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:53 gibba023 bash[30844]: cluster 2021-03-10T20:23:51.860332+0000 mgr.gibba044.wflcwh (mgr.34466) 858 : cluster [DBG] pgmap v477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:53.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:53 gibba023 bash[30844]: audit 2021-03-10T20:23:52.611709+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:23:53.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:53 gibba023 bash[30844]: cephadm 2021-03-10T20:23:52.617567+0000 mgr.gibba044.wflcwh (mgr.34466) 859 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:23:53.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:53 gibba023 bash[30844]: audit 2021-03-10T20:23:52.831397+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:23:53.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:53 gibba023 bash[30844]: audit 2021-03-10T20:23:52.835018+0000 mon.a (mon.0) 777 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:23:53.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:53 gibba023 bash[30844]: audit 2021-03-10T20:23:52.837089+0000 mon.a (mon.0) 778 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:53.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:53 gibba023 bash[30844]: audit 2021-03-10T20:23:52.838924+0000 mon.a (mon.0) 779 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:53.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:53 gibba023 bash[30844]: audit 2021-03-10T20:23:52.840859+0000 mon.a (mon.0) 780 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:53.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:53 gibba023 bash[30844]: audit 2021-03-10T20:23:52.844189+0000 mon.a (mon.0) 781 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:53.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:53 gibba023 bash[30844]: audit 2021-03-10T20:23:52.845929+0000 mon.a (mon.0) 782 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:53.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:53 gibba023 bash[31815]: cluster 2021-03-10T20:23:51.860332+0000 mgr.gibba044.wflcwh (mgr.34466) 858 : cluster [DBG] pgmap v477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:53.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:53 gibba023 bash[31815]: audit 2021-03-10T20:23:52.611709+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:23:53.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:53 gibba023 bash[31815]: cephadm 2021-03-10T20:23:52.617567+0000 mgr.gibba044.wflcwh (mgr.34466) 859 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:23:53.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:53 gibba023 bash[31815]: audit 2021-03-10T20:23:52.831397+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:23:53.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:53 gibba023 bash[31815]: audit 2021-03-10T20:23:52.835018+0000 mon.a (mon.0) 777 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:23:53.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:53 gibba023 bash[31815]: audit 2021-03-10T20:23:52.837089+0000 mon.a (mon.0) 778 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:53.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:53 gibba023 bash[31815]: audit 2021-03-10T20:23:52.838924+0000 mon.a (mon.0) 779 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:53.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:53 gibba023 bash[31815]: audit 2021-03-10T20:23:52.840859+0000 mon.a (mon.0) 780 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:53.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:53 gibba023 bash[31815]: audit 2021-03-10T20:23:52.844189+0000 mon.a (mon.0) 781 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:53.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:53 gibba023 bash[31815]: audit 2021-03-10T20:23:52.845929+0000 mon.a (mon.0) 782 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:53.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:53 gibba044 bash[25485]: cluster 2021-03-10T20:23:51.860332+0000 mgr.gibba044.wflcwh (mgr.34466) 858 : cluster [DBG] pgmap v477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:53.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:53 gibba044 bash[25485]: audit 2021-03-10T20:23:52.611709+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:23:53.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:53 gibba044 bash[25485]: cephadm 2021-03-10T20:23:52.617567+0000 mgr.gibba044.wflcwh (mgr.34466) 859 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:23:53.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:53 gibba044 bash[25485]: audit 2021-03-10T20:23:52.831397+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:23:53.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:53 gibba044 bash[25485]: audit 2021-03-10T20:23:52.835018+0000 mon.a (mon.0) 777 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:23:53.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:53 gibba044 bash[25485]: audit 2021-03-10T20:23:52.837089+0000 mon.a (mon.0) 778 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:53.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:53 gibba044 bash[25485]: audit 2021-03-10T20:23:52.838924+0000 mon.a (mon.0) 779 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:53.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:53 gibba044 bash[25485]: audit 2021-03-10T20:23:52.840859+0000 mon.a (mon.0) 780 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:53.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:53 gibba044 bash[25485]: audit 2021-03-10T20:23:52.844189+0000 mon.a (mon.0) 781 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:54.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:53 gibba044 bash[25485]: audit 2021-03-10T20:23:52.845929+0000 mon.a (mon.0) 782 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:23:54.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:54 gibba023 bash[30844]: cephadm 2021-03-10T20:23:52.838735+0000 mgr.gibba044.wflcwh (mgr.34466) 860 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:23:54.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:54 gibba023 bash[30844]: cephadm 2021-03-10T20:23:52.841090+0000 mgr.gibba044.wflcwh (mgr.34466) 861 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:23:54.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:54 gibba023 bash[30844]: cephadm 2021-03-10T20:23:52.842895+0000 mgr.gibba044.wflcwh (mgr.34466) 862 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:23:54.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:54 gibba023 bash[30844]: cephadm 2021-03-10T20:23:52.842930+0000 mgr.gibba044.wflcwh (mgr.34466) 863 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:23:54.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:54 gibba023 bash[30844]: cephadm 2021-03-10T20:23:52.844878+0000 mgr.gibba044.wflcwh (mgr.34466) 864 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:23:54.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:54 gibba023 bash[30844]: cephadm 2021-03-10T20:23:52.844914+0000 mgr.gibba044.wflcwh (mgr.34466) 865 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:23:54.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:54 gibba023 bash[30844]: cephadm 2021-03-10T20:23:52.846913+0000 mgr.gibba044.wflcwh (mgr.34466) 866 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:23:54.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:54 gibba023 bash[30844]: cephadm 2021-03-10T20:23:52.848150+0000 mgr.gibba044.wflcwh (mgr.34466) 867 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:23:54.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:54 gibba023 bash[30844]: cephadm 2021-03-10T20:23:52.848245+0000 mgr.gibba044.wflcwh (mgr.34466) 868 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:23:54.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:54 gibba023 bash[30844]: cephadm 2021-03-10T20:23:52.849850+0000 mgr.gibba044.wflcwh (mgr.34466) 869 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:23:54.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:54 gibba023 bash[30844]: cephadm 2021-03-10T20:23:52.850158+0000 mgr.gibba044.wflcwh (mgr.34466) 870 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:23:54.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:54 gibba023 bash[30844]: cephadm 2021-03-10T20:23:52.851765+0000 mgr.gibba044.wflcwh (mgr.34466) 871 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:23:54.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:54 gibba023 bash[30844]: cephadm 2021-03-10T20:23:52.851800+0000 mgr.gibba044.wflcwh (mgr.34466) 872 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:23:54.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:54 gibba023 bash[30844]: cephadm 2021-03-10T20:23:52.851926+0000 mgr.gibba044.wflcwh (mgr.34466) 873 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:23:54.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:54 gibba023 bash[31815]: cephadm 2021-03-10T20:23:52.838735+0000 mgr.gibba044.wflcwh (mgr.34466) 860 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:23:54.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:54 gibba023 bash[31815]: cephadm 2021-03-10T20:23:52.841090+0000 mgr.gibba044.wflcwh (mgr.34466) 861 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:23:54.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:54 gibba023 bash[31815]: cephadm 2021-03-10T20:23:52.842895+0000 mgr.gibba044.wflcwh (mgr.34466) 862 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:23:54.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:54 gibba023 bash[31815]: cephadm 2021-03-10T20:23:52.842930+0000 mgr.gibba044.wflcwh (mgr.34466) 863 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:23:54.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:54 gibba023 bash[31815]: cephadm 2021-03-10T20:23:52.844878+0000 mgr.gibba044.wflcwh (mgr.34466) 864 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:23:54.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:54 gibba023 bash[31815]: cephadm 2021-03-10T20:23:52.844914+0000 mgr.gibba044.wflcwh (mgr.34466) 865 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:23:54.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:54 gibba023 bash[31815]: cephadm 2021-03-10T20:23:52.846913+0000 mgr.gibba044.wflcwh (mgr.34466) 866 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:23:54.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:54 gibba023 bash[31815]: cephadm 2021-03-10T20:23:52.848150+0000 mgr.gibba044.wflcwh (mgr.34466) 867 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:23:54.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:54 gibba023 bash[31815]: cephadm 2021-03-10T20:23:52.848245+0000 mgr.gibba044.wflcwh (mgr.34466) 868 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:23:54.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:54 gibba023 bash[31815]: cephadm 2021-03-10T20:23:52.849850+0000 mgr.gibba044.wflcwh (mgr.34466) 869 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:23:54.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:54 gibba023 bash[31815]: cephadm 2021-03-10T20:23:52.850158+0000 mgr.gibba044.wflcwh (mgr.34466) 870 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:23:54.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:54 gibba023 bash[31815]: cephadm 2021-03-10T20:23:52.851765+0000 mgr.gibba044.wflcwh (mgr.34466) 871 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:23:54.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:54 gibba023 bash[31815]: cephadm 2021-03-10T20:23:52.851800+0000 mgr.gibba044.wflcwh (mgr.34466) 872 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:23:54.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:54 gibba023 bash[31815]: cephadm 2021-03-10T20:23:52.851926+0000 mgr.gibba044.wflcwh (mgr.34466) 873 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:23:54.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:54 gibba044 bash[25485]: cephadm 2021-03-10T20:23:52.838735+0000 mgr.gibba044.wflcwh (mgr.34466) 860 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:23:54.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:54 gibba044 bash[25485]: cephadm 2021-03-10T20:23:52.841090+0000 mgr.gibba044.wflcwh (mgr.34466) 861 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:23:54.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:54 gibba044 bash[25485]: cephadm 2021-03-10T20:23:52.842895+0000 mgr.gibba044.wflcwh (mgr.34466) 862 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:23:54.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:54 gibba044 bash[25485]: cephadm 2021-03-10T20:23:52.842930+0000 mgr.gibba044.wflcwh (mgr.34466) 863 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:23:54.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:54 gibba044 bash[25485]: cephadm 2021-03-10T20:23:52.844878+0000 mgr.gibba044.wflcwh (mgr.34466) 864 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:23:54.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:54 gibba044 bash[25485]: cephadm 2021-03-10T20:23:52.844914+0000 mgr.gibba044.wflcwh (mgr.34466) 865 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:23:54.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:54 gibba044 bash[25485]: cephadm 2021-03-10T20:23:52.846913+0000 mgr.gibba044.wflcwh (mgr.34466) 866 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:23:54.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:54 gibba044 bash[25485]: cephadm 2021-03-10T20:23:52.848150+0000 mgr.gibba044.wflcwh (mgr.34466) 867 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:23:54.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:54 gibba044 bash[25485]: cephadm 2021-03-10T20:23:52.848245+0000 mgr.gibba044.wflcwh (mgr.34466) 868 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:23:54.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:54 gibba044 bash[25485]: cephadm 2021-03-10T20:23:52.849850+0000 mgr.gibba044.wflcwh (mgr.34466) 869 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:23:54.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:54 gibba044 bash[25485]: cephadm 2021-03-10T20:23:52.850158+0000 mgr.gibba044.wflcwh (mgr.34466) 870 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:23:54.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:54 gibba044 bash[25485]: cephadm 2021-03-10T20:23:52.851765+0000 mgr.gibba044.wflcwh (mgr.34466) 871 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:23:54.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:54 gibba044 bash[25485]: cephadm 2021-03-10T20:23:52.851800+0000 mgr.gibba044.wflcwh (mgr.34466) 872 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:23:54.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:54 gibba044 bash[25485]: cephadm 2021-03-10T20:23:52.851926+0000 mgr.gibba044.wflcwh (mgr.34466) 873 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:23:55.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:55 gibba023 bash[30844]: cluster 2021-03-10T20:23:53.862052+0000 mgr.gibba044.wflcwh (mgr.34466) 874 : cluster [DBG] pgmap v478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:55.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:55 gibba023 bash[31815]: cluster 2021-03-10T20:23:53.862052+0000 mgr.gibba044.wflcwh (mgr.34466) 874 : cluster [DBG] pgmap v478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:55.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:55 gibba044 bash[25485]: cluster 2021-03-10T20:23:53.862052+0000 mgr.gibba044.wflcwh (mgr.34466) 874 : cluster [DBG] pgmap v478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:57.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:57 gibba023 bash[30844]: cluster 2021-03-10T20:23:55.863607+0000 mgr.gibba044.wflcwh (mgr.34466) 875 : cluster [DBG] pgmap v479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:57.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:57 gibba023 bash[31815]: cluster 2021-03-10T20:23:55.863607+0000 mgr.gibba044.wflcwh (mgr.34466) 875 : cluster [DBG] pgmap v479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:57.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:57 gibba044 bash[25485]: cluster 2021-03-10T20:23:55.863607+0000 mgr.gibba044.wflcwh (mgr.34466) 875 : cluster [DBG] pgmap v479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:59.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:23:59 gibba023 bash[30844]: cluster 2021-03-10T20:23:57.865109+0000 mgr.gibba044.wflcwh (mgr.34466) 876 : cluster [DBG] pgmap v480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:59.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:23:59 gibba023 bash[31815]: cluster 2021-03-10T20:23:57.865109+0000 mgr.gibba044.wflcwh (mgr.34466) 876 : cluster [DBG] pgmap v480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:23:59.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:23:59 gibba044 bash[25485]: cluster 2021-03-10T20:23:57.865109+0000 mgr.gibba044.wflcwh (mgr.34466) 876 : cluster [DBG] pgmap v480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:01.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:01 gibba023 bash[30844]: cluster 2021-03-10T20:23:59.866320+0000 mgr.gibba044.wflcwh (mgr.34466) 877 : cluster [DBG] pgmap v481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:01.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:01 gibba023 bash[31815]: cluster 2021-03-10T20:23:59.866320+0000 mgr.gibba044.wflcwh (mgr.34466) 877 : cluster [DBG] pgmap v481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:01.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:01 gibba044 bash[25485]: cluster 2021-03-10T20:23:59.866320+0000 mgr.gibba044.wflcwh (mgr.34466) 877 : cluster [DBG] pgmap v481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:03.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:03 gibba023 bash[30844]: cluster 2021-03-10T20:24:01.867984+0000 mgr.gibba044.wflcwh (mgr.34466) 878 : cluster [DBG] pgmap v482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:03.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:03 gibba023 bash[31815]: cluster 2021-03-10T20:24:01.867984+0000 mgr.gibba044.wflcwh (mgr.34466) 878 : cluster [DBG] pgmap v482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:03.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:03 gibba044 bash[25485]: cluster 2021-03-10T20:24:01.867984+0000 mgr.gibba044.wflcwh (mgr.34466) 878 : cluster [DBG] pgmap v482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:05.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:05 gibba023 bash[30844]: cluster 2021-03-10T20:24:03.869806+0000 mgr.gibba044.wflcwh (mgr.34466) 879 : cluster [DBG] pgmap v483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:05.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:05 gibba023 bash[31815]: cluster 2021-03-10T20:24:03.869806+0000 mgr.gibba044.wflcwh (mgr.34466) 879 : cluster [DBG] pgmap v483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:05.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:05 gibba044 bash[25485]: cluster 2021-03-10T20:24:03.869806+0000 mgr.gibba044.wflcwh (mgr.34466) 879 : cluster [DBG] pgmap v483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:06.835 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:24:07.063 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:24:07.063 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (15m) 78s ago 20m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:24:07.063 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (20m) 14s ago 20m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:24:07.064 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (15m) 14s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:24:07.064 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (15m) 14s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:24:07.064 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (14m) 78s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:24:07.064 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (14m) 78s ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:24:07.065 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (14m) 14s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:24:07.065 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (14m) 78s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:24:07.065 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (20m) 78s ago 20m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:24:07.065 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (20m) 14s ago 20m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:24:07.065 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (13m) 78s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:24:07.066 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (13m) 78s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:24:07.066 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (12m) 78s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:24:07.066 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (12m) 78s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:24:07.066 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (11m) 14s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:24:07.066 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (11m) 14s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:24:07.067 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (10m) 14s ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:24:07.067 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (10m) 14s ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:24:07.067 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (20m) 14s ago 20m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:24:07.067 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 78s ago 18m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:24:07.068 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 14s ago 18m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:24:07.311 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:24:07.312 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:24:07.312 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:24:07.313 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:24:07.313 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:24:07.313 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:24:07.314 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:24:07.315 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:24:07.315 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:24:07.315 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:24:07.316 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:24:07.316 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:24:07.317 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:24:07.317 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:24:07.318 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:24:07.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:07 gibba044 bash[25485]: cluster 2021-03-10T20:24:05.871483+0000 mgr.gibba044.wflcwh (mgr.34466) 880 : cluster [DBG] pgmap v484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:07.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:07 gibba044 bash[25485]: audit 2021-03-10T20:24:07.312063+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.2.123:0/2445941310' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:08.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:07 gibba023 bash[30844]: cluster 2021-03-10T20:24:05.871483+0000 mgr.gibba044.wflcwh (mgr.34466) 880 : cluster [DBG] pgmap v484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:08.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:07 gibba023 bash[30844]: audit 2021-03-10T20:24:07.312063+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.2.123:0/2445941310' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:08.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:07 gibba023 bash[31815]: cluster 2021-03-10T20:24:05.871483+0000 mgr.gibba044.wflcwh (mgr.34466) 880 : cluster [DBG] pgmap v484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:08.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:07 gibba023 bash[31815]: audit 2021-03-10T20:24:07.312063+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.2.123:0/2445941310' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:08.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:08 gibba044 bash[25485]: audit 2021-03-10T20:24:06.831279+0000 mgr.gibba044.wflcwh (mgr.34466) 881 : audit [DBG] from='client.44652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:24:08.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:08 gibba044 bash[25485]: audit 2021-03-10T20:24:07.056223+0000 mgr.gibba044.wflcwh (mgr.34466) 882 : audit [DBG] from='client.44658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:24:09.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:08 gibba023 bash[30844]: audit 2021-03-10T20:24:06.831279+0000 mgr.gibba044.wflcwh (mgr.34466) 881 : audit [DBG] from='client.44652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:24:09.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:08 gibba023 bash[30844]: audit 2021-03-10T20:24:07.056223+0000 mgr.gibba044.wflcwh (mgr.34466) 882 : audit [DBG] from='client.44658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:24:09.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:08 gibba023 bash[31815]: audit 2021-03-10T20:24:06.831279+0000 mgr.gibba044.wflcwh (mgr.34466) 881 : audit [DBG] from='client.44652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:24:09.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:08 gibba023 bash[31815]: audit 2021-03-10T20:24:07.056223+0000 mgr.gibba044.wflcwh (mgr.34466) 882 : audit [DBG] from='client.44658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:24:09.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:09 gibba044 bash[25485]: cephadm 2021-03-10T20:24:07.867938+0000 mgr.gibba044.wflcwh (mgr.34466) 883 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:24:09.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:09 gibba044 bash[25485]: cluster 2021-03-10T20:24:07.872973+0000 mgr.gibba044.wflcwh (mgr.34466) 884 : cluster [DBG] pgmap v485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:10.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:09 gibba023 bash[30844]: cephadm 2021-03-10T20:24:07.867938+0000 mgr.gibba044.wflcwh (mgr.34466) 883 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:24:10.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:09 gibba023 bash[30844]: cluster 2021-03-10T20:24:07.872973+0000 mgr.gibba044.wflcwh (mgr.34466) 884 : cluster [DBG] pgmap v485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:10.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:09 gibba023 bash[31815]: cephadm 2021-03-10T20:24:07.867938+0000 mgr.gibba044.wflcwh (mgr.34466) 883 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:24:10.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:09 gibba023 bash[31815]: cluster 2021-03-10T20:24:07.872973+0000 mgr.gibba044.wflcwh (mgr.34466) 884 : cluster [DBG] pgmap v485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:11.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:11 gibba044 bash[25485]: cluster 2021-03-10T20:24:09.874283+0000 mgr.gibba044.wflcwh (mgr.34466) 885 : cluster [DBG] pgmap v486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:12.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:11 gibba023 bash[30844]: cluster 2021-03-10T20:24:09.874283+0000 mgr.gibba044.wflcwh (mgr.34466) 885 : cluster [DBG] pgmap v486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:12.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:11 gibba023 bash[31815]: cluster 2021-03-10T20:24:09.874283+0000 mgr.gibba044.wflcwh (mgr.34466) 885 : cluster [DBG] pgmap v486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:13.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:13 gibba044 bash[25485]: cluster 2021-03-10T20:24:11.875891+0000 mgr.gibba044.wflcwh (mgr.34466) 886 : cluster [DBG] pgmap v487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:14.173 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:13 gibba023 bash[30844]: cluster 2021-03-10T20:24:11.875891+0000 mgr.gibba044.wflcwh (mgr.34466) 886 : cluster [DBG] pgmap v487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:14.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:13 gibba023 bash[31815]: cluster 2021-03-10T20:24:11.875891+0000 mgr.gibba044.wflcwh (mgr.34466) 886 : cluster [DBG] pgmap v487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:14.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:14 gibba044 bash[25485]: cluster 2021-03-10T20:24:13.877728+0000 mgr.gibba044.wflcwh (mgr.34466) 887 : cluster [DBG] pgmap v488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:15.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:14 gibba023 bash[30844]: cluster 2021-03-10T20:24:13.877728+0000 mgr.gibba044.wflcwh (mgr.34466) 887 : cluster [DBG] pgmap v488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:15.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:14 gibba023 bash[31815]: cluster 2021-03-10T20:24:13.877728+0000 mgr.gibba044.wflcwh (mgr.34466) 887 : cluster [DBG] pgmap v488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:17.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:17 gibba023 bash[30844]: cluster 2021-03-10T20:24:15.879429+0000 mgr.gibba044.wflcwh (mgr.34466) 888 : cluster [DBG] pgmap v489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:17.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:17 gibba023 bash[31815]: cluster 2021-03-10T20:24:15.879429+0000 mgr.gibba044.wflcwh (mgr.34466) 888 : cluster [DBG] pgmap v489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:17.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:17 gibba044 bash[25485]: cluster 2021-03-10T20:24:15.879429+0000 mgr.gibba044.wflcwh (mgr.34466) 888 : cluster [DBG] pgmap v489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:19.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:19 gibba023 bash[30844]: cluster 2021-03-10T20:24:17.880963+0000 mgr.gibba044.wflcwh (mgr.34466) 889 : cluster [DBG] pgmap v490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:19.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:19 gibba023 bash[31815]: cluster 2021-03-10T20:24:17.880963+0000 mgr.gibba044.wflcwh (mgr.34466) 889 : cluster [DBG] pgmap v490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:19.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:19 gibba044 bash[25485]: cluster 2021-03-10T20:24:17.880963+0000 mgr.gibba044.wflcwh (mgr.34466) 889 : cluster [DBG] pgmap v490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:21.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:21 gibba023 bash[30844]: cluster 2021-03-10T20:24:19.881833+0000 mgr.gibba044.wflcwh (mgr.34466) 890 : cluster [DBG] pgmap v491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:21.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:21 gibba023 bash[31815]: cluster 2021-03-10T20:24:19.881833+0000 mgr.gibba044.wflcwh (mgr.34466) 890 : cluster [DBG] pgmap v491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:21.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:21 gibba044 bash[25485]: cluster 2021-03-10T20:24:19.881833+0000 mgr.gibba044.wflcwh (mgr.34466) 890 : cluster [DBG] pgmap v491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:23.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:23 gibba023 bash[30844]: cluster 2021-03-10T20:24:21.883087+0000 mgr.gibba044.wflcwh (mgr.34466) 891 : cluster [DBG] pgmap v492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:23.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:23 gibba023 bash[31815]: cluster 2021-03-10T20:24:21.883087+0000 mgr.gibba044.wflcwh (mgr.34466) 891 : cluster [DBG] pgmap v492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:23.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:23 gibba044 bash[25485]: cluster 2021-03-10T20:24:21.883087+0000 mgr.gibba044.wflcwh (mgr.34466) 891 : cluster [DBG] pgmap v492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:24.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:24 gibba023 bash[30844]: cephadm 2021-03-10T20:24:22.884036+0000 mgr.gibba044.wflcwh (mgr.34466) 892 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:24:24.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:24 gibba023 bash[31815]: cephadm 2021-03-10T20:24:22.884036+0000 mgr.gibba044.wflcwh (mgr.34466) 892 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:24:24.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:24 gibba044 bash[25485]: cephadm 2021-03-10T20:24:22.884036+0000 mgr.gibba044.wflcwh (mgr.34466) 892 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:24:25.673 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:25 gibba023 bash[30844]: cluster 2021-03-10T20:24:23.884661+0000 mgr.gibba044.wflcwh (mgr.34466) 893 : cluster [DBG] pgmap v493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:25.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:25 gibba023 bash[31815]: cluster 2021-03-10T20:24:23.884661+0000 mgr.gibba044.wflcwh (mgr.34466) 893 : cluster [DBG] pgmap v493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:25.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:25 gibba044 bash[25485]: cluster 2021-03-10T20:24:23.884661+0000 mgr.gibba044.wflcwh (mgr.34466) 893 : cluster [DBG] pgmap v493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:27.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:27 gibba023 bash[30844]: cluster 2021-03-10T20:24:25.886401+0000 mgr.gibba044.wflcwh (mgr.34466) 894 : cluster [DBG] pgmap v494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:27.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:27 gibba023 bash[30844]: audit 2021-03-10T20:24:27.065311+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:24:27.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:27 gibba023 bash[30844]: audit 2021-03-10T20:24:27.066117+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:24:27.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:27 gibba023 bash[30844]: audit 2021-03-10T20:24:27.066838+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:24:27.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:27 gibba023 bash[30844]: audit 2021-03-10T20:24:27.067585+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:24:27.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:27 gibba023 bash[30844]: audit 2021-03-10T20:24:27.126800+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:24:27.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:27 gibba023 bash[30844]: audit 2021-03-10T20:24:27.128909+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:24:27.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:27 gibba023 bash[31815]: cluster 2021-03-10T20:24:25.886401+0000 mgr.gibba044.wflcwh (mgr.34466) 894 : cluster [DBG] pgmap v494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:27.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:27 gibba023 bash[31815]: audit 2021-03-10T20:24:27.065311+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:24:27.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:27 gibba023 bash[31815]: audit 2021-03-10T20:24:27.066117+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:24:27.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:27 gibba023 bash[31815]: audit 2021-03-10T20:24:27.066838+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:24:27.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:27 gibba023 bash[31815]: audit 2021-03-10T20:24:27.067585+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:24:27.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:27 gibba023 bash[31815]: audit 2021-03-10T20:24:27.126800+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:24:27.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:27 gibba023 bash[31815]: audit 2021-03-10T20:24:27.128909+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:24:27.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:27 gibba044 bash[25485]: cluster 2021-03-10T20:24:25.886401+0000 mgr.gibba044.wflcwh (mgr.34466) 894 : cluster [DBG] pgmap v494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:27.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:27 gibba044 bash[25485]: audit 2021-03-10T20:24:27.065311+0000 mon.a (mon.0) 783 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:24:27.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:27 gibba044 bash[25485]: audit 2021-03-10T20:24:27.066117+0000 mon.a (mon.0) 784 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:24:27.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:27 gibba044 bash[25485]: audit 2021-03-10T20:24:27.066838+0000 mon.a (mon.0) 785 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:24:27.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:27 gibba044 bash[25485]: audit 2021-03-10T20:24:27.067585+0000 mon.a (mon.0) 786 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:24:27.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:27 gibba044 bash[25485]: audit 2021-03-10T20:24:27.126800+0000 mon.a (mon.0) 787 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:24:27.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:27 gibba044 bash[25485]: audit 2021-03-10T20:24:27.128909+0000 mon.a (mon.0) 788 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:24:29.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:29 gibba044 bash[25485]: cluster 2021-03-10T20:24:27.887835+0000 mgr.gibba044.wflcwh (mgr.34466) 895 : cluster [DBG] pgmap v495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:29.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:29 gibba023 bash[30844]: cluster 2021-03-10T20:24:27.887835+0000 mgr.gibba044.wflcwh (mgr.34466) 895 : cluster [DBG] pgmap v495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:29.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:29 gibba023 bash[31815]: cluster 2021-03-10T20:24:27.887835+0000 mgr.gibba044.wflcwh (mgr.34466) 895 : cluster [DBG] pgmap v495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:31.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:31 gibba044 bash[25485]: cluster 2021-03-10T20:24:29.889037+0000 mgr.gibba044.wflcwh (mgr.34466) 896 : cluster [DBG] pgmap v496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:31.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:31 gibba023 bash[30844]: cluster 2021-03-10T20:24:29.889037+0000 mgr.gibba044.wflcwh (mgr.34466) 896 : cluster [DBG] pgmap v496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:31.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:31 gibba023 bash[31815]: cluster 2021-03-10T20:24:29.889037+0000 mgr.gibba044.wflcwh (mgr.34466) 896 : cluster [DBG] pgmap v496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:33.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:33 gibba044 bash[25485]: cluster 2021-03-10T20:24:31.890686+0000 mgr.gibba044.wflcwh (mgr.34466) 897 : cluster [DBG] pgmap v497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:33.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:33 gibba023 bash[30844]: cluster 2021-03-10T20:24:31.890686+0000 mgr.gibba044.wflcwh (mgr.34466) 897 : cluster [DBG] pgmap v497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:33.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:33 gibba023 bash[31815]: cluster 2021-03-10T20:24:31.890686+0000 mgr.gibba044.wflcwh (mgr.34466) 897 : cluster [DBG] pgmap v497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:35.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:35 gibba044 bash[25485]: cluster 2021-03-10T20:24:33.892576+0000 mgr.gibba044.wflcwh (mgr.34466) 898 : cluster [DBG] pgmap v498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:35.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:35 gibba023 bash[30844]: cluster 2021-03-10T20:24:33.892576+0000 mgr.gibba044.wflcwh (mgr.34466) 898 : cluster [DBG] pgmap v498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:35.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:35 gibba023 bash[31815]: cluster 2021-03-10T20:24:33.892576+0000 mgr.gibba044.wflcwh (mgr.34466) 898 : cluster [DBG] pgmap v498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:37.553 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:24:37.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:37 gibba044 bash[25485]: cluster 2021-03-10T20:24:35.894357+0000 mgr.gibba044.wflcwh (mgr.34466) 899 : cluster [DBG] pgmap v499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:37.782 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:24:37.783 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (15m) 109s ago 21m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:24:37.783 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (21m) 45s ago 21m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:24:37.783 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (16m) 45s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:24:37.783 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (16m) 45s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:24:37.784 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (15m) 109s ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:24:37.784 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (15m) 109s ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:24:37.784 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (14m) 45s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:24:37.784 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (15m) 109s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:24:37.784 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (21m) 109s ago 21m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:24:37.785 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (21m) 45s ago 21m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:24:37.785 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (14m) 109s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:24:37.785 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (13m) 109s ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:24:37.785 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (13m) 109s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:24:37.786 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (12m) 109s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:24:37.786 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (12m) 45s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:24:37.786 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (11m) 45s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:24:37.786 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (11m) 45s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:24:37.786 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (10m) 45s ago 21m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:24:37.787 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (20m) 45s ago 21m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:24:37.787 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 109s ago 19m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:24:37.787 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 45s ago 19m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:24:37.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:37 gibba023 bash[30844]: cluster 2021-03-10T20:24:35.894357+0000 mgr.gibba044.wflcwh (mgr.34466) 899 : cluster [DBG] pgmap v499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:37.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:37 gibba023 bash[31815]: cluster 2021-03-10T20:24:35.894357+0000 mgr.gibba044.wflcwh (mgr.34466) 899 : cluster [DBG] pgmap v499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:38.032 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:24:38.033 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:24:38.033 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:24:38.033 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:24:38.034 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:24:38.034 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:24:38.034 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:24:38.034 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:24:38.035 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:24:38.035 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:24:38.035 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:24:38.035 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:24:38.036 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:24:38.036 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:24:38.036 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:24:38.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:38 gibba044 bash[25485]: audit 2021-03-10T20:24:37.550656+0000 mgr.gibba044.wflcwh (mgr.34466) 900 : audit [DBG] from='client.54649 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:24:38.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:38 gibba044 bash[25485]: audit 2021-03-10T20:24:38.033539+0000 mon.c (mon.1) 28 : audit [DBG] from='client.? 172.21.2.123:0/351531892' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:38.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:38 gibba023 bash[30844]: audit 2021-03-10T20:24:37.550656+0000 mgr.gibba044.wflcwh (mgr.34466) 900 : audit [DBG] from='client.54649 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:24:38.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:38 gibba023 bash[30844]: audit 2021-03-10T20:24:38.033539+0000 mon.c (mon.1) 28 : audit [DBG] from='client.? 172.21.2.123:0/351531892' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:38.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:38 gibba023 bash[31815]: audit 2021-03-10T20:24:37.550656+0000 mgr.gibba044.wflcwh (mgr.34466) 900 : audit [DBG] from='client.54649 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:24:38.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:38 gibba023 bash[31815]: audit 2021-03-10T20:24:38.033539+0000 mon.c (mon.1) 28 : audit [DBG] from='client.? 172.21.2.123:0/351531892' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:39.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:39 gibba044 bash[25485]: audit 2021-03-10T20:24:37.775136+0000 mgr.gibba044.wflcwh (mgr.34466) 901 : audit [DBG] from='client.54655 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:24:39.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:39 gibba044 bash[25485]: cluster 2021-03-10T20:24:37.895738+0000 mgr.gibba044.wflcwh (mgr.34466) 902 : cluster [DBG] pgmap v500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:39.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:39 gibba044 bash[25485]: cephadm 2021-03-10T20:24:37.899881+0000 mgr.gibba044.wflcwh (mgr.34466) 903 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:24:39.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:39 gibba023 bash[30844]: audit 2021-03-10T20:24:37.775136+0000 mgr.gibba044.wflcwh (mgr.34466) 901 : audit [DBG] from='client.54655 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:24:39.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:39 gibba023 bash[30844]: cluster 2021-03-10T20:24:37.895738+0000 mgr.gibba044.wflcwh (mgr.34466) 902 : cluster [DBG] pgmap v500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:39.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:39 gibba023 bash[30844]: cephadm 2021-03-10T20:24:37.899881+0000 mgr.gibba044.wflcwh (mgr.34466) 903 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:24:39.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:39 gibba023 bash[31815]: audit 2021-03-10T20:24:37.775136+0000 mgr.gibba044.wflcwh (mgr.34466) 901 : audit [DBG] from='client.54655 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:24:39.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:39 gibba023 bash[31815]: cluster 2021-03-10T20:24:37.895738+0000 mgr.gibba044.wflcwh (mgr.34466) 902 : cluster [DBG] pgmap v500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:39.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:39 gibba023 bash[31815]: cephadm 2021-03-10T20:24:37.899881+0000 mgr.gibba044.wflcwh (mgr.34466) 903 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:24:41.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:41 gibba044 bash[25485]: cluster 2021-03-10T20:24:39.896947+0000 mgr.gibba044.wflcwh (mgr.34466) 904 : cluster [DBG] pgmap v501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:41.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:41 gibba023 bash[30844]: cluster 2021-03-10T20:24:39.896947+0000 mgr.gibba044.wflcwh (mgr.34466) 904 : cluster [DBG] pgmap v501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:41.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:41 gibba023 bash[31815]: cluster 2021-03-10T20:24:39.896947+0000 mgr.gibba044.wflcwh (mgr.34466) 904 : cluster [DBG] pgmap v501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:43.746 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:43 gibba044 bash[25485]: cluster 2021-03-10T20:24:41.898279+0000 mgr.gibba044.wflcwh (mgr.34466) 905 : cluster [DBG] pgmap v502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:43.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:43 gibba023 bash[30844]: cluster 2021-03-10T20:24:41.898279+0000 mgr.gibba044.wflcwh (mgr.34466) 905 : cluster [DBG] pgmap v502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:43.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:43 gibba023 bash[31815]: cluster 2021-03-10T20:24:41.898279+0000 mgr.gibba044.wflcwh (mgr.34466) 905 : cluster [DBG] pgmap v502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:45.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:45 gibba023 bash[30844]: cluster 2021-03-10T20:24:43.899108+0000 mgr.gibba044.wflcwh (mgr.34466) 906 : cluster [DBG] pgmap v503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:45.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:45 gibba023 bash[31815]: cluster 2021-03-10T20:24:43.899108+0000 mgr.gibba044.wflcwh (mgr.34466) 906 : cluster [DBG] pgmap v503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:45.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:45 gibba044 bash[25485]: cluster 2021-03-10T20:24:43.899108+0000 mgr.gibba044.wflcwh (mgr.34466) 906 : cluster [DBG] pgmap v503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:47.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:47 gibba023 bash[30844]: cluster 2021-03-10T20:24:45.900787+0000 mgr.gibba044.wflcwh (mgr.34466) 907 : cluster [DBG] pgmap v504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:47.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:47 gibba023 bash[31815]: cluster 2021-03-10T20:24:45.900787+0000 mgr.gibba044.wflcwh (mgr.34466) 907 : cluster [DBG] pgmap v504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:47.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:47 gibba044 bash[25485]: cluster 2021-03-10T20:24:45.900787+0000 mgr.gibba044.wflcwh (mgr.34466) 907 : cluster [DBG] pgmap v504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:49.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:49 gibba023 bash[30844]: cluster 2021-03-10T20:24:47.901495+0000 mgr.gibba044.wflcwh (mgr.34466) 908 : cluster [DBG] pgmap v505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:49.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:49 gibba023 bash[31815]: cluster 2021-03-10T20:24:47.901495+0000 mgr.gibba044.wflcwh (mgr.34466) 908 : cluster [DBG] pgmap v505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:49.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:49 gibba044 bash[25485]: cluster 2021-03-10T20:24:47.901495+0000 mgr.gibba044.wflcwh (mgr.34466) 908 : cluster [DBG] pgmap v505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:51.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:51 gibba023 bash[30844]: cluster 2021-03-10T20:24:49.902595+0000 mgr.gibba044.wflcwh (mgr.34466) 909 : cluster [DBG] pgmap v506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:51.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:51 gibba023 bash[31815]: cluster 2021-03-10T20:24:49.902595+0000 mgr.gibba044.wflcwh (mgr.34466) 909 : cluster [DBG] pgmap v506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:51.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:51 gibba044 bash[25485]: cluster 2021-03-10T20:24:49.902595+0000 mgr.gibba044.wflcwh (mgr.34466) 909 : cluster [DBG] pgmap v506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:53.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:53 gibba023 bash[30844]: cluster 2021-03-10T20:24:51.904020+0000 mgr.gibba044.wflcwh (mgr.34466) 910 : cluster [DBG] pgmap v507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:53.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:53 gibba023 bash[30844]: audit 2021-03-10T20:24:53.124378+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:24:53.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:53 gibba023 bash[30844]: audit 2021-03-10T20:24:53.127820+0000 mon.a (mon.0) 790 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:24:53.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:53 gibba023 bash[30844]: audit 2021-03-10T20:24:53.129103+0000 mon.a (mon.0) 791 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:53.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:53 gibba023 bash[30844]: audit 2021-03-10T20:24:53.130317+0000 mon.a (mon.0) 792 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:53.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:53 gibba023 bash[30844]: audit 2021-03-10T20:24:53.131449+0000 mon.a (mon.0) 793 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:53.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:53 gibba023 bash[30844]: audit 2021-03-10T20:24:53.134084+0000 mon.a (mon.0) 794 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:53.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:53 gibba023 bash[30844]: audit 2021-03-10T20:24:53.135448+0000 mon.a (mon.0) 795 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:53.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:53 gibba023 bash[31815]: cluster 2021-03-10T20:24:51.904020+0000 mgr.gibba044.wflcwh (mgr.34466) 910 : cluster [DBG] pgmap v507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:53.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:53 gibba023 bash[31815]: audit 2021-03-10T20:24:53.124378+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:24:53.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:53 gibba023 bash[31815]: audit 2021-03-10T20:24:53.127820+0000 mon.a (mon.0) 790 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:24:53.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:53 gibba023 bash[31815]: audit 2021-03-10T20:24:53.129103+0000 mon.a (mon.0) 791 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:53.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:53 gibba023 bash[31815]: audit 2021-03-10T20:24:53.130317+0000 mon.a (mon.0) 792 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:53.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:53 gibba023 bash[31815]: audit 2021-03-10T20:24:53.131449+0000 mon.a (mon.0) 793 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:53.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:53 gibba023 bash[31815]: audit 2021-03-10T20:24:53.134084+0000 mon.a (mon.0) 794 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:53.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:53 gibba023 bash[31815]: audit 2021-03-10T20:24:53.135448+0000 mon.a (mon.0) 795 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:53.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:53 gibba044 bash[25485]: cluster 2021-03-10T20:24:51.904020+0000 mgr.gibba044.wflcwh (mgr.34466) 910 : cluster [DBG] pgmap v507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:53.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:53 gibba044 bash[25485]: audit 2021-03-10T20:24:53.124378+0000 mon.a (mon.0) 789 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:24:53.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:53 gibba044 bash[25485]: audit 2021-03-10T20:24:53.127820+0000 mon.a (mon.0) 790 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:24:53.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:53 gibba044 bash[25485]: audit 2021-03-10T20:24:53.129103+0000 mon.a (mon.0) 791 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:53.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:53 gibba044 bash[25485]: audit 2021-03-10T20:24:53.130317+0000 mon.a (mon.0) 792 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:53.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:53 gibba044 bash[25485]: audit 2021-03-10T20:24:53.131449+0000 mon.a (mon.0) 793 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:53.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:53 gibba044 bash[25485]: audit 2021-03-10T20:24:53.134084+0000 mon.a (mon.0) 794 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:53.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:53 gibba044 bash[25485]: audit 2021-03-10T20:24:53.135448+0000 mon.a (mon.0) 795 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:24:54.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[30844]: cephadm 2021-03-10T20:24:52.913679+0000 mgr.gibba044.wflcwh (mgr.34466) 911 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:24:54.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[30844]: cephadm 2021-03-10T20:24:52.915240+0000 mgr.gibba044.wflcwh (mgr.34466) 912 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:24:54.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[30844]: cephadm 2021-03-10T20:24:53.131106+0000 mgr.gibba044.wflcwh (mgr.34466) 913 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:24:54.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[30844]: cephadm 2021-03-10T20:24:53.132629+0000 mgr.gibba044.wflcwh (mgr.34466) 914 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:24:54.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[30844]: cephadm 2021-03-10T20:24:53.133804+0000 mgr.gibba044.wflcwh (mgr.34466) 915 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:24:54.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[30844]: cephadm 2021-03-10T20:24:53.133949+0000 mgr.gibba044.wflcwh (mgr.34466) 916 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:24:54.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[30844]: cephadm 2021-03-10T20:24:53.134935+0000 mgr.gibba044.wflcwh (mgr.34466) 917 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:24:54.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[30844]: cephadm 2021-03-10T20:24:53.135033+0000 mgr.gibba044.wflcwh (mgr.34466) 918 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:24:54.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[30844]: cephadm 2021-03-10T20:24:53.136309+0000 mgr.gibba044.wflcwh (mgr.34466) 919 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:24:54.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[30844]: cephadm 2021-03-10T20:24:53.137335+0000 mgr.gibba044.wflcwh (mgr.34466) 920 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:24:54.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[30844]: cephadm 2021-03-10T20:24:53.137404+0000 mgr.gibba044.wflcwh (mgr.34466) 921 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:24:54.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[30844]: cephadm 2021-03-10T20:24:53.138707+0000 mgr.gibba044.wflcwh (mgr.34466) 922 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:24:54.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[30844]: cephadm 2021-03-10T20:24:53.139086+0000 mgr.gibba044.wflcwh (mgr.34466) 923 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:24:54.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[30844]: cephadm 2021-03-10T20:24:53.140206+0000 mgr.gibba044.wflcwh (mgr.34466) 924 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:24:54.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[30844]: cephadm 2021-03-10T20:24:53.140244+0000 mgr.gibba044.wflcwh (mgr.34466) 925 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:24:54.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[30844]: cephadm 2021-03-10T20:24:53.140372+0000 mgr.gibba044.wflcwh (mgr.34466) 926 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:24:54.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[31815]: cephadm 2021-03-10T20:24:52.913679+0000 mgr.gibba044.wflcwh (mgr.34466) 911 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:24:54.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[31815]: cephadm 2021-03-10T20:24:52.915240+0000 mgr.gibba044.wflcwh (mgr.34466) 912 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:24:54.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[31815]: cephadm 2021-03-10T20:24:53.131106+0000 mgr.gibba044.wflcwh (mgr.34466) 913 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:24:54.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[31815]: cephadm 2021-03-10T20:24:53.132629+0000 mgr.gibba044.wflcwh (mgr.34466) 914 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:24:54.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[31815]: cephadm 2021-03-10T20:24:53.133804+0000 mgr.gibba044.wflcwh (mgr.34466) 915 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:24:54.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[31815]: cephadm 2021-03-10T20:24:53.133949+0000 mgr.gibba044.wflcwh (mgr.34466) 916 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:24:54.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[31815]: cephadm 2021-03-10T20:24:53.134935+0000 mgr.gibba044.wflcwh (mgr.34466) 917 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:24:54.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[31815]: cephadm 2021-03-10T20:24:53.135033+0000 mgr.gibba044.wflcwh (mgr.34466) 918 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:24:54.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[31815]: cephadm 2021-03-10T20:24:53.136309+0000 mgr.gibba044.wflcwh (mgr.34466) 919 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:24:54.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[31815]: cephadm 2021-03-10T20:24:53.137335+0000 mgr.gibba044.wflcwh (mgr.34466) 920 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:24:54.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[31815]: cephadm 2021-03-10T20:24:53.137404+0000 mgr.gibba044.wflcwh (mgr.34466) 921 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:24:54.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[31815]: cephadm 2021-03-10T20:24:53.138707+0000 mgr.gibba044.wflcwh (mgr.34466) 922 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:24:54.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[31815]: cephadm 2021-03-10T20:24:53.139086+0000 mgr.gibba044.wflcwh (mgr.34466) 923 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:24:54.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[31815]: cephadm 2021-03-10T20:24:53.140206+0000 mgr.gibba044.wflcwh (mgr.34466) 924 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:24:54.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[31815]: cephadm 2021-03-10T20:24:53.140244+0000 mgr.gibba044.wflcwh (mgr.34466) 925 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:24:54.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:54 gibba023 bash[31815]: cephadm 2021-03-10T20:24:53.140372+0000 mgr.gibba044.wflcwh (mgr.34466) 926 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:24:54.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:54 gibba044 bash[25485]: cephadm 2021-03-10T20:24:52.913679+0000 mgr.gibba044.wflcwh (mgr.34466) 911 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:24:54.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:54 gibba044 bash[25485]: cephadm 2021-03-10T20:24:52.915240+0000 mgr.gibba044.wflcwh (mgr.34466) 912 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:24:54.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:54 gibba044 bash[25485]: cephadm 2021-03-10T20:24:53.131106+0000 mgr.gibba044.wflcwh (mgr.34466) 913 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:24:54.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:54 gibba044 bash[25485]: cephadm 2021-03-10T20:24:53.132629+0000 mgr.gibba044.wflcwh (mgr.34466) 914 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:24:54.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:54 gibba044 bash[25485]: cephadm 2021-03-10T20:24:53.133804+0000 mgr.gibba044.wflcwh (mgr.34466) 915 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:24:54.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:54 gibba044 bash[25485]: cephadm 2021-03-10T20:24:53.133949+0000 mgr.gibba044.wflcwh (mgr.34466) 916 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:24:54.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:54 gibba044 bash[25485]: cephadm 2021-03-10T20:24:53.134935+0000 mgr.gibba044.wflcwh (mgr.34466) 917 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:24:54.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:54 gibba044 bash[25485]: cephadm 2021-03-10T20:24:53.135033+0000 mgr.gibba044.wflcwh (mgr.34466) 918 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:24:54.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:54 gibba044 bash[25485]: cephadm 2021-03-10T20:24:53.136309+0000 mgr.gibba044.wflcwh (mgr.34466) 919 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:24:54.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:54 gibba044 bash[25485]: cephadm 2021-03-10T20:24:53.137335+0000 mgr.gibba044.wflcwh (mgr.34466) 920 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:24:54.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:54 gibba044 bash[25485]: cephadm 2021-03-10T20:24:53.137404+0000 mgr.gibba044.wflcwh (mgr.34466) 921 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:24:55.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:54 gibba044 bash[25485]: cephadm 2021-03-10T20:24:53.138707+0000 mgr.gibba044.wflcwh (mgr.34466) 922 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:24:55.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:54 gibba044 bash[25485]: cephadm 2021-03-10T20:24:53.139086+0000 mgr.gibba044.wflcwh (mgr.34466) 923 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:24:55.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:54 gibba044 bash[25485]: cephadm 2021-03-10T20:24:53.140206+0000 mgr.gibba044.wflcwh (mgr.34466) 924 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:24:55.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:54 gibba044 bash[25485]: cephadm 2021-03-10T20:24:53.140244+0000 mgr.gibba044.wflcwh (mgr.34466) 925 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:24:55.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:54 gibba044 bash[25485]: cephadm 2021-03-10T20:24:53.140372+0000 mgr.gibba044.wflcwh (mgr.34466) 926 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:24:55.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:55 gibba023 bash[30844]: cluster 2021-03-10T20:24:53.904567+0000 mgr.gibba044.wflcwh (mgr.34466) 927 : cluster [DBG] pgmap v508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:55.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:55 gibba023 bash[31815]: cluster 2021-03-10T20:24:53.904567+0000 mgr.gibba044.wflcwh (mgr.34466) 927 : cluster [DBG] pgmap v508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:55.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:55 gibba044 bash[25485]: cluster 2021-03-10T20:24:53.904567+0000 mgr.gibba044.wflcwh (mgr.34466) 927 : cluster [DBG] pgmap v508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:57.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:57 gibba023 bash[30844]: cluster 2021-03-10T20:24:55.905889+0000 mgr.gibba044.wflcwh (mgr.34466) 928 : cluster [DBG] pgmap v509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:57.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:57 gibba023 bash[31815]: cluster 2021-03-10T20:24:55.905889+0000 mgr.gibba044.wflcwh (mgr.34466) 928 : cluster [DBG] pgmap v509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:57.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:57 gibba044 bash[25485]: cluster 2021-03-10T20:24:55.905889+0000 mgr.gibba044.wflcwh (mgr.34466) 928 : cluster [DBG] pgmap v509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:59.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:24:59 gibba023 bash[30844]: cluster 2021-03-10T20:24:57.907541+0000 mgr.gibba044.wflcwh (mgr.34466) 929 : cluster [DBG] pgmap v510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:59.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:24:59 gibba023 bash[31815]: cluster 2021-03-10T20:24:57.907541+0000 mgr.gibba044.wflcwh (mgr.34466) 929 : cluster [DBG] pgmap v510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:24:59.996 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:24:59 gibba044 bash[25485]: cluster 2021-03-10T20:24:57.907541+0000 mgr.gibba044.wflcwh (mgr.34466) 929 : cluster [DBG] pgmap v510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:01.875 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:01 gibba044 bash[25485]: cluster 2021-03-10T20:24:59.908758+0000 mgr.gibba044.wflcwh (mgr.34466) 930 : cluster [DBG] pgmap v511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:01.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:01 gibba023 bash[30844]: cluster 2021-03-10T20:24:59.908758+0000 mgr.gibba044.wflcwh (mgr.34466) 930 : cluster [DBG] pgmap v511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:01.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:01 gibba023 bash[31815]: cluster 2021-03-10T20:24:59.908758+0000 mgr.gibba044.wflcwh (mgr.34466) 930 : cluster [DBG] pgmap v511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:03.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:03 gibba023 bash[30844]: cluster 2021-03-10T20:25:01.909488+0000 mgr.gibba044.wflcwh (mgr.34466) 931 : cluster [DBG] pgmap v512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:03.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:03 gibba023 bash[31815]: cluster 2021-03-10T20:25:01.909488+0000 mgr.gibba044.wflcwh (mgr.34466) 931 : cluster [DBG] pgmap v512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:03.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:03 gibba044 bash[25485]: cluster 2021-03-10T20:25:01.909488+0000 mgr.gibba044.wflcwh (mgr.34466) 931 : cluster [DBG] pgmap v512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:05.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:05 gibba023 bash[30844]: cluster 2021-03-10T20:25:03.909914+0000 mgr.gibba044.wflcwh (mgr.34466) 932 : cluster [DBG] pgmap v513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:05.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:05 gibba023 bash[31815]: cluster 2021-03-10T20:25:03.909914+0000 mgr.gibba044.wflcwh (mgr.34466) 932 : cluster [DBG] pgmap v513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:05.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:05 gibba044 bash[25485]: cluster 2021-03-10T20:25:03.909914+0000 mgr.gibba044.wflcwh (mgr.34466) 932 : cluster [DBG] pgmap v513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:07.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:07 gibba023 bash[30844]: cluster 2021-03-10T20:25:05.910561+0000 mgr.gibba044.wflcwh (mgr.34466) 933 : cluster [DBG] pgmap v514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:07.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:07 gibba023 bash[31815]: cluster 2021-03-10T20:25:05.910561+0000 mgr.gibba044.wflcwh (mgr.34466) 933 : cluster [DBG] pgmap v514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:07.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:07 gibba044 bash[25485]: cluster 2021-03-10T20:25:05.910561+0000 mgr.gibba044.wflcwh (mgr.34466) 933 : cluster [DBG] pgmap v514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:08.275 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:25:08.502 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:25:08.503 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (16m) 2m ago 21m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:25:08.503 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (21m) 75s ago 21m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:25:08.503 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (16m) 75s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:25:08.503 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (16m) 75s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:25:08.504 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (15m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:25:08.504 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (15m) 2m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:25:08.504 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (15m) 75s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:25:08.504 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (15m) 2m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:25:08.504 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (21m) 2m ago 21m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:25:08.505 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (21m) 75s ago 22m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:25:08.505 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (14m) 2m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:25:08.505 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (14m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:25:08.505 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (13m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:25:08.506 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (13m) 2m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:25:08.506 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (12m) 75s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:25:08.506 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (12m) 75s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:25:08.506 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (11m) 75s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:25:08.506 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (11m) 75s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:25:08.507 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (21m) 75s ago 22m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:25:08.507 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 2m ago 19m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:25:08.507 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 75s ago 19m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:25:08.755 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:25:08.755 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:25:08.755 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:25:08.755 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:25:08.756 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:25:08.756 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:25:08.756 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:25:08.756 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:25:08.756 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:25:08.757 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:25:08.757 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:25:08.757 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:25:08.757 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:25:08.758 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:25:08.758 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:25:09.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:09 gibba023 bash[30844]: cluster 2021-03-10T20:25:07.912127+0000 mgr.gibba044.wflcwh (mgr.34466) 934 : cluster [DBG] pgmap v515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:09.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:09 gibba023 bash[30844]: cephadm 2021-03-10T20:25:08.145495+0000 mgr.gibba044.wflcwh (mgr.34466) 935 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:25:09.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:09 gibba023 bash[30844]: audit 2021-03-10T20:25:08.270958+0000 mgr.gibba044.wflcwh (mgr.34466) 936 : audit [DBG] from='client.54667 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:25:09.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:09 gibba023 bash[30844]: audit 2021-03-10T20:25:08.494548+0000 mgr.gibba044.wflcwh (mgr.34466) 937 : audit [DBG] from='client.54673 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:25:09.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:09 gibba023 bash[30844]: audit 2021-03-10T20:25:08.755609+0000 mon.a (mon.0) 796 : audit [DBG] from='client.? 172.21.2.123:0/2991909109' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:09.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:09 gibba023 bash[31815]: cluster 2021-03-10T20:25:07.912127+0000 mgr.gibba044.wflcwh (mgr.34466) 934 : cluster [DBG] pgmap v515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:09.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:09 gibba023 bash[31815]: cephadm 2021-03-10T20:25:08.145495+0000 mgr.gibba044.wflcwh (mgr.34466) 935 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:25:09.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:09 gibba023 bash[31815]: audit 2021-03-10T20:25:08.270958+0000 mgr.gibba044.wflcwh (mgr.34466) 936 : audit [DBG] from='client.54667 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:25:09.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:09 gibba023 bash[31815]: audit 2021-03-10T20:25:08.494548+0000 mgr.gibba044.wflcwh (mgr.34466) 937 : audit [DBG] from='client.54673 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:25:09.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:09 gibba023 bash[31815]: audit 2021-03-10T20:25:08.755609+0000 mon.a (mon.0) 796 : audit [DBG] from='client.? 172.21.2.123:0/2991909109' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:09.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:09 gibba044 bash[25485]: cluster 2021-03-10T20:25:07.912127+0000 mgr.gibba044.wflcwh (mgr.34466) 934 : cluster [DBG] pgmap v515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:09.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:09 gibba044 bash[25485]: cephadm 2021-03-10T20:25:08.145495+0000 mgr.gibba044.wflcwh (mgr.34466) 935 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:25:09.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:09 gibba044 bash[25485]: audit 2021-03-10T20:25:08.270958+0000 mgr.gibba044.wflcwh (mgr.34466) 936 : audit [DBG] from='client.54667 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:25:09.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:09 gibba044 bash[25485]: audit 2021-03-10T20:25:08.494548+0000 mgr.gibba044.wflcwh (mgr.34466) 937 : audit [DBG] from='client.54673 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:25:09.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:09 gibba044 bash[25485]: audit 2021-03-10T20:25:08.755609+0000 mon.a (mon.0) 796 : audit [DBG] from='client.? 172.21.2.123:0/2991909109' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:11.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:11 gibba023 bash[30844]: cluster 2021-03-10T20:25:09.913359+0000 mgr.gibba044.wflcwh (mgr.34466) 938 : cluster [DBG] pgmap v516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:11.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:11 gibba023 bash[31815]: cluster 2021-03-10T20:25:09.913359+0000 mgr.gibba044.wflcwh (mgr.34466) 938 : cluster [DBG] pgmap v516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:11.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:11 gibba044 bash[25485]: cluster 2021-03-10T20:25:09.913359+0000 mgr.gibba044.wflcwh (mgr.34466) 938 : cluster [DBG] pgmap v516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:13.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:13 gibba023 bash[30844]: cluster 2021-03-10T20:25:11.914136+0000 mgr.gibba044.wflcwh (mgr.34466) 939 : cluster [DBG] pgmap v517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:13.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:13 gibba023 bash[31815]: cluster 2021-03-10T20:25:11.914136+0000 mgr.gibba044.wflcwh (mgr.34466) 939 : cluster [DBG] pgmap v517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:13.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:13 gibba044 bash[25485]: cluster 2021-03-10T20:25:11.914136+0000 mgr.gibba044.wflcwh (mgr.34466) 939 : cluster [DBG] pgmap v517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:15.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:15 gibba023 bash[30844]: cluster 2021-03-10T20:25:13.914942+0000 mgr.gibba044.wflcwh (mgr.34466) 940 : cluster [DBG] pgmap v518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:15.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:15 gibba023 bash[31815]: cluster 2021-03-10T20:25:13.914942+0000 mgr.gibba044.wflcwh (mgr.34466) 940 : cluster [DBG] pgmap v518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:15.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:15 gibba044 bash[25485]: cluster 2021-03-10T20:25:13.914942+0000 mgr.gibba044.wflcwh (mgr.34466) 940 : cluster [DBG] pgmap v518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:17.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:17 gibba023 bash[30844]: cluster 2021-03-10T20:25:15.916445+0000 mgr.gibba044.wflcwh (mgr.34466) 941 : cluster [DBG] pgmap v519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:17.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:17 gibba023 bash[31815]: cluster 2021-03-10T20:25:15.916445+0000 mgr.gibba044.wflcwh (mgr.34466) 941 : cluster [DBG] pgmap v519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:17.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:17 gibba044 bash[25485]: cluster 2021-03-10T20:25:15.916445+0000 mgr.gibba044.wflcwh (mgr.34466) 941 : cluster [DBG] pgmap v519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:19.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:19 gibba023 bash[30844]: cluster 2021-03-10T20:25:17.917121+0000 mgr.gibba044.wflcwh (mgr.34466) 942 : cluster [DBG] pgmap v520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:19.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:19 gibba023 bash[31815]: cluster 2021-03-10T20:25:17.917121+0000 mgr.gibba044.wflcwh (mgr.34466) 942 : cluster [DBG] pgmap v520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:19.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:19 gibba044 bash[25485]: cluster 2021-03-10T20:25:17.917121+0000 mgr.gibba044.wflcwh (mgr.34466) 942 : cluster [DBG] pgmap v520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:21.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:21 gibba023 bash[30844]: cluster 2021-03-10T20:25:19.918257+0000 mgr.gibba044.wflcwh (mgr.34466) 943 : cluster [DBG] pgmap v521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:21.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:21 gibba023 bash[31815]: cluster 2021-03-10T20:25:19.918257+0000 mgr.gibba044.wflcwh (mgr.34466) 943 : cluster [DBG] pgmap v521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:21.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:21 gibba044 bash[25485]: cluster 2021-03-10T20:25:19.918257+0000 mgr.gibba044.wflcwh (mgr.34466) 943 : cluster [DBG] pgmap v521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:23.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:23 gibba023 bash[30844]: cluster 2021-03-10T20:25:21.919785+0000 mgr.gibba044.wflcwh (mgr.34466) 944 : cluster [DBG] pgmap v522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:23.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:23 gibba023 bash[31815]: cluster 2021-03-10T20:25:21.919785+0000 mgr.gibba044.wflcwh (mgr.34466) 944 : cluster [DBG] pgmap v522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:23.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:23 gibba044 bash[25485]: cluster 2021-03-10T20:25:21.919785+0000 mgr.gibba044.wflcwh (mgr.34466) 944 : cluster [DBG] pgmap v522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:24.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:24 gibba044 bash[25485]: cephadm 2021-03-10T20:25:23.161511+0000 mgr.gibba044.wflcwh (mgr.34466) 945 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:25:25.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:24 gibba023 bash[30844]: cephadm 2021-03-10T20:25:23.161511+0000 mgr.gibba044.wflcwh (mgr.34466) 945 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:25:25.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:24 gibba023 bash[31815]: cephadm 2021-03-10T20:25:23.161511+0000 mgr.gibba044.wflcwh (mgr.34466) 945 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:25:25.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:25 gibba044 bash[25485]: cluster 2021-03-10T20:25:23.921299+0000 mgr.gibba044.wflcwh (mgr.34466) 946 : cluster [DBG] pgmap v523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:26.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:25 gibba023 bash[30844]: cluster 2021-03-10T20:25:23.921299+0000 mgr.gibba044.wflcwh (mgr.34466) 946 : cluster [DBG] pgmap v523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:26.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:25 gibba023 bash[31815]: cluster 2021-03-10T20:25:23.921299+0000 mgr.gibba044.wflcwh (mgr.34466) 946 : cluster [DBG] pgmap v523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:27.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:27 gibba044 bash[25485]: cluster 2021-03-10T20:25:25.922842+0000 mgr.gibba044.wflcwh (mgr.34466) 947 : cluster [DBG] pgmap v524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:27.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:27 gibba044 bash[25485]: audit 2021-03-10T20:25:27.075495+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:25:27.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:27 gibba044 bash[25485]: audit 2021-03-10T20:25:27.076269+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:25:27.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:27 gibba044 bash[25485]: audit 2021-03-10T20:25:27.076965+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:25:27.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:27 gibba044 bash[25485]: audit 2021-03-10T20:25:27.077683+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:25:27.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:27 gibba044 bash[25485]: audit 2021-03-10T20:25:27.130050+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:25:27.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:27 gibba044 bash[25485]: audit 2021-03-10T20:25:27.135179+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:25:28.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:27 gibba023 bash[30844]: cluster 2021-03-10T20:25:25.922842+0000 mgr.gibba044.wflcwh (mgr.34466) 947 : cluster [DBG] pgmap v524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:28.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:27 gibba023 bash[30844]: audit 2021-03-10T20:25:27.075495+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:25:28.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:27 gibba023 bash[30844]: audit 2021-03-10T20:25:27.076269+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:25:28.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:27 gibba023 bash[30844]: audit 2021-03-10T20:25:27.076965+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:25:28.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:27 gibba023 bash[30844]: audit 2021-03-10T20:25:27.077683+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:25:28.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:27 gibba023 bash[30844]: audit 2021-03-10T20:25:27.130050+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:25:28.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:27 gibba023 bash[30844]: audit 2021-03-10T20:25:27.135179+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:25:28.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:27 gibba023 bash[31815]: cluster 2021-03-10T20:25:25.922842+0000 mgr.gibba044.wflcwh (mgr.34466) 947 : cluster [DBG] pgmap v524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:28.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:27 gibba023 bash[31815]: audit 2021-03-10T20:25:27.075495+0000 mon.a (mon.0) 797 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:25:28.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:27 gibba023 bash[31815]: audit 2021-03-10T20:25:27.076269+0000 mon.a (mon.0) 798 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:25:28.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:27 gibba023 bash[31815]: audit 2021-03-10T20:25:27.076965+0000 mon.a (mon.0) 799 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:25:28.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:27 gibba023 bash[31815]: audit 2021-03-10T20:25:27.077683+0000 mon.a (mon.0) 800 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:25:28.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:27 gibba023 bash[31815]: audit 2021-03-10T20:25:27.130050+0000 mon.a (mon.0) 801 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:25:28.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:27 gibba023 bash[31815]: audit 2021-03-10T20:25:27.135179+0000 mon.a (mon.0) 802 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:25:29.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:29 gibba044 bash[25485]: cluster 2021-03-10T20:25:27.924427+0000 mgr.gibba044.wflcwh (mgr.34466) 948 : cluster [DBG] pgmap v525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:30.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:29 gibba023 bash[30844]: cluster 2021-03-10T20:25:27.924427+0000 mgr.gibba044.wflcwh (mgr.34466) 948 : cluster [DBG] pgmap v525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:30.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:29 gibba023 bash[31815]: cluster 2021-03-10T20:25:27.924427+0000 mgr.gibba044.wflcwh (mgr.34466) 948 : cluster [DBG] pgmap v525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:31.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:31 gibba044 bash[25485]: cluster 2021-03-10T20:25:29.925697+0000 mgr.gibba044.wflcwh (mgr.34466) 949 : cluster [DBG] pgmap v526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:32.173 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:31 gibba023 bash[30844]: cluster 2021-03-10T20:25:29.925697+0000 mgr.gibba044.wflcwh (mgr.34466) 949 : cluster [DBG] pgmap v526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:32.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:31 gibba023 bash[31815]: cluster 2021-03-10T20:25:29.925697+0000 mgr.gibba044.wflcwh (mgr.34466) 949 : cluster [DBG] pgmap v526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:33.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:33 gibba044 bash[25485]: cluster 2021-03-10T20:25:31.927037+0000 mgr.gibba044.wflcwh (mgr.34466) 950 : cluster [DBG] pgmap v527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:34.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:33 gibba023 bash[30844]: cluster 2021-03-10T20:25:31.927037+0000 mgr.gibba044.wflcwh (mgr.34466) 950 : cluster [DBG] pgmap v527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:34.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:33 gibba023 bash[31815]: cluster 2021-03-10T20:25:31.927037+0000 mgr.gibba044.wflcwh (mgr.34466) 950 : cluster [DBG] pgmap v527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:35.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:35 gibba044 bash[25485]: cluster 2021-03-10T20:25:33.927955+0000 mgr.gibba044.wflcwh (mgr.34466) 951 : cluster [DBG] pgmap v528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:36.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:35 gibba023 bash[30844]: cluster 2021-03-10T20:25:33.927955+0000 mgr.gibba044.wflcwh (mgr.34466) 951 : cluster [DBG] pgmap v528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:36.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:35 gibba023 bash[31815]: cluster 2021-03-10T20:25:33.927955+0000 mgr.gibba044.wflcwh (mgr.34466) 951 : cluster [DBG] pgmap v528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:38.172 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:37 gibba044 bash[25485]: cluster 2021-03-10T20:25:35.929597+0000 mgr.gibba044.wflcwh (mgr.34466) 952 : cluster [DBG] pgmap v529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:38.173 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:37 gibba023 bash[30844]: cluster 2021-03-10T20:25:35.929597+0000 mgr.gibba044.wflcwh (mgr.34466) 952 : cluster [DBG] pgmap v529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:38.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:37 gibba023 bash[31815]: cluster 2021-03-10T20:25:35.929597+0000 mgr.gibba044.wflcwh (mgr.34466) 952 : cluster [DBG] pgmap v529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:39.002 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:25:39.173 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:38 gibba023 bash[30844]: cluster 2021-03-10T20:25:37.931264+0000 mgr.gibba044.wflcwh (mgr.34466) 953 : cluster [DBG] pgmap v530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:39.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:38 gibba023 bash[30844]: cephadm 2021-03-10T20:25:38.176550+0000 mgr.gibba044.wflcwh (mgr.34466) 954 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:25:39.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:38 gibba023 bash[31815]: cluster 2021-03-10T20:25:37.931264+0000 mgr.gibba044.wflcwh (mgr.34466) 953 : cluster [DBG] pgmap v530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:39.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:38 gibba023 bash[31815]: cephadm 2021-03-10T20:25:38.176550+0000 mgr.gibba044.wflcwh (mgr.34466) 954 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:25:39.232 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:25:39.233 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (16m) 2m ago 22m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:25:39.233 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (22m) 106s ago 22m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:25:39.233 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (17m) 106s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:25:39.233 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (17m) 106s ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:25:39.234 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (16m) 2m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:25:39.234 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (16m) 2m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:25:39.234 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (15m) 106s ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:25:39.234 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (16m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:25:39.235 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (22m) 2m ago 22m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:25:39.235 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (22m) 106s ago 22m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:25:39.235 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (15m) 2m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:25:39.235 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (14m) 2m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:25:39.236 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (14m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:25:39.236 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (13m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:25:39.237 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (13m) 106s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:25:39.237 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (12m) 106s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:25:39.237 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (12m) 106s ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:25:39.238 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (11m) 106s ago 22m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:25:39.238 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (21m) 106s ago 22m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:25:39.239 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 2m ago 20m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:25:39.239 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 106s ago 20m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:25:39.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:38 gibba044 bash[25485]: cluster 2021-03-10T20:25:37.931264+0000 mgr.gibba044.wflcwh (mgr.34466) 953 : cluster [DBG] pgmap v530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:39.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:38 gibba044 bash[25485]: cephadm 2021-03-10T20:25:38.176550+0000 mgr.gibba044.wflcwh (mgr.34466) 954 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:25:39.485 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:25:39.485 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:25:39.486 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:25:39.486 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:25:39.486 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:25:39.486 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:25:39.486 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:25:39.487 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:25:39.487 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:25:39.487 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:25:39.487 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:25:39.488 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:25:39.488 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:25:39.488 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:25:39.488 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:25:40.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:39 gibba023 bash[30844]: audit 2021-03-10T20:25:38.997967+0000 mgr.gibba044.wflcwh (mgr.34466) 955 : audit [DBG] from='client.54685 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:25:40.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:39 gibba023 bash[30844]: audit 2021-03-10T20:25:39.224090+0000 mgr.gibba044.wflcwh (mgr.34466) 956 : audit [DBG] from='client.54691 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:25:40.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:39 gibba023 bash[30844]: audit 2021-03-10T20:25:39.485933+0000 mon.c (mon.1) 29 : audit [DBG] from='client.? 172.21.2.123:0/1579908343' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:40.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:39 gibba023 bash[31815]: audit 2021-03-10T20:25:38.997967+0000 mgr.gibba044.wflcwh (mgr.34466) 955 : audit [DBG] from='client.54685 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:25:40.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:39 gibba023 bash[31815]: audit 2021-03-10T20:25:39.224090+0000 mgr.gibba044.wflcwh (mgr.34466) 956 : audit [DBG] from='client.54691 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:25:40.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:39 gibba023 bash[31815]: audit 2021-03-10T20:25:39.485933+0000 mon.c (mon.1) 29 : audit [DBG] from='client.? 172.21.2.123:0/1579908343' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:40.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:39 gibba044 bash[25485]: audit 2021-03-10T20:25:38.997967+0000 mgr.gibba044.wflcwh (mgr.34466) 955 : audit [DBG] from='client.54685 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:25:40.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:39 gibba044 bash[25485]: audit 2021-03-10T20:25:39.224090+0000 mgr.gibba044.wflcwh (mgr.34466) 956 : audit [DBG] from='client.54691 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:25:40.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:39 gibba044 bash[25485]: audit 2021-03-10T20:25:39.485933+0000 mon.c (mon.1) 29 : audit [DBG] from='client.? 172.21.2.123:0/1579908343' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:41.173 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:40 gibba023 bash[30844]: cluster 2021-03-10T20:25:39.932508+0000 mgr.gibba044.wflcwh (mgr.34466) 957 : cluster [DBG] pgmap v531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:41.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:40 gibba023 bash[31815]: cluster 2021-03-10T20:25:39.932508+0000 mgr.gibba044.wflcwh (mgr.34466) 957 : cluster [DBG] pgmap v531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:41.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:40 gibba044 bash[25485]: cluster 2021-03-10T20:25:39.932508+0000 mgr.gibba044.wflcwh (mgr.34466) 957 : cluster [DBG] pgmap v531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:43.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:43 gibba044 bash[25485]: cluster 2021-03-10T20:25:41.933319+0000 mgr.gibba044.wflcwh (mgr.34466) 958 : cluster [DBG] pgmap v532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:43.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:43 gibba023 bash[30844]: cluster 2021-03-10T20:25:41.933319+0000 mgr.gibba044.wflcwh (mgr.34466) 958 : cluster [DBG] pgmap v532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:43.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:43 gibba023 bash[31815]: cluster 2021-03-10T20:25:41.933319+0000 mgr.gibba044.wflcwh (mgr.34466) 958 : cluster [DBG] pgmap v532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:45.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:45 gibba044 bash[25485]: cluster 2021-03-10T20:25:43.934176+0000 mgr.gibba044.wflcwh (mgr.34466) 959 : cluster [DBG] pgmap v533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:45.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:45 gibba023 bash[30844]: cluster 2021-03-10T20:25:43.934176+0000 mgr.gibba044.wflcwh (mgr.34466) 959 : cluster [DBG] pgmap v533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:45.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:45 gibba023 bash[31815]: cluster 2021-03-10T20:25:43.934176+0000 mgr.gibba044.wflcwh (mgr.34466) 959 : cluster [DBG] pgmap v533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:47.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:47 gibba044 bash[25485]: cluster 2021-03-10T20:25:45.935848+0000 mgr.gibba044.wflcwh (mgr.34466) 960 : cluster [DBG] pgmap v534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:47.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:47 gibba023 bash[30844]: cluster 2021-03-10T20:25:45.935848+0000 mgr.gibba044.wflcwh (mgr.34466) 960 : cluster [DBG] pgmap v534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:47.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:47 gibba023 bash[31815]: cluster 2021-03-10T20:25:45.935848+0000 mgr.gibba044.wflcwh (mgr.34466) 960 : cluster [DBG] pgmap v534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:49.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:49 gibba044 bash[25485]: cluster 2021-03-10T20:25:47.936687+0000 mgr.gibba044.wflcwh (mgr.34466) 961 : cluster [DBG] pgmap v535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:49.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:49 gibba023 bash[30844]: cluster 2021-03-10T20:25:47.936687+0000 mgr.gibba044.wflcwh (mgr.34466) 961 : cluster [DBG] pgmap v535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:49.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:49 gibba023 bash[31815]: cluster 2021-03-10T20:25:47.936687+0000 mgr.gibba044.wflcwh (mgr.34466) 961 : cluster [DBG] pgmap v535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:51.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:51 gibba044 bash[25485]: cluster 2021-03-10T20:25:49.937814+0000 mgr.gibba044.wflcwh (mgr.34466) 962 : cluster [DBG] pgmap v536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:51.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:51 gibba023 bash[30844]: cluster 2021-03-10T20:25:49.937814+0000 mgr.gibba044.wflcwh (mgr.34466) 962 : cluster [DBG] pgmap v536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:51.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:51 gibba023 bash[31815]: cluster 2021-03-10T20:25:49.937814+0000 mgr.gibba044.wflcwh (mgr.34466) 962 : cluster [DBG] pgmap v536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:53.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:53 gibba044 bash[25485]: cluster 2021-03-10T20:25:51.939359+0000 mgr.gibba044.wflcwh (mgr.34466) 963 : cluster [DBG] pgmap v537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:53.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:53 gibba044 bash[25485]: audit 2021-03-10T20:25:53.415136+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:25:53.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:53 gibba044 bash[25485]: audit 2021-03-10T20:25:53.418583+0000 mon.a (mon.0) 804 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:25:53.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:53 gibba044 bash[25485]: audit 2021-03-10T20:25:53.419934+0000 mon.a (mon.0) 805 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:53.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:53 gibba044 bash[25485]: audit 2021-03-10T20:25:53.421235+0000 mon.a (mon.0) 806 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:53.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:53 gibba044 bash[25485]: audit 2021-03-10T20:25:53.422448+0000 mon.a (mon.0) 807 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:53.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:53 gibba044 bash[25485]: audit 2021-03-10T20:25:53.425341+0000 mon.a (mon.0) 808 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:53.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:53 gibba044 bash[25485]: audit 2021-03-10T20:25:53.426928+0000 mon.a (mon.0) 809 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:53.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:53 gibba023 bash[30844]: cluster 2021-03-10T20:25:51.939359+0000 mgr.gibba044.wflcwh (mgr.34466) 963 : cluster [DBG] pgmap v537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:53.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:53 gibba023 bash[30844]: audit 2021-03-10T20:25:53.415136+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:25:53.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:53 gibba023 bash[30844]: audit 2021-03-10T20:25:53.418583+0000 mon.a (mon.0) 804 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:25:53.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:53 gibba023 bash[30844]: audit 2021-03-10T20:25:53.419934+0000 mon.a (mon.0) 805 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:53.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:53 gibba023 bash[30844]: audit 2021-03-10T20:25:53.421235+0000 mon.a (mon.0) 806 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:53.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:53 gibba023 bash[30844]: audit 2021-03-10T20:25:53.422448+0000 mon.a (mon.0) 807 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:53.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:53 gibba023 bash[30844]: audit 2021-03-10T20:25:53.425341+0000 mon.a (mon.0) 808 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:53.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:53 gibba023 bash[30844]: audit 2021-03-10T20:25:53.426928+0000 mon.a (mon.0) 809 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:53.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:53 gibba023 bash[31815]: cluster 2021-03-10T20:25:51.939359+0000 mgr.gibba044.wflcwh (mgr.34466) 963 : cluster [DBG] pgmap v537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:53.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:53 gibba023 bash[31815]: audit 2021-03-10T20:25:53.415136+0000 mon.a (mon.0) 803 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:25:53.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:53 gibba023 bash[31815]: audit 2021-03-10T20:25:53.418583+0000 mon.a (mon.0) 804 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:25:53.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:53 gibba023 bash[31815]: audit 2021-03-10T20:25:53.419934+0000 mon.a (mon.0) 805 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:53.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:53 gibba023 bash[31815]: audit 2021-03-10T20:25:53.421235+0000 mon.a (mon.0) 806 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:53.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:53 gibba023 bash[31815]: audit 2021-03-10T20:25:53.422448+0000 mon.a (mon.0) 807 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:53.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:53 gibba023 bash[31815]: audit 2021-03-10T20:25:53.425341+0000 mon.a (mon.0) 808 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:53.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:53 gibba023 bash[31815]: audit 2021-03-10T20:25:53.426928+0000 mon.a (mon.0) 809 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:25:54.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:54 gibba044 bash[25485]: cephadm 2021-03-10T20:25:53.193271+0000 mgr.gibba044.wflcwh (mgr.34466) 964 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:25:54.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:54 gibba044 bash[25485]: cephadm 2021-03-10T20:25:53.194817+0000 mgr.gibba044.wflcwh (mgr.34466) 965 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:25:54.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:54 gibba044 bash[25485]: cephadm 2021-03-10T20:25:53.421407+0000 mgr.gibba044.wflcwh (mgr.34466) 966 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:25:54.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:54 gibba044 bash[25485]: cephadm 2021-03-10T20:25:53.422928+0000 mgr.gibba044.wflcwh (mgr.34466) 967 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:25:54.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:54 gibba044 bash[25485]: cephadm 2021-03-10T20:25:53.424391+0000 mgr.gibba044.wflcwh (mgr.34466) 968 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:25:54.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:54 gibba044 bash[25485]: cephadm 2021-03-10T20:25:53.424428+0000 mgr.gibba044.wflcwh (mgr.34466) 969 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:25:54.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:54 gibba044 bash[25485]: cephadm 2021-03-10T20:25:53.425593+0000 mgr.gibba044.wflcwh (mgr.34466) 970 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:25:54.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:54 gibba044 bash[25485]: cephadm 2021-03-10T20:25:53.425631+0000 mgr.gibba044.wflcwh (mgr.34466) 971 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:25:54.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:54 gibba044 bash[25485]: cephadm 2021-03-10T20:25:53.426849+0000 mgr.gibba044.wflcwh (mgr.34466) 972 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:25:54.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:54 gibba044 bash[25485]: cephadm 2021-03-10T20:25:53.428300+0000 mgr.gibba044.wflcwh (mgr.34466) 973 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:25:54.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:54 gibba044 bash[25485]: cephadm 2021-03-10T20:25:53.428335+0000 mgr.gibba044.wflcwh (mgr.34466) 974 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:25:54.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:54 gibba044 bash[25485]: cephadm 2021-03-10T20:25:53.429647+0000 mgr.gibba044.wflcwh (mgr.34466) 975 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:25:54.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:54 gibba044 bash[25485]: cephadm 2021-03-10T20:25:53.429961+0000 mgr.gibba044.wflcwh (mgr.34466) 976 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:25:54.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:54 gibba044 bash[25485]: cephadm 2021-03-10T20:25:53.431513+0000 mgr.gibba044.wflcwh (mgr.34466) 977 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:25:54.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:54 gibba044 bash[25485]: cephadm 2021-03-10T20:25:53.431552+0000 mgr.gibba044.wflcwh (mgr.34466) 978 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:25:54.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:54 gibba044 bash[25485]: cephadm 2021-03-10T20:25:53.431735+0000 mgr.gibba044.wflcwh (mgr.34466) 979 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:25:54.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[30844]: cephadm 2021-03-10T20:25:53.193271+0000 mgr.gibba044.wflcwh (mgr.34466) 964 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:25:54.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[30844]: cephadm 2021-03-10T20:25:53.194817+0000 mgr.gibba044.wflcwh (mgr.34466) 965 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:25:54.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[30844]: cephadm 2021-03-10T20:25:53.421407+0000 mgr.gibba044.wflcwh (mgr.34466) 966 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:25:54.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[30844]: cephadm 2021-03-10T20:25:53.422928+0000 mgr.gibba044.wflcwh (mgr.34466) 967 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:25:54.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[30844]: cephadm 2021-03-10T20:25:53.424391+0000 mgr.gibba044.wflcwh (mgr.34466) 968 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:25:54.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[30844]: cephadm 2021-03-10T20:25:53.424428+0000 mgr.gibba044.wflcwh (mgr.34466) 969 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:25:54.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[30844]: cephadm 2021-03-10T20:25:53.425593+0000 mgr.gibba044.wflcwh (mgr.34466) 970 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:25:54.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[30844]: cephadm 2021-03-10T20:25:53.425631+0000 mgr.gibba044.wflcwh (mgr.34466) 971 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:25:54.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[30844]: cephadm 2021-03-10T20:25:53.426849+0000 mgr.gibba044.wflcwh (mgr.34466) 972 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:25:54.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[30844]: cephadm 2021-03-10T20:25:53.428300+0000 mgr.gibba044.wflcwh (mgr.34466) 973 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:25:54.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[30844]: cephadm 2021-03-10T20:25:53.428335+0000 mgr.gibba044.wflcwh (mgr.34466) 974 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:25:54.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[30844]: cephadm 2021-03-10T20:25:53.429647+0000 mgr.gibba044.wflcwh (mgr.34466) 975 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:25:54.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[30844]: cephadm 2021-03-10T20:25:53.429961+0000 mgr.gibba044.wflcwh (mgr.34466) 976 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:25:54.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[30844]: cephadm 2021-03-10T20:25:53.431513+0000 mgr.gibba044.wflcwh (mgr.34466) 977 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:25:54.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[30844]: cephadm 2021-03-10T20:25:53.431552+0000 mgr.gibba044.wflcwh (mgr.34466) 978 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:25:54.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[30844]: cephadm 2021-03-10T20:25:53.431735+0000 mgr.gibba044.wflcwh (mgr.34466) 979 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:25:54.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[31815]: cephadm 2021-03-10T20:25:53.193271+0000 mgr.gibba044.wflcwh (mgr.34466) 964 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:25:54.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[31815]: cephadm 2021-03-10T20:25:53.194817+0000 mgr.gibba044.wflcwh (mgr.34466) 965 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:25:54.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[31815]: cephadm 2021-03-10T20:25:53.421407+0000 mgr.gibba044.wflcwh (mgr.34466) 966 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:25:54.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[31815]: cephadm 2021-03-10T20:25:53.422928+0000 mgr.gibba044.wflcwh (mgr.34466) 967 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:25:54.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[31815]: cephadm 2021-03-10T20:25:53.424391+0000 mgr.gibba044.wflcwh (mgr.34466) 968 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:25:54.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[31815]: cephadm 2021-03-10T20:25:53.424428+0000 mgr.gibba044.wflcwh (mgr.34466) 969 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:25:54.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[31815]: cephadm 2021-03-10T20:25:53.425593+0000 mgr.gibba044.wflcwh (mgr.34466) 970 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:25:54.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[31815]: cephadm 2021-03-10T20:25:53.425631+0000 mgr.gibba044.wflcwh (mgr.34466) 971 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:25:54.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[31815]: cephadm 2021-03-10T20:25:53.426849+0000 mgr.gibba044.wflcwh (mgr.34466) 972 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:25:54.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[31815]: cephadm 2021-03-10T20:25:53.428300+0000 mgr.gibba044.wflcwh (mgr.34466) 973 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:25:54.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[31815]: cephadm 2021-03-10T20:25:53.428335+0000 mgr.gibba044.wflcwh (mgr.34466) 974 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:25:54.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[31815]: cephadm 2021-03-10T20:25:53.429647+0000 mgr.gibba044.wflcwh (mgr.34466) 975 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:25:54.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[31815]: cephadm 2021-03-10T20:25:53.429961+0000 mgr.gibba044.wflcwh (mgr.34466) 976 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:25:54.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[31815]: cephadm 2021-03-10T20:25:53.431513+0000 mgr.gibba044.wflcwh (mgr.34466) 977 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:25:54.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[31815]: cephadm 2021-03-10T20:25:53.431552+0000 mgr.gibba044.wflcwh (mgr.34466) 978 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:25:54.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:54 gibba023 bash[31815]: cephadm 2021-03-10T20:25:53.431735+0000 mgr.gibba044.wflcwh (mgr.34466) 979 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:25:55.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:55 gibba044 bash[25485]: cluster 2021-03-10T20:25:53.940370+0000 mgr.gibba044.wflcwh (mgr.34466) 980 : cluster [DBG] pgmap v538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:55.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:55 gibba023 bash[30844]: cluster 2021-03-10T20:25:53.940370+0000 mgr.gibba044.wflcwh (mgr.34466) 980 : cluster [DBG] pgmap v538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:55.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:55 gibba023 bash[31815]: cluster 2021-03-10T20:25:53.940370+0000 mgr.gibba044.wflcwh (mgr.34466) 980 : cluster [DBG] pgmap v538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:57.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:57 gibba044 bash[25485]: cluster 2021-03-10T20:25:55.942087+0000 mgr.gibba044.wflcwh (mgr.34466) 981 : cluster [DBG] pgmap v539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:57.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:57 gibba023 bash[30844]: cluster 2021-03-10T20:25:55.942087+0000 mgr.gibba044.wflcwh (mgr.34466) 981 : cluster [DBG] pgmap v539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:57.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:57 gibba023 bash[31815]: cluster 2021-03-10T20:25:55.942087+0000 mgr.gibba044.wflcwh (mgr.34466) 981 : cluster [DBG] pgmap v539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:59.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:25:59 gibba044 bash[25485]: cluster 2021-03-10T20:25:57.943807+0000 mgr.gibba044.wflcwh (mgr.34466) 982 : cluster [DBG] pgmap v540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:59.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:25:59 gibba023 bash[30844]: cluster 2021-03-10T20:25:57.943807+0000 mgr.gibba044.wflcwh (mgr.34466) 982 : cluster [DBG] pgmap v540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:25:59.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:25:59 gibba023 bash[31815]: cluster 2021-03-10T20:25:57.943807+0000 mgr.gibba044.wflcwh (mgr.34466) 982 : cluster [DBG] pgmap v540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:01.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:01 gibba023 bash[30844]: cluster 2021-03-10T20:25:59.944462+0000 mgr.gibba044.wflcwh (mgr.34466) 983 : cluster [DBG] pgmap v541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:01.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:01 gibba023 bash[31815]: cluster 2021-03-10T20:25:59.944462+0000 mgr.gibba044.wflcwh (mgr.34466) 983 : cluster [DBG] pgmap v541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:01.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:01 gibba044 bash[25485]: cluster 2021-03-10T20:25:59.944462+0000 mgr.gibba044.wflcwh (mgr.34466) 983 : cluster [DBG] pgmap v541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:03.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:03 gibba023 bash[30844]: cluster 2021-03-10T20:26:01.945979+0000 mgr.gibba044.wflcwh (mgr.34466) 984 : cluster [DBG] pgmap v542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:03.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:03 gibba023 bash[31815]: cluster 2021-03-10T20:26:01.945979+0000 mgr.gibba044.wflcwh (mgr.34466) 984 : cluster [DBG] pgmap v542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:03.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:03 gibba044 bash[25485]: cluster 2021-03-10T20:26:01.945979+0000 mgr.gibba044.wflcwh (mgr.34466) 984 : cluster [DBG] pgmap v542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:05.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:05 gibba023 bash[30844]: cluster 2021-03-10T20:26:03.947187+0000 mgr.gibba044.wflcwh (mgr.34466) 985 : cluster [DBG] pgmap v543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:05.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:05 gibba023 bash[31815]: cluster 2021-03-10T20:26:03.947187+0000 mgr.gibba044.wflcwh (mgr.34466) 985 : cluster [DBG] pgmap v543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:05.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:05 gibba044 bash[25485]: cluster 2021-03-10T20:26:03.947187+0000 mgr.gibba044.wflcwh (mgr.34466) 985 : cluster [DBG] pgmap v543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:07.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:07 gibba023 bash[30844]: cluster 2021-03-10T20:26:05.947799+0000 mgr.gibba044.wflcwh (mgr.34466) 986 : cluster [DBG] pgmap v544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:07.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:07 gibba023 bash[31815]: cluster 2021-03-10T20:26:05.947799+0000 mgr.gibba044.wflcwh (mgr.34466) 986 : cluster [DBG] pgmap v544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:07.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:07 gibba044 bash[25485]: cluster 2021-03-10T20:26:05.947799+0000 mgr.gibba044.wflcwh (mgr.34466) 986 : cluster [DBG] pgmap v544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:09.732 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:26:09.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:09 gibba023 bash[30844]: cluster 2021-03-10T20:26:07.949405+0000 mgr.gibba044.wflcwh (mgr.34466) 987 : cluster [DBG] pgmap v545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:09.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:09 gibba023 bash[30844]: cephadm 2021-03-10T20:26:08.447841+0000 mgr.gibba044.wflcwh (mgr.34466) 988 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:26:09.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:09 gibba023 bash[31815]: cluster 2021-03-10T20:26:07.949405+0000 mgr.gibba044.wflcwh (mgr.34466) 987 : cluster [DBG] pgmap v545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:09.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:09 gibba023 bash[31815]: cephadm 2021-03-10T20:26:08.447841+0000 mgr.gibba044.wflcwh (mgr.34466) 988 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:26:09.987 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:26:09.987 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (17m) 3m ago 22m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:26:09.987 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (22m) 2m ago 22m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:26:09.988 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (17m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:26:09.988 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (17m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:26:09.988 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (17m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:26:09.988 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (16m) 3m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:26:09.988 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (16m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:26:09.989 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (16m) 3m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:26:09.989 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (22m) 3m ago 23m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:26:09.989 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (22m) 2m ago 23m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:26:09.989 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (15m) 3m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:26:09.990 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (15m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:26:09.990 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (14m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:26:09.990 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (14m) 3m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:26:09.990 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (13m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:26:09.991 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (13m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:26:09.991 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (12m) 2m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:26:09.991 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (12m) 2m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:26:09.991 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (22m) 2m ago 23m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:26:09.991 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 3m ago 20m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:26:09.992 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 2m ago 20m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:26:09.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:09 gibba044 bash[25485]: cluster 2021-03-10T20:26:07.949405+0000 mgr.gibba044.wflcwh (mgr.34466) 987 : cluster [DBG] pgmap v545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:09.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:09 gibba044 bash[25485]: cephadm 2021-03-10T20:26:08.447841+0000 mgr.gibba044.wflcwh (mgr.34466) 988 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:26:10.240 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:26:10.240 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:26:10.240 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:26:10.241 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:26:10.241 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:26:10.241 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:26:10.241 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:26:10.241 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:26:10.242 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:26:10.242 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:26:10.242 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:26:10.242 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:26:10.243 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:26:10.243 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:26:10.243 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:26:10.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:10 gibba023 bash[30844]: audit 2021-03-10T20:26:09.727672+0000 mgr.gibba044.wflcwh (mgr.34466) 989 : audit [DBG] from='client.54703 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:26:10.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:10 gibba023 bash[30844]: audit 2021-03-10T20:26:10.240921+0000 mon.c (mon.1) 30 : audit [DBG] from='client.? 172.21.2.123:0/800667777' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:10.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:10 gibba023 bash[31815]: audit 2021-03-10T20:26:09.727672+0000 mgr.gibba044.wflcwh (mgr.34466) 989 : audit [DBG] from='client.54703 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:26:10.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:10 gibba023 bash[31815]: audit 2021-03-10T20:26:10.240921+0000 mon.c (mon.1) 30 : audit [DBG] from='client.? 172.21.2.123:0/800667777' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:10.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:10 gibba044 bash[25485]: audit 2021-03-10T20:26:09.727672+0000 mgr.gibba044.wflcwh (mgr.34466) 989 : audit [DBG] from='client.54703 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:26:10.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:10 gibba044 bash[25485]: audit 2021-03-10T20:26:10.240921+0000 mon.c (mon.1) 30 : audit [DBG] from='client.? 172.21.2.123:0/800667777' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:11.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:11 gibba023 bash[30844]: audit 2021-03-10T20:26:09.950790+0000 mgr.gibba044.wflcwh (mgr.34466) 990 : audit [DBG] from='client.44730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:26:11.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:11 gibba023 bash[30844]: cluster 2021-03-10T20:26:09.951837+0000 mgr.gibba044.wflcwh (mgr.34466) 991 : cluster [DBG] pgmap v546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:11.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:11 gibba023 bash[31815]: audit 2021-03-10T20:26:09.950790+0000 mgr.gibba044.wflcwh (mgr.34466) 990 : audit [DBG] from='client.44730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:26:11.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:11 gibba023 bash[31815]: cluster 2021-03-10T20:26:09.951837+0000 mgr.gibba044.wflcwh (mgr.34466) 991 : cluster [DBG] pgmap v546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:11.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:11 gibba044 bash[25485]: audit 2021-03-10T20:26:09.950790+0000 mgr.gibba044.wflcwh (mgr.34466) 990 : audit [DBG] from='client.44730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:26:11.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:11 gibba044 bash[25485]: cluster 2021-03-10T20:26:09.951837+0000 mgr.gibba044.wflcwh (mgr.34466) 991 : cluster [DBG] pgmap v546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:13.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:13 gibba023 bash[30844]: cluster 2021-03-10T20:26:11.953277+0000 mgr.gibba044.wflcwh (mgr.34466) 992 : cluster [DBG] pgmap v547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:13.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:13 gibba023 bash[31815]: cluster 2021-03-10T20:26:11.953277+0000 mgr.gibba044.wflcwh (mgr.34466) 992 : cluster [DBG] pgmap v547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:13.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:13 gibba044 bash[25485]: cluster 2021-03-10T20:26:11.953277+0000 mgr.gibba044.wflcwh (mgr.34466) 992 : cluster [DBG] pgmap v547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:15.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:15 gibba023 bash[30844]: cluster 2021-03-10T20:26:13.954202+0000 mgr.gibba044.wflcwh (mgr.34466) 993 : cluster [DBG] pgmap v548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:15.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:15 gibba023 bash[31815]: cluster 2021-03-10T20:26:13.954202+0000 mgr.gibba044.wflcwh (mgr.34466) 993 : cluster [DBG] pgmap v548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:15.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:15 gibba044 bash[25485]: cluster 2021-03-10T20:26:13.954202+0000 mgr.gibba044.wflcwh (mgr.34466) 993 : cluster [DBG] pgmap v548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:17.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:17 gibba023 bash[30844]: cluster 2021-03-10T20:26:15.955884+0000 mgr.gibba044.wflcwh (mgr.34466) 994 : cluster [DBG] pgmap v549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:17.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:17 gibba023 bash[31815]: cluster 2021-03-10T20:26:15.955884+0000 mgr.gibba044.wflcwh (mgr.34466) 994 : cluster [DBG] pgmap v549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:17.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:17 gibba044 bash[25485]: cluster 2021-03-10T20:26:15.955884+0000 mgr.gibba044.wflcwh (mgr.34466) 994 : cluster [DBG] pgmap v549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:19.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:19 gibba023 bash[30844]: cluster 2021-03-10T20:26:17.956489+0000 mgr.gibba044.wflcwh (mgr.34466) 995 : cluster [DBG] pgmap v550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:19.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:19 gibba023 bash[31815]: cluster 2021-03-10T20:26:17.956489+0000 mgr.gibba044.wflcwh (mgr.34466) 995 : cluster [DBG] pgmap v550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:19.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:19 gibba044 bash[25485]: cluster 2021-03-10T20:26:17.956489+0000 mgr.gibba044.wflcwh (mgr.34466) 995 : cluster [DBG] pgmap v550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:21.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:21 gibba023 bash[30844]: cluster 2021-03-10T20:26:19.957609+0000 mgr.gibba044.wflcwh (mgr.34466) 996 : cluster [DBG] pgmap v551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:21.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:21 gibba023 bash[31815]: cluster 2021-03-10T20:26:19.957609+0000 mgr.gibba044.wflcwh (mgr.34466) 996 : cluster [DBG] pgmap v551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:21.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:21 gibba044 bash[25485]: cluster 2021-03-10T20:26:19.957609+0000 mgr.gibba044.wflcwh (mgr.34466) 996 : cluster [DBG] pgmap v551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:23.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:23 gibba044 bash[25485]: cluster 2021-03-10T20:26:21.959266+0000 mgr.gibba044.wflcwh (mgr.34466) 997 : cluster [DBG] pgmap v552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:23.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:23 gibba023 bash[30844]: cluster 2021-03-10T20:26:21.959266+0000 mgr.gibba044.wflcwh (mgr.34466) 997 : cluster [DBG] pgmap v552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:23.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:23 gibba023 bash[31815]: cluster 2021-03-10T20:26:21.959266+0000 mgr.gibba044.wflcwh (mgr.34466) 997 : cluster [DBG] pgmap v552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:24.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:24 gibba023 bash[30844]: cephadm 2021-03-10T20:26:23.463895+0000 mgr.gibba044.wflcwh (mgr.34466) 998 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:26:24.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:24 gibba023 bash[31815]: cephadm 2021-03-10T20:26:23.463895+0000 mgr.gibba044.wflcwh (mgr.34466) 998 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:26:24.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:24 gibba044 bash[25485]: cephadm 2021-03-10T20:26:23.463895+0000 mgr.gibba044.wflcwh (mgr.34466) 998 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:26:25.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:25 gibba023 bash[30844]: cluster 2021-03-10T20:26:23.960399+0000 mgr.gibba044.wflcwh (mgr.34466) 999 : cluster [DBG] pgmap v553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:25.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:25 gibba023 bash[31815]: cluster 2021-03-10T20:26:23.960399+0000 mgr.gibba044.wflcwh (mgr.34466) 999 : cluster [DBG] pgmap v553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:25.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:25 gibba044 bash[25485]: cluster 2021-03-10T20:26:23.960399+0000 mgr.gibba044.wflcwh (mgr.34466) 999 : cluster [DBG] pgmap v553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:27.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:27 gibba023 bash[30844]: cluster 2021-03-10T20:26:25.962083+0000 mgr.gibba044.wflcwh (mgr.34466) 1000 : cluster [DBG] pgmap v554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:27.945 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:27 gibba023 bash[30844]: audit 2021-03-10T20:26:27.086380+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:26:27.946 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:27 gibba023 bash[30844]: audit 2021-03-10T20:26:27.087161+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:26:27.946 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:27 gibba023 bash[30844]: audit 2021-03-10T20:26:27.087870+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:26:27.946 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:27 gibba023 bash[30844]: audit 2021-03-10T20:26:27.088576+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T20:26:27.947 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:27 gibba023 bash[30844]: audit 2021-03-10T20:26:27.134330+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:26:27.947 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:27 gibba023 bash[30844]: audit 2021-03-10T20:26:27.139531+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:26:27.947 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:27 gibba023 bash[31815]: cluster 2021-03-10T20:26:25.962083+0000 mgr.gibba044.wflcwh (mgr.34466) 1000 : cluster [DBG] pgmap v554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:27.948 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:27 gibba023 bash[31815]: audit 2021-03-10T20:26:27.086380+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:26:27.948 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:27 gibba023 bash[31815]: audit 2021-03-10T20:26:27.087161+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:26:27.948 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:27 gibba023 bash[31815]: audit 2021-03-10T20:26:27.087870+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:26:27.948 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:27 gibba023 bash[31815]: audit 2021-03-10T20:26:27.088576+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T20:26:27.948 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:27 gibba023 bash[31815]: audit 2021-03-10T20:26:27.134330+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:26:27.949 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:27 gibba023 bash[31815]: audit 2021-03-10T20:26:27.139531+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:26:27.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:27 gibba044 bash[25485]: cluster 2021-03-10T20:26:25.962083+0000 mgr.gibba044.wflcwh (mgr.34466) 1000 : cluster [DBG] pgmap v554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:27.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:27 gibba044 bash[25485]: audit 2021-03-10T20:26:27.086380+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:26:27.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:27 gibba044 bash[25485]: audit 2021-03-10T20:26:27.087161+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:26:27.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:27 gibba044 bash[25485]: audit 2021-03-10T20:26:27.087870+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:26:27.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:27 gibba044 bash[25485]: audit 2021-03-10T20:26:27.088576+0000 mon.a (mon.0) 813 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T20:26:27.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:27 gibba044 bash[25485]: audit 2021-03-10T20:26:27.134330+0000 mon.a (mon.0) 814 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:26:27.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:27 gibba044 bash[25485]: audit 2021-03-10T20:26:27.139531+0000 mon.a (mon.0) 815 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:26:29.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:29 gibba023 bash[30844]: cluster 2021-03-10T20:26:27.963455+0000 mgr.gibba044.wflcwh (mgr.34466) 1001 : cluster [DBG] pgmap v555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:29.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:29 gibba023 bash[31815]: cluster 2021-03-10T20:26:27.963455+0000 mgr.gibba044.wflcwh (mgr.34466) 1001 : cluster [DBG] pgmap v555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:29.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:29 gibba044 bash[25485]: cluster 2021-03-10T20:26:27.963455+0000 mgr.gibba044.wflcwh (mgr.34466) 1001 : cluster [DBG] pgmap v555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:31.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:31 gibba023 bash[30844]: cluster 2021-03-10T20:26:29.964662+0000 mgr.gibba044.wflcwh (mgr.34466) 1002 : cluster [DBG] pgmap v556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:31.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:31 gibba023 bash[31815]: cluster 2021-03-10T20:26:29.964662+0000 mgr.gibba044.wflcwh (mgr.34466) 1002 : cluster [DBG] pgmap v556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:31.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:31 gibba044 bash[25485]: cluster 2021-03-10T20:26:29.964662+0000 mgr.gibba044.wflcwh (mgr.34466) 1002 : cluster [DBG] pgmap v556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:33.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:33 gibba023 bash[30844]: cluster 2021-03-10T20:26:31.966121+0000 mgr.gibba044.wflcwh (mgr.34466) 1003 : cluster [DBG] pgmap v557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:33.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:33 gibba023 bash[31815]: cluster 2021-03-10T20:26:31.966121+0000 mgr.gibba044.wflcwh (mgr.34466) 1003 : cluster [DBG] pgmap v557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:33.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:33 gibba044 bash[25485]: cluster 2021-03-10T20:26:31.966121+0000 mgr.gibba044.wflcwh (mgr.34466) 1003 : cluster [DBG] pgmap v557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:35.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:35 gibba023 bash[30844]: cluster 2021-03-10T20:26:33.967281+0000 mgr.gibba044.wflcwh (mgr.34466) 1004 : cluster [DBG] pgmap v558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:35.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:35 gibba023 bash[31815]: cluster 2021-03-10T20:26:33.967281+0000 mgr.gibba044.wflcwh (mgr.34466) 1004 : cluster [DBG] pgmap v558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:35.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:35 gibba044 bash[25485]: cluster 2021-03-10T20:26:33.967281+0000 mgr.gibba044.wflcwh (mgr.34466) 1004 : cluster [DBG] pgmap v558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:37.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:37 gibba023 bash[30844]: cluster 2021-03-10T20:26:35.968282+0000 mgr.gibba044.wflcwh (mgr.34466) 1005 : cluster [DBG] pgmap v559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:37.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:37 gibba023 bash[31815]: cluster 2021-03-10T20:26:35.968282+0000 mgr.gibba044.wflcwh (mgr.34466) 1005 : cluster [DBG] pgmap v559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:37.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:37 gibba044 bash[25485]: cluster 2021-03-10T20:26:35.968282+0000 mgr.gibba044.wflcwh (mgr.34466) 1005 : cluster [DBG] pgmap v559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:39.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:39 gibba023 bash[30844]: cluster 2021-03-10T20:26:37.969711+0000 mgr.gibba044.wflcwh (mgr.34466) 1006 : cluster [DBG] pgmap v560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:39.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:39 gibba023 bash[30844]: cephadm 2021-03-10T20:26:38.479880+0000 mgr.gibba044.wflcwh (mgr.34466) 1007 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:26:39.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:39 gibba023 bash[31815]: cluster 2021-03-10T20:26:37.969711+0000 mgr.gibba044.wflcwh (mgr.34466) 1006 : cluster [DBG] pgmap v560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:39.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:39 gibba023 bash[31815]: cephadm 2021-03-10T20:26:38.479880+0000 mgr.gibba044.wflcwh (mgr.34466) 1007 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:26:39.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:39 gibba044 bash[25485]: cluster 2021-03-10T20:26:37.969711+0000 mgr.gibba044.wflcwh (mgr.34466) 1006 : cluster [DBG] pgmap v560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:39.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:39 gibba044 bash[25485]: cephadm 2021-03-10T20:26:38.479880+0000 mgr.gibba044.wflcwh (mgr.34466) 1007 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:26:40.484 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:26:40.707 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:26:40.707 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (17m) 3m ago 23m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:26:40.707 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (23m) 2m ago 23m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:26:40.707 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (18m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:26:40.708 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (18m) 2m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:26:40.708 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (17m) 3m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:26:40.708 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (17m) 3m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:26:40.708 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (16m) 2m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:26:40.709 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (17m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:26:40.709 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (23m) 3m ago 23m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:26:40.709 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (23m) 2m ago 23m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:26:40.709 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (16m) 3m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:26:40.709 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (15m) 3m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:26:40.710 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (15m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:26:40.710 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (14m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:26:40.710 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (14m) 2m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:26:40.710 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (13m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:26:40.711 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (13m) 2m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:26:40.711 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (13m) 2m ago 23m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:26:40.711 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (22m) 2m ago 23m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:26:40.711 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 3m ago 21m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:26:40.711 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 2m ago 21m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:26:40.956 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:26:40.957 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:26:40.957 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:26:40.957 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:26:40.958 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:26:40.958 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:26:40.958 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:26:40.958 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:26:40.958 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:26:40.959 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:26:40.959 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:26:40.959 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:26:40.959 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:26:40.960 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:26:40.960 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:26:41.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:41 gibba044 bash[25485]: cluster 2021-03-10T20:26:39.971074+0000 mgr.gibba044.wflcwh (mgr.34466) 1008 : cluster [DBG] pgmap v561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:41.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:41 gibba044 bash[25485]: audit 2021-03-10T20:26:40.478918+0000 mgr.gibba044.wflcwh (mgr.34466) 1009 : audit [DBG] from='client.54721 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:26:41.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:41 gibba044 bash[25485]: audit 2021-03-10T20:26:40.702512+0000 mgr.gibba044.wflcwh (mgr.34466) 1010 : audit [DBG] from='client.54727 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:26:41.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:41 gibba044 bash[25485]: audit 2021-03-10T20:26:40.957764+0000 mon.c (mon.1) 31 : audit [DBG] from='client.? 172.21.2.123:0/2996425701' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:42.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:41 gibba023 bash[30844]: cluster 2021-03-10T20:26:39.971074+0000 mgr.gibba044.wflcwh (mgr.34466) 1008 : cluster [DBG] pgmap v561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:42.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:41 gibba023 bash[30844]: audit 2021-03-10T20:26:40.478918+0000 mgr.gibba044.wflcwh (mgr.34466) 1009 : audit [DBG] from='client.54721 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:26:42.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:41 gibba023 bash[30844]: audit 2021-03-10T20:26:40.702512+0000 mgr.gibba044.wflcwh (mgr.34466) 1010 : audit [DBG] from='client.54727 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:26:42.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:41 gibba023 bash[30844]: audit 2021-03-10T20:26:40.957764+0000 mon.c (mon.1) 31 : audit [DBG] from='client.? 172.21.2.123:0/2996425701' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:42.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:41 gibba023 bash[31815]: cluster 2021-03-10T20:26:39.971074+0000 mgr.gibba044.wflcwh (mgr.34466) 1008 : cluster [DBG] pgmap v561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:42.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:41 gibba023 bash[31815]: audit 2021-03-10T20:26:40.478918+0000 mgr.gibba044.wflcwh (mgr.34466) 1009 : audit [DBG] from='client.54721 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:26:42.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:41 gibba023 bash[31815]: audit 2021-03-10T20:26:40.702512+0000 mgr.gibba044.wflcwh (mgr.34466) 1010 : audit [DBG] from='client.54727 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:26:42.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:41 gibba023 bash[31815]: audit 2021-03-10T20:26:40.957764+0000 mon.c (mon.1) 31 : audit [DBG] from='client.? 172.21.2.123:0/2996425701' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:43.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:43 gibba044 bash[25485]: cluster 2021-03-10T20:26:41.972723+0000 mgr.gibba044.wflcwh (mgr.34466) 1011 : cluster [DBG] pgmap v562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:44.173 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:43 gibba023 bash[30844]: cluster 2021-03-10T20:26:41.972723+0000 mgr.gibba044.wflcwh (mgr.34466) 1011 : cluster [DBG] pgmap v562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:44.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:43 gibba023 bash[31815]: cluster 2021-03-10T20:26:41.972723+0000 mgr.gibba044.wflcwh (mgr.34466) 1011 : cluster [DBG] pgmap v562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:45.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:45 gibba044 bash[25485]: cluster 2021-03-10T20:26:43.973809+0000 mgr.gibba044.wflcwh (mgr.34466) 1012 : cluster [DBG] pgmap v563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:46.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:45 gibba023 bash[30844]: cluster 2021-03-10T20:26:43.973809+0000 mgr.gibba044.wflcwh (mgr.34466) 1012 : cluster [DBG] pgmap v563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:46.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:45 gibba023 bash[31815]: cluster 2021-03-10T20:26:43.973809+0000 mgr.gibba044.wflcwh (mgr.34466) 1012 : cluster [DBG] pgmap v563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:47.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:47 gibba044 bash[25485]: cluster 2021-03-10T20:26:45.975429+0000 mgr.gibba044.wflcwh (mgr.34466) 1013 : cluster [DBG] pgmap v564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:48.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:47 gibba023 bash[30844]: cluster 2021-03-10T20:26:45.975429+0000 mgr.gibba044.wflcwh (mgr.34466) 1013 : cluster [DBG] pgmap v564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:48.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:47 gibba023 bash[31815]: cluster 2021-03-10T20:26:45.975429+0000 mgr.gibba044.wflcwh (mgr.34466) 1013 : cluster [DBG] pgmap v564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:49.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:49 gibba044 bash[25485]: cluster 2021-03-10T20:26:47.976729+0000 mgr.gibba044.wflcwh (mgr.34466) 1014 : cluster [DBG] pgmap v565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:50.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:49 gibba023 bash[30844]: cluster 2021-03-10T20:26:47.976729+0000 mgr.gibba044.wflcwh (mgr.34466) 1014 : cluster [DBG] pgmap v565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:50.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:49 gibba023 bash[31815]: cluster 2021-03-10T20:26:47.976729+0000 mgr.gibba044.wflcwh (mgr.34466) 1014 : cluster [DBG] pgmap v565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:51.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:51 gibba044 bash[25485]: cluster 2021-03-10T20:26:49.977919+0000 mgr.gibba044.wflcwh (mgr.34466) 1015 : cluster [DBG] pgmap v566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:52.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:51 gibba023 bash[30844]: cluster 2021-03-10T20:26:49.977919+0000 mgr.gibba044.wflcwh (mgr.34466) 1015 : cluster [DBG] pgmap v566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:52.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:51 gibba023 bash[31815]: cluster 2021-03-10T20:26:49.977919+0000 mgr.gibba044.wflcwh (mgr.34466) 1015 : cluster [DBG] pgmap v566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:53.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:53 gibba044 bash[25485]: cluster 2021-03-10T20:26:51.979569+0000 mgr.gibba044.wflcwh (mgr.34466) 1016 : cluster [DBG] pgmap v567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:53.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:53 gibba044 bash[25485]: audit 2021-03-10T20:26:53.725077+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:26:54.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:53 gibba023 bash[30844]: cluster 2021-03-10T20:26:51.979569+0000 mgr.gibba044.wflcwh (mgr.34466) 1016 : cluster [DBG] pgmap v567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:54.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:53 gibba023 bash[30844]: audit 2021-03-10T20:26:53.725077+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:26:54.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:53 gibba023 bash[31815]: cluster 2021-03-10T20:26:51.979569+0000 mgr.gibba044.wflcwh (mgr.34466) 1016 : cluster [DBG] pgmap v567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:54.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:53 gibba023 bash[31815]: audit 2021-03-10T20:26:53.725077+0000 mon.a (mon.0) 816 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:26:54.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:54 gibba044 bash[25485]: cephadm 2021-03-10T20:26:53.493442+0000 mgr.gibba044.wflcwh (mgr.34466) 1017 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:26:54.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:54 gibba044 bash[25485]: cephadm 2021-03-10T20:26:53.494962+0000 mgr.gibba044.wflcwh (mgr.34466) 1018 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:26:54.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:54 gibba044 bash[25485]: audit 2021-03-10T20:26:53.729648+0000 mon.a (mon.0) 817 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:26:54.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:54 gibba044 bash[25485]: audit 2021-03-10T20:26:53.731040+0000 mon.a (mon.0) 818 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:54.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:54 gibba044 bash[25485]: cephadm 2021-03-10T20:26:53.731800+0000 mgr.gibba044.wflcwh (mgr.34466) 1019 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:26:54.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:54 gibba044 bash[25485]: audit 2021-03-10T20:26:53.732493+0000 mon.a (mon.0) 819 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:55.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:54 gibba044 bash[25485]: cephadm 2021-03-10T20:26:53.733620+0000 mgr.gibba044.wflcwh (mgr.34466) 1020 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:26:55.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:54 gibba044 bash[25485]: audit 2021-03-10T20:26:53.733790+0000 mon.a (mon.0) 820 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:55.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:54 gibba044 bash[25485]: cephadm 2021-03-10T20:26:53.734982+0000 mgr.gibba044.wflcwh (mgr.34466) 1021 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:26:55.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:54 gibba044 bash[25485]: cephadm 2021-03-10T20:26:53.735074+0000 mgr.gibba044.wflcwh (mgr.34466) 1022 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:26:55.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:54 gibba044 bash[25485]: cephadm 2021-03-10T20:26:53.736419+0000 mgr.gibba044.wflcwh (mgr.34466) 1023 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:26:55.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:54 gibba044 bash[25485]: cephadm 2021-03-10T20:26:53.736487+0000 mgr.gibba044.wflcwh (mgr.34466) 1024 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:26:55.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:54 gibba044 bash[25485]: audit 2021-03-10T20:26:53.736541+0000 mon.a (mon.0) 821 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:55.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:54 gibba044 bash[25485]: cephadm 2021-03-10T20:26:53.737723+0000 mgr.gibba044.wflcwh (mgr.34466) 1025 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:26:55.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:54 gibba044 bash[25485]: audit 2021-03-10T20:26:53.738359+0000 mon.a (mon.0) 822 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:55.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:54 gibba044 bash[25485]: cephadm 2021-03-10T20:26:53.739051+0000 mgr.gibba044.wflcwh (mgr.34466) 1026 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:26:55.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:54 gibba044 bash[25485]: cephadm 2021-03-10T20:26:53.739090+0000 mgr.gibba044.wflcwh (mgr.34466) 1027 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:26:55.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:54 gibba044 bash[25485]: cephadm 2021-03-10T20:26:53.740722+0000 mgr.gibba044.wflcwh (mgr.34466) 1028 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:26:55.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:54 gibba044 bash[25485]: cephadm 2021-03-10T20:26:53.741042+0000 mgr.gibba044.wflcwh (mgr.34466) 1029 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:26:55.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:54 gibba044 bash[25485]: cephadm 2021-03-10T20:26:53.742637+0000 mgr.gibba044.wflcwh (mgr.34466) 1030 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:26:55.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:54 gibba044 bash[25485]: cephadm 2021-03-10T20:26:53.742674+0000 mgr.gibba044.wflcwh (mgr.34466) 1031 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:26:55.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:54 gibba044 bash[25485]: cephadm 2021-03-10T20:26:53.742805+0000 mgr.gibba044.wflcwh (mgr.34466) 1032 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:26:55.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[30844]: cephadm 2021-03-10T20:26:53.493442+0000 mgr.gibba044.wflcwh (mgr.34466) 1017 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:26:55.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[30844]: cephadm 2021-03-10T20:26:53.494962+0000 mgr.gibba044.wflcwh (mgr.34466) 1018 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:26:55.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[30844]: audit 2021-03-10T20:26:53.729648+0000 mon.a (mon.0) 817 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:26:55.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[30844]: audit 2021-03-10T20:26:53.731040+0000 mon.a (mon.0) 818 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:55.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[30844]: cephadm 2021-03-10T20:26:53.731800+0000 mgr.gibba044.wflcwh (mgr.34466) 1019 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:26:55.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[30844]: audit 2021-03-10T20:26:53.732493+0000 mon.a (mon.0) 819 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:55.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[30844]: cephadm 2021-03-10T20:26:53.733620+0000 mgr.gibba044.wflcwh (mgr.34466) 1020 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:26:55.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[30844]: audit 2021-03-10T20:26:53.733790+0000 mon.a (mon.0) 820 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:55.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[30844]: cephadm 2021-03-10T20:26:53.734982+0000 mgr.gibba044.wflcwh (mgr.34466) 1021 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:26:55.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[30844]: cephadm 2021-03-10T20:26:53.735074+0000 mgr.gibba044.wflcwh (mgr.34466) 1022 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:26:55.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[30844]: cephadm 2021-03-10T20:26:53.736419+0000 mgr.gibba044.wflcwh (mgr.34466) 1023 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:26:55.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[30844]: cephadm 2021-03-10T20:26:53.736487+0000 mgr.gibba044.wflcwh (mgr.34466) 1024 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:26:55.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[30844]: audit 2021-03-10T20:26:53.736541+0000 mon.a (mon.0) 821 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:55.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[30844]: cephadm 2021-03-10T20:26:53.737723+0000 mgr.gibba044.wflcwh (mgr.34466) 1025 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:26:55.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[30844]: audit 2021-03-10T20:26:53.738359+0000 mon.a (mon.0) 822 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:55.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[30844]: cephadm 2021-03-10T20:26:53.739051+0000 mgr.gibba044.wflcwh (mgr.34466) 1026 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:26:55.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[30844]: cephadm 2021-03-10T20:26:53.739090+0000 mgr.gibba044.wflcwh (mgr.34466) 1027 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:26:55.183 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[30844]: cephadm 2021-03-10T20:26:53.740722+0000 mgr.gibba044.wflcwh (mgr.34466) 1028 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:26:55.183 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[30844]: cephadm 2021-03-10T20:26:53.741042+0000 mgr.gibba044.wflcwh (mgr.34466) 1029 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:26:55.184 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[30844]: cephadm 2021-03-10T20:26:53.742637+0000 mgr.gibba044.wflcwh (mgr.34466) 1030 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:26:55.188 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[30844]: cephadm 2021-03-10T20:26:53.742674+0000 mgr.gibba044.wflcwh (mgr.34466) 1031 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:26:55.189 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[30844]: cephadm 2021-03-10T20:26:53.742805+0000 mgr.gibba044.wflcwh (mgr.34466) 1032 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:26:55.190 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[31815]: cephadm 2021-03-10T20:26:53.493442+0000 mgr.gibba044.wflcwh (mgr.34466) 1017 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:26:55.191 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[31815]: cephadm 2021-03-10T20:26:53.494962+0000 mgr.gibba044.wflcwh (mgr.34466) 1018 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:26:55.191 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[31815]: audit 2021-03-10T20:26:53.729648+0000 mon.a (mon.0) 817 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:26:55.192 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[31815]: audit 2021-03-10T20:26:53.731040+0000 mon.a (mon.0) 818 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:55.193 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[31815]: cephadm 2021-03-10T20:26:53.731800+0000 mgr.gibba044.wflcwh (mgr.34466) 1019 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:26:55.193 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[31815]: audit 2021-03-10T20:26:53.732493+0000 mon.a (mon.0) 819 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:55.194 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[31815]: cephadm 2021-03-10T20:26:53.733620+0000 mgr.gibba044.wflcwh (mgr.34466) 1020 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:26:55.194 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[31815]: audit 2021-03-10T20:26:53.733790+0000 mon.a (mon.0) 820 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:55.195 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[31815]: cephadm 2021-03-10T20:26:53.734982+0000 mgr.gibba044.wflcwh (mgr.34466) 1021 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:26:55.195 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[31815]: cephadm 2021-03-10T20:26:53.735074+0000 mgr.gibba044.wflcwh (mgr.34466) 1022 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:26:55.195 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[31815]: cephadm 2021-03-10T20:26:53.736419+0000 mgr.gibba044.wflcwh (mgr.34466) 1023 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:26:55.196 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[31815]: cephadm 2021-03-10T20:26:53.736487+0000 mgr.gibba044.wflcwh (mgr.34466) 1024 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:26:55.196 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[31815]: audit 2021-03-10T20:26:53.736541+0000 mon.a (mon.0) 821 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:55.197 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[31815]: cephadm 2021-03-10T20:26:53.737723+0000 mgr.gibba044.wflcwh (mgr.34466) 1025 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:26:55.197 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[31815]: audit 2021-03-10T20:26:53.738359+0000 mon.a (mon.0) 822 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:26:55.198 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[31815]: cephadm 2021-03-10T20:26:53.739051+0000 mgr.gibba044.wflcwh (mgr.34466) 1026 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:26:55.198 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[31815]: cephadm 2021-03-10T20:26:53.739090+0000 mgr.gibba044.wflcwh (mgr.34466) 1027 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:26:55.198 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[31815]: cephadm 2021-03-10T20:26:53.740722+0000 mgr.gibba044.wflcwh (mgr.34466) 1028 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:26:55.199 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[31815]: cephadm 2021-03-10T20:26:53.741042+0000 mgr.gibba044.wflcwh (mgr.34466) 1029 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:26:55.199 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[31815]: cephadm 2021-03-10T20:26:53.742637+0000 mgr.gibba044.wflcwh (mgr.34466) 1030 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:26:55.200 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[31815]: cephadm 2021-03-10T20:26:53.742674+0000 mgr.gibba044.wflcwh (mgr.34466) 1031 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:26:55.200 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:54 gibba023 bash[31815]: cephadm 2021-03-10T20:26:53.742805+0000 mgr.gibba044.wflcwh (mgr.34466) 1032 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:26:56.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:55 gibba023 bash[30844]: cluster 2021-03-10T20:26:53.981416+0000 mgr.gibba044.wflcwh (mgr.34466) 1033 : cluster [DBG] pgmap v568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:56.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:55 gibba023 bash[31815]: cluster 2021-03-10T20:26:53.981416+0000 mgr.gibba044.wflcwh (mgr.34466) 1033 : cluster [DBG] pgmap v568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:56.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:55 gibba044 bash[25485]: cluster 2021-03-10T20:26:53.981416+0000 mgr.gibba044.wflcwh (mgr.34466) 1033 : cluster [DBG] pgmap v568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:58.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:57 gibba023 bash[30844]: cluster 2021-03-10T20:26:55.983003+0000 mgr.gibba044.wflcwh (mgr.34466) 1034 : cluster [DBG] pgmap v569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:58.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:57 gibba023 bash[31815]: cluster 2021-03-10T20:26:55.983003+0000 mgr.gibba044.wflcwh (mgr.34466) 1034 : cluster [DBG] pgmap v569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:26:58.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:57 gibba044 bash[25485]: cluster 2021-03-10T20:26:55.983003+0000 mgr.gibba044.wflcwh (mgr.34466) 1034 : cluster [DBG] pgmap v569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:00.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:26:59 gibba023 bash[30844]: cluster 2021-03-10T20:26:57.984874+0000 mgr.gibba044.wflcwh (mgr.34466) 1035 : cluster [DBG] pgmap v570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:00.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:26:59 gibba023 bash[31815]: cluster 2021-03-10T20:26:57.984874+0000 mgr.gibba044.wflcwh (mgr.34466) 1035 : cluster [DBG] pgmap v570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:00.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:26:59 gibba044 bash[25485]: cluster 2021-03-10T20:26:57.984874+0000 mgr.gibba044.wflcwh (mgr.34466) 1035 : cluster [DBG] pgmap v570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:02.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:01 gibba023 bash[30844]: cluster 2021-03-10T20:26:59.986247+0000 mgr.gibba044.wflcwh (mgr.34466) 1036 : cluster [DBG] pgmap v571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:02.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:01 gibba023 bash[31815]: cluster 2021-03-10T20:26:59.986247+0000 mgr.gibba044.wflcwh (mgr.34466) 1036 : cluster [DBG] pgmap v571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:02.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:01 gibba044 bash[25485]: cluster 2021-03-10T20:26:59.986247+0000 mgr.gibba044.wflcwh (mgr.34466) 1036 : cluster [DBG] pgmap v571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:04.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:03 gibba023 bash[30844]: cluster 2021-03-10T20:27:01.987931+0000 mgr.gibba044.wflcwh (mgr.34466) 1037 : cluster [DBG] pgmap v572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:04.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:03 gibba023 bash[31815]: cluster 2021-03-10T20:27:01.987931+0000 mgr.gibba044.wflcwh (mgr.34466) 1037 : cluster [DBG] pgmap v572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:04.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:03 gibba044 bash[25485]: cluster 2021-03-10T20:27:01.987931+0000 mgr.gibba044.wflcwh (mgr.34466) 1037 : cluster [DBG] pgmap v572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:05.173 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:04 gibba023 bash[30844]: cluster 2021-03-10T20:27:03.989215+0000 mgr.gibba044.wflcwh (mgr.34466) 1038 : cluster [DBG] pgmap v573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:05.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:04 gibba023 bash[31815]: cluster 2021-03-10T20:27:03.989215+0000 mgr.gibba044.wflcwh (mgr.34466) 1038 : cluster [DBG] pgmap v573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:05.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:04 gibba044 bash[25485]: cluster 2021-03-10T20:27:03.989215+0000 mgr.gibba044.wflcwh (mgr.34466) 1038 : cluster [DBG] pgmap v573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:07.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:07 gibba044 bash[25485]: cluster 2021-03-10T20:27:05.990774+0000 mgr.gibba044.wflcwh (mgr.34466) 1039 : cluster [DBG] pgmap v574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:07.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:07 gibba023 bash[30844]: cluster 2021-03-10T20:27:05.990774+0000 mgr.gibba044.wflcwh (mgr.34466) 1039 : cluster [DBG] pgmap v574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:07.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:07 gibba023 bash[31815]: cluster 2021-03-10T20:27:05.990774+0000 mgr.gibba044.wflcwh (mgr.34466) 1039 : cluster [DBG] pgmap v574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:09.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:09 gibba044 bash[25485]: cluster 2021-03-10T20:27:07.992612+0000 mgr.gibba044.wflcwh (mgr.34466) 1040 : cluster [DBG] pgmap v575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:09.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:09 gibba044 bash[25485]: cephadm 2021-03-10T20:27:08.758834+0000 mgr.gibba044.wflcwh (mgr.34466) 1041 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:27:09.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:09 gibba023 bash[30844]: cluster 2021-03-10T20:27:07.992612+0000 mgr.gibba044.wflcwh (mgr.34466) 1040 : cluster [DBG] pgmap v575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:09.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:09 gibba023 bash[30844]: cephadm 2021-03-10T20:27:08.758834+0000 mgr.gibba044.wflcwh (mgr.34466) 1041 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:27:09.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:09 gibba023 bash[31815]: cluster 2021-03-10T20:27:07.992612+0000 mgr.gibba044.wflcwh (mgr.34466) 1040 : cluster [DBG] pgmap v575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:09.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:09 gibba023 bash[31815]: cephadm 2021-03-10T20:27:08.758834+0000 mgr.gibba044.wflcwh (mgr.34466) 1041 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:27:11.200 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:27:11.427 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:27:11.427 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (18m) 4m ago 23m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:27:11.428 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (23m) 3m ago 23m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:27:11.428 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (18m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:27:11.428 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (18m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:27:11.428 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (18m) 4m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:27:11.429 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (17m) 4m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:27:11.429 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (17m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:27:11.429 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (17m) 4m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:27:11.429 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (24m) 4m ago 24m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:27:11.429 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (24m) 3m ago 24m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:27:11.430 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (16m) 4m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:27:11.430 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (16m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:27:11.430 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (15m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:27:11.430 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (15m) 4m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:27:11.430 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (14m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:27:11.431 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (14m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:27:11.431 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (13m) 3m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:27:11.431 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (13m) 3m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:27:11.431 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (23m) 3m ago 24m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:27:11.432 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 4m ago 21m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:27:11.432 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 3m ago 21m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:27:11.680 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:27:11.680 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:27:11.681 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:27:11.681 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:27:11.681 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:27:11.681 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:27:11.682 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:27:11.682 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:27:11.682 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:27:11.682 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:27:11.683 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:27:11.683 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:27:11.683 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:27:11.683 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:27:11.683 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:27:11.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:11 gibba044 bash[25485]: cluster 2021-03-10T20:27:09.993863+0000 mgr.gibba044.wflcwh (mgr.34466) 1042 : cluster [DBG] pgmap v576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:11.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:11 gibba023 bash[30844]: cluster 2021-03-10T20:27:09.993863+0000 mgr.gibba044.wflcwh (mgr.34466) 1042 : cluster [DBG] pgmap v576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:11.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:11 gibba023 bash[31815]: cluster 2021-03-10T20:27:09.993863+0000 mgr.gibba044.wflcwh (mgr.34466) 1042 : cluster [DBG] pgmap v576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:12.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:12 gibba044 bash[25485]: audit 2021-03-10T20:27:11.194730+0000 mgr.gibba044.wflcwh (mgr.34466) 1043 : audit [DBG] from='client.44760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:27:12.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:12 gibba044 bash[25485]: audit 2021-03-10T20:27:11.418331+0000 mgr.gibba044.wflcwh (mgr.34466) 1044 : audit [DBG] from='client.54745 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:27:12.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:12 gibba044 bash[25485]: audit 2021-03-10T20:27:11.681224+0000 mon.c (mon.1) 32 : audit [DBG] from='client.? 172.21.2.123:0/3107888209' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:12.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:12 gibba023 bash[30844]: audit 2021-03-10T20:27:11.194730+0000 mgr.gibba044.wflcwh (mgr.34466) 1043 : audit [DBG] from='client.44760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:27:12.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:12 gibba023 bash[30844]: audit 2021-03-10T20:27:11.418331+0000 mgr.gibba044.wflcwh (mgr.34466) 1044 : audit [DBG] from='client.54745 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:27:12.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:12 gibba023 bash[30844]: audit 2021-03-10T20:27:11.681224+0000 mon.c (mon.1) 32 : audit [DBG] from='client.? 172.21.2.123:0/3107888209' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:12.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:12 gibba023 bash[31815]: audit 2021-03-10T20:27:11.194730+0000 mgr.gibba044.wflcwh (mgr.34466) 1043 : audit [DBG] from='client.44760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:27:12.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:12 gibba023 bash[31815]: audit 2021-03-10T20:27:11.418331+0000 mgr.gibba044.wflcwh (mgr.34466) 1044 : audit [DBG] from='client.54745 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:27:12.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:12 gibba023 bash[31815]: audit 2021-03-10T20:27:11.681224+0000 mon.c (mon.1) 32 : audit [DBG] from='client.? 172.21.2.123:0/3107888209' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:13.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:13 gibba044 bash[25485]: cluster 2021-03-10T20:27:11.995375+0000 mgr.gibba044.wflcwh (mgr.34466) 1045 : cluster [DBG] pgmap v577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:13.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:13 gibba023 bash[30844]: cluster 2021-03-10T20:27:11.995375+0000 mgr.gibba044.wflcwh (mgr.34466) 1045 : cluster [DBG] pgmap v577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:13.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:13 gibba023 bash[31815]: cluster 2021-03-10T20:27:11.995375+0000 mgr.gibba044.wflcwh (mgr.34466) 1045 : cluster [DBG] pgmap v577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:15.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:15 gibba023 bash[30844]: cluster 2021-03-10T20:27:13.996509+0000 mgr.gibba044.wflcwh (mgr.34466) 1046 : cluster [DBG] pgmap v578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:15.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:15 gibba023 bash[31815]: cluster 2021-03-10T20:27:13.996509+0000 mgr.gibba044.wflcwh (mgr.34466) 1046 : cluster [DBG] pgmap v578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:15.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:15 gibba044 bash[25485]: cluster 2021-03-10T20:27:13.996509+0000 mgr.gibba044.wflcwh (mgr.34466) 1046 : cluster [DBG] pgmap v578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:17.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:17 gibba023 bash[30844]: cluster 2021-03-10T20:27:15.998097+0000 mgr.gibba044.wflcwh (mgr.34466) 1047 : cluster [DBG] pgmap v579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:17.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:17 gibba023 bash[31815]: cluster 2021-03-10T20:27:15.998097+0000 mgr.gibba044.wflcwh (mgr.34466) 1047 : cluster [DBG] pgmap v579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:17.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:17 gibba044 bash[25485]: cluster 2021-03-10T20:27:15.998097+0000 mgr.gibba044.wflcwh (mgr.34466) 1047 : cluster [DBG] pgmap v579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:19.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:19 gibba023 bash[30844]: cluster 2021-03-10T20:27:17.999759+0000 mgr.gibba044.wflcwh (mgr.34466) 1048 : cluster [DBG] pgmap v580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:19.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:19 gibba023 bash[31815]: cluster 2021-03-10T20:27:17.999759+0000 mgr.gibba044.wflcwh (mgr.34466) 1048 : cluster [DBG] pgmap v580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:19.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:19 gibba044 bash[25485]: cluster 2021-03-10T20:27:17.999759+0000 mgr.gibba044.wflcwh (mgr.34466) 1048 : cluster [DBG] pgmap v580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:21.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:21 gibba023 bash[30844]: cluster 2021-03-10T20:27:20.001020+0000 mgr.gibba044.wflcwh (mgr.34466) 1049 : cluster [DBG] pgmap v581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:21.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:21 gibba023 bash[31815]: cluster 2021-03-10T20:27:20.001020+0000 mgr.gibba044.wflcwh (mgr.34466) 1049 : cluster [DBG] pgmap v581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:21.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:21 gibba044 bash[25485]: cluster 2021-03-10T20:27:20.001020+0000 mgr.gibba044.wflcwh (mgr.34466) 1049 : cluster [DBG] pgmap v581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:23.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:23 gibba023 bash[30844]: cluster 2021-03-10T20:27:22.002654+0000 mgr.gibba044.wflcwh (mgr.34466) 1050 : cluster [DBG] pgmap v582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:23.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:23 gibba023 bash[31815]: cluster 2021-03-10T20:27:22.002654+0000 mgr.gibba044.wflcwh (mgr.34466) 1050 : cluster [DBG] pgmap v582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:23.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:23 gibba044 bash[25485]: cluster 2021-03-10T20:27:22.002654+0000 mgr.gibba044.wflcwh (mgr.34466) 1050 : cluster [DBG] pgmap v582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:24.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:24 gibba023 bash[30844]: cephadm 2021-03-10T20:27:23.762394+0000 mgr.gibba044.wflcwh (mgr.34466) 1051 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:27:24.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:24 gibba023 bash[31815]: cephadm 2021-03-10T20:27:23.762394+0000 mgr.gibba044.wflcwh (mgr.34466) 1051 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:27:24.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:24 gibba044 bash[25485]: cephadm 2021-03-10T20:27:23.762394+0000 mgr.gibba044.wflcwh (mgr.34466) 1051 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:27:25.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:25 gibba023 bash[30844]: cluster 2021-03-10T20:27:24.004307+0000 mgr.gibba044.wflcwh (mgr.34466) 1052 : cluster [DBG] pgmap v583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:25.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:25 gibba023 bash[31815]: cluster 2021-03-10T20:27:24.004307+0000 mgr.gibba044.wflcwh (mgr.34466) 1052 : cluster [DBG] pgmap v583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:25.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:25 gibba044 bash[25485]: cluster 2021-03-10T20:27:24.004307+0000 mgr.gibba044.wflcwh (mgr.34466) 1052 : cluster [DBG] pgmap v583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:27.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:27 gibba023 bash[30844]: cluster 2021-03-10T20:27:26.005780+0000 mgr.gibba044.wflcwh (mgr.34466) 1053 : cluster [DBG] pgmap v584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:27.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:27 gibba023 bash[30844]: audit 2021-03-10T20:27:27.096957+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:27:27.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:27 gibba023 bash[30844]: audit 2021-03-10T20:27:27.098050+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:27:27.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:27 gibba023 bash[30844]: audit 2021-03-10T20:27:27.099147+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T20:27:27.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:27 gibba023 bash[30844]: audit 2021-03-10T20:27:27.100202+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:27:27.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:27 gibba023 bash[30844]: audit 2021-03-10T20:27:27.139900+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:27:27.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:27 gibba023 bash[30844]: audit 2021-03-10T20:27:27.143000+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:27:27.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:27 gibba023 bash[31815]: cluster 2021-03-10T20:27:26.005780+0000 mgr.gibba044.wflcwh (mgr.34466) 1053 : cluster [DBG] pgmap v584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:27.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:27 gibba023 bash[31815]: audit 2021-03-10T20:27:27.096957+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:27:27.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:27 gibba023 bash[31815]: audit 2021-03-10T20:27:27.098050+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:27:27.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:27 gibba023 bash[31815]: audit 2021-03-10T20:27:27.099147+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T20:27:27.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:27 gibba023 bash[31815]: audit 2021-03-10T20:27:27.100202+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:27:27.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:27 gibba023 bash[31815]: audit 2021-03-10T20:27:27.139900+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:27:27.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:27 gibba023 bash[31815]: audit 2021-03-10T20:27:27.143000+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:27:27.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:27 gibba044 bash[25485]: cluster 2021-03-10T20:27:26.005780+0000 mgr.gibba044.wflcwh (mgr.34466) 1053 : cluster [DBG] pgmap v584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:27.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:27 gibba044 bash[25485]: audit 2021-03-10T20:27:27.096957+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:27:27.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:27 gibba044 bash[25485]: audit 2021-03-10T20:27:27.098050+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:27:27.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:27 gibba044 bash[25485]: audit 2021-03-10T20:27:27.099147+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 5]}]: dispatch 2021-03-10T20:27:27.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:27 gibba044 bash[25485]: audit 2021-03-10T20:27:27.100202+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:27:27.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:27 gibba044 bash[25485]: audit 2021-03-10T20:27:27.139900+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:27:28.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:27 gibba044 bash[25485]: audit 2021-03-10T20:27:27.143000+0000 mon.a (mon.0) 828 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:27:29.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:29 gibba023 bash[30844]: cluster 2021-03-10T20:27:28.007342+0000 mgr.gibba044.wflcwh (mgr.34466) 1054 : cluster [DBG] pgmap v585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:29.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:29 gibba023 bash[31815]: cluster 2021-03-10T20:27:28.007342+0000 mgr.gibba044.wflcwh (mgr.34466) 1054 : cluster [DBG] pgmap v585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:29.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:29 gibba044 bash[25485]: cluster 2021-03-10T20:27:28.007342+0000 mgr.gibba044.wflcwh (mgr.34466) 1054 : cluster [DBG] pgmap v585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:31.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:31 gibba023 bash[30844]: cluster 2021-03-10T20:27:30.007851+0000 mgr.gibba044.wflcwh (mgr.34466) 1055 : cluster [DBG] pgmap v586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:31.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:31 gibba023 bash[31815]: cluster 2021-03-10T20:27:30.007851+0000 mgr.gibba044.wflcwh (mgr.34466) 1055 : cluster [DBG] pgmap v586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:31.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:31 gibba044 bash[25485]: cluster 2021-03-10T20:27:30.007851+0000 mgr.gibba044.wflcwh (mgr.34466) 1055 : cluster [DBG] pgmap v586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:33.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:33 gibba023 bash[30844]: cluster 2021-03-10T20:27:32.009067+0000 mgr.gibba044.wflcwh (mgr.34466) 1056 : cluster [DBG] pgmap v587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:33.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:33 gibba023 bash[31815]: cluster 2021-03-10T20:27:32.009067+0000 mgr.gibba044.wflcwh (mgr.34466) 1056 : cluster [DBG] pgmap v587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:33.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:33 gibba044 bash[25485]: cluster 2021-03-10T20:27:32.009067+0000 mgr.gibba044.wflcwh (mgr.34466) 1056 : cluster [DBG] pgmap v587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:35.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:35 gibba023 bash[30844]: cluster 2021-03-10T20:27:34.010743+0000 mgr.gibba044.wflcwh (mgr.34466) 1057 : cluster [DBG] pgmap v588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:35.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:35 gibba023 bash[31815]: cluster 2021-03-10T20:27:34.010743+0000 mgr.gibba044.wflcwh (mgr.34466) 1057 : cluster [DBG] pgmap v588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:35.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:35 gibba044 bash[25485]: cluster 2021-03-10T20:27:34.010743+0000 mgr.gibba044.wflcwh (mgr.34466) 1057 : cluster [DBG] pgmap v588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:37.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:37 gibba023 bash[30844]: cluster 2021-03-10T20:27:36.012402+0000 mgr.gibba044.wflcwh (mgr.34466) 1058 : cluster [DBG] pgmap v589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:37.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:37 gibba023 bash[31815]: cluster 2021-03-10T20:27:36.012402+0000 mgr.gibba044.wflcwh (mgr.34466) 1058 : cluster [DBG] pgmap v589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:37.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:37 gibba044 bash[25485]: cluster 2021-03-10T20:27:36.012402+0000 mgr.gibba044.wflcwh (mgr.34466) 1058 : cluster [DBG] pgmap v589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:39.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:39 gibba023 bash[30844]: cluster 2021-03-10T20:27:38.013832+0000 mgr.gibba044.wflcwh (mgr.34466) 1059 : cluster [DBG] pgmap v590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:39.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:39 gibba023 bash[30844]: cephadm 2021-03-10T20:27:38.778335+0000 mgr.gibba044.wflcwh (mgr.34466) 1060 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:27:39.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:39 gibba023 bash[31815]: cluster 2021-03-10T20:27:38.013832+0000 mgr.gibba044.wflcwh (mgr.34466) 1059 : cluster [DBG] pgmap v590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:39.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:39 gibba023 bash[31815]: cephadm 2021-03-10T20:27:38.778335+0000 mgr.gibba044.wflcwh (mgr.34466) 1060 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:27:39.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:39 gibba044 bash[25485]: cluster 2021-03-10T20:27:38.013832+0000 mgr.gibba044.wflcwh (mgr.34466) 1059 : cluster [DBG] pgmap v590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:39.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:39 gibba044 bash[25485]: cephadm 2021-03-10T20:27:38.778335+0000 mgr.gibba044.wflcwh (mgr.34466) 1060 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:27:41.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:41 gibba023 bash[30844]: cluster 2021-03-10T20:27:40.015042+0000 mgr.gibba044.wflcwh (mgr.34466) 1061 : cluster [DBG] pgmap v591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:41.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:41 gibba023 bash[31815]: cluster 2021-03-10T20:27:40.015042+0000 mgr.gibba044.wflcwh (mgr.34466) 1061 : cluster [DBG] pgmap v591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:41.924 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:27:41.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:41 gibba044 bash[25485]: cluster 2021-03-10T20:27:40.015042+0000 mgr.gibba044.wflcwh (mgr.34466) 1061 : cluster [DBG] pgmap v591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:42.155 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:27:42.155 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (18m) 4m ago 24m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:27:42.156 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (24m) 3m ago 24m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:27:42.156 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (19m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:27:42.156 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (19m) 3m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:27:42.157 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (18m) 4m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:27:42.157 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (18m) 4m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:27:42.157 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (17m) 3m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:27:42.157 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (18m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:27:42.158 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (24m) 4m ago 24m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:27:42.158 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (24m) 3m ago 24m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:27:42.158 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (17m) 4m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:27:42.159 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (16m) 4m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:27:42.159 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (16m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:27:42.159 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (15m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:27:42.159 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (15m) 3m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:27:42.159 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (14m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:27:42.160 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (14m) 3m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:27:42.160 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (14m) 3m ago 24m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:27:42.160 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (23m) 3m ago 24m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:27:42.161 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 4m ago 22m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:27:42.161 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 3m ago 22m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:27:42.404 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:27:42.404 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:27:42.404 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:27:42.405 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:27:42.405 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:27:42.405 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:27:42.405 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:27:42.406 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:27:42.406 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:27:42.406 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:27:42.406 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:27:42.406 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:27:42.407 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:27:42.407 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:27:42.407 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:27:42.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:42 gibba023 bash[30844]: audit 2021-03-10T20:27:42.405162+0000 mon.a (mon.0) 829 : audit [DBG] from='client.? 172.21.2.123:0/1233995770' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:42.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:42 gibba023 bash[31815]: audit 2021-03-10T20:27:42.405162+0000 mon.a (mon.0) 829 : audit [DBG] from='client.? 172.21.2.123:0/1233995770' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:42.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:42 gibba044 bash[25485]: audit 2021-03-10T20:27:42.405162+0000 mon.a (mon.0) 829 : audit [DBG] from='client.? 172.21.2.123:0/1233995770' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:43.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:43 gibba023 bash[30844]: audit 2021-03-10T20:27:41.919280+0000 mgr.gibba044.wflcwh (mgr.34466) 1062 : audit [DBG] from='client.54757 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:27:43.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:43 gibba023 bash[30844]: cluster 2021-03-10T20:27:42.016694+0000 mgr.gibba044.wflcwh (mgr.34466) 1063 : cluster [DBG] pgmap v592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:43.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:43 gibba023 bash[30844]: audit 2021-03-10T20:27:42.146242+0000 mgr.gibba044.wflcwh (mgr.34466) 1064 : audit [DBG] from='client.54763 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:27:43.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:43 gibba023 bash[31815]: audit 2021-03-10T20:27:41.919280+0000 mgr.gibba044.wflcwh (mgr.34466) 1062 : audit [DBG] from='client.54757 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:27:43.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:43 gibba023 bash[31815]: cluster 2021-03-10T20:27:42.016694+0000 mgr.gibba044.wflcwh (mgr.34466) 1063 : cluster [DBG] pgmap v592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:43.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:43 gibba023 bash[31815]: audit 2021-03-10T20:27:42.146242+0000 mgr.gibba044.wflcwh (mgr.34466) 1064 : audit [DBG] from='client.54763 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:27:43.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:43 gibba044 bash[25485]: audit 2021-03-10T20:27:41.919280+0000 mgr.gibba044.wflcwh (mgr.34466) 1062 : audit [DBG] from='client.54757 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:27:43.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:43 gibba044 bash[25485]: cluster 2021-03-10T20:27:42.016694+0000 mgr.gibba044.wflcwh (mgr.34466) 1063 : cluster [DBG] pgmap v592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:43.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:43 gibba044 bash[25485]: audit 2021-03-10T20:27:42.146242+0000 mgr.gibba044.wflcwh (mgr.34466) 1064 : audit [DBG] from='client.54763 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:27:45.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:45 gibba023 bash[30844]: cluster 2021-03-10T20:27:44.018230+0000 mgr.gibba044.wflcwh (mgr.34466) 1065 : cluster [DBG] pgmap v593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:45.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:45 gibba023 bash[31815]: cluster 2021-03-10T20:27:44.018230+0000 mgr.gibba044.wflcwh (mgr.34466) 1065 : cluster [DBG] pgmap v593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:45.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:45 gibba044 bash[25485]: cluster 2021-03-10T20:27:44.018230+0000 mgr.gibba044.wflcwh (mgr.34466) 1065 : cluster [DBG] pgmap v593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:47.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:47 gibba023 bash[30844]: cluster 2021-03-10T20:27:46.019854+0000 mgr.gibba044.wflcwh (mgr.34466) 1066 : cluster [DBG] pgmap v594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:47.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:47 gibba023 bash[31815]: cluster 2021-03-10T20:27:46.019854+0000 mgr.gibba044.wflcwh (mgr.34466) 1066 : cluster [DBG] pgmap v594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:47.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:47 gibba044 bash[25485]: cluster 2021-03-10T20:27:46.019854+0000 mgr.gibba044.wflcwh (mgr.34466) 1066 : cluster [DBG] pgmap v594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:49.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:49 gibba023 bash[30844]: cluster 2021-03-10T20:27:48.021405+0000 mgr.gibba044.wflcwh (mgr.34466) 1067 : cluster [DBG] pgmap v595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:49.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:49 gibba023 bash[31815]: cluster 2021-03-10T20:27:48.021405+0000 mgr.gibba044.wflcwh (mgr.34466) 1067 : cluster [DBG] pgmap v595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:49.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:49 gibba044 bash[25485]: cluster 2021-03-10T20:27:48.021405+0000 mgr.gibba044.wflcwh (mgr.34466) 1067 : cluster [DBG] pgmap v595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:51.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:51 gibba044 bash[25485]: cluster 2021-03-10T20:27:50.021955+0000 mgr.gibba044.wflcwh (mgr.34466) 1068 : cluster [DBG] pgmap v596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:52.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:51 gibba023 bash[30844]: cluster 2021-03-10T20:27:50.021955+0000 mgr.gibba044.wflcwh (mgr.34466) 1068 : cluster [DBG] pgmap v596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:52.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:51 gibba023 bash[31815]: cluster 2021-03-10T20:27:50.021955+0000 mgr.gibba044.wflcwh (mgr.34466) 1068 : cluster [DBG] pgmap v596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:53.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:53 gibba044 bash[25485]: cluster 2021-03-10T20:27:52.023457+0000 mgr.gibba044.wflcwh (mgr.34466) 1069 : cluster [DBG] pgmap v597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:54.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:53 gibba023 bash[30844]: cluster 2021-03-10T20:27:52.023457+0000 mgr.gibba044.wflcwh (mgr.34466) 1069 : cluster [DBG] pgmap v597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:54.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:53 gibba023 bash[31815]: cluster 2021-03-10T20:27:52.023457+0000 mgr.gibba044.wflcwh (mgr.34466) 1069 : cluster [DBG] pgmap v597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:54.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:54 gibba044 bash[25485]: cephadm 2021-03-10T20:27:53.795115+0000 mgr.gibba044.wflcwh (mgr.34466) 1070 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:27:54.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:54 gibba044 bash[25485]: cephadm 2021-03-10T20:27:53.796714+0000 mgr.gibba044.wflcwh (mgr.34466) 1071 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:27:54.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:54 gibba044 bash[25485]: audit 2021-03-10T20:27:54.008424+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:27:54.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:54 gibba044 bash[25485]: audit 2021-03-10T20:27:54.011875+0000 mon.a (mon.0) 831 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:27:54.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:54 gibba044 bash[25485]: audit 2021-03-10T20:27:54.013295+0000 mon.a (mon.0) 832 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:54.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:54 gibba044 bash[25485]: audit 2021-03-10T20:27:54.014325+0000 mon.a (mon.0) 833 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:54.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:54 gibba044 bash[25485]: audit 2021-03-10T20:27:54.015501+0000 mon.a (mon.0) 834 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:54.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:54 gibba044 bash[25485]: audit 2021-03-10T20:27:54.017538+0000 mon.a (mon.0) 835 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:55.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:54 gibba044 bash[25485]: audit 2021-03-10T20:27:54.018746+0000 mon.a (mon.0) 836 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:55.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:54 gibba023 bash[30844]: cephadm 2021-03-10T20:27:53.795115+0000 mgr.gibba044.wflcwh (mgr.34466) 1070 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:27:55.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:54 gibba023 bash[30844]: cephadm 2021-03-10T20:27:53.796714+0000 mgr.gibba044.wflcwh (mgr.34466) 1071 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:27:55.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:54 gibba023 bash[30844]: audit 2021-03-10T20:27:54.008424+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:27:55.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:54 gibba023 bash[30844]: audit 2021-03-10T20:27:54.011875+0000 mon.a (mon.0) 831 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:27:55.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:54 gibba023 bash[30844]: audit 2021-03-10T20:27:54.013295+0000 mon.a (mon.0) 832 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:55.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:54 gibba023 bash[30844]: audit 2021-03-10T20:27:54.014325+0000 mon.a (mon.0) 833 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:55.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:54 gibba023 bash[30844]: audit 2021-03-10T20:27:54.015501+0000 mon.a (mon.0) 834 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:55.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:54 gibba023 bash[30844]: audit 2021-03-10T20:27:54.017538+0000 mon.a (mon.0) 835 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:55.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:54 gibba023 bash[30844]: audit 2021-03-10T20:27:54.018746+0000 mon.a (mon.0) 836 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:55.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:54 gibba023 bash[31815]: cephadm 2021-03-10T20:27:53.795115+0000 mgr.gibba044.wflcwh (mgr.34466) 1070 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:27:55.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:54 gibba023 bash[31815]: cephadm 2021-03-10T20:27:53.796714+0000 mgr.gibba044.wflcwh (mgr.34466) 1071 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:27:55.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:54 gibba023 bash[31815]: audit 2021-03-10T20:27:54.008424+0000 mon.a (mon.0) 830 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:27:55.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:54 gibba023 bash[31815]: audit 2021-03-10T20:27:54.011875+0000 mon.a (mon.0) 831 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:27:55.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:54 gibba023 bash[31815]: audit 2021-03-10T20:27:54.013295+0000 mon.a (mon.0) 832 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:55.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:54 gibba023 bash[31815]: audit 2021-03-10T20:27:54.014325+0000 mon.a (mon.0) 833 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:55.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:54 gibba023 bash[31815]: audit 2021-03-10T20:27:54.015501+0000 mon.a (mon.0) 834 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:55.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:54 gibba023 bash[31815]: audit 2021-03-10T20:27:54.017538+0000 mon.a (mon.0) 835 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:55.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:54 gibba023 bash[31815]: audit 2021-03-10T20:27:54.018746+0000 mon.a (mon.0) 836 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:27:55.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:55 gibba044 bash[25485]: cephadm 2021-03-10T20:27:54.013915+0000 mgr.gibba044.wflcwh (mgr.34466) 1072 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:27:55.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:55 gibba044 bash[25485]: cephadm 2021-03-10T20:27:54.015838+0000 mgr.gibba044.wflcwh (mgr.34466) 1073 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:27:55.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:55 gibba044 bash[25485]: cephadm 2021-03-10T20:27:54.016853+0000 mgr.gibba044.wflcwh (mgr.34466) 1074 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:27:56.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:55 gibba044 bash[25485]: cephadm 2021-03-10T20:27:54.016892+0000 mgr.gibba044.wflcwh (mgr.34466) 1075 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:27:56.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:55 gibba044 bash[25485]: cephadm 2021-03-10T20:27:54.018093+0000 mgr.gibba044.wflcwh (mgr.34466) 1076 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:27:56.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:55 gibba044 bash[25485]: cephadm 2021-03-10T20:27:54.018132+0000 mgr.gibba044.wflcwh (mgr.34466) 1077 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:27:56.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:55 gibba044 bash[25485]: cephadm 2021-03-10T20:27:54.019072+0000 mgr.gibba044.wflcwh (mgr.34466) 1078 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:27:56.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:55 gibba044 bash[25485]: cephadm 2021-03-10T20:27:54.019922+0000 mgr.gibba044.wflcwh (mgr.34466) 1079 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:27:56.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:55 gibba044 bash[25485]: cephadm 2021-03-10T20:27:54.019960+0000 mgr.gibba044.wflcwh (mgr.34466) 1080 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:27:56.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:55 gibba044 bash[25485]: cephadm 2021-03-10T20:27:54.021087+0000 mgr.gibba044.wflcwh (mgr.34466) 1081 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:27:56.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:55 gibba044 bash[25485]: cephadm 2021-03-10T20:27:54.021406+0000 mgr.gibba044.wflcwh (mgr.34466) 1082 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:27:56.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:55 gibba044 bash[25485]: cephadm 2021-03-10T20:27:54.022408+0000 mgr.gibba044.wflcwh (mgr.34466) 1083 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:27:56.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:55 gibba044 bash[25485]: cephadm 2021-03-10T20:27:54.022445+0000 mgr.gibba044.wflcwh (mgr.34466) 1084 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:27:56.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:55 gibba044 bash[25485]: cephadm 2021-03-10T20:27:54.022573+0000 mgr.gibba044.wflcwh (mgr.34466) 1085 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:27:56.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:55 gibba044 bash[25485]: cluster 2021-03-10T20:27:54.023923+0000 mgr.gibba044.wflcwh (mgr.34466) 1086 : cluster [DBG] pgmap v598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:56.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[30844]: cephadm 2021-03-10T20:27:54.013915+0000 mgr.gibba044.wflcwh (mgr.34466) 1072 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:27:56.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[30844]: cephadm 2021-03-10T20:27:54.015838+0000 mgr.gibba044.wflcwh (mgr.34466) 1073 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:27:56.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[30844]: cephadm 2021-03-10T20:27:54.016853+0000 mgr.gibba044.wflcwh (mgr.34466) 1074 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:27:56.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[30844]: cephadm 2021-03-10T20:27:54.016892+0000 mgr.gibba044.wflcwh (mgr.34466) 1075 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:27:56.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[30844]: cephadm 2021-03-10T20:27:54.018093+0000 mgr.gibba044.wflcwh (mgr.34466) 1076 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:27:56.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[30844]: cephadm 2021-03-10T20:27:54.018132+0000 mgr.gibba044.wflcwh (mgr.34466) 1077 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:27:56.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[30844]: cephadm 2021-03-10T20:27:54.019072+0000 mgr.gibba044.wflcwh (mgr.34466) 1078 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:27:56.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[30844]: cephadm 2021-03-10T20:27:54.019922+0000 mgr.gibba044.wflcwh (mgr.34466) 1079 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:27:56.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[30844]: cephadm 2021-03-10T20:27:54.019960+0000 mgr.gibba044.wflcwh (mgr.34466) 1080 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:27:56.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[30844]: cephadm 2021-03-10T20:27:54.021087+0000 mgr.gibba044.wflcwh (mgr.34466) 1081 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:27:56.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[30844]: cephadm 2021-03-10T20:27:54.021406+0000 mgr.gibba044.wflcwh (mgr.34466) 1082 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:27:56.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[30844]: cephadm 2021-03-10T20:27:54.022408+0000 mgr.gibba044.wflcwh (mgr.34466) 1083 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:27:56.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[30844]: cephadm 2021-03-10T20:27:54.022445+0000 mgr.gibba044.wflcwh (mgr.34466) 1084 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:27:56.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[30844]: cephadm 2021-03-10T20:27:54.022573+0000 mgr.gibba044.wflcwh (mgr.34466) 1085 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:27:56.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[30844]: cluster 2021-03-10T20:27:54.023923+0000 mgr.gibba044.wflcwh (mgr.34466) 1086 : cluster [DBG] pgmap v598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:56.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[31815]: cephadm 2021-03-10T20:27:54.013915+0000 mgr.gibba044.wflcwh (mgr.34466) 1072 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:27:56.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[31815]: cephadm 2021-03-10T20:27:54.015838+0000 mgr.gibba044.wflcwh (mgr.34466) 1073 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:27:56.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[31815]: cephadm 2021-03-10T20:27:54.016853+0000 mgr.gibba044.wflcwh (mgr.34466) 1074 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:27:56.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[31815]: cephadm 2021-03-10T20:27:54.016892+0000 mgr.gibba044.wflcwh (mgr.34466) 1075 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:27:56.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[31815]: cephadm 2021-03-10T20:27:54.018093+0000 mgr.gibba044.wflcwh (mgr.34466) 1076 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:27:56.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[31815]: cephadm 2021-03-10T20:27:54.018132+0000 mgr.gibba044.wflcwh (mgr.34466) 1077 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:27:56.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[31815]: cephadm 2021-03-10T20:27:54.019072+0000 mgr.gibba044.wflcwh (mgr.34466) 1078 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:27:56.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[31815]: cephadm 2021-03-10T20:27:54.019922+0000 mgr.gibba044.wflcwh (mgr.34466) 1079 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:27:56.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[31815]: cephadm 2021-03-10T20:27:54.019960+0000 mgr.gibba044.wflcwh (mgr.34466) 1080 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:27:56.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[31815]: cephadm 2021-03-10T20:27:54.021087+0000 mgr.gibba044.wflcwh (mgr.34466) 1081 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:27:56.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[31815]: cephadm 2021-03-10T20:27:54.021406+0000 mgr.gibba044.wflcwh (mgr.34466) 1082 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:27:56.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[31815]: cephadm 2021-03-10T20:27:54.022408+0000 mgr.gibba044.wflcwh (mgr.34466) 1083 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:27:56.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[31815]: cephadm 2021-03-10T20:27:54.022445+0000 mgr.gibba044.wflcwh (mgr.34466) 1084 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:27:56.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[31815]: cephadm 2021-03-10T20:27:54.022573+0000 mgr.gibba044.wflcwh (mgr.34466) 1085 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:27:56.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:55 gibba023 bash[31815]: cluster 2021-03-10T20:27:54.023923+0000 mgr.gibba044.wflcwh (mgr.34466) 1086 : cluster [DBG] pgmap v598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:57.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:57 gibba044 bash[25485]: cluster 2021-03-10T20:27:56.025285+0000 mgr.gibba044.wflcwh (mgr.34466) 1087 : cluster [DBG] pgmap v599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:58.173 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:57 gibba023 bash[30844]: cluster 2021-03-10T20:27:56.025285+0000 mgr.gibba044.wflcwh (mgr.34466) 1087 : cluster [DBG] pgmap v599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:58.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:57 gibba023 bash[31815]: cluster 2021-03-10T20:27:56.025285+0000 mgr.gibba044.wflcwh (mgr.34466) 1087 : cluster [DBG] pgmap v599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:27:59.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:27:59 gibba044 bash[25485]: cluster 2021-03-10T20:27:58.026715+0000 mgr.gibba044.wflcwh (mgr.34466) 1088 : cluster [DBG] pgmap v600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:00.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:27:59 gibba023 bash[30844]: cluster 2021-03-10T20:27:58.026715+0000 mgr.gibba044.wflcwh (mgr.34466) 1088 : cluster [DBG] pgmap v600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:00.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:27:59 gibba023 bash[31815]: cluster 2021-03-10T20:27:58.026715+0000 mgr.gibba044.wflcwh (mgr.34466) 1088 : cluster [DBG] pgmap v600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:01.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:01 gibba044 bash[25485]: cluster 2021-03-10T20:28:00.027207+0000 mgr.gibba044.wflcwh (mgr.34466) 1089 : cluster [DBG] pgmap v601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:02.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:01 gibba023 bash[30844]: cluster 2021-03-10T20:28:00.027207+0000 mgr.gibba044.wflcwh (mgr.34466) 1089 : cluster [DBG] pgmap v601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:02.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:01 gibba023 bash[31815]: cluster 2021-03-10T20:28:00.027207+0000 mgr.gibba044.wflcwh (mgr.34466) 1089 : cluster [DBG] pgmap v601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:03.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:03 gibba044 bash[25485]: cluster 2021-03-10T20:28:02.028794+0000 mgr.gibba044.wflcwh (mgr.34466) 1090 : cluster [DBG] pgmap v602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:04.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:03 gibba023 bash[30844]: cluster 2021-03-10T20:28:02.028794+0000 mgr.gibba044.wflcwh (mgr.34466) 1090 : cluster [DBG] pgmap v602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:04.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:03 gibba023 bash[31815]: cluster 2021-03-10T20:28:02.028794+0000 mgr.gibba044.wflcwh (mgr.34466) 1090 : cluster [DBG] pgmap v602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:05.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:05 gibba044 bash[25485]: cluster 2021-03-10T20:28:04.030149+0000 mgr.gibba044.wflcwh (mgr.34466) 1091 : cluster [DBG] pgmap v603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:06.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:05 gibba023 bash[30844]: cluster 2021-03-10T20:28:04.030149+0000 mgr.gibba044.wflcwh (mgr.34466) 1091 : cluster [DBG] pgmap v603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:06.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:05 gibba023 bash[31815]: cluster 2021-03-10T20:28:04.030149+0000 mgr.gibba044.wflcwh (mgr.34466) 1091 : cluster [DBG] pgmap v603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:07.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:07 gibba044 bash[25485]: cluster 2021-03-10T20:28:06.031604+0000 mgr.gibba044.wflcwh (mgr.34466) 1092 : cluster [DBG] pgmap v604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:08.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:07 gibba023 bash[30844]: cluster 2021-03-10T20:28:06.031604+0000 mgr.gibba044.wflcwh (mgr.34466) 1092 : cluster [DBG] pgmap v604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:08.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:07 gibba023 bash[31815]: cluster 2021-03-10T20:28:06.031604+0000 mgr.gibba044.wflcwh (mgr.34466) 1092 : cluster [DBG] pgmap v604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:10.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:09 gibba023 bash[30844]: cluster 2021-03-10T20:28:08.033138+0000 mgr.gibba044.wflcwh (mgr.34466) 1093 : cluster [DBG] pgmap v605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:10.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:09 gibba023 bash[31815]: cluster 2021-03-10T20:28:08.033138+0000 mgr.gibba044.wflcwh (mgr.34466) 1093 : cluster [DBG] pgmap v605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:10.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:09 gibba044 bash[25485]: cluster 2021-03-10T20:28:08.033138+0000 mgr.gibba044.wflcwh (mgr.34466) 1093 : cluster [DBG] pgmap v605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:11.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:10 gibba023 bash[30844]: cephadm 2021-03-10T20:28:09.038434+0000 mgr.gibba044.wflcwh (mgr.34466) 1094 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:28:11.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:10 gibba023 bash[31815]: cephadm 2021-03-10T20:28:09.038434+0000 mgr.gibba044.wflcwh (mgr.34466) 1094 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:28:11.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:10 gibba044 bash[25485]: cephadm 2021-03-10T20:28:09.038434+0000 mgr.gibba044.wflcwh (mgr.34466) 1094 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:28:12.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:11 gibba023 bash[30844]: cluster 2021-03-10T20:28:10.033948+0000 mgr.gibba044.wflcwh (mgr.34466) 1095 : cluster [DBG] pgmap v606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:12.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:11 gibba023 bash[31815]: cluster 2021-03-10T20:28:10.033948+0000 mgr.gibba044.wflcwh (mgr.34466) 1095 : cluster [DBG] pgmap v606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:12.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:11 gibba044 bash[25485]: cluster 2021-03-10T20:28:10.033948+0000 mgr.gibba044.wflcwh (mgr.34466) 1095 : cluster [DBG] pgmap v606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:12.647 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:28:12.873 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:28:12.874 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (19m) 5m ago 24m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:28:12.874 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (24m) 4m ago 24m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:28:12.874 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (19m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:28:12.874 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (20m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:28:12.875 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (19m) 5m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:28:12.875 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (18m) 5m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:28:12.875 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (18m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:28:12.875 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (18m) 5m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:28:12.876 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (25m) 5m ago 25m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:28:12.876 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (25m) 4m ago 25m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:28:12.876 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (17m) 5m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:28:12.876 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (17m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:28:12.876 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (16m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:28:12.877 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (16m) 5m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:28:12.877 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (15m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:28:12.877 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (15m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:28:12.877 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (14m) 4m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:28:12.878 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (14m) 4m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:28:12.878 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (24m) 4m ago 25m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:28:12.878 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 5m ago 22m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:28:12.878 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 4m ago 22m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:28:13.122 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:28:13.123 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:28:13.123 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:28:13.123 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:28:13.124 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:28:13.124 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:28:13.124 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:28:13.124 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:28:13.124 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:28:13.125 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:28:13.125 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:28:13.125 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:28:13.125 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:28:13.125 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:28:13.126 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:28:14.173 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:13 gibba023 bash[30844]: cluster 2021-03-10T20:28:12.035678+0000 mgr.gibba044.wflcwh (mgr.34466) 1096 : cluster [DBG] pgmap v607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:14.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:13 gibba023 bash[30844]: audit 2021-03-10T20:28:12.641297+0000 mgr.gibba044.wflcwh (mgr.34466) 1097 : audit [DBG] from='client.54775 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:28:14.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:13 gibba023 bash[30844]: audit 2021-03-10T20:28:13.123528+0000 mon.c (mon.1) 33 : audit [DBG] from='client.? 172.21.2.123:0/2992357696' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:14.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:13 gibba023 bash[31815]: cluster 2021-03-10T20:28:12.035678+0000 mgr.gibba044.wflcwh (mgr.34466) 1096 : cluster [DBG] pgmap v607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:14.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:13 gibba023 bash[31815]: audit 2021-03-10T20:28:12.641297+0000 mgr.gibba044.wflcwh (mgr.34466) 1097 : audit [DBG] from='client.54775 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:28:14.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:13 gibba023 bash[31815]: audit 2021-03-10T20:28:13.123528+0000 mon.c (mon.1) 33 : audit [DBG] from='client.? 172.21.2.123:0/2992357696' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:14.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:13 gibba044 bash[25485]: cluster 2021-03-10T20:28:12.035678+0000 mgr.gibba044.wflcwh (mgr.34466) 1096 : cluster [DBG] pgmap v607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:14.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:13 gibba044 bash[25485]: audit 2021-03-10T20:28:12.641297+0000 mgr.gibba044.wflcwh (mgr.34466) 1097 : audit [DBG] from='client.54775 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:28:14.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:13 gibba044 bash[25485]: audit 2021-03-10T20:28:13.123528+0000 mon.c (mon.1) 33 : audit [DBG] from='client.? 172.21.2.123:0/2992357696' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:15.173 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:14 gibba023 bash[30844]: audit 2021-03-10T20:28:12.865901+0000 mgr.gibba044.wflcwh (mgr.34466) 1098 : audit [DBG] from='client.44802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:28:15.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:14 gibba023 bash[31815]: audit 2021-03-10T20:28:12.865901+0000 mgr.gibba044.wflcwh (mgr.34466) 1098 : audit [DBG] from='client.44802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:28:15.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:14 gibba044 bash[25485]: audit 2021-03-10T20:28:12.865901+0000 mgr.gibba044.wflcwh (mgr.34466) 1098 : audit [DBG] from='client.44802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:28:16.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:15 gibba023 bash[30844]: cluster 2021-03-10T20:28:14.037227+0000 mgr.gibba044.wflcwh (mgr.34466) 1099 : cluster [DBG] pgmap v608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:16.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:15 gibba023 bash[31815]: cluster 2021-03-10T20:28:14.037227+0000 mgr.gibba044.wflcwh (mgr.34466) 1099 : cluster [DBG] pgmap v608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:16.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:15 gibba044 bash[25485]: cluster 2021-03-10T20:28:14.037227+0000 mgr.gibba044.wflcwh (mgr.34466) 1099 : cluster [DBG] pgmap v608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:18.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:17 gibba023 bash[30844]: cluster 2021-03-10T20:28:16.038995+0000 mgr.gibba044.wflcwh (mgr.34466) 1100 : cluster [DBG] pgmap v609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:18.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:17 gibba023 bash[31815]: cluster 2021-03-10T20:28:16.038995+0000 mgr.gibba044.wflcwh (mgr.34466) 1100 : cluster [DBG] pgmap v609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:18.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:17 gibba044 bash[25485]: cluster 2021-03-10T20:28:16.038995+0000 mgr.gibba044.wflcwh (mgr.34466) 1100 : cluster [DBG] pgmap v609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:20.173 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:19 gibba023 bash[30844]: cluster 2021-03-10T20:28:18.040613+0000 mgr.gibba044.wflcwh (mgr.34466) 1101 : cluster [DBG] pgmap v610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:20.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:19 gibba023 bash[31815]: cluster 2021-03-10T20:28:18.040613+0000 mgr.gibba044.wflcwh (mgr.34466) 1101 : cluster [DBG] pgmap v610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:20.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:19 gibba044 bash[25485]: cluster 2021-03-10T20:28:18.040613+0000 mgr.gibba044.wflcwh (mgr.34466) 1101 : cluster [DBG] pgmap v610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:21.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:20 gibba023 bash[30844]: cluster 2021-03-10T20:28:20.041186+0000 mgr.gibba044.wflcwh (mgr.34466) 1102 : cluster [DBG] pgmap v611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:21.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:20 gibba023 bash[31815]: cluster 2021-03-10T20:28:20.041186+0000 mgr.gibba044.wflcwh (mgr.34466) 1102 : cluster [DBG] pgmap v611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:21.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:20 gibba044 bash[25485]: cluster 2021-03-10T20:28:20.041186+0000 mgr.gibba044.wflcwh (mgr.34466) 1102 : cluster [DBG] pgmap v611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:23.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:23 gibba023 bash[30844]: cluster 2021-03-10T20:28:22.042846+0000 mgr.gibba044.wflcwh (mgr.34466) 1103 : cluster [DBG] pgmap v612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:23.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:23 gibba023 bash[31815]: cluster 2021-03-10T20:28:22.042846+0000 mgr.gibba044.wflcwh (mgr.34466) 1103 : cluster [DBG] pgmap v612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:23.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:23 gibba044 bash[25485]: cluster 2021-03-10T20:28:22.042846+0000 mgr.gibba044.wflcwh (mgr.34466) 1103 : cluster [DBG] pgmap v612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:25.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:25 gibba023 bash[30844]: cluster 2021-03-10T20:28:24.044837+0000 mgr.gibba044.wflcwh (mgr.34466) 1104 : cluster [DBG] pgmap v613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:25.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:25 gibba023 bash[30844]: cephadm 2021-03-10T20:28:24.054471+0000 mgr.gibba044.wflcwh (mgr.34466) 1105 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:28:25.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:25 gibba023 bash[31815]: cluster 2021-03-10T20:28:24.044837+0000 mgr.gibba044.wflcwh (mgr.34466) 1104 : cluster [DBG] pgmap v613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:25.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:25 gibba023 bash[31815]: cephadm 2021-03-10T20:28:24.054471+0000 mgr.gibba044.wflcwh (mgr.34466) 1105 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:28:25.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:25 gibba044 bash[25485]: cluster 2021-03-10T20:28:24.044837+0000 mgr.gibba044.wflcwh (mgr.34466) 1104 : cluster [DBG] pgmap v613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:25.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:25 gibba044 bash[25485]: cephadm 2021-03-10T20:28:24.054471+0000 mgr.gibba044.wflcwh (mgr.34466) 1105 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:28:27.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:27 gibba023 bash[30844]: cluster 2021-03-10T20:28:26.046338+0000 mgr.gibba044.wflcwh (mgr.34466) 1106 : cluster [DBG] pgmap v614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:27.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:27 gibba023 bash[30844]: audit 2021-03-10T20:28:27.109220+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:28:27.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:27 gibba023 bash[30844]: audit 2021-03-10T20:28:27.110019+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:28:27.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:27 gibba023 bash[30844]: audit 2021-03-10T20:28:27.110755+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:28:27.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:27 gibba023 bash[30844]: audit 2021-03-10T20:28:27.111438+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:28:27.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:27 gibba023 bash[30844]: audit 2021-03-10T20:28:27.143892+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:28:27.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:27 gibba023 bash[30844]: audit 2021-03-10T20:28:27.146612+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:28:27.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:27 gibba023 bash[31815]: cluster 2021-03-10T20:28:26.046338+0000 mgr.gibba044.wflcwh (mgr.34466) 1106 : cluster [DBG] pgmap v614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:27.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:27 gibba023 bash[31815]: audit 2021-03-10T20:28:27.109220+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:28:27.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:27 gibba023 bash[31815]: audit 2021-03-10T20:28:27.110019+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:28:27.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:27 gibba023 bash[31815]: audit 2021-03-10T20:28:27.110755+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:28:27.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:27 gibba023 bash[31815]: audit 2021-03-10T20:28:27.111438+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:28:27.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:27 gibba023 bash[31815]: audit 2021-03-10T20:28:27.143892+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:28:27.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:27 gibba023 bash[31815]: audit 2021-03-10T20:28:27.146612+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:28:27.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:27 gibba044 bash[25485]: cluster 2021-03-10T20:28:26.046338+0000 mgr.gibba044.wflcwh (mgr.34466) 1106 : cluster [DBG] pgmap v614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:27.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:27 gibba044 bash[25485]: audit 2021-03-10T20:28:27.109220+0000 mon.a (mon.0) 837 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T20:28:27.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:27 gibba044 bash[25485]: audit 2021-03-10T20:28:27.110019+0000 mon.a (mon.0) 838 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:28:27.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:27 gibba044 bash[25485]: audit 2021-03-10T20:28:27.110755+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:28:28.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:27 gibba044 bash[25485]: audit 2021-03-10T20:28:27.111438+0000 mon.a (mon.0) 840 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:28:28.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:27 gibba044 bash[25485]: audit 2021-03-10T20:28:27.143892+0000 mon.a (mon.0) 841 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:28:28.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:27 gibba044 bash[25485]: audit 2021-03-10T20:28:27.146612+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:28:29.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:29 gibba023 bash[30844]: cluster 2021-03-10T20:28:28.047967+0000 mgr.gibba044.wflcwh (mgr.34466) 1107 : cluster [DBG] pgmap v615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:29.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:29 gibba023 bash[31815]: cluster 2021-03-10T20:28:28.047967+0000 mgr.gibba044.wflcwh (mgr.34466) 1107 : cluster [DBG] pgmap v615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:29.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:29 gibba044 bash[25485]: cluster 2021-03-10T20:28:28.047967+0000 mgr.gibba044.wflcwh (mgr.34466) 1107 : cluster [DBG] pgmap v615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:31.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:31 gibba023 bash[30844]: cluster 2021-03-10T20:28:30.049197+0000 mgr.gibba044.wflcwh (mgr.34466) 1108 : cluster [DBG] pgmap v616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:31.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:31 gibba023 bash[31815]: cluster 2021-03-10T20:28:30.049197+0000 mgr.gibba044.wflcwh (mgr.34466) 1108 : cluster [DBG] pgmap v616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:31.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:31 gibba044 bash[25485]: cluster 2021-03-10T20:28:30.049197+0000 mgr.gibba044.wflcwh (mgr.34466) 1108 : cluster [DBG] pgmap v616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:33.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:33 gibba023 bash[30844]: cluster 2021-03-10T20:28:32.050937+0000 mgr.gibba044.wflcwh (mgr.34466) 1109 : cluster [DBG] pgmap v617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:33.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:33 gibba023 bash[31815]: cluster 2021-03-10T20:28:32.050937+0000 mgr.gibba044.wflcwh (mgr.34466) 1109 : cluster [DBG] pgmap v617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:33.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:33 gibba044 bash[25485]: cluster 2021-03-10T20:28:32.050937+0000 mgr.gibba044.wflcwh (mgr.34466) 1109 : cluster [DBG] pgmap v617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:35.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:35 gibba023 bash[30844]: cluster 2021-03-10T20:28:34.052473+0000 mgr.gibba044.wflcwh (mgr.34466) 1110 : cluster [DBG] pgmap v618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:35.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:35 gibba023 bash[31815]: cluster 2021-03-10T20:28:34.052473+0000 mgr.gibba044.wflcwh (mgr.34466) 1110 : cluster [DBG] pgmap v618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:36.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:35 gibba044 bash[25485]: cluster 2021-03-10T20:28:34.052473+0000 mgr.gibba044.wflcwh (mgr.34466) 1110 : cluster [DBG] pgmap v618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:37.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:37 gibba023 bash[30844]: cluster 2021-03-10T20:28:36.054101+0000 mgr.gibba044.wflcwh (mgr.34466) 1111 : cluster [DBG] pgmap v619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:37.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:37 gibba023 bash[31815]: cluster 2021-03-10T20:28:36.054101+0000 mgr.gibba044.wflcwh (mgr.34466) 1111 : cluster [DBG] pgmap v619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:37.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:37 gibba044 bash[25485]: cluster 2021-03-10T20:28:36.054101+0000 mgr.gibba044.wflcwh (mgr.34466) 1111 : cluster [DBG] pgmap v619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:39.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:39 gibba023 bash[30844]: cluster 2021-03-10T20:28:38.055773+0000 mgr.gibba044.wflcwh (mgr.34466) 1112 : cluster [DBG] pgmap v620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:39.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:39 gibba023 bash[31815]: cluster 2021-03-10T20:28:38.055773+0000 mgr.gibba044.wflcwh (mgr.34466) 1112 : cluster [DBG] pgmap v620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:39.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:39 gibba044 bash[25485]: cluster 2021-03-10T20:28:38.055773+0000 mgr.gibba044.wflcwh (mgr.34466) 1112 : cluster [DBG] pgmap v620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:40.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:40 gibba023 bash[30844]: cephadm 2021-03-10T20:28:39.070483+0000 mgr.gibba044.wflcwh (mgr.34466) 1113 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:28:40.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:40 gibba023 bash[31815]: cephadm 2021-03-10T20:28:39.070483+0000 mgr.gibba044.wflcwh (mgr.34466) 1113 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:28:40.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:40 gibba044 bash[25485]: cephadm 2021-03-10T20:28:39.070483+0000 mgr.gibba044.wflcwh (mgr.34466) 1113 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:28:41.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:41 gibba023 bash[30844]: cluster 2021-03-10T20:28:40.057021+0000 mgr.gibba044.wflcwh (mgr.34466) 1114 : cluster [DBG] pgmap v621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:41.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:41 gibba023 bash[31815]: cluster 2021-03-10T20:28:40.057021+0000 mgr.gibba044.wflcwh (mgr.34466) 1114 : cluster [DBG] pgmap v621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:41.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:41 gibba044 bash[25485]: cluster 2021-03-10T20:28:40.057021+0000 mgr.gibba044.wflcwh (mgr.34466) 1114 : cluster [DBG] pgmap v621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:43.365 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:28:43.625 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:28:43.626 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (19m) 5m ago 25m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:28:43.626 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (25m) 4m ago 25m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:28:43.626 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (20m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:28:43.626 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (20m) 4m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:28:43.627 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (19m) 5m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:28:43.627 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (19m) 5m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:28:43.627 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (18m) 4m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:28:43.627 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (19m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:28:43.627 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (25m) 5m ago 25m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:28:43.628 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (25m) 4m ago 25m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:28:43.628 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (18m) 5m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:28:43.628 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (17m) 5m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:28:43.628 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (17m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:28:43.629 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (16m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:28:43.629 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (16m) 4m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:28:43.629 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (15m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:28:43.629 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (15m) 4m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:28:43.629 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (15m) 4m ago 25m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:28:43.630 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (24m) 4m ago 25m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:28:43.630 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 5m ago 23m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:28:43.630 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 4m ago 23m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:28:43.881 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:28:43.882 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:28:43.882 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:28:43.882 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:28:43.882 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:28:43.883 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:28:43.883 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:28:43.883 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:28:43.883 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:28:43.884 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:28:43.884 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:28:43.884 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:28:43.884 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:28:43.884 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:28:43.885 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:28:43.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:43 gibba023 bash[30844]: cluster 2021-03-10T20:28:42.058760+0000 mgr.gibba044.wflcwh (mgr.34466) 1115 : cluster [DBG] pgmap v622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:43.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:43 gibba023 bash[31815]: cluster 2021-03-10T20:28:42.058760+0000 mgr.gibba044.wflcwh (mgr.34466) 1115 : cluster [DBG] pgmap v622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:43.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:43 gibba044 bash[25485]: cluster 2021-03-10T20:28:42.058760+0000 mgr.gibba044.wflcwh (mgr.34466) 1115 : cluster [DBG] pgmap v622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:44.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:44 gibba023 bash[30844]: audit 2021-03-10T20:28:43.360423+0000 mgr.gibba044.wflcwh (mgr.34466) 1116 : audit [DBG] from='client.44814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:28:44.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:44 gibba023 bash[30844]: audit 2021-03-10T20:28:43.588796+0000 mgr.gibba044.wflcwh (mgr.34466) 1117 : audit [DBG] from='client.54799 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:28:44.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:44 gibba023 bash[30844]: audit 2021-03-10T20:28:43.882485+0000 mon.a (mon.0) 843 : audit [DBG] from='client.? 172.21.2.123:0/4023747905' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:44.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:44 gibba023 bash[31815]: audit 2021-03-10T20:28:43.360423+0000 mgr.gibba044.wflcwh (mgr.34466) 1116 : audit [DBG] from='client.44814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:28:44.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:44 gibba023 bash[31815]: audit 2021-03-10T20:28:43.588796+0000 mgr.gibba044.wflcwh (mgr.34466) 1117 : audit [DBG] from='client.54799 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:28:44.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:44 gibba023 bash[31815]: audit 2021-03-10T20:28:43.882485+0000 mon.a (mon.0) 843 : audit [DBG] from='client.? 172.21.2.123:0/4023747905' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:44.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:44 gibba044 bash[25485]: audit 2021-03-10T20:28:43.360423+0000 mgr.gibba044.wflcwh (mgr.34466) 1116 : audit [DBG] from='client.44814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:28:44.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:44 gibba044 bash[25485]: audit 2021-03-10T20:28:43.588796+0000 mgr.gibba044.wflcwh (mgr.34466) 1117 : audit [DBG] from='client.54799 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:28:44.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:44 gibba044 bash[25485]: audit 2021-03-10T20:28:43.882485+0000 mon.a (mon.0) 843 : audit [DBG] from='client.? 172.21.2.123:0/4023747905' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:45.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:45 gibba023 bash[30844]: cluster 2021-03-10T20:28:44.060396+0000 mgr.gibba044.wflcwh (mgr.34466) 1118 : cluster [DBG] pgmap v623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:45.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:45 gibba023 bash[31815]: cluster 2021-03-10T20:28:44.060396+0000 mgr.gibba044.wflcwh (mgr.34466) 1118 : cluster [DBG] pgmap v623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:45.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:45 gibba044 bash[25485]: cluster 2021-03-10T20:28:44.060396+0000 mgr.gibba044.wflcwh (mgr.34466) 1118 : cluster [DBG] pgmap v623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:47.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:47 gibba023 bash[30844]: cluster 2021-03-10T20:28:46.061923+0000 mgr.gibba044.wflcwh (mgr.34466) 1119 : cluster [DBG] pgmap v624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:47.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:47 gibba023 bash[31815]: cluster 2021-03-10T20:28:46.061923+0000 mgr.gibba044.wflcwh (mgr.34466) 1119 : cluster [DBG] pgmap v624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:47.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:47 gibba044 bash[25485]: cluster 2021-03-10T20:28:46.061923+0000 mgr.gibba044.wflcwh (mgr.34466) 1119 : cluster [DBG] pgmap v624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:49.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:49 gibba023 bash[30844]: cluster 2021-03-10T20:28:48.063364+0000 mgr.gibba044.wflcwh (mgr.34466) 1120 : cluster [DBG] pgmap v625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:49.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:49 gibba023 bash[31815]: cluster 2021-03-10T20:28:48.063364+0000 mgr.gibba044.wflcwh (mgr.34466) 1120 : cluster [DBG] pgmap v625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:49.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:49 gibba044 bash[25485]: cluster 2021-03-10T20:28:48.063364+0000 mgr.gibba044.wflcwh (mgr.34466) 1120 : cluster [DBG] pgmap v625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:51.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:51 gibba023 bash[30844]: cluster 2021-03-10T20:28:50.064127+0000 mgr.gibba044.wflcwh (mgr.34466) 1121 : cluster [DBG] pgmap v626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:51.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:51 gibba023 bash[31815]: cluster 2021-03-10T20:28:50.064127+0000 mgr.gibba044.wflcwh (mgr.34466) 1121 : cluster [DBG] pgmap v626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:52.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:51 gibba044 bash[25485]: cluster 2021-03-10T20:28:50.064127+0000 mgr.gibba044.wflcwh (mgr.34466) 1121 : cluster [DBG] pgmap v626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:53.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:53 gibba023 bash[30844]: cluster 2021-03-10T20:28:52.065750+0000 mgr.gibba044.wflcwh (mgr.34466) 1122 : cluster [DBG] pgmap v627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:53.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:53 gibba023 bash[31815]: cluster 2021-03-10T20:28:52.065750+0000 mgr.gibba044.wflcwh (mgr.34466) 1122 : cluster [DBG] pgmap v627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:53.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:53 gibba044 bash[25485]: cluster 2021-03-10T20:28:52.065750+0000 mgr.gibba044.wflcwh (mgr.34466) 1122 : cluster [DBG] pgmap v627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:55.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[30844]: cluster 2021-03-10T20:28:54.067404+0000 mgr.gibba044.wflcwh (mgr.34466) 1123 : cluster [DBG] pgmap v628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:55.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[30844]: cephadm 2021-03-10T20:28:54.088565+0000 mgr.gibba044.wflcwh (mgr.34466) 1124 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:28:55.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[30844]: audit 2021-03-10T20:28:54.289153+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:28:55.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[30844]: cephadm 2021-03-10T20:28:54.292405+0000 mgr.gibba044.wflcwh (mgr.34466) 1125 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:28:55.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[30844]: audit 2021-03-10T20:28:54.479600+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:28:55.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[30844]: audit 2021-03-10T20:28:54.489206+0000 mon.a (mon.0) 846 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:28:55.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[30844]: cephadm 2021-03-10T20:28:54.490640+0000 mgr.gibba044.wflcwh (mgr.34466) 1126 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:28:55.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[30844]: audit 2021-03-10T20:28:54.492696+0000 mon.a (mon.0) 847 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:55.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[30844]: cephadm 2021-03-10T20:28:54.494692+0000 mgr.gibba044.wflcwh (mgr.34466) 1127 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:28:55.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[30844]: audit 2021-03-10T20:28:54.495615+0000 mon.a (mon.0) 848 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:55.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[30844]: cephadm 2021-03-10T20:28:54.497414+0000 mgr.gibba044.wflcwh (mgr.34466) 1128 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:28:55.681 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[30844]: cephadm 2021-03-10T20:28:54.497457+0000 mgr.gibba044.wflcwh (mgr.34466) 1129 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:28:55.681 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[30844]: audit 2021-03-10T20:28:54.498240+0000 mon.a (mon.0) 849 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:55.682 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[30844]: cephadm 2021-03-10T20:28:54.500335+0000 mgr.gibba044.wflcwh (mgr.34466) 1130 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:28:55.683 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[30844]: cephadm 2021-03-10T20:28:54.500374+0000 mgr.gibba044.wflcwh (mgr.34466) 1131 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:28:55.683 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[30844]: cephadm 2021-03-10T20:28:54.502915+0000 mgr.gibba044.wflcwh (mgr.34466) 1132 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:28:55.684 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[30844]: audit 2021-03-10T20:28:54.503607+0000 mon.a (mon.0) 850 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:55.684 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[30844]: cephadm 2021-03-10T20:28:54.505458+0000 mgr.gibba044.wflcwh (mgr.34466) 1133 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:28:55.684 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[30844]: cephadm 2021-03-10T20:28:54.505505+0000 mgr.gibba044.wflcwh (mgr.34466) 1134 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:28:55.685 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[30844]: audit 2021-03-10T20:28:54.507228+0000 mon.a (mon.0) 851 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:55.686 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[31815]: cluster 2021-03-10T20:28:54.067404+0000 mgr.gibba044.wflcwh (mgr.34466) 1123 : cluster [DBG] pgmap v628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:55.686 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[31815]: cephadm 2021-03-10T20:28:54.088565+0000 mgr.gibba044.wflcwh (mgr.34466) 1124 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:28:55.687 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[31815]: audit 2021-03-10T20:28:54.289153+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:28:55.687 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[31815]: cephadm 2021-03-10T20:28:54.292405+0000 mgr.gibba044.wflcwh (mgr.34466) 1125 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:28:55.688 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[31815]: audit 2021-03-10T20:28:54.479600+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:28:55.688 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[31815]: audit 2021-03-10T20:28:54.489206+0000 mon.a (mon.0) 846 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:28:55.689 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[31815]: cephadm 2021-03-10T20:28:54.490640+0000 mgr.gibba044.wflcwh (mgr.34466) 1126 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:28:55.689 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[31815]: audit 2021-03-10T20:28:54.492696+0000 mon.a (mon.0) 847 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:55.690 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[31815]: cephadm 2021-03-10T20:28:54.494692+0000 mgr.gibba044.wflcwh (mgr.34466) 1127 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:28:55.690 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[31815]: audit 2021-03-10T20:28:54.495615+0000 mon.a (mon.0) 848 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:55.691 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[31815]: cephadm 2021-03-10T20:28:54.497414+0000 mgr.gibba044.wflcwh (mgr.34466) 1128 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:28:55.691 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[31815]: cephadm 2021-03-10T20:28:54.497457+0000 mgr.gibba044.wflcwh (mgr.34466) 1129 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:28:55.692 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[31815]: audit 2021-03-10T20:28:54.498240+0000 mon.a (mon.0) 849 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:55.693 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[31815]: cephadm 2021-03-10T20:28:54.500335+0000 mgr.gibba044.wflcwh (mgr.34466) 1130 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:28:55.693 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[31815]: cephadm 2021-03-10T20:28:54.500374+0000 mgr.gibba044.wflcwh (mgr.34466) 1131 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:28:55.694 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[31815]: cephadm 2021-03-10T20:28:54.502915+0000 mgr.gibba044.wflcwh (mgr.34466) 1132 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:28:55.694 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[31815]: audit 2021-03-10T20:28:54.503607+0000 mon.a (mon.0) 850 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:55.695 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[31815]: cephadm 2021-03-10T20:28:54.505458+0000 mgr.gibba044.wflcwh (mgr.34466) 1133 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:28:55.697 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[31815]: cephadm 2021-03-10T20:28:54.505505+0000 mgr.gibba044.wflcwh (mgr.34466) 1134 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:28:55.697 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[31815]: audit 2021-03-10T20:28:54.507228+0000 mon.a (mon.0) 851 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:55.698 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[30844]: cephadm 2021-03-10T20:28:54.508590+0000 mgr.gibba044.wflcwh (mgr.34466) 1135 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:28:55.698 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[30844]: cephadm 2021-03-10T20:28:54.509115+0000 mgr.gibba044.wflcwh (mgr.34466) 1136 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:28:55.699 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[30844]: cephadm 2021-03-10T20:28:54.512031+0000 mgr.gibba044.wflcwh (mgr.34466) 1137 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:28:55.699 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[30844]: cephadm 2021-03-10T20:28:54.512083+0000 mgr.gibba044.wflcwh (mgr.34466) 1138 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:28:55.699 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[30844]: cephadm 2021-03-10T20:28:54.512279+0000 mgr.gibba044.wflcwh (mgr.34466) 1139 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:28:55.700 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[31815]: cephadm 2021-03-10T20:28:54.508590+0000 mgr.gibba044.wflcwh (mgr.34466) 1135 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:28:55.700 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[31815]: cephadm 2021-03-10T20:28:54.509115+0000 mgr.gibba044.wflcwh (mgr.34466) 1136 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:28:55.700 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[31815]: cephadm 2021-03-10T20:28:54.512031+0000 mgr.gibba044.wflcwh (mgr.34466) 1137 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:28:55.701 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[31815]: cephadm 2021-03-10T20:28:54.512083+0000 mgr.gibba044.wflcwh (mgr.34466) 1138 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:28:55.701 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:55 gibba023 bash[31815]: cephadm 2021-03-10T20:28:54.512279+0000 mgr.gibba044.wflcwh (mgr.34466) 1139 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:28:55.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:55 gibba044 bash[25485]: cluster 2021-03-10T20:28:54.067404+0000 mgr.gibba044.wflcwh (mgr.34466) 1123 : cluster [DBG] pgmap v628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:55.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:55 gibba044 bash[25485]: cephadm 2021-03-10T20:28:54.088565+0000 mgr.gibba044.wflcwh (mgr.34466) 1124 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:28:55.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:55 gibba044 bash[25485]: audit 2021-03-10T20:28:54.289153+0000 mon.a (mon.0) 844 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:28:55.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:55 gibba044 bash[25485]: cephadm 2021-03-10T20:28:54.292405+0000 mgr.gibba044.wflcwh (mgr.34466) 1125 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:28:55.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:55 gibba044 bash[25485]: audit 2021-03-10T20:28:54.479600+0000 mon.a (mon.0) 845 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:28:55.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:55 gibba044 bash[25485]: audit 2021-03-10T20:28:54.489206+0000 mon.a (mon.0) 846 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:28:55.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:55 gibba044 bash[25485]: cephadm 2021-03-10T20:28:54.490640+0000 mgr.gibba044.wflcwh (mgr.34466) 1126 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:28:55.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:55 gibba044 bash[25485]: audit 2021-03-10T20:28:54.492696+0000 mon.a (mon.0) 847 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:55.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:55 gibba044 bash[25485]: cephadm 2021-03-10T20:28:54.494692+0000 mgr.gibba044.wflcwh (mgr.34466) 1127 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:28:55.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:55 gibba044 bash[25485]: audit 2021-03-10T20:28:54.495615+0000 mon.a (mon.0) 848 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:55.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:55 gibba044 bash[25485]: cephadm 2021-03-10T20:28:54.497414+0000 mgr.gibba044.wflcwh (mgr.34466) 1128 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:28:55.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:55 gibba044 bash[25485]: cephadm 2021-03-10T20:28:54.497457+0000 mgr.gibba044.wflcwh (mgr.34466) 1129 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:28:55.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:55 gibba044 bash[25485]: audit 2021-03-10T20:28:54.498240+0000 mon.a (mon.0) 849 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:55.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:55 gibba044 bash[25485]: cephadm 2021-03-10T20:28:54.500335+0000 mgr.gibba044.wflcwh (mgr.34466) 1130 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:28:55.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:55 gibba044 bash[25485]: cephadm 2021-03-10T20:28:54.500374+0000 mgr.gibba044.wflcwh (mgr.34466) 1131 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:28:55.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:55 gibba044 bash[25485]: cephadm 2021-03-10T20:28:54.502915+0000 mgr.gibba044.wflcwh (mgr.34466) 1132 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:28:55.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:55 gibba044 bash[25485]: audit 2021-03-10T20:28:54.503607+0000 mon.a (mon.0) 850 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:55.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:55 gibba044 bash[25485]: cephadm 2021-03-10T20:28:54.505458+0000 mgr.gibba044.wflcwh (mgr.34466) 1133 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:28:55.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:55 gibba044 bash[25485]: cephadm 2021-03-10T20:28:54.505505+0000 mgr.gibba044.wflcwh (mgr.34466) 1134 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:28:55.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:55 gibba044 bash[25485]: audit 2021-03-10T20:28:54.507228+0000 mon.a (mon.0) 851 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:28:55.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:55 gibba044 bash[25485]: cephadm 2021-03-10T20:28:54.508590+0000 mgr.gibba044.wflcwh (mgr.34466) 1135 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:28:55.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:55 gibba044 bash[25485]: cephadm 2021-03-10T20:28:54.509115+0000 mgr.gibba044.wflcwh (mgr.34466) 1136 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:28:55.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:55 gibba044 bash[25485]: cephadm 2021-03-10T20:28:54.512031+0000 mgr.gibba044.wflcwh (mgr.34466) 1137 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:28:55.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:55 gibba044 bash[25485]: cephadm 2021-03-10T20:28:54.512083+0000 mgr.gibba044.wflcwh (mgr.34466) 1138 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:28:55.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:55 gibba044 bash[25485]: cephadm 2021-03-10T20:28:54.512279+0000 mgr.gibba044.wflcwh (mgr.34466) 1139 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:28:57.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:57 gibba023 bash[30844]: cluster 2021-03-10T20:28:56.068970+0000 mgr.gibba044.wflcwh (mgr.34466) 1140 : cluster [DBG] pgmap v629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:57.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:57 gibba023 bash[31815]: cluster 2021-03-10T20:28:56.068970+0000 mgr.gibba044.wflcwh (mgr.34466) 1140 : cluster [DBG] pgmap v629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:57.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:57 gibba044 bash[25485]: cluster 2021-03-10T20:28:56.068970+0000 mgr.gibba044.wflcwh (mgr.34466) 1140 : cluster [DBG] pgmap v629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:59.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:28:59 gibba023 bash[30844]: cluster 2021-03-10T20:28:58.070505+0000 mgr.gibba044.wflcwh (mgr.34466) 1141 : cluster [DBG] pgmap v630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:59.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:28:59 gibba023 bash[31815]: cluster 2021-03-10T20:28:58.070505+0000 mgr.gibba044.wflcwh (mgr.34466) 1141 : cluster [DBG] pgmap v630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:28:59.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:28:59 gibba044 bash[25485]: cluster 2021-03-10T20:28:58.070505+0000 mgr.gibba044.wflcwh (mgr.34466) 1141 : cluster [DBG] pgmap v630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:01.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:01 gibba023 bash[30844]: cluster 2021-03-10T20:29:00.071872+0000 mgr.gibba044.wflcwh (mgr.34466) 1142 : cluster [DBG] pgmap v631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:01.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:01 gibba023 bash[31815]: cluster 2021-03-10T20:29:00.071872+0000 mgr.gibba044.wflcwh (mgr.34466) 1142 : cluster [DBG] pgmap v631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:01.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:01 gibba044 bash[25485]: cluster 2021-03-10T20:29:00.071872+0000 mgr.gibba044.wflcwh (mgr.34466) 1142 : cluster [DBG] pgmap v631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:03.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:03 gibba023 bash[30844]: cluster 2021-03-10T20:29:02.073460+0000 mgr.gibba044.wflcwh (mgr.34466) 1143 : cluster [DBG] pgmap v632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:03.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:03 gibba023 bash[31815]: cluster 2021-03-10T20:29:02.073460+0000 mgr.gibba044.wflcwh (mgr.34466) 1143 : cluster [DBG] pgmap v632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:03.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:03 gibba044 bash[25485]: cluster 2021-03-10T20:29:02.073460+0000 mgr.gibba044.wflcwh (mgr.34466) 1143 : cluster [DBG] pgmap v632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:05.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:05 gibba023 bash[30844]: cluster 2021-03-10T20:29:04.075186+0000 mgr.gibba044.wflcwh (mgr.34466) 1144 : cluster [DBG] pgmap v633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:05.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:05 gibba023 bash[31815]: cluster 2021-03-10T20:29:04.075186+0000 mgr.gibba044.wflcwh (mgr.34466) 1144 : cluster [DBG] pgmap v633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:05.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:05 gibba044 bash[25485]: cluster 2021-03-10T20:29:04.075186+0000 mgr.gibba044.wflcwh (mgr.34466) 1144 : cluster [DBG] pgmap v633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:07.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:07 gibba023 bash[30844]: cluster 2021-03-10T20:29:06.076730+0000 mgr.gibba044.wflcwh (mgr.34466) 1145 : cluster [DBG] pgmap v634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:07.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:07 gibba023 bash[31815]: cluster 2021-03-10T20:29:06.076730+0000 mgr.gibba044.wflcwh (mgr.34466) 1145 : cluster [DBG] pgmap v634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:07.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:07 gibba044 bash[25485]: cluster 2021-03-10T20:29:06.076730+0000 mgr.gibba044.wflcwh (mgr.34466) 1145 : cluster [DBG] pgmap v634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:09.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:09 gibba023 bash[30844]: cluster 2021-03-10T20:29:08.078376+0000 mgr.gibba044.wflcwh (mgr.34466) 1146 : cluster [DBG] pgmap v635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:09.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:09 gibba023 bash[31815]: cluster 2021-03-10T20:29:08.078376+0000 mgr.gibba044.wflcwh (mgr.34466) 1146 : cluster [DBG] pgmap v635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:09.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:09 gibba044 bash[25485]: cluster 2021-03-10T20:29:08.078376+0000 mgr.gibba044.wflcwh (mgr.34466) 1146 : cluster [DBG] pgmap v635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:10.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:10 gibba023 bash[30844]: cephadm 2021-03-10T20:29:09.524520+0000 mgr.gibba044.wflcwh (mgr.34466) 1147 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:29:10.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:10 gibba023 bash[31815]: cephadm 2021-03-10T20:29:09.524520+0000 mgr.gibba044.wflcwh (mgr.34466) 1147 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:29:10.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:10 gibba044 bash[25485]: cephadm 2021-03-10T20:29:09.524520+0000 mgr.gibba044.wflcwh (mgr.34466) 1147 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:29:11.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:11 gibba023 bash[30844]: cluster 2021-03-10T20:29:10.079551+0000 mgr.gibba044.wflcwh (mgr.34466) 1148 : cluster [DBG] pgmap v636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:11.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:11 gibba023 bash[31815]: cluster 2021-03-10T20:29:10.079551+0000 mgr.gibba044.wflcwh (mgr.34466) 1148 : cluster [DBG] pgmap v636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:11.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:11 gibba044 bash[25485]: cluster 2021-03-10T20:29:10.079551+0000 mgr.gibba044.wflcwh (mgr.34466) 1148 : cluster [DBG] pgmap v636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:13.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:13 gibba023 bash[30844]: cluster 2021-03-10T20:29:12.081153+0000 mgr.gibba044.wflcwh (mgr.34466) 1149 : cluster [DBG] pgmap v637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:13.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:13 gibba023 bash[31815]: cluster 2021-03-10T20:29:12.081153+0000 mgr.gibba044.wflcwh (mgr.34466) 1149 : cluster [DBG] pgmap v637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:13.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:13 gibba044 bash[25485]: cluster 2021-03-10T20:29:12.081153+0000 mgr.gibba044.wflcwh (mgr.34466) 1149 : cluster [DBG] pgmap v637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:14.125 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:29:14.352 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:29:14.352 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (20m) 6m ago 25m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:29:14.352 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (25m) 5m ago 25m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:29:14.353 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (20m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:29:14.353 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (21m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:29:14.353 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (20m) 6m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:29:14.353 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (19m) 6m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:29:14.354 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (19m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:29:14.354 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (19m) 6m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:29:14.354 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (26m) 6m ago 26m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:29:14.354 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (26m) 5m ago 26m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:29:14.354 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (18m) 6m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:29:14.355 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (18m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:29:14.355 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (17m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:29:14.355 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (17m) 6m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:29:14.355 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (16m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:29:14.356 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (16m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:29:14.356 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (16m) 5m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:29:14.356 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (15m) 5m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:29:14.356 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (25m) 5m ago 26m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:29:14.356 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 6m ago 23m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:29:14.357 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 5m ago 23m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:29:14.600 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:29:14.600 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:29:14.600 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:29:14.600 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:29:14.601 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:29:14.601 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:29:14.601 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:29:14.601 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:29:14.602 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:29:14.602 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:29:14.602 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:29:14.602 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:29:14.602 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:29:14.603 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:29:14.603 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:29:15.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:15 gibba023 bash[30844]: cluster 2021-03-10T20:29:14.082779+0000 mgr.gibba044.wflcwh (mgr.34466) 1150 : cluster [DBG] pgmap v638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:15.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:15 gibba023 bash[30844]: audit 2021-03-10T20:29:14.119480+0000 mgr.gibba044.wflcwh (mgr.34466) 1151 : audit [DBG] from='client.44832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:29:15.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:15 gibba023 bash[30844]: audit 2021-03-10T20:29:14.344884+0000 mgr.gibba044.wflcwh (mgr.34466) 1152 : audit [DBG] from='client.54817 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:29:15.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:15 gibba023 bash[30844]: audit 2021-03-10T20:29:14.600814+0000 mon.c (mon.1) 34 : audit [DBG] from='client.? 172.21.2.123:0/610334512' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:15.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:15 gibba023 bash[31815]: cluster 2021-03-10T20:29:14.082779+0000 mgr.gibba044.wflcwh (mgr.34466) 1150 : cluster [DBG] pgmap v638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:15.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:15 gibba023 bash[31815]: audit 2021-03-10T20:29:14.119480+0000 mgr.gibba044.wflcwh (mgr.34466) 1151 : audit [DBG] from='client.44832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:29:15.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:15 gibba023 bash[31815]: audit 2021-03-10T20:29:14.344884+0000 mgr.gibba044.wflcwh (mgr.34466) 1152 : audit [DBG] from='client.54817 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:29:15.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:15 gibba023 bash[31815]: audit 2021-03-10T20:29:14.600814+0000 mon.c (mon.1) 34 : audit [DBG] from='client.? 172.21.2.123:0/610334512' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:15.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:15 gibba044 bash[25485]: cluster 2021-03-10T20:29:14.082779+0000 mgr.gibba044.wflcwh (mgr.34466) 1150 : cluster [DBG] pgmap v638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:15.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:15 gibba044 bash[25485]: audit 2021-03-10T20:29:14.119480+0000 mgr.gibba044.wflcwh (mgr.34466) 1151 : audit [DBG] from='client.44832 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:29:15.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:15 gibba044 bash[25485]: audit 2021-03-10T20:29:14.344884+0000 mgr.gibba044.wflcwh (mgr.34466) 1152 : audit [DBG] from='client.54817 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:29:15.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:15 gibba044 bash[25485]: audit 2021-03-10T20:29:14.600814+0000 mon.c (mon.1) 34 : audit [DBG] from='client.? 172.21.2.123:0/610334512' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:17.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:17 gibba023 bash[30844]: cluster 2021-03-10T20:29:16.084500+0000 mgr.gibba044.wflcwh (mgr.34466) 1153 : cluster [DBG] pgmap v639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:17.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:17 gibba023 bash[31815]: cluster 2021-03-10T20:29:16.084500+0000 mgr.gibba044.wflcwh (mgr.34466) 1153 : cluster [DBG] pgmap v639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:17.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:17 gibba044 bash[25485]: cluster 2021-03-10T20:29:16.084500+0000 mgr.gibba044.wflcwh (mgr.34466) 1153 : cluster [DBG] pgmap v639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:19.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:19 gibba023 bash[30844]: cluster 2021-03-10T20:29:18.085989+0000 mgr.gibba044.wflcwh (mgr.34466) 1154 : cluster [DBG] pgmap v640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:19.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:19 gibba023 bash[31815]: cluster 2021-03-10T20:29:18.085989+0000 mgr.gibba044.wflcwh (mgr.34466) 1154 : cluster [DBG] pgmap v640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:19.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:19 gibba044 bash[25485]: cluster 2021-03-10T20:29:18.085989+0000 mgr.gibba044.wflcwh (mgr.34466) 1154 : cluster [DBG] pgmap v640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:21.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:21 gibba023 bash[30844]: cluster 2021-03-10T20:29:20.087420+0000 mgr.gibba044.wflcwh (mgr.34466) 1155 : cluster [DBG] pgmap v641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:21.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:21 gibba023 bash[31815]: cluster 2021-03-10T20:29:20.087420+0000 mgr.gibba044.wflcwh (mgr.34466) 1155 : cluster [DBG] pgmap v641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:21.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:21 gibba044 bash[25485]: cluster 2021-03-10T20:29:20.087420+0000 mgr.gibba044.wflcwh (mgr.34466) 1155 : cluster [DBG] pgmap v641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:23.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:23 gibba023 bash[30844]: cluster 2021-03-10T20:29:22.088971+0000 mgr.gibba044.wflcwh (mgr.34466) 1156 : cluster [DBG] pgmap v642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:23.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:23 gibba023 bash[31815]: cluster 2021-03-10T20:29:22.088971+0000 mgr.gibba044.wflcwh (mgr.34466) 1156 : cluster [DBG] pgmap v642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:23.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:23 gibba044 bash[25485]: cluster 2021-03-10T20:29:22.088971+0000 mgr.gibba044.wflcwh (mgr.34466) 1156 : cluster [DBG] pgmap v642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:25.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:25 gibba023 bash[30844]: cluster 2021-03-10T20:29:24.090729+0000 mgr.gibba044.wflcwh (mgr.34466) 1157 : cluster [DBG] pgmap v643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:25.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:25 gibba023 bash[30844]: cephadm 2021-03-10T20:29:24.540566+0000 mgr.gibba044.wflcwh (mgr.34466) 1158 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:29:25.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:25 gibba023 bash[31815]: cluster 2021-03-10T20:29:24.090729+0000 mgr.gibba044.wflcwh (mgr.34466) 1157 : cluster [DBG] pgmap v643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:25.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:25 gibba023 bash[31815]: cephadm 2021-03-10T20:29:24.540566+0000 mgr.gibba044.wflcwh (mgr.34466) 1158 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:29:25.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:25 gibba044 bash[25485]: cluster 2021-03-10T20:29:24.090729+0000 mgr.gibba044.wflcwh (mgr.34466) 1157 : cluster [DBG] pgmap v643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:25.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:25 gibba044 bash[25485]: cephadm 2021-03-10T20:29:24.540566+0000 mgr.gibba044.wflcwh (mgr.34466) 1158 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:29:27.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:27 gibba023 bash[30844]: cluster 2021-03-10T20:29:26.092254+0000 mgr.gibba044.wflcwh (mgr.34466) 1159 : cluster [DBG] pgmap v644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:27.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:27 gibba023 bash[30844]: audit 2021-03-10T20:29:27.116711+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T20:29:27.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:27 gibba023 bash[30844]: audit 2021-03-10T20:29:27.117462+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:29:27.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:27 gibba023 bash[30844]: audit 2021-03-10T20:29:27.118165+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:29:27.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:27 gibba023 bash[30844]: audit 2021-03-10T20:29:27.118955+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:29:27.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:27 gibba023 bash[30844]: audit 2021-03-10T20:29:27.148388+0000 mon.a (mon.0) 856 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:29:27.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:27 gibba023 bash[30844]: audit 2021-03-10T20:29:27.149348+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:29:27.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:27 gibba023 bash[31815]: cluster 2021-03-10T20:29:26.092254+0000 mgr.gibba044.wflcwh (mgr.34466) 1159 : cluster [DBG] pgmap v644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:27.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:27 gibba023 bash[31815]: audit 2021-03-10T20:29:27.116711+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T20:29:27.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:27 gibba023 bash[31815]: audit 2021-03-10T20:29:27.117462+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:29:27.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:27 gibba023 bash[31815]: audit 2021-03-10T20:29:27.118165+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:29:27.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:27 gibba023 bash[31815]: audit 2021-03-10T20:29:27.118955+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:29:27.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:27 gibba023 bash[31815]: audit 2021-03-10T20:29:27.148388+0000 mon.a (mon.0) 856 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:29:27.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:27 gibba023 bash[31815]: audit 2021-03-10T20:29:27.149348+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:29:27.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:27 gibba044 bash[25485]: cluster 2021-03-10T20:29:26.092254+0000 mgr.gibba044.wflcwh (mgr.34466) 1159 : cluster [DBG] pgmap v644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:27.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:27 gibba044 bash[25485]: audit 2021-03-10T20:29:27.116711+0000 mon.a (mon.0) 852 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T20:29:27.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:27 gibba044 bash[25485]: audit 2021-03-10T20:29:27.117462+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:29:27.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:27 gibba044 bash[25485]: audit 2021-03-10T20:29:27.118165+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:29:27.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:27 gibba044 bash[25485]: audit 2021-03-10T20:29:27.118955+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:29:27.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:27 gibba044 bash[25485]: audit 2021-03-10T20:29:27.148388+0000 mon.a (mon.0) 856 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:29:27.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:27 gibba044 bash[25485]: audit 2021-03-10T20:29:27.149348+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:29:29.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:29 gibba023 bash[30844]: cluster 2021-03-10T20:29:28.093830+0000 mgr.gibba044.wflcwh (mgr.34466) 1160 : cluster [DBG] pgmap v645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:29.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:29 gibba023 bash[31815]: cluster 2021-03-10T20:29:28.093830+0000 mgr.gibba044.wflcwh (mgr.34466) 1160 : cluster [DBG] pgmap v645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:29.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:29 gibba044 bash[25485]: cluster 2021-03-10T20:29:28.093830+0000 mgr.gibba044.wflcwh (mgr.34466) 1160 : cluster [DBG] pgmap v645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:31.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:31 gibba023 bash[30844]: cluster 2021-03-10T20:29:30.095431+0000 mgr.gibba044.wflcwh (mgr.34466) 1161 : cluster [DBG] pgmap v646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:31.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:31 gibba023 bash[31815]: cluster 2021-03-10T20:29:30.095431+0000 mgr.gibba044.wflcwh (mgr.34466) 1161 : cluster [DBG] pgmap v646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:31.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:31 gibba044 bash[25485]: cluster 2021-03-10T20:29:30.095431+0000 mgr.gibba044.wflcwh (mgr.34466) 1161 : cluster [DBG] pgmap v646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:33.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:33 gibba023 bash[30844]: cluster 2021-03-10T20:29:32.097244+0000 mgr.gibba044.wflcwh (mgr.34466) 1162 : cluster [DBG] pgmap v647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:33.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:33 gibba023 bash[31815]: cluster 2021-03-10T20:29:32.097244+0000 mgr.gibba044.wflcwh (mgr.34466) 1162 : cluster [DBG] pgmap v647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:33.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:33 gibba044 bash[25485]: cluster 2021-03-10T20:29:32.097244+0000 mgr.gibba044.wflcwh (mgr.34466) 1162 : cluster [DBG] pgmap v647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:35.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:35 gibba023 bash[30844]: cluster 2021-03-10T20:29:34.098982+0000 mgr.gibba044.wflcwh (mgr.34466) 1163 : cluster [DBG] pgmap v648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:35.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:35 gibba023 bash[31815]: cluster 2021-03-10T20:29:34.098982+0000 mgr.gibba044.wflcwh (mgr.34466) 1163 : cluster [DBG] pgmap v648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:35.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:35 gibba044 bash[25485]: cluster 2021-03-10T20:29:34.098982+0000 mgr.gibba044.wflcwh (mgr.34466) 1163 : cluster [DBG] pgmap v648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:37.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:37 gibba044 bash[25485]: cluster 2021-03-10T20:29:36.100683+0000 mgr.gibba044.wflcwh (mgr.34466) 1164 : cluster [DBG] pgmap v649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:38.173 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:37 gibba023 bash[30844]: cluster 2021-03-10T20:29:36.100683+0000 mgr.gibba044.wflcwh (mgr.34466) 1164 : cluster [DBG] pgmap v649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:38.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:37 gibba023 bash[31815]: cluster 2021-03-10T20:29:36.100683+0000 mgr.gibba044.wflcwh (mgr.34466) 1164 : cluster [DBG] pgmap v649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:39.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:39 gibba044 bash[25485]: cluster 2021-03-10T20:29:38.102389+0000 mgr.gibba044.wflcwh (mgr.34466) 1165 : cluster [DBG] pgmap v650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:40.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:39 gibba023 bash[30844]: cluster 2021-03-10T20:29:38.102389+0000 mgr.gibba044.wflcwh (mgr.34466) 1165 : cluster [DBG] pgmap v650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:40.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:39 gibba023 bash[31815]: cluster 2021-03-10T20:29:38.102389+0000 mgr.gibba044.wflcwh (mgr.34466) 1165 : cluster [DBG] pgmap v650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:40.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:40 gibba044 bash[25485]: cephadm 2021-03-10T20:29:39.556632+0000 mgr.gibba044.wflcwh (mgr.34466) 1166 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:29:41.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:40 gibba023 bash[30844]: cephadm 2021-03-10T20:29:39.556632+0000 mgr.gibba044.wflcwh (mgr.34466) 1166 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:29:41.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:40 gibba023 bash[31815]: cephadm 2021-03-10T20:29:39.556632+0000 mgr.gibba044.wflcwh (mgr.34466) 1166 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:29:41.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:41 gibba044 bash[25485]: cluster 2021-03-10T20:29:40.103603+0000 mgr.gibba044.wflcwh (mgr.34466) 1167 : cluster [DBG] pgmap v651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:42.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:41 gibba023 bash[30844]: cluster 2021-03-10T20:29:40.103603+0000 mgr.gibba044.wflcwh (mgr.34466) 1167 : cluster [DBG] pgmap v651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:42.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:41 gibba023 bash[31815]: cluster 2021-03-10T20:29:40.103603+0000 mgr.gibba044.wflcwh (mgr.34466) 1167 : cluster [DBG] pgmap v651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:43.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:43 gibba044 bash[25485]: cluster 2021-03-10T20:29:42.105369+0000 mgr.gibba044.wflcwh (mgr.34466) 1168 : cluster [DBG] pgmap v652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:44.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:43 gibba023 bash[30844]: cluster 2021-03-10T20:29:42.105369+0000 mgr.gibba044.wflcwh (mgr.34466) 1168 : cluster [DBG] pgmap v652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:44.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:43 gibba023 bash[31815]: cluster 2021-03-10T20:29:42.105369+0000 mgr.gibba044.wflcwh (mgr.34466) 1168 : cluster [DBG] pgmap v652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:44.845 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:29:45.072 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:29:45.072 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (20m) 6m ago 26m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:29:45.072 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (26m) 5m ago 26m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:29:45.073 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (21m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:29:45.073 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (21m) 5m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:29:45.073 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (20m) 6m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:29:45.073 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (20m) 6m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:29:45.074 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (19m) 5m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:29:45.074 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (20m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:29:45.074 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (26m) 6m ago 26m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:29:45.074 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (26m) 5m ago 26m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:29:45.075 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (19m) 6m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:29:45.075 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (18m) 6m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:29:45.075 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (18m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:29:45.075 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (17m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:29:45.075 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (17m) 5m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:29:45.076 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (16m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:29:45.076 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (16m) 5m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:29:45.076 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (16m) 5m ago 26m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:29:45.076 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (25m) 5m ago 26m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:29:45.076 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 6m ago 24m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:29:45.077 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 5m ago 24m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:29:45.326 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:29:45.326 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:29:45.327 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:29:45.327 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:29:45.327 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:29:45.327 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:29:45.328 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:29:45.328 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:29:45.328 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:29:45.328 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:29:45.328 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:29:45.329 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:29:45.329 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:29:45.329 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:29:45.329 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:29:45.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:45 gibba044 bash[25485]: cluster 2021-03-10T20:29:44.106852+0000 mgr.gibba044.wflcwh (mgr.34466) 1169 : cluster [DBG] pgmap v653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:46.087 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:45 gibba044 bash[25485]: audit 2021-03-10T20:29:44.839902+0000 mgr.gibba044.wflcwh (mgr.34466) 1170 : audit [DBG] from='client.44850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:29:46.088 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:45 gibba044 bash[25485]: audit 2021-03-10T20:29:45.327122+0000 mon.a (mon.0) 858 : audit [DBG] from='client.? 172.21.2.123:0/2476107884' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:46.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:45 gibba023 bash[30844]: cluster 2021-03-10T20:29:44.106852+0000 mgr.gibba044.wflcwh (mgr.34466) 1169 : cluster [DBG] pgmap v653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:46.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:45 gibba023 bash[30844]: audit 2021-03-10T20:29:44.839902+0000 mgr.gibba044.wflcwh (mgr.34466) 1170 : audit [DBG] from='client.44850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:29:46.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:45 gibba023 bash[30844]: audit 2021-03-10T20:29:45.327122+0000 mon.a (mon.0) 858 : audit [DBG] from='client.? 172.21.2.123:0/2476107884' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:46.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:45 gibba023 bash[31815]: cluster 2021-03-10T20:29:44.106852+0000 mgr.gibba044.wflcwh (mgr.34466) 1169 : cluster [DBG] pgmap v653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:46.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:45 gibba023 bash[31815]: audit 2021-03-10T20:29:44.839902+0000 mgr.gibba044.wflcwh (mgr.34466) 1170 : audit [DBG] from='client.44850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:29:46.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:45 gibba023 bash[31815]: audit 2021-03-10T20:29:45.327122+0000 mon.a (mon.0) 858 : audit [DBG] from='client.? 172.21.2.123:0/2476107884' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:46.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:46 gibba044 bash[25485]: audit 2021-03-10T20:29:45.063338+0000 mgr.gibba044.wflcwh (mgr.34466) 1171 : audit [DBG] from='client.54835 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:29:47.173 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:46 gibba023 bash[30844]: audit 2021-03-10T20:29:45.063338+0000 mgr.gibba044.wflcwh (mgr.34466) 1171 : audit [DBG] from='client.54835 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:29:47.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:46 gibba023 bash[31815]: audit 2021-03-10T20:29:45.063338+0000 mgr.gibba044.wflcwh (mgr.34466) 1171 : audit [DBG] from='client.54835 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:29:47.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:47 gibba044 bash[25485]: cluster 2021-03-10T20:29:46.108807+0000 mgr.gibba044.wflcwh (mgr.34466) 1172 : cluster [DBG] pgmap v654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:48.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:47 gibba023 bash[30844]: cluster 2021-03-10T20:29:46.108807+0000 mgr.gibba044.wflcwh (mgr.34466) 1172 : cluster [DBG] pgmap v654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:48.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:47 gibba023 bash[31815]: cluster 2021-03-10T20:29:46.108807+0000 mgr.gibba044.wflcwh (mgr.34466) 1172 : cluster [DBG] pgmap v654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:49.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:49 gibba044 bash[25485]: cluster 2021-03-10T20:29:48.110657+0000 mgr.gibba044.wflcwh (mgr.34466) 1173 : cluster [DBG] pgmap v655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:50.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:49 gibba023 bash[30844]: cluster 2021-03-10T20:29:48.110657+0000 mgr.gibba044.wflcwh (mgr.34466) 1173 : cluster [DBG] pgmap v655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:50.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:49 gibba023 bash[31815]: cluster 2021-03-10T20:29:48.110657+0000 mgr.gibba044.wflcwh (mgr.34466) 1173 : cluster [DBG] pgmap v655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:52.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:51 gibba023 bash[30844]: cluster 2021-03-10T20:29:50.111571+0000 mgr.gibba044.wflcwh (mgr.34466) 1174 : cluster [DBG] pgmap v656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:52.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:51 gibba023 bash[31815]: cluster 2021-03-10T20:29:50.111571+0000 mgr.gibba044.wflcwh (mgr.34466) 1174 : cluster [DBG] pgmap v656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:52.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:51 gibba044 bash[25485]: cluster 2021-03-10T20:29:50.111571+0000 mgr.gibba044.wflcwh (mgr.34466) 1174 : cluster [DBG] pgmap v656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:54.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:53 gibba023 bash[30844]: cluster 2021-03-10T20:29:52.113164+0000 mgr.gibba044.wflcwh (mgr.34466) 1175 : cluster [DBG] pgmap v657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:54.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:53 gibba023 bash[31815]: cluster 2021-03-10T20:29:52.113164+0000 mgr.gibba044.wflcwh (mgr.34466) 1175 : cluster [DBG] pgmap v657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:54.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:53 gibba044 bash[25485]: cluster 2021-03-10T20:29:52.113164+0000 mgr.gibba044.wflcwh (mgr.34466) 1175 : cluster [DBG] pgmap v657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:56.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:55 gibba023 bash[30844]: cluster 2021-03-10T20:29:54.115114+0000 mgr.gibba044.wflcwh (mgr.34466) 1176 : cluster [DBG] pgmap v658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:56.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:55 gibba023 bash[30844]: cephadm 2021-03-10T20:29:54.573129+0000 mgr.gibba044.wflcwh (mgr.34466) 1177 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:29:56.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:55 gibba023 bash[30844]: audit 2021-03-10T20:29:54.770135+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:29:56.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:55 gibba023 bash[30844]: cephadm 2021-03-10T20:29:54.773613+0000 mgr.gibba044.wflcwh (mgr.34466) 1178 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:29:56.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:55 gibba023 bash[30844]: audit 2021-03-10T20:29:54.960564+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:29:56.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:55 gibba023 bash[30844]: audit 2021-03-10T20:29:54.964688+0000 mon.a (mon.0) 861 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:29:56.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:55 gibba023 bash[30844]: audit 2021-03-10T20:29:54.966798+0000 mon.a (mon.0) 862 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:56.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:55 gibba023 bash[30844]: audit 2021-03-10T20:29:54.968306+0000 mon.a (mon.0) 863 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:56.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:55 gibba023 bash[30844]: audit 2021-03-10T20:29:54.969977+0000 mon.a (mon.0) 864 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:56.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:55 gibba023 bash[30844]: audit 2021-03-10T20:29:54.973791+0000 mon.a (mon.0) 865 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:56.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:55 gibba023 bash[30844]: audit 2021-03-10T20:29:54.975357+0000 mon.a (mon.0) 866 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:56.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:55 gibba023 bash[31815]: cluster 2021-03-10T20:29:54.115114+0000 mgr.gibba044.wflcwh (mgr.34466) 1176 : cluster [DBG] pgmap v658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:56.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:55 gibba023 bash[31815]: cephadm 2021-03-10T20:29:54.573129+0000 mgr.gibba044.wflcwh (mgr.34466) 1177 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:29:56.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:55 gibba023 bash[31815]: audit 2021-03-10T20:29:54.770135+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:29:56.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:55 gibba023 bash[31815]: cephadm 2021-03-10T20:29:54.773613+0000 mgr.gibba044.wflcwh (mgr.34466) 1178 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:29:56.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:55 gibba023 bash[31815]: audit 2021-03-10T20:29:54.960564+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:29:56.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:55 gibba023 bash[31815]: audit 2021-03-10T20:29:54.964688+0000 mon.a (mon.0) 861 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:29:56.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:55 gibba023 bash[31815]: audit 2021-03-10T20:29:54.966798+0000 mon.a (mon.0) 862 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:56.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:55 gibba023 bash[31815]: audit 2021-03-10T20:29:54.968306+0000 mon.a (mon.0) 863 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:56.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:55 gibba023 bash[31815]: audit 2021-03-10T20:29:54.969977+0000 mon.a (mon.0) 864 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:56.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:55 gibba023 bash[31815]: audit 2021-03-10T20:29:54.973791+0000 mon.a (mon.0) 865 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:56.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:55 gibba023 bash[31815]: audit 2021-03-10T20:29:54.975357+0000 mon.a (mon.0) 866 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:56.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:55 gibba044 bash[25485]: cluster 2021-03-10T20:29:54.115114+0000 mgr.gibba044.wflcwh (mgr.34466) 1176 : cluster [DBG] pgmap v658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:56.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:55 gibba044 bash[25485]: cephadm 2021-03-10T20:29:54.573129+0000 mgr.gibba044.wflcwh (mgr.34466) 1177 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:29:56.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:55 gibba044 bash[25485]: audit 2021-03-10T20:29:54.770135+0000 mon.a (mon.0) 859 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:29:56.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:55 gibba044 bash[25485]: cephadm 2021-03-10T20:29:54.773613+0000 mgr.gibba044.wflcwh (mgr.34466) 1178 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:29:56.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:55 gibba044 bash[25485]: audit 2021-03-10T20:29:54.960564+0000 mon.a (mon.0) 860 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:29:56.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:55 gibba044 bash[25485]: audit 2021-03-10T20:29:54.964688+0000 mon.a (mon.0) 861 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:29:56.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:55 gibba044 bash[25485]: audit 2021-03-10T20:29:54.966798+0000 mon.a (mon.0) 862 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:56.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:55 gibba044 bash[25485]: audit 2021-03-10T20:29:54.968306+0000 mon.a (mon.0) 863 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:56.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:55 gibba044 bash[25485]: audit 2021-03-10T20:29:54.969977+0000 mon.a (mon.0) 864 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:56.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:55 gibba044 bash[25485]: audit 2021-03-10T20:29:54.973791+0000 mon.a (mon.0) 865 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:56.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:55 gibba044 bash[25485]: audit 2021-03-10T20:29:54.975357+0000 mon.a (mon.0) 866 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:29:57.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:56 gibba023 bash[30844]: cephadm 2021-03-10T20:29:54.966544+0000 mgr.gibba044.wflcwh (mgr.34466) 1179 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:29:57.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:56 gibba023 bash[30844]: cephadm 2021-03-10T20:29:54.968964+0000 mgr.gibba044.wflcwh (mgr.34466) 1180 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:29:57.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:56 gibba023 bash[30844]: cephadm 2021-03-10T20:29:54.970567+0000 mgr.gibba044.wflcwh (mgr.34466) 1181 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:29:57.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:56 gibba023 bash[30844]: cephadm 2021-03-10T20:29:54.970606+0000 mgr.gibba044.wflcwh (mgr.34466) 1182 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:29:57.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:56 gibba023 bash[30844]: cephadm 2021-03-10T20:29:54.972306+0000 mgr.gibba044.wflcwh (mgr.34466) 1183 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:29:57.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:56 gibba023 bash[30844]: cephadm 2021-03-10T20:29:54.972345+0000 mgr.gibba044.wflcwh (mgr.34466) 1184 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:29:57.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:56 gibba023 bash[30844]: cephadm 2021-03-10T20:29:54.974263+0000 mgr.gibba044.wflcwh (mgr.34466) 1185 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:29:57.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:56 gibba023 bash[30844]: cephadm 2021-03-10T20:29:54.975974+0000 mgr.gibba044.wflcwh (mgr.34466) 1186 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:29:57.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:56 gibba023 bash[30844]: cephadm 2021-03-10T20:29:54.976010+0000 mgr.gibba044.wflcwh (mgr.34466) 1187 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:29:57.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:56 gibba023 bash[30844]: cephadm 2021-03-10T20:29:54.977719+0000 mgr.gibba044.wflcwh (mgr.34466) 1188 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:29:57.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:56 gibba023 bash[30844]: cephadm 2021-03-10T20:29:54.978033+0000 mgr.gibba044.wflcwh (mgr.34466) 1189 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:29:57.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:56 gibba023 bash[30844]: cephadm 2021-03-10T20:29:54.979423+0000 mgr.gibba044.wflcwh (mgr.34466) 1190 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:29:57.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:56 gibba023 bash[30844]: cephadm 2021-03-10T20:29:54.979461+0000 mgr.gibba044.wflcwh (mgr.34466) 1191 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:29:57.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:56 gibba023 bash[30844]: cephadm 2021-03-10T20:29:54.979588+0000 mgr.gibba044.wflcwh (mgr.34466) 1192 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:29:57.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:56 gibba023 bash[31815]: cephadm 2021-03-10T20:29:54.966544+0000 mgr.gibba044.wflcwh (mgr.34466) 1179 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:29:57.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:56 gibba023 bash[31815]: cephadm 2021-03-10T20:29:54.968964+0000 mgr.gibba044.wflcwh (mgr.34466) 1180 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:29:57.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:56 gibba023 bash[31815]: cephadm 2021-03-10T20:29:54.970567+0000 mgr.gibba044.wflcwh (mgr.34466) 1181 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:29:57.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:56 gibba023 bash[31815]: cephadm 2021-03-10T20:29:54.970606+0000 mgr.gibba044.wflcwh (mgr.34466) 1182 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:29:57.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:56 gibba023 bash[31815]: cephadm 2021-03-10T20:29:54.972306+0000 mgr.gibba044.wflcwh (mgr.34466) 1183 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:29:57.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:56 gibba023 bash[31815]: cephadm 2021-03-10T20:29:54.972345+0000 mgr.gibba044.wflcwh (mgr.34466) 1184 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:29:57.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:56 gibba023 bash[31815]: cephadm 2021-03-10T20:29:54.974263+0000 mgr.gibba044.wflcwh (mgr.34466) 1185 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:29:57.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:56 gibba023 bash[31815]: cephadm 2021-03-10T20:29:54.975974+0000 mgr.gibba044.wflcwh (mgr.34466) 1186 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:29:57.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:56 gibba023 bash[31815]: cephadm 2021-03-10T20:29:54.976010+0000 mgr.gibba044.wflcwh (mgr.34466) 1187 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:29:57.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:56 gibba023 bash[31815]: cephadm 2021-03-10T20:29:54.977719+0000 mgr.gibba044.wflcwh (mgr.34466) 1188 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:29:57.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:56 gibba023 bash[31815]: cephadm 2021-03-10T20:29:54.978033+0000 mgr.gibba044.wflcwh (mgr.34466) 1189 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:29:57.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:56 gibba023 bash[31815]: cephadm 2021-03-10T20:29:54.979423+0000 mgr.gibba044.wflcwh (mgr.34466) 1190 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:29:57.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:56 gibba023 bash[31815]: cephadm 2021-03-10T20:29:54.979461+0000 mgr.gibba044.wflcwh (mgr.34466) 1191 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:29:57.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:56 gibba023 bash[31815]: cephadm 2021-03-10T20:29:54.979588+0000 mgr.gibba044.wflcwh (mgr.34466) 1192 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:29:57.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:56 gibba044 bash[25485]: cephadm 2021-03-10T20:29:54.966544+0000 mgr.gibba044.wflcwh (mgr.34466) 1179 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:29:57.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:56 gibba044 bash[25485]: cephadm 2021-03-10T20:29:54.968964+0000 mgr.gibba044.wflcwh (mgr.34466) 1180 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:29:57.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:56 gibba044 bash[25485]: cephadm 2021-03-10T20:29:54.970567+0000 mgr.gibba044.wflcwh (mgr.34466) 1181 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:29:57.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:56 gibba044 bash[25485]: cephadm 2021-03-10T20:29:54.970606+0000 mgr.gibba044.wflcwh (mgr.34466) 1182 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:29:57.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:56 gibba044 bash[25485]: cephadm 2021-03-10T20:29:54.972306+0000 mgr.gibba044.wflcwh (mgr.34466) 1183 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:29:57.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:56 gibba044 bash[25485]: cephadm 2021-03-10T20:29:54.972345+0000 mgr.gibba044.wflcwh (mgr.34466) 1184 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:29:57.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:56 gibba044 bash[25485]: cephadm 2021-03-10T20:29:54.974263+0000 mgr.gibba044.wflcwh (mgr.34466) 1185 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:29:57.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:56 gibba044 bash[25485]: cephadm 2021-03-10T20:29:54.975974+0000 mgr.gibba044.wflcwh (mgr.34466) 1186 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:29:57.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:56 gibba044 bash[25485]: cephadm 2021-03-10T20:29:54.976010+0000 mgr.gibba044.wflcwh (mgr.34466) 1187 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:29:57.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:56 gibba044 bash[25485]: cephadm 2021-03-10T20:29:54.977719+0000 mgr.gibba044.wflcwh (mgr.34466) 1188 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:29:57.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:56 gibba044 bash[25485]: cephadm 2021-03-10T20:29:54.978033+0000 mgr.gibba044.wflcwh (mgr.34466) 1189 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:29:57.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:56 gibba044 bash[25485]: cephadm 2021-03-10T20:29:54.979423+0000 mgr.gibba044.wflcwh (mgr.34466) 1190 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:29:57.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:56 gibba044 bash[25485]: cephadm 2021-03-10T20:29:54.979461+0000 mgr.gibba044.wflcwh (mgr.34466) 1191 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:29:57.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:56 gibba044 bash[25485]: cephadm 2021-03-10T20:29:54.979588+0000 mgr.gibba044.wflcwh (mgr.34466) 1192 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:29:58.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:57 gibba023 bash[30844]: cluster 2021-03-10T20:29:56.116800+0000 mgr.gibba044.wflcwh (mgr.34466) 1193 : cluster [DBG] pgmap v659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:58.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:57 gibba023 bash[31815]: cluster 2021-03-10T20:29:56.116800+0000 mgr.gibba044.wflcwh (mgr.34466) 1193 : cluster [DBG] pgmap v659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:29:58.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:57 gibba044 bash[25485]: cluster 2021-03-10T20:29:56.116800+0000 mgr.gibba044.wflcwh (mgr.34466) 1193 : cluster [DBG] pgmap v659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:00.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:29:59 gibba023 bash[30844]: cluster 2021-03-10T20:29:58.118509+0000 mgr.gibba044.wflcwh (mgr.34466) 1194 : cluster [DBG] pgmap v660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:00.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:00 gibba023 bash[30844]: debug 2021-03-10T20:29:59.995+0000 7fa7fde59700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:30:00.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:29:59 gibba023 bash[31815]: cluster 2021-03-10T20:29:58.118509+0000 mgr.gibba044.wflcwh (mgr.34466) 1194 : cluster [DBG] pgmap v660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:00.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:29:59 gibba044 bash[25485]: cluster 2021-03-10T20:29:58.118509+0000 mgr.gibba044.wflcwh (mgr.34466) 1194 : cluster [DBG] pgmap v660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:01.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:00 gibba023 bash[30844]: cluster 2021-03-10T20:30:00.000387+0000 mon.a (mon.0) 867 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:30:01.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:00 gibba023 bash[31815]: cluster 2021-03-10T20:30:00.000387+0000 mon.a (mon.0) 867 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:30:01.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:00 gibba044 bash[25485]: cluster 2021-03-10T20:30:00.000387+0000 mon.a (mon.0) 867 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:30:02.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:01 gibba023 bash[30844]: cluster 2021-03-10T20:30:00.119734+0000 mgr.gibba044.wflcwh (mgr.34466) 1195 : cluster [DBG] pgmap v661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:02.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:01 gibba023 bash[31815]: cluster 2021-03-10T20:30:00.119734+0000 mgr.gibba044.wflcwh (mgr.34466) 1195 : cluster [DBG] pgmap v661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:02.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:01 gibba044 bash[25485]: cluster 2021-03-10T20:30:00.119734+0000 mgr.gibba044.wflcwh (mgr.34466) 1195 : cluster [DBG] pgmap v661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:04.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:03 gibba023 bash[30844]: cluster 2021-03-10T20:30:02.121189+0000 mgr.gibba044.wflcwh (mgr.34466) 1196 : cluster [DBG] pgmap v662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:04.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:03 gibba023 bash[31815]: cluster 2021-03-10T20:30:02.121189+0000 mgr.gibba044.wflcwh (mgr.34466) 1196 : cluster [DBG] pgmap v662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:04.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:03 gibba044 bash[25485]: cluster 2021-03-10T20:30:02.121189+0000 mgr.gibba044.wflcwh (mgr.34466) 1196 : cluster [DBG] pgmap v662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:06.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:05 gibba023 bash[30844]: cluster 2021-03-10T20:30:04.122954+0000 mgr.gibba044.wflcwh (mgr.34466) 1197 : cluster [DBG] pgmap v663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:06.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:05 gibba023 bash[31815]: cluster 2021-03-10T20:30:04.122954+0000 mgr.gibba044.wflcwh (mgr.34466) 1197 : cluster [DBG] pgmap v663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:06.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:05 gibba044 bash[25485]: cluster 2021-03-10T20:30:04.122954+0000 mgr.gibba044.wflcwh (mgr.34466) 1197 : cluster [DBG] pgmap v663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:08.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:07 gibba023 bash[30844]: cluster 2021-03-10T20:30:06.124579+0000 mgr.gibba044.wflcwh (mgr.34466) 1198 : cluster [DBG] pgmap v664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:08.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:07 gibba023 bash[31815]: cluster 2021-03-10T20:30:06.124579+0000 mgr.gibba044.wflcwh (mgr.34466) 1198 : cluster [DBG] pgmap v664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:08.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:07 gibba044 bash[25485]: cluster 2021-03-10T20:30:06.124579+0000 mgr.gibba044.wflcwh (mgr.34466) 1198 : cluster [DBG] pgmap v664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:10.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:09 gibba023 bash[30844]: cluster 2021-03-10T20:30:08.126231+0000 mgr.gibba044.wflcwh (mgr.34466) 1199 : cluster [DBG] pgmap v665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:10.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:09 gibba023 bash[31815]: cluster 2021-03-10T20:30:08.126231+0000 mgr.gibba044.wflcwh (mgr.34466) 1199 : cluster [DBG] pgmap v665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:10.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:09 gibba044 bash[25485]: cluster 2021-03-10T20:30:08.126231+0000 mgr.gibba044.wflcwh (mgr.34466) 1199 : cluster [DBG] pgmap v665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:11.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:10 gibba023 bash[30844]: cephadm 2021-03-10T20:30:09.995704+0000 mgr.gibba044.wflcwh (mgr.34466) 1200 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:30:11.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:10 gibba023 bash[30844]: cluster 2021-03-10T20:30:10.127735+0000 mgr.gibba044.wflcwh (mgr.34466) 1201 : cluster [DBG] pgmap v666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:11.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:10 gibba023 bash[31815]: cephadm 2021-03-10T20:30:09.995704+0000 mgr.gibba044.wflcwh (mgr.34466) 1200 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:30:11.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:10 gibba023 bash[31815]: cluster 2021-03-10T20:30:10.127735+0000 mgr.gibba044.wflcwh (mgr.34466) 1201 : cluster [DBG] pgmap v666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:11.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:10 gibba044 bash[25485]: cephadm 2021-03-10T20:30:09.995704+0000 mgr.gibba044.wflcwh (mgr.34466) 1200 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:30:11.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:10 gibba044 bash[25485]: cluster 2021-03-10T20:30:10.127735+0000 mgr.gibba044.wflcwh (mgr.34466) 1201 : cluster [DBG] pgmap v666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:13.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:13 gibba023 bash[30844]: cluster 2021-03-10T20:30:12.129240+0000 mgr.gibba044.wflcwh (mgr.34466) 1202 : cluster [DBG] pgmap v667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:13.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:13 gibba023 bash[31815]: cluster 2021-03-10T20:30:12.129240+0000 mgr.gibba044.wflcwh (mgr.34466) 1202 : cluster [DBG] pgmap v667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:13.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:13 gibba044 bash[25485]: cluster 2021-03-10T20:30:12.129240+0000 mgr.gibba044.wflcwh (mgr.34466) 1202 : cluster [DBG] pgmap v667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:15.571 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:30:15.799 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:30:15.799 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (21m) 7m ago 26m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:30:15.800 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (26m) 6m ago 26m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:30:15.800 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (21m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:30:15.800 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (22m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:30:15.800 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (21m) 7m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:30:15.801 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (20m) 7m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:30:15.801 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (20m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:30:15.801 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (20m) 7m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:30:15.801 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (27m) 7m ago 27m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:30:15.801 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (27m) 6m ago 27m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:30:15.802 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (19m) 7m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:30:15.802 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (19m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:30:15.802 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (18m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:30:15.802 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (18m) 7m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:30:15.803 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (17m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:30:15.803 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (17m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:30:15.803 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (17m) 6m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:30:15.803 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (16m) 6m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:30:15.804 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (26m) 6m ago 27m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:30:15.804 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 7m ago 24m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:30:15.804 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 6m ago 24m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:30:15.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:15 gibba023 bash[30844]: cluster 2021-03-10T20:30:14.130970+0000 mgr.gibba044.wflcwh (mgr.34466) 1203 : cluster [DBG] pgmap v668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:15.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:15 gibba023 bash[31815]: cluster 2021-03-10T20:30:14.130970+0000 mgr.gibba044.wflcwh (mgr.34466) 1203 : cluster [DBG] pgmap v668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:15.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:15 gibba044 bash[25485]: cluster 2021-03-10T20:30:14.130970+0000 mgr.gibba044.wflcwh (mgr.34466) 1203 : cluster [DBG] pgmap v668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:16.049 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:30:16.049 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:30:16.049 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:30:16.050 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:30:16.050 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:30:16.050 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:30:16.050 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:30:16.051 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:30:16.051 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:30:16.051 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:30:16.051 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:30:16.052 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:30:16.052 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:30:16.052 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:30:16.053 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:30:16.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:16 gibba023 bash[30844]: audit 2021-03-10T20:30:15.565601+0000 mgr.gibba044.wflcwh (mgr.34466) 1204 : audit [DBG] from='client.54847 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:30:16.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:16 gibba023 bash[30844]: audit 2021-03-10T20:30:15.791513+0000 mgr.gibba044.wflcwh (mgr.34466) 1205 : audit [DBG] from='client.44874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:30:16.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:16 gibba023 bash[30844]: audit 2021-03-10T20:30:16.049579+0000 mon.c (mon.1) 35 : audit [DBG] from='client.? 172.21.2.123:0/2985565093' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:16.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:16 gibba023 bash[31815]: audit 2021-03-10T20:30:15.565601+0000 mgr.gibba044.wflcwh (mgr.34466) 1204 : audit [DBG] from='client.54847 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:30:16.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:16 gibba023 bash[31815]: audit 2021-03-10T20:30:15.791513+0000 mgr.gibba044.wflcwh (mgr.34466) 1205 : audit [DBG] from='client.44874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:30:16.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:16 gibba023 bash[31815]: audit 2021-03-10T20:30:16.049579+0000 mon.c (mon.1) 35 : audit [DBG] from='client.? 172.21.2.123:0/2985565093' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:16.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:16 gibba044 bash[25485]: audit 2021-03-10T20:30:15.565601+0000 mgr.gibba044.wflcwh (mgr.34466) 1204 : audit [DBG] from='client.54847 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:30:16.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:16 gibba044 bash[25485]: audit 2021-03-10T20:30:15.791513+0000 mgr.gibba044.wflcwh (mgr.34466) 1205 : audit [DBG] from='client.44874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:30:16.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:16 gibba044 bash[25485]: audit 2021-03-10T20:30:16.049579+0000 mon.c (mon.1) 35 : audit [DBG] from='client.? 172.21.2.123:0/2985565093' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:17.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:17 gibba023 bash[30844]: cluster 2021-03-10T20:30:16.132584+0000 mgr.gibba044.wflcwh (mgr.34466) 1206 : cluster [DBG] pgmap v669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:17.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:17 gibba023 bash[31815]: cluster 2021-03-10T20:30:16.132584+0000 mgr.gibba044.wflcwh (mgr.34466) 1206 : cluster [DBG] pgmap v669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:17.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:17 gibba044 bash[25485]: cluster 2021-03-10T20:30:16.132584+0000 mgr.gibba044.wflcwh (mgr.34466) 1206 : cluster [DBG] pgmap v669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:19.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:19 gibba023 bash[30844]: cluster 2021-03-10T20:30:18.134290+0000 mgr.gibba044.wflcwh (mgr.34466) 1207 : cluster [DBG] pgmap v670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:19.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:19 gibba023 bash[31815]: cluster 2021-03-10T20:30:18.134290+0000 mgr.gibba044.wflcwh (mgr.34466) 1207 : cluster [DBG] pgmap v670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:19.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:19 gibba044 bash[25485]: cluster 2021-03-10T20:30:18.134290+0000 mgr.gibba044.wflcwh (mgr.34466) 1207 : cluster [DBG] pgmap v670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:21.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:21 gibba023 bash[30844]: cluster 2021-03-10T20:30:20.135572+0000 mgr.gibba044.wflcwh (mgr.34466) 1208 : cluster [DBG] pgmap v671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:21.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:21 gibba023 bash[31815]: cluster 2021-03-10T20:30:20.135572+0000 mgr.gibba044.wflcwh (mgr.34466) 1208 : cluster [DBG] pgmap v671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:21.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:21 gibba044 bash[25485]: cluster 2021-03-10T20:30:20.135572+0000 mgr.gibba044.wflcwh (mgr.34466) 1208 : cluster [DBG] pgmap v671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:23.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:23 gibba023 bash[30844]: cluster 2021-03-10T20:30:22.137110+0000 mgr.gibba044.wflcwh (mgr.34466) 1209 : cluster [DBG] pgmap v672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:23.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:23 gibba023 bash[31815]: cluster 2021-03-10T20:30:22.137110+0000 mgr.gibba044.wflcwh (mgr.34466) 1209 : cluster [DBG] pgmap v672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:23.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:23 gibba044 bash[25485]: cluster 2021-03-10T20:30:22.137110+0000 mgr.gibba044.wflcwh (mgr.34466) 1209 : cluster [DBG] pgmap v672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:25.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:25 gibba023 bash[30844]: cluster 2021-03-10T20:30:24.138721+0000 mgr.gibba044.wflcwh (mgr.34466) 1210 : cluster [DBG] pgmap v673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:25.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:25 gibba023 bash[31815]: cluster 2021-03-10T20:30:24.138721+0000 mgr.gibba044.wflcwh (mgr.34466) 1210 : cluster [DBG] pgmap v673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:25.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:25 gibba044 bash[25485]: cluster 2021-03-10T20:30:24.138721+0000 mgr.gibba044.wflcwh (mgr.34466) 1210 : cluster [DBG] pgmap v673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:26.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:26 gibba023 bash[30844]: cephadm 2021-03-10T20:30:25.011662+0000 mgr.gibba044.wflcwh (mgr.34466) 1211 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:30:26.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:26 gibba023 bash[31815]: cephadm 2021-03-10T20:30:25.011662+0000 mgr.gibba044.wflcwh (mgr.34466) 1211 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:30:26.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:26 gibba044 bash[25485]: cephadm 2021-03-10T20:30:25.011662+0000 mgr.gibba044.wflcwh (mgr.34466) 1211 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:30:27.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:27 gibba023 bash[30844]: cluster 2021-03-10T20:30:26.140390+0000 mgr.gibba044.wflcwh (mgr.34466) 1212 : cluster [DBG] pgmap v674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:27.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:27 gibba023 bash[30844]: audit 2021-03-10T20:30:27.126449+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T20:30:27.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:27 gibba023 bash[30844]: audit 2021-03-10T20:30:27.127175+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:30:27.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:27 gibba023 bash[30844]: audit 2021-03-10T20:30:27.127869+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:30:27.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:27 gibba023 bash[30844]: audit 2021-03-10T20:30:27.128537+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:30:27.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:27 gibba023 bash[30844]: audit 2021-03-10T20:30:27.152472+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:30:27.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:27 gibba023 bash[30844]: audit 2021-03-10T20:30:27.153097+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:30:27.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:27 gibba023 bash[31815]: cluster 2021-03-10T20:30:26.140390+0000 mgr.gibba044.wflcwh (mgr.34466) 1212 : cluster [DBG] pgmap v674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:27.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:27 gibba023 bash[31815]: audit 2021-03-10T20:30:27.126449+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T20:30:27.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:27 gibba023 bash[31815]: audit 2021-03-10T20:30:27.127175+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:30:27.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:27 gibba023 bash[31815]: audit 2021-03-10T20:30:27.127869+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:30:27.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:27 gibba023 bash[31815]: audit 2021-03-10T20:30:27.128537+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:30:27.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:27 gibba023 bash[31815]: audit 2021-03-10T20:30:27.152472+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:30:27.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:27 gibba023 bash[31815]: audit 2021-03-10T20:30:27.153097+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:30:27.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:27 gibba044 bash[25485]: cluster 2021-03-10T20:30:26.140390+0000 mgr.gibba044.wflcwh (mgr.34466) 1212 : cluster [DBG] pgmap v674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:27.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:27 gibba044 bash[25485]: audit 2021-03-10T20:30:27.126449+0000 mon.a (mon.0) 868 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T20:30:27.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:27 gibba044 bash[25485]: audit 2021-03-10T20:30:27.127175+0000 mon.a (mon.0) 869 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:30:27.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:27 gibba044 bash[25485]: audit 2021-03-10T20:30:27.127869+0000 mon.a (mon.0) 870 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:30:27.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:27 gibba044 bash[25485]: audit 2021-03-10T20:30:27.128537+0000 mon.a (mon.0) 871 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:30:27.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:27 gibba044 bash[25485]: audit 2021-03-10T20:30:27.152472+0000 mon.a (mon.0) 872 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:30:27.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:27 gibba044 bash[25485]: audit 2021-03-10T20:30:27.153097+0000 mon.a (mon.0) 873 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:30:29.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:29 gibba023 bash[30844]: cluster 2021-03-10T20:30:28.142016+0000 mgr.gibba044.wflcwh (mgr.34466) 1213 : cluster [DBG] pgmap v675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:29.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:29 gibba023 bash[31815]: cluster 2021-03-10T20:30:28.142016+0000 mgr.gibba044.wflcwh (mgr.34466) 1213 : cluster [DBG] pgmap v675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:29.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:29 gibba044 bash[25485]: cluster 2021-03-10T20:30:28.142016+0000 mgr.gibba044.wflcwh (mgr.34466) 1213 : cluster [DBG] pgmap v675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:31.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:31 gibba023 bash[30844]: cluster 2021-03-10T20:30:30.143390+0000 mgr.gibba044.wflcwh (mgr.34466) 1214 : cluster [DBG] pgmap v676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:31.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:31 gibba023 bash[31815]: cluster 2021-03-10T20:30:30.143390+0000 mgr.gibba044.wflcwh (mgr.34466) 1214 : cluster [DBG] pgmap v676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:31.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:31 gibba044 bash[25485]: cluster 2021-03-10T20:30:30.143390+0000 mgr.gibba044.wflcwh (mgr.34466) 1214 : cluster [DBG] pgmap v676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:33.923 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:33 gibba023 bash[30844]: cluster 2021-03-10T20:30:32.145147+0000 mgr.gibba044.wflcwh (mgr.34466) 1215 : cluster [DBG] pgmap v677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:33.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:33 gibba023 bash[31815]: cluster 2021-03-10T20:30:32.145147+0000 mgr.gibba044.wflcwh (mgr.34466) 1215 : cluster [DBG] pgmap v677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:33.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:33 gibba044 bash[25485]: cluster 2021-03-10T20:30:32.145147+0000 mgr.gibba044.wflcwh (mgr.34466) 1215 : cluster [DBG] pgmap v677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:35.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:35 gibba023 bash[30844]: cluster 2021-03-10T20:30:34.146961+0000 mgr.gibba044.wflcwh (mgr.34466) 1216 : cluster [DBG] pgmap v678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:35.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:35 gibba023 bash[31815]: cluster 2021-03-10T20:30:34.146961+0000 mgr.gibba044.wflcwh (mgr.34466) 1216 : cluster [DBG] pgmap v678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:35.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:35 gibba044 bash[25485]: cluster 2021-03-10T20:30:34.146961+0000 mgr.gibba044.wflcwh (mgr.34466) 1216 : cluster [DBG] pgmap v678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:37.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:37 gibba023 bash[30844]: cluster 2021-03-10T20:30:36.148479+0000 mgr.gibba044.wflcwh (mgr.34466) 1217 : cluster [DBG] pgmap v679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:37.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:37 gibba023 bash[31815]: cluster 2021-03-10T20:30:36.148479+0000 mgr.gibba044.wflcwh (mgr.34466) 1217 : cluster [DBG] pgmap v679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:37.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:37 gibba044 bash[25485]: cluster 2021-03-10T20:30:36.148479+0000 mgr.gibba044.wflcwh (mgr.34466) 1217 : cluster [DBG] pgmap v679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:39.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:39 gibba023 bash[30844]: cluster 2021-03-10T20:30:38.150024+0000 mgr.gibba044.wflcwh (mgr.34466) 1218 : cluster [DBG] pgmap v680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:39.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:39 gibba023 bash[31815]: cluster 2021-03-10T20:30:38.150024+0000 mgr.gibba044.wflcwh (mgr.34466) 1218 : cluster [DBG] pgmap v680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:39.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:39 gibba044 bash[25485]: cluster 2021-03-10T20:30:38.150024+0000 mgr.gibba044.wflcwh (mgr.34466) 1218 : cluster [DBG] pgmap v680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:42.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:41 gibba044 bash[25485]: cephadm 2021-03-10T20:30:40.013770+0000 mgr.gibba044.wflcwh (mgr.34466) 1219 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:30:42.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:41 gibba044 bash[25485]: cluster 2021-03-10T20:30:40.151268+0000 mgr.gibba044.wflcwh (mgr.34466) 1220 : cluster [DBG] pgmap v681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:42.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:41 gibba023 bash[30844]: cephadm 2021-03-10T20:30:40.013770+0000 mgr.gibba044.wflcwh (mgr.34466) 1219 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:30:42.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:41 gibba023 bash[30844]: cluster 2021-03-10T20:30:40.151268+0000 mgr.gibba044.wflcwh (mgr.34466) 1220 : cluster [DBG] pgmap v681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:42.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:41 gibba023 bash[31815]: cephadm 2021-03-10T20:30:40.013770+0000 mgr.gibba044.wflcwh (mgr.34466) 1219 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:30:42.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:41 gibba023 bash[31815]: cluster 2021-03-10T20:30:40.151268+0000 mgr.gibba044.wflcwh (mgr.34466) 1220 : cluster [DBG] pgmap v681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:43.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:43 gibba044 bash[25485]: cluster 2021-03-10T20:30:42.153023+0000 mgr.gibba044.wflcwh (mgr.34466) 1221 : cluster [DBG] pgmap v682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:44.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:43 gibba023 bash[30844]: cluster 2021-03-10T20:30:42.153023+0000 mgr.gibba044.wflcwh (mgr.34466) 1221 : cluster [DBG] pgmap v682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:44.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:43 gibba023 bash[31815]: cluster 2021-03-10T20:30:42.153023+0000 mgr.gibba044.wflcwh (mgr.34466) 1221 : cluster [DBG] pgmap v682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:45.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:45 gibba044 bash[25485]: cluster 2021-03-10T20:30:44.154849+0000 mgr.gibba044.wflcwh (mgr.34466) 1222 : cluster [DBG] pgmap v683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:46.173 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:45 gibba023 bash[30844]: cluster 2021-03-10T20:30:44.154849+0000 mgr.gibba044.wflcwh (mgr.34466) 1222 : cluster [DBG] pgmap v683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:46.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:45 gibba023 bash[31815]: cluster 2021-03-10T20:30:44.154849+0000 mgr.gibba044.wflcwh (mgr.34466) 1222 : cluster [DBG] pgmap v683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:46.292 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:30:46.521 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:30:46.521 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (21m) 7m ago 27m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:30:46.521 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (27m) 6m ago 27m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:30:46.522 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (22m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:30:46.522 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (22m) 6m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:30:46.522 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (21m) 7m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:30:46.522 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (21m) 7m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:30:46.522 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (20m) 6m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:30:46.523 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (21m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:30:46.523 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (27m) 7m ago 27m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:30:46.523 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (27m) 6m ago 27m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:30:46.523 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (20m) 7m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:30:46.524 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (19m) 7m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:30:46.524 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (19m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:30:46.524 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (18m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:30:46.524 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (18m) 6m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:30:46.524 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (17m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:30:46.525 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (17m) 6m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:30:46.525 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (17m) 6m ago 27m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:30:46.525 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (26m) 6m ago 27m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:30:46.525 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 7m ago 25m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:30:46.525 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 6m ago 25m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:30:46.773 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:30:46.774 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:30:46.774 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:30:46.774 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:30:46.774 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:30:46.775 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:30:46.775 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:30:46.775 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:30:46.775 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:30:46.776 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:30:46.776 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:30:46.776 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:30:46.776 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:30:46.776 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:30:46.777 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:30:47.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:47 gibba044 bash[25485]: cluster 2021-03-10T20:30:46.156387+0000 mgr.gibba044.wflcwh (mgr.34466) 1223 : cluster [DBG] pgmap v684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:47.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:47 gibba044 bash[25485]: audit 2021-03-10T20:30:46.287044+0000 mgr.gibba044.wflcwh (mgr.34466) 1224 : audit [DBG] from='client.54865 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:30:47.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:47 gibba044 bash[25485]: audit 2021-03-10T20:30:46.512369+0000 mgr.gibba044.wflcwh (mgr.34466) 1225 : audit [DBG] from='client.44892 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:30:47.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:47 gibba044 bash[25485]: audit 2021-03-10T20:30:46.774356+0000 mon.a (mon.0) 874 : audit [DBG] from='client.? 172.21.2.123:0/3074759145' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:48.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:47 gibba023 bash[30844]: cluster 2021-03-10T20:30:46.156387+0000 mgr.gibba044.wflcwh (mgr.34466) 1223 : cluster [DBG] pgmap v684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:48.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:47 gibba023 bash[30844]: audit 2021-03-10T20:30:46.287044+0000 mgr.gibba044.wflcwh (mgr.34466) 1224 : audit [DBG] from='client.54865 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:30:48.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:47 gibba023 bash[30844]: audit 2021-03-10T20:30:46.512369+0000 mgr.gibba044.wflcwh (mgr.34466) 1225 : audit [DBG] from='client.44892 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:30:48.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:47 gibba023 bash[30844]: audit 2021-03-10T20:30:46.774356+0000 mon.a (mon.0) 874 : audit [DBG] from='client.? 172.21.2.123:0/3074759145' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:48.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:47 gibba023 bash[31815]: cluster 2021-03-10T20:30:46.156387+0000 mgr.gibba044.wflcwh (mgr.34466) 1223 : cluster [DBG] pgmap v684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:48.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:47 gibba023 bash[31815]: audit 2021-03-10T20:30:46.287044+0000 mgr.gibba044.wflcwh (mgr.34466) 1224 : audit [DBG] from='client.54865 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:30:48.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:47 gibba023 bash[31815]: audit 2021-03-10T20:30:46.512369+0000 mgr.gibba044.wflcwh (mgr.34466) 1225 : audit [DBG] from='client.44892 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:30:48.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:47 gibba023 bash[31815]: audit 2021-03-10T20:30:46.774356+0000 mon.a (mon.0) 874 : audit [DBG] from='client.? 172.21.2.123:0/3074759145' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:49.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:49 gibba044 bash[25485]: cluster 2021-03-10T20:30:48.157932+0000 mgr.gibba044.wflcwh (mgr.34466) 1226 : cluster [DBG] pgmap v685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:50.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:49 gibba023 bash[30844]: cluster 2021-03-10T20:30:48.157932+0000 mgr.gibba044.wflcwh (mgr.34466) 1226 : cluster [DBG] pgmap v685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:50.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:49 gibba023 bash[31815]: cluster 2021-03-10T20:30:48.157932+0000 mgr.gibba044.wflcwh (mgr.34466) 1226 : cluster [DBG] pgmap v685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:51.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:51 gibba044 bash[25485]: cluster 2021-03-10T20:30:50.158914+0000 mgr.gibba044.wflcwh (mgr.34466) 1227 : cluster [DBG] pgmap v686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:52.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:51 gibba023 bash[30844]: cluster 2021-03-10T20:30:50.158914+0000 mgr.gibba044.wflcwh (mgr.34466) 1227 : cluster [DBG] pgmap v686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:52.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:51 gibba023 bash[31815]: cluster 2021-03-10T20:30:50.158914+0000 mgr.gibba044.wflcwh (mgr.34466) 1227 : cluster [DBG] pgmap v686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:53.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:53 gibba044 bash[25485]: cluster 2021-03-10T20:30:52.160529+0000 mgr.gibba044.wflcwh (mgr.34466) 1228 : cluster [DBG] pgmap v687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:54.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:53 gibba023 bash[30844]: cluster 2021-03-10T20:30:52.160529+0000 mgr.gibba044.wflcwh (mgr.34466) 1228 : cluster [DBG] pgmap v687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:54.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:53 gibba023 bash[31815]: cluster 2021-03-10T20:30:52.160529+0000 mgr.gibba044.wflcwh (mgr.34466) 1228 : cluster [DBG] pgmap v687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:55.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:55 gibba044 bash[25485]: cluster 2021-03-10T20:30:54.162047+0000 mgr.gibba044.wflcwh (mgr.34466) 1229 : cluster [DBG] pgmap v688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:56.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:55 gibba044 bash[25485]: audit 2021-03-10T20:30:55.260876+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:30:56.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:55 gibba044 bash[25485]: audit 2021-03-10T20:30:55.264903+0000 mon.a (mon.0) 876 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:30:56.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:55 gibba044 bash[25485]: audit 2021-03-10T20:30:55.266584+0000 mon.a (mon.0) 877 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:56.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:55 gibba044 bash[25485]: audit 2021-03-10T20:30:55.268116+0000 mon.a (mon.0) 878 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:56.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:55 gibba044 bash[25485]: audit 2021-03-10T20:30:55.269390+0000 mon.a (mon.0) 879 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:56.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:55 gibba044 bash[25485]: audit 2021-03-10T20:30:55.271943+0000 mon.a (mon.0) 880 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:56.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:55 gibba044 bash[25485]: audit 2021-03-10T20:30:55.273704+0000 mon.a (mon.0) 881 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:56.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:55 gibba023 bash[30844]: cluster 2021-03-10T20:30:54.162047+0000 mgr.gibba044.wflcwh (mgr.34466) 1229 : cluster [DBG] pgmap v688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:56.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:55 gibba023 bash[30844]: audit 2021-03-10T20:30:55.260876+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:30:56.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:55 gibba023 bash[30844]: audit 2021-03-10T20:30:55.264903+0000 mon.a (mon.0) 876 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:30:56.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:55 gibba023 bash[30844]: audit 2021-03-10T20:30:55.266584+0000 mon.a (mon.0) 877 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:56.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:55 gibba023 bash[30844]: audit 2021-03-10T20:30:55.268116+0000 mon.a (mon.0) 878 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:56.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:55 gibba023 bash[30844]: audit 2021-03-10T20:30:55.269390+0000 mon.a (mon.0) 879 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:56.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:55 gibba023 bash[30844]: audit 2021-03-10T20:30:55.271943+0000 mon.a (mon.0) 880 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:56.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:55 gibba023 bash[30844]: audit 2021-03-10T20:30:55.273704+0000 mon.a (mon.0) 881 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:56.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:55 gibba023 bash[31815]: cluster 2021-03-10T20:30:54.162047+0000 mgr.gibba044.wflcwh (mgr.34466) 1229 : cluster [DBG] pgmap v688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:56.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:55 gibba023 bash[31815]: audit 2021-03-10T20:30:55.260876+0000 mon.a (mon.0) 875 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:30:56.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:55 gibba023 bash[31815]: audit 2021-03-10T20:30:55.264903+0000 mon.a (mon.0) 876 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:30:56.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:55 gibba023 bash[31815]: audit 2021-03-10T20:30:55.266584+0000 mon.a (mon.0) 877 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:56.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:55 gibba023 bash[31815]: audit 2021-03-10T20:30:55.268116+0000 mon.a (mon.0) 878 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:56.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:55 gibba023 bash[31815]: audit 2021-03-10T20:30:55.269390+0000 mon.a (mon.0) 879 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:56.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:55 gibba023 bash[31815]: audit 2021-03-10T20:30:55.271943+0000 mon.a (mon.0) 880 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:56.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:55 gibba023 bash[31815]: audit 2021-03-10T20:30:55.273704+0000 mon.a (mon.0) 881 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:30:56.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:56 gibba044 bash[25485]: cephadm 2021-03-10T20:30:55.030286+0000 mgr.gibba044.wflcwh (mgr.34466) 1230 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:30:56.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:56 gibba044 bash[25485]: cephadm 2021-03-10T20:30:55.031904+0000 mgr.gibba044.wflcwh (mgr.34466) 1231 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:30:56.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:56 gibba044 bash[25485]: cephadm 2021-03-10T20:30:55.267133+0000 mgr.gibba044.wflcwh (mgr.34466) 1232 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:30:56.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:56 gibba044 bash[25485]: cephadm 2021-03-10T20:30:55.269226+0000 mgr.gibba044.wflcwh (mgr.34466) 1233 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:30:56.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:56 gibba044 bash[25485]: cephadm 2021-03-10T20:30:55.270735+0000 mgr.gibba044.wflcwh (mgr.34466) 1234 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:30:56.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:56 gibba044 bash[25485]: cephadm 2021-03-10T20:30:55.270782+0000 mgr.gibba044.wflcwh (mgr.34466) 1235 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:30:57.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:56 gibba044 bash[25485]: cephadm 2021-03-10T20:30:55.272202+0000 mgr.gibba044.wflcwh (mgr.34466) 1236 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:30:57.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:56 gibba044 bash[25485]: cephadm 2021-03-10T20:30:55.272247+0000 mgr.gibba044.wflcwh (mgr.34466) 1237 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:30:57.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:56 gibba044 bash[25485]: cephadm 2021-03-10T20:30:55.273427+0000 mgr.gibba044.wflcwh (mgr.34466) 1238 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:30:57.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:56 gibba044 bash[25485]: cephadm 2021-03-10T20:30:55.274481+0000 mgr.gibba044.wflcwh (mgr.34466) 1239 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:30:57.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:56 gibba044 bash[25485]: cephadm 2021-03-10T20:30:55.274529+0000 mgr.gibba044.wflcwh (mgr.34466) 1240 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:30:57.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:56 gibba044 bash[25485]: cephadm 2021-03-10T20:30:55.276037+0000 mgr.gibba044.wflcwh (mgr.34466) 1241 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:30:57.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:56 gibba044 bash[25485]: cephadm 2021-03-10T20:30:55.276457+0000 mgr.gibba044.wflcwh (mgr.34466) 1242 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:30:57.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:56 gibba044 bash[25485]: cephadm 2021-03-10T20:30:55.278171+0000 mgr.gibba044.wflcwh (mgr.34466) 1243 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:30:57.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:56 gibba044 bash[25485]: cephadm 2021-03-10T20:30:55.278227+0000 mgr.gibba044.wflcwh (mgr.34466) 1244 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:30:57.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:56 gibba044 bash[25485]: cephadm 2021-03-10T20:30:55.278417+0000 mgr.gibba044.wflcwh (mgr.34466) 1245 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:30:57.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[30844]: cephadm 2021-03-10T20:30:55.030286+0000 mgr.gibba044.wflcwh (mgr.34466) 1230 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:30:57.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[30844]: cephadm 2021-03-10T20:30:55.031904+0000 mgr.gibba044.wflcwh (mgr.34466) 1231 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:30:57.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[30844]: cephadm 2021-03-10T20:30:55.267133+0000 mgr.gibba044.wflcwh (mgr.34466) 1232 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:30:57.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[30844]: cephadm 2021-03-10T20:30:55.269226+0000 mgr.gibba044.wflcwh (mgr.34466) 1233 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:30:57.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[30844]: cephadm 2021-03-10T20:30:55.270735+0000 mgr.gibba044.wflcwh (mgr.34466) 1234 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:30:57.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[30844]: cephadm 2021-03-10T20:30:55.270782+0000 mgr.gibba044.wflcwh (mgr.34466) 1235 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:30:57.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[30844]: cephadm 2021-03-10T20:30:55.272202+0000 mgr.gibba044.wflcwh (mgr.34466) 1236 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:30:57.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[30844]: cephadm 2021-03-10T20:30:55.272247+0000 mgr.gibba044.wflcwh (mgr.34466) 1237 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:30:57.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[30844]: cephadm 2021-03-10T20:30:55.273427+0000 mgr.gibba044.wflcwh (mgr.34466) 1238 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:30:57.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[30844]: cephadm 2021-03-10T20:30:55.274481+0000 mgr.gibba044.wflcwh (mgr.34466) 1239 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:30:57.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[30844]: cephadm 2021-03-10T20:30:55.274529+0000 mgr.gibba044.wflcwh (mgr.34466) 1240 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:30:57.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[30844]: cephadm 2021-03-10T20:30:55.276037+0000 mgr.gibba044.wflcwh (mgr.34466) 1241 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:30:57.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[30844]: cephadm 2021-03-10T20:30:55.276457+0000 mgr.gibba044.wflcwh (mgr.34466) 1242 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:30:57.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[30844]: cephadm 2021-03-10T20:30:55.278171+0000 mgr.gibba044.wflcwh (mgr.34466) 1243 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:30:57.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[30844]: cephadm 2021-03-10T20:30:55.278227+0000 mgr.gibba044.wflcwh (mgr.34466) 1244 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:30:57.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[30844]: cephadm 2021-03-10T20:30:55.278417+0000 mgr.gibba044.wflcwh (mgr.34466) 1245 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:30:57.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[31815]: cephadm 2021-03-10T20:30:55.030286+0000 mgr.gibba044.wflcwh (mgr.34466) 1230 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:30:57.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[31815]: cephadm 2021-03-10T20:30:55.031904+0000 mgr.gibba044.wflcwh (mgr.34466) 1231 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:30:57.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[31815]: cephadm 2021-03-10T20:30:55.267133+0000 mgr.gibba044.wflcwh (mgr.34466) 1232 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:30:57.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[31815]: cephadm 2021-03-10T20:30:55.269226+0000 mgr.gibba044.wflcwh (mgr.34466) 1233 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:30:57.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[31815]: cephadm 2021-03-10T20:30:55.270735+0000 mgr.gibba044.wflcwh (mgr.34466) 1234 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:30:57.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[31815]: cephadm 2021-03-10T20:30:55.270782+0000 mgr.gibba044.wflcwh (mgr.34466) 1235 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:30:57.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[31815]: cephadm 2021-03-10T20:30:55.272202+0000 mgr.gibba044.wflcwh (mgr.34466) 1236 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:30:57.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[31815]: cephadm 2021-03-10T20:30:55.272247+0000 mgr.gibba044.wflcwh (mgr.34466) 1237 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:30:57.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[31815]: cephadm 2021-03-10T20:30:55.273427+0000 mgr.gibba044.wflcwh (mgr.34466) 1238 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:30:57.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[31815]: cephadm 2021-03-10T20:30:55.274481+0000 mgr.gibba044.wflcwh (mgr.34466) 1239 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:30:57.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[31815]: cephadm 2021-03-10T20:30:55.274529+0000 mgr.gibba044.wflcwh (mgr.34466) 1240 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:30:57.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[31815]: cephadm 2021-03-10T20:30:55.276037+0000 mgr.gibba044.wflcwh (mgr.34466) 1241 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:30:57.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[31815]: cephadm 2021-03-10T20:30:55.276457+0000 mgr.gibba044.wflcwh (mgr.34466) 1242 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:30:57.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[31815]: cephadm 2021-03-10T20:30:55.278171+0000 mgr.gibba044.wflcwh (mgr.34466) 1243 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:30:57.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[31815]: cephadm 2021-03-10T20:30:55.278227+0000 mgr.gibba044.wflcwh (mgr.34466) 1244 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:30:57.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:56 gibba023 bash[31815]: cephadm 2021-03-10T20:30:55.278417+0000 mgr.gibba044.wflcwh (mgr.34466) 1245 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:30:58.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:57 gibba023 bash[30844]: cluster 2021-03-10T20:30:56.163412+0000 mgr.gibba044.wflcwh (mgr.34466) 1246 : cluster [DBG] pgmap v689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:58.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:57 gibba023 bash[31815]: cluster 2021-03-10T20:30:56.163412+0000 mgr.gibba044.wflcwh (mgr.34466) 1246 : cluster [DBG] pgmap v689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:30:58.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:57 gibba044 bash[25485]: cluster 2021-03-10T20:30:56.163412+0000 mgr.gibba044.wflcwh (mgr.34466) 1246 : cluster [DBG] pgmap v689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:00.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:30:59 gibba023 bash[30844]: cluster 2021-03-10T20:30:58.164967+0000 mgr.gibba044.wflcwh (mgr.34466) 1247 : cluster [DBG] pgmap v690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:00.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:30:59 gibba023 bash[31815]: cluster 2021-03-10T20:30:58.164967+0000 mgr.gibba044.wflcwh (mgr.34466) 1247 : cluster [DBG] pgmap v690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:00.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:30:59 gibba044 bash[25485]: cluster 2021-03-10T20:30:58.164967+0000 mgr.gibba044.wflcwh (mgr.34466) 1247 : cluster [DBG] pgmap v690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:02.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:01 gibba023 bash[30844]: cluster 2021-03-10T20:31:00.166253+0000 mgr.gibba044.wflcwh (mgr.34466) 1248 : cluster [DBG] pgmap v691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:02.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:01 gibba023 bash[31815]: cluster 2021-03-10T20:31:00.166253+0000 mgr.gibba044.wflcwh (mgr.34466) 1248 : cluster [DBG] pgmap v691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:02.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:01 gibba044 bash[25485]: cluster 2021-03-10T20:31:00.166253+0000 mgr.gibba044.wflcwh (mgr.34466) 1248 : cluster [DBG] pgmap v691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:04.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:03 gibba023 bash[30844]: cluster 2021-03-10T20:31:02.167921+0000 mgr.gibba044.wflcwh (mgr.34466) 1249 : cluster [DBG] pgmap v692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:04.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:03 gibba023 bash[31815]: cluster 2021-03-10T20:31:02.167921+0000 mgr.gibba044.wflcwh (mgr.34466) 1249 : cluster [DBG] pgmap v692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:04.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:03 gibba044 bash[25485]: cluster 2021-03-10T20:31:02.167921+0000 mgr.gibba044.wflcwh (mgr.34466) 1249 : cluster [DBG] pgmap v692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:06.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:05 gibba023 bash[30844]: cluster 2021-03-10T20:31:04.169443+0000 mgr.gibba044.wflcwh (mgr.34466) 1250 : cluster [DBG] pgmap v693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:06.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:05 gibba023 bash[31815]: cluster 2021-03-10T20:31:04.169443+0000 mgr.gibba044.wflcwh (mgr.34466) 1250 : cluster [DBG] pgmap v693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:06.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:05 gibba044 bash[25485]: cluster 2021-03-10T20:31:04.169443+0000 mgr.gibba044.wflcwh (mgr.34466) 1250 : cluster [DBG] pgmap v693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:08.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:07 gibba023 bash[30844]: cluster 2021-03-10T20:31:06.170915+0000 mgr.gibba044.wflcwh (mgr.34466) 1251 : cluster [DBG] pgmap v694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:08.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:07 gibba023 bash[31815]: cluster 2021-03-10T20:31:06.170915+0000 mgr.gibba044.wflcwh (mgr.34466) 1251 : cluster [DBG] pgmap v694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:08.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:07 gibba044 bash[25485]: cluster 2021-03-10T20:31:06.170915+0000 mgr.gibba044.wflcwh (mgr.34466) 1251 : cluster [DBG] pgmap v694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:10.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:09 gibba023 bash[30844]: cluster 2021-03-10T20:31:08.172599+0000 mgr.gibba044.wflcwh (mgr.34466) 1252 : cluster [DBG] pgmap v695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:10.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:09 gibba023 bash[31815]: cluster 2021-03-10T20:31:08.172599+0000 mgr.gibba044.wflcwh (mgr.34466) 1252 : cluster [DBG] pgmap v695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:10.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:09 gibba044 bash[25485]: cluster 2021-03-10T20:31:08.172599+0000 mgr.gibba044.wflcwh (mgr.34466) 1252 : cluster [DBG] pgmap v695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:12.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:11 gibba023 bash[30844]: cluster 2021-03-10T20:31:10.173878+0000 mgr.gibba044.wflcwh (mgr.34466) 1253 : cluster [DBG] pgmap v696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:12.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:11 gibba023 bash[30844]: cephadm 2021-03-10T20:31:10.294188+0000 mgr.gibba044.wflcwh (mgr.34466) 1254 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:31:12.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:11 gibba023 bash[31815]: cluster 2021-03-10T20:31:10.173878+0000 mgr.gibba044.wflcwh (mgr.34466) 1253 : cluster [DBG] pgmap v696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:12.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:11 gibba023 bash[31815]: cephadm 2021-03-10T20:31:10.294188+0000 mgr.gibba044.wflcwh (mgr.34466) 1254 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:31:12.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:11 gibba044 bash[25485]: cluster 2021-03-10T20:31:10.173878+0000 mgr.gibba044.wflcwh (mgr.34466) 1253 : cluster [DBG] pgmap v696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:12.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:11 gibba044 bash[25485]: cephadm 2021-03-10T20:31:10.294188+0000 mgr.gibba044.wflcwh (mgr.34466) 1254 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:31:14.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:13 gibba023 bash[30844]: cluster 2021-03-10T20:31:12.175407+0000 mgr.gibba044.wflcwh (mgr.34466) 1255 : cluster [DBG] pgmap v697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:14.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:13 gibba023 bash[31815]: cluster 2021-03-10T20:31:12.175407+0000 mgr.gibba044.wflcwh (mgr.34466) 1255 : cluster [DBG] pgmap v697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:14.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:13 gibba044 bash[25485]: cluster 2021-03-10T20:31:12.175407+0000 mgr.gibba044.wflcwh (mgr.34466) 1255 : cluster [DBG] pgmap v697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:16.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:15 gibba023 bash[30844]: cluster 2021-03-10T20:31:14.176913+0000 mgr.gibba044.wflcwh (mgr.34466) 1256 : cluster [DBG] pgmap v698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:16.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:15 gibba023 bash[31815]: cluster 2021-03-10T20:31:14.176913+0000 mgr.gibba044.wflcwh (mgr.34466) 1256 : cluster [DBG] pgmap v698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:16.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:15 gibba044 bash[25485]: cluster 2021-03-10T20:31:14.176913+0000 mgr.gibba044.wflcwh (mgr.34466) 1256 : cluster [DBG] pgmap v698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:17.020 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:31:17.250 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:31:17.250 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (22m) 8m ago 27m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:31:17.250 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (27m) 7m ago 27m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:31:17.251 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (22m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:31:17.251 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (23m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:31:17.251 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (22m) 8m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:31:17.251 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (21m) 8m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:31:17.251 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (21m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:31:17.252 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (21m) 8m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:31:17.252 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (28m) 8m ago 28m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:31:17.252 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (28m) 7m ago 28m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:31:17.252 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (20m) 8m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:31:17.253 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (20m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:31:17.253 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (19m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:31:17.253 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (19m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:31:17.253 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (18m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:31:17.253 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (18m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:31:17.254 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (18m) 7m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:31:17.254 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (17m) 7m ago 28m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:31:17.254 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (27m) 7m ago 28m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:31:17.254 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 8m ago 25m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:31:17.254 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 7m ago 25m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:31:17.497 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:31:17.498 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:31:17.498 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:31:17.498 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:31:17.498 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:31:17.498 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:31:17.499 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:31:17.499 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:31:17.499 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:31:17.499 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:31:17.500 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:31:17.500 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:31:17.500 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:31:17.500 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:31:17.501 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:31:18.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:17 gibba023 bash[30844]: cluster 2021-03-10T20:31:16.178309+0000 mgr.gibba044.wflcwh (mgr.34466) 1257 : cluster [DBG] pgmap v699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:18.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:17 gibba023 bash[30844]: audit 2021-03-10T20:31:17.497878+0000 mon.c (mon.1) 36 : audit [DBG] from='client.? 172.21.2.123:0/2937168704' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:31:18.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:17 gibba023 bash[31815]: cluster 2021-03-10T20:31:16.178309+0000 mgr.gibba044.wflcwh (mgr.34466) 1257 : cluster [DBG] pgmap v699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:18.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:17 gibba023 bash[31815]: audit 2021-03-10T20:31:17.497878+0000 mon.c (mon.1) 36 : audit [DBG] from='client.? 172.21.2.123:0/2937168704' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:31:18.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:17 gibba044 bash[25485]: cluster 2021-03-10T20:31:16.178309+0000 mgr.gibba044.wflcwh (mgr.34466) 1257 : cluster [DBG] pgmap v699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:18.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:17 gibba044 bash[25485]: audit 2021-03-10T20:31:17.497878+0000 mon.c (mon.1) 36 : audit [DBG] from='client.? 172.21.2.123:0/2937168704' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:31:19.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:18 gibba023 bash[30844]: audit 2021-03-10T20:31:17.015385+0000 mgr.gibba044.wflcwh (mgr.34466) 1258 : audit [DBG] from='client.44904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:31:19.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:18 gibba023 bash[30844]: audit 2021-03-10T20:31:17.239863+0000 mgr.gibba044.wflcwh (mgr.34466) 1259 : audit [DBG] from='client.54889 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:31:19.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:18 gibba023 bash[31815]: audit 2021-03-10T20:31:17.015385+0000 mgr.gibba044.wflcwh (mgr.34466) 1258 : audit [DBG] from='client.44904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:31:19.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:18 gibba023 bash[31815]: audit 2021-03-10T20:31:17.239863+0000 mgr.gibba044.wflcwh (mgr.34466) 1259 : audit [DBG] from='client.54889 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:31:19.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:18 gibba044 bash[25485]: audit 2021-03-10T20:31:17.015385+0000 mgr.gibba044.wflcwh (mgr.34466) 1258 : audit [DBG] from='client.44904 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:31:19.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:18 gibba044 bash[25485]: audit 2021-03-10T20:31:17.239863+0000 mgr.gibba044.wflcwh (mgr.34466) 1259 : audit [DBG] from='client.54889 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:31:20.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:19 gibba023 bash[30844]: cluster 2021-03-10T20:31:18.179817+0000 mgr.gibba044.wflcwh (mgr.34466) 1260 : cluster [DBG] pgmap v700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:20.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:19 gibba023 bash[31815]: cluster 2021-03-10T20:31:18.179817+0000 mgr.gibba044.wflcwh (mgr.34466) 1260 : cluster [DBG] pgmap v700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:20.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:19 gibba044 bash[25485]: cluster 2021-03-10T20:31:18.179817+0000 mgr.gibba044.wflcwh (mgr.34466) 1260 : cluster [DBG] pgmap v700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:22.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:21 gibba023 bash[30844]: cluster 2021-03-10T20:31:20.180983+0000 mgr.gibba044.wflcwh (mgr.34466) 1261 : cluster [DBG] pgmap v701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:22.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:21 gibba023 bash[31815]: cluster 2021-03-10T20:31:20.180983+0000 mgr.gibba044.wflcwh (mgr.34466) 1261 : cluster [DBG] pgmap v701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:22.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:21 gibba044 bash[25485]: cluster 2021-03-10T20:31:20.180983+0000 mgr.gibba044.wflcwh (mgr.34466) 1261 : cluster [DBG] pgmap v701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:24.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:23 gibba023 bash[30844]: cluster 2021-03-10T20:31:22.182570+0000 mgr.gibba044.wflcwh (mgr.34466) 1262 : cluster [DBG] pgmap v702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:24.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:23 gibba023 bash[31815]: cluster 2021-03-10T20:31:22.182570+0000 mgr.gibba044.wflcwh (mgr.34466) 1262 : cluster [DBG] pgmap v702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:24.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:23 gibba044 bash[25485]: cluster 2021-03-10T20:31:22.182570+0000 mgr.gibba044.wflcwh (mgr.34466) 1262 : cluster [DBG] pgmap v702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:26.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:25 gibba023 bash[30844]: cluster 2021-03-10T20:31:24.184281+0000 mgr.gibba044.wflcwh (mgr.34466) 1263 : cluster [DBG] pgmap v703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:26.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:25 gibba023 bash[31815]: cluster 2021-03-10T20:31:24.184281+0000 mgr.gibba044.wflcwh (mgr.34466) 1263 : cluster [DBG] pgmap v703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:26.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:25 gibba044 bash[25485]: cluster 2021-03-10T20:31:24.184281+0000 mgr.gibba044.wflcwh (mgr.34466) 1263 : cluster [DBG] pgmap v703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:27.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:26 gibba023 bash[30844]: cephadm 2021-03-10T20:31:25.310282+0000 mgr.gibba044.wflcwh (mgr.34466) 1264 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:31:27.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:26 gibba023 bash[31815]: cephadm 2021-03-10T20:31:25.310282+0000 mgr.gibba044.wflcwh (mgr.34466) 1264 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:31:27.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:26 gibba044 bash[25485]: cephadm 2021-03-10T20:31:25.310282+0000 mgr.gibba044.wflcwh (mgr.34466) 1264 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:31:28.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:27 gibba023 bash[30844]: cluster 2021-03-10T20:31:26.185669+0000 mgr.gibba044.wflcwh (mgr.34466) 1265 : cluster [DBG] pgmap v704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:28.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:27 gibba023 bash[30844]: audit 2021-03-10T20:31:27.134736+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T20:31:28.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:27 gibba023 bash[30844]: audit 2021-03-10T20:31:27.135451+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:31:28.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:27 gibba023 bash[30844]: audit 2021-03-10T20:31:27.136196+0000 mon.a (mon.0) 884 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:31:28.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:27 gibba023 bash[30844]: audit 2021-03-10T20:31:27.136872+0000 mon.a (mon.0) 885 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:31:28.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:27 gibba023 bash[30844]: audit 2021-03-10T20:31:27.155194+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:31:28.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:27 gibba023 bash[30844]: audit 2021-03-10T20:31:27.155806+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:31:28.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:27 gibba023 bash[31815]: cluster 2021-03-10T20:31:26.185669+0000 mgr.gibba044.wflcwh (mgr.34466) 1265 : cluster [DBG] pgmap v704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:28.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:27 gibba023 bash[31815]: audit 2021-03-10T20:31:27.134736+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T20:31:28.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:27 gibba023 bash[31815]: audit 2021-03-10T20:31:27.135451+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:31:28.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:27 gibba023 bash[31815]: audit 2021-03-10T20:31:27.136196+0000 mon.a (mon.0) 884 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:31:28.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:27 gibba023 bash[31815]: audit 2021-03-10T20:31:27.136872+0000 mon.a (mon.0) 885 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:31:28.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:27 gibba023 bash[31815]: audit 2021-03-10T20:31:27.155194+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:31:28.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:27 gibba023 bash[31815]: audit 2021-03-10T20:31:27.155806+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:31:28.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:27 gibba044 bash[25485]: cluster 2021-03-10T20:31:26.185669+0000 mgr.gibba044.wflcwh (mgr.34466) 1265 : cluster [DBG] pgmap v704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:28.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:27 gibba044 bash[25485]: audit 2021-03-10T20:31:27.134736+0000 mon.a (mon.0) 882 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T20:31:28.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:27 gibba044 bash[25485]: audit 2021-03-10T20:31:27.135451+0000 mon.a (mon.0) 883 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:31:28.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:27 gibba044 bash[25485]: audit 2021-03-10T20:31:27.136196+0000 mon.a (mon.0) 884 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:31:28.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:27 gibba044 bash[25485]: audit 2021-03-10T20:31:27.136872+0000 mon.a (mon.0) 885 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:31:28.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:27 gibba044 bash[25485]: audit 2021-03-10T20:31:27.155194+0000 mon.a (mon.0) 886 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:31:28.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:27 gibba044 bash[25485]: audit 2021-03-10T20:31:27.155806+0000 mon.a (mon.0) 887 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:31:29.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:28 gibba023 bash[30844]: cluster 2021-03-10T20:31:28.187217+0000 mgr.gibba044.wflcwh (mgr.34466) 1266 : cluster [DBG] pgmap v705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:29.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:28 gibba023 bash[31815]: cluster 2021-03-10T20:31:28.187217+0000 mgr.gibba044.wflcwh (mgr.34466) 1266 : cluster [DBG] pgmap v705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:29.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:28 gibba044 bash[25485]: cluster 2021-03-10T20:31:28.187217+0000 mgr.gibba044.wflcwh (mgr.34466) 1266 : cluster [DBG] pgmap v705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:31.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:31 gibba023 bash[30844]: cluster 2021-03-10T20:31:30.188616+0000 mgr.gibba044.wflcwh (mgr.34466) 1267 : cluster [DBG] pgmap v706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:31.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:31 gibba023 bash[31815]: cluster 2021-03-10T20:31:30.188616+0000 mgr.gibba044.wflcwh (mgr.34466) 1267 : cluster [DBG] pgmap v706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:31.747 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:31 gibba044 bash[25485]: cluster 2021-03-10T20:31:30.188616+0000 mgr.gibba044.wflcwh (mgr.34466) 1267 : cluster [DBG] pgmap v706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:33.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:33 gibba023 bash[30844]: cluster 2021-03-10T20:31:32.190183+0000 mgr.gibba044.wflcwh (mgr.34466) 1268 : cluster [DBG] pgmap v707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:33.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:33 gibba023 bash[31815]: cluster 2021-03-10T20:31:32.190183+0000 mgr.gibba044.wflcwh (mgr.34466) 1268 : cluster [DBG] pgmap v707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:34.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:33 gibba044 bash[25485]: cluster 2021-03-10T20:31:32.190183+0000 mgr.gibba044.wflcwh (mgr.34466) 1268 : cluster [DBG] pgmap v707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:35.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:35 gibba023 bash[30844]: cluster 2021-03-10T20:31:34.191921+0000 mgr.gibba044.wflcwh (mgr.34466) 1269 : cluster [DBG] pgmap v708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:35.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:35 gibba023 bash[31815]: cluster 2021-03-10T20:31:34.191921+0000 mgr.gibba044.wflcwh (mgr.34466) 1269 : cluster [DBG] pgmap v708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:35.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:35 gibba044 bash[25485]: cluster 2021-03-10T20:31:34.191921+0000 mgr.gibba044.wflcwh (mgr.34466) 1269 : cluster [DBG] pgmap v708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:37.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:37 gibba023 bash[30844]: cluster 2021-03-10T20:31:36.193378+0000 mgr.gibba044.wflcwh (mgr.34466) 1270 : cluster [DBG] pgmap v709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:37.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:37 gibba023 bash[31815]: cluster 2021-03-10T20:31:36.193378+0000 mgr.gibba044.wflcwh (mgr.34466) 1270 : cluster [DBG] pgmap v709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:37.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:37 gibba044 bash[25485]: cluster 2021-03-10T20:31:36.193378+0000 mgr.gibba044.wflcwh (mgr.34466) 1270 : cluster [DBG] pgmap v709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:39.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:39 gibba023 bash[30844]: cluster 2021-03-10T20:31:38.195121+0000 mgr.gibba044.wflcwh (mgr.34466) 1271 : cluster [DBG] pgmap v710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:39.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:39 gibba023 bash[31815]: cluster 2021-03-10T20:31:38.195121+0000 mgr.gibba044.wflcwh (mgr.34466) 1271 : cluster [DBG] pgmap v710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:39.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:39 gibba044 bash[25485]: cluster 2021-03-10T20:31:38.195121+0000 mgr.gibba044.wflcwh (mgr.34466) 1271 : cluster [DBG] pgmap v710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:41.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:41 gibba023 bash[30844]: cluster 2021-03-10T20:31:40.196377+0000 mgr.gibba044.wflcwh (mgr.34466) 1272 : cluster [DBG] pgmap v711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:41.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:41 gibba023 bash[30844]: cephadm 2021-03-10T20:31:40.326381+0000 mgr.gibba044.wflcwh (mgr.34466) 1273 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:31:41.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:41 gibba023 bash[31815]: cluster 2021-03-10T20:31:40.196377+0000 mgr.gibba044.wflcwh (mgr.34466) 1272 : cluster [DBG] pgmap v711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:41.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:41 gibba023 bash[31815]: cephadm 2021-03-10T20:31:40.326381+0000 mgr.gibba044.wflcwh (mgr.34466) 1273 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:31:41.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:41 gibba044 bash[25485]: cluster 2021-03-10T20:31:40.196377+0000 mgr.gibba044.wflcwh (mgr.34466) 1272 : cluster [DBG] pgmap v711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:41.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:41 gibba044 bash[25485]: cephadm 2021-03-10T20:31:40.326381+0000 mgr.gibba044.wflcwh (mgr.34466) 1273 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:31:43.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:43 gibba023 bash[30844]: cluster 2021-03-10T20:31:42.198039+0000 mgr.gibba044.wflcwh (mgr.34466) 1274 : cluster [DBG] pgmap v712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:43.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:43 gibba023 bash[31815]: cluster 2021-03-10T20:31:42.198039+0000 mgr.gibba044.wflcwh (mgr.34466) 1274 : cluster [DBG] pgmap v712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:43.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:43 gibba044 bash[25485]: cluster 2021-03-10T20:31:42.198039+0000 mgr.gibba044.wflcwh (mgr.34466) 1274 : cluster [DBG] pgmap v712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:45.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:45 gibba023 bash[30844]: cluster 2021-03-10T20:31:44.200263+0000 mgr.gibba044.wflcwh (mgr.34466) 1275 : cluster [DBG] pgmap v713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:45.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:45 gibba023 bash[31815]: cluster 2021-03-10T20:31:44.200263+0000 mgr.gibba044.wflcwh (mgr.34466) 1275 : cluster [DBG] pgmap v713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:45.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:45 gibba044 bash[25485]: cluster 2021-03-10T20:31:44.200263+0000 mgr.gibba044.wflcwh (mgr.34466) 1275 : cluster [DBG] pgmap v713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:47.742 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:31:47.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:47 gibba023 bash[30844]: cluster 2021-03-10T20:31:46.201652+0000 mgr.gibba044.wflcwh (mgr.34466) 1276 : cluster [DBG] pgmap v714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:47.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:47 gibba023 bash[31815]: cluster 2021-03-10T20:31:46.201652+0000 mgr.gibba044.wflcwh (mgr.34466) 1276 : cluster [DBG] pgmap v714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:47.969 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:31:47.969 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (22m) 8m ago 28m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:31:47.970 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (28m) 7m ago 28m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:31:47.970 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (23m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:31:47.970 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (23m) 7m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:31:47.970 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (22m) 8m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:31:47.971 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (22m) 8m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:31:47.971 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (22m) 7m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:31:47.971 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (22m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:31:47.971 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (28m) 8m ago 28m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:31:47.972 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (28m) 7m ago 28m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:31:47.972 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (21m) 8m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:31:47.972 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (20m) 8m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:31:47.972 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (20m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:31:47.972 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (19m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:31:47.973 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (19m) 7m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:31:47.973 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (19m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:31:47.974 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (18m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:31:47.974 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (18m) 7m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:31:47.975 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (28m) 7m ago 28m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:31:47.975 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 8m ago 26m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:31:47.976 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 7m ago 26m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:31:47.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:47 gibba044 bash[25485]: cluster 2021-03-10T20:31:46.201652+0000 mgr.gibba044.wflcwh (mgr.34466) 1276 : cluster [DBG] pgmap v714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:48.216 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:31:48.217 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:31:48.217 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:31:48.217 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:31:48.217 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:31:48.218 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:31:48.218 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:31:48.218 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:31:48.218 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:31:48.219 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:31:48.219 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:31:48.219 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:31:48.219 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:31:48.220 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:31:48.220 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:31:48.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:48 gibba023 bash[30844]: audit 2021-03-10T20:31:47.735758+0000 mgr.gibba044.wflcwh (mgr.34466) 1277 : audit [DBG] from='client.54901 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:31:48.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:48 gibba023 bash[30844]: audit 2021-03-10T20:31:48.216947+0000 mon.a (mon.0) 888 : audit [DBG] from='client.? 172.21.2.123:0/4180710061' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:31:48.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:48 gibba023 bash[31815]: audit 2021-03-10T20:31:47.735758+0000 mgr.gibba044.wflcwh (mgr.34466) 1277 : audit [DBG] from='client.54901 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:31:48.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:48 gibba023 bash[31815]: audit 2021-03-10T20:31:48.216947+0000 mon.a (mon.0) 888 : audit [DBG] from='client.? 172.21.2.123:0/4180710061' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:31:48.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:48 gibba044 bash[25485]: audit 2021-03-10T20:31:47.735758+0000 mgr.gibba044.wflcwh (mgr.34466) 1277 : audit [DBG] from='client.54901 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:31:48.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:48 gibba044 bash[25485]: audit 2021-03-10T20:31:48.216947+0000 mon.a (mon.0) 888 : audit [DBG] from='client.? 172.21.2.123:0/4180710061' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:31:49.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:49 gibba044 bash[25485]: audit 2021-03-10T20:31:47.961793+0000 mgr.gibba044.wflcwh (mgr.34466) 1278 : audit [DBG] from='client.54907 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:31:49.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:49 gibba044 bash[25485]: cluster 2021-03-10T20:31:48.203381+0000 mgr.gibba044.wflcwh (mgr.34466) 1279 : cluster [DBG] pgmap v715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:50.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:49 gibba023 bash[30844]: audit 2021-03-10T20:31:47.961793+0000 mgr.gibba044.wflcwh (mgr.34466) 1278 : audit [DBG] from='client.54907 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:31:50.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:49 gibba023 bash[30844]: cluster 2021-03-10T20:31:48.203381+0000 mgr.gibba044.wflcwh (mgr.34466) 1279 : cluster [DBG] pgmap v715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:50.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:49 gibba023 bash[31815]: audit 2021-03-10T20:31:47.961793+0000 mgr.gibba044.wflcwh (mgr.34466) 1278 : audit [DBG] from='client.54907 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:31:50.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:49 gibba023 bash[31815]: cluster 2021-03-10T20:31:48.203381+0000 mgr.gibba044.wflcwh (mgr.34466) 1279 : cluster [DBG] pgmap v715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:51.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:51 gibba044 bash[25485]: cluster 2021-03-10T20:31:50.204583+0000 mgr.gibba044.wflcwh (mgr.34466) 1280 : cluster [DBG] pgmap v716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:52.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:51 gibba023 bash[30844]: cluster 2021-03-10T20:31:50.204583+0000 mgr.gibba044.wflcwh (mgr.34466) 1280 : cluster [DBG] pgmap v716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:52.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:51 gibba023 bash[31815]: cluster 2021-03-10T20:31:50.204583+0000 mgr.gibba044.wflcwh (mgr.34466) 1280 : cluster [DBG] pgmap v716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:53.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:53 gibba044 bash[25485]: cluster 2021-03-10T20:31:52.207298+0000 mgr.gibba044.wflcwh (mgr.34466) 1281 : cluster [DBG] pgmap v717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:54.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:53 gibba023 bash[30844]: cluster 2021-03-10T20:31:52.207298+0000 mgr.gibba044.wflcwh (mgr.34466) 1281 : cluster [DBG] pgmap v717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:54.174 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:53 gibba023 bash[31815]: cluster 2021-03-10T20:31:52.207298+0000 mgr.gibba044.wflcwh (mgr.34466) 1281 : cluster [DBG] pgmap v717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:55.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:55 gibba023 bash[30844]: cluster 2021-03-10T20:31:54.208977+0000 mgr.gibba044.wflcwh (mgr.34466) 1282 : cluster [DBG] pgmap v718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:55.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:55 gibba023 bash[30844]: audit 2021-03-10T20:31:55.340977+0000 mon.a (mon.0) 889 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T20:31:55.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:55 gibba023 bash[31815]: cluster 2021-03-10T20:31:54.208977+0000 mgr.gibba044.wflcwh (mgr.34466) 1282 : cluster [DBG] pgmap v718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:55.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:55 gibba023 bash[31815]: audit 2021-03-10T20:31:55.340977+0000 mon.a (mon.0) 889 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T20:31:55.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:55 gibba044 bash[25485]: cluster 2021-03-10T20:31:54.208977+0000 mgr.gibba044.wflcwh (mgr.34466) 1282 : cluster [DBG] pgmap v718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:55.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:55 gibba044 bash[25485]: audit 2021-03-10T20:31:55.340977+0000 mon.a (mon.0) 889 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T20:31:56.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:56 gibba044 bash[25485]: cephadm 2021-03-10T20:31:55.344127+0000 mgr.gibba044.wflcwh (mgr.34466) 1283 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:31:57.145 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:56 gibba023 bash[30844]: cephadm 2021-03-10T20:31:55.344127+0000 mgr.gibba044.wflcwh (mgr.34466) 1283 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:31:57.146 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:56 gibba023 bash[31815]: cephadm 2021-03-10T20:31:55.344127+0000 mgr.gibba044.wflcwh (mgr.34466) 1283 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:31:57.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:57 gibba044 bash[25485]: cluster 2021-03-10T20:31:56.210578+0000 mgr.gibba044.wflcwh (mgr.34466) 1284 : cluster [DBG] pgmap v719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:58.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:57 gibba023 bash[30844]: cluster 2021-03-10T20:31:56.210578+0000 mgr.gibba044.wflcwh (mgr.34466) 1284 : cluster [DBG] pgmap v719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:58.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:57 gibba023 bash[31815]: cluster 2021-03-10T20:31:56.210578+0000 mgr.gibba044.wflcwh (mgr.34466) 1284 : cluster [DBG] pgmap v719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:59.993 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:31:59 gibba023 bash[30844]: cluster 2021-03-10T20:31:58.212155+0000 mgr.gibba044.wflcwh (mgr.34466) 1285 : cluster [DBG] pgmap v720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:59.993 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:31:59 gibba023 bash[31815]: cluster 2021-03-10T20:31:58.212155+0000 mgr.gibba044.wflcwh (mgr.34466) 1285 : cluster [DBG] pgmap v720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:31:59.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:31:59 gibba044 bash[25485]: cluster 2021-03-10T20:31:58.212155+0000 mgr.gibba044.wflcwh (mgr.34466) 1285 : cluster [DBG] pgmap v720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:00.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:00 gibba044 bash[25485]: audit 2021-03-10T20:32:00.696617+0000 mon.a (mon.0) 890 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:32:01.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:00 gibba023 bash[30844]: audit 2021-03-10T20:32:00.696617+0000 mon.a (mon.0) 890 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:32:01.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:00 gibba023 bash[31815]: audit 2021-03-10T20:32:00.696617+0000 mon.a (mon.0) 890 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:32:02.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:01 gibba023 bash[30844]: cluster 2021-03-10T20:32:00.213451+0000 mgr.gibba044.wflcwh (mgr.34466) 1286 : cluster [DBG] pgmap v721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:02.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:01 gibba023 bash[30844]: audit 2021-03-10T20:32:00.876516+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:32:02.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:01 gibba023 bash[30844]: cephadm 2021-03-10T20:32:00.881597+0000 mgr.gibba044.wflcwh (mgr.34466) 1287 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:32:02.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:01 gibba023 bash[30844]: audit 2021-03-10T20:32:01.077628+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:32:02.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:01 gibba023 bash[30844]: audit 2021-03-10T20:32:01.085762+0000 mon.a (mon.0) 893 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:32:02.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:01 gibba023 bash[30844]: audit 2021-03-10T20:32:01.087452+0000 mon.a (mon.0) 894 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:02.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:01 gibba023 bash[30844]: audit 2021-03-10T20:32:01.089142+0000 mon.a (mon.0) 895 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:02.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:01 gibba023 bash[30844]: audit 2021-03-10T20:32:01.090621+0000 mon.a (mon.0) 896 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:02.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:01 gibba023 bash[30844]: audit 2021-03-10T20:32:01.093035+0000 mon.a (mon.0) 897 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:02.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:01 gibba023 bash[30844]: audit 2021-03-10T20:32:01.094346+0000 mon.a (mon.0) 898 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:02.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:01 gibba023 bash[31815]: cluster 2021-03-10T20:32:00.213451+0000 mgr.gibba044.wflcwh (mgr.34466) 1286 : cluster [DBG] pgmap v721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:02.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:01 gibba023 bash[31815]: audit 2021-03-10T20:32:00.876516+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:32:02.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:01 gibba023 bash[31815]: cephadm 2021-03-10T20:32:00.881597+0000 mgr.gibba044.wflcwh (mgr.34466) 1287 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:32:02.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:01 gibba023 bash[31815]: audit 2021-03-10T20:32:01.077628+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:32:02.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:01 gibba023 bash[31815]: audit 2021-03-10T20:32:01.085762+0000 mon.a (mon.0) 893 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:32:02.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:01 gibba023 bash[31815]: audit 2021-03-10T20:32:01.087452+0000 mon.a (mon.0) 894 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:02.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:01 gibba023 bash[31815]: audit 2021-03-10T20:32:01.089142+0000 mon.a (mon.0) 895 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:02.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:01 gibba023 bash[31815]: audit 2021-03-10T20:32:01.090621+0000 mon.a (mon.0) 896 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:02.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:01 gibba023 bash[31815]: audit 2021-03-10T20:32:01.093035+0000 mon.a (mon.0) 897 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:02.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:01 gibba023 bash[31815]: audit 2021-03-10T20:32:01.094346+0000 mon.a (mon.0) 898 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:02.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:01 gibba044 bash[25485]: cluster 2021-03-10T20:32:00.213451+0000 mgr.gibba044.wflcwh (mgr.34466) 1286 : cluster [DBG] pgmap v721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:02.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:01 gibba044 bash[25485]: audit 2021-03-10T20:32:00.876516+0000 mon.a (mon.0) 891 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:32:02.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:01 gibba044 bash[25485]: cephadm 2021-03-10T20:32:00.881597+0000 mgr.gibba044.wflcwh (mgr.34466) 1287 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:32:02.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:01 gibba044 bash[25485]: audit 2021-03-10T20:32:01.077628+0000 mon.a (mon.0) 892 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:32:02.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:01 gibba044 bash[25485]: audit 2021-03-10T20:32:01.085762+0000 mon.a (mon.0) 893 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:32:02.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:01 gibba044 bash[25485]: audit 2021-03-10T20:32:01.087452+0000 mon.a (mon.0) 894 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:02.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:01 gibba044 bash[25485]: audit 2021-03-10T20:32:01.089142+0000 mon.a (mon.0) 895 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:02.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:01 gibba044 bash[25485]: audit 2021-03-10T20:32:01.090621+0000 mon.a (mon.0) 896 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:02.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:01 gibba044 bash[25485]: audit 2021-03-10T20:32:01.093035+0000 mon.a (mon.0) 897 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:02.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:01 gibba044 bash[25485]: audit 2021-03-10T20:32:01.094346+0000 mon.a (mon.0) 898 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:03.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:02 gibba023 bash[30844]: cephadm 2021-03-10T20:32:01.088241+0000 mgr.gibba044.wflcwh (mgr.34466) 1288 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:32:03.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:02 gibba023 bash[30844]: cephadm 2021-03-10T20:32:01.090350+0000 mgr.gibba044.wflcwh (mgr.34466) 1289 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:32:03.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:02 gibba023 bash[30844]: cephadm 2021-03-10T20:32:01.092117+0000 mgr.gibba044.wflcwh (mgr.34466) 1290 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:32:03.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:02 gibba023 bash[30844]: cephadm 2021-03-10T20:32:01.092165+0000 mgr.gibba044.wflcwh (mgr.34466) 1291 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:32:03.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:02 gibba023 bash[30844]: cephadm 2021-03-10T20:32:01.093741+0000 mgr.gibba044.wflcwh (mgr.34466) 1292 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:32:03.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:02 gibba023 bash[30844]: cephadm 2021-03-10T20:32:01.093792+0000 mgr.gibba044.wflcwh (mgr.34466) 1293 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:32:03.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:02 gibba023 bash[30844]: cephadm 2021-03-10T20:32:01.095160+0000 mgr.gibba044.wflcwh (mgr.34466) 1294 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:32:03.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:02 gibba023 bash[30844]: cephadm 2021-03-10T20:32:01.096126+0000 mgr.gibba044.wflcwh (mgr.34466) 1295 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:32:03.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:02 gibba023 bash[30844]: cephadm 2021-03-10T20:32:01.096167+0000 mgr.gibba044.wflcwh (mgr.34466) 1296 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:32:03.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:02 gibba023 bash[30844]: cephadm 2021-03-10T20:32:01.097272+0000 mgr.gibba044.wflcwh (mgr.34466) 1297 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:32:03.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:02 gibba023 bash[30844]: cephadm 2021-03-10T20:32:01.097622+0000 mgr.gibba044.wflcwh (mgr.34466) 1298 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:32:03.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:02 gibba023 bash[30844]: cephadm 2021-03-10T20:32:01.098578+0000 mgr.gibba044.wflcwh (mgr.34466) 1299 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:32:03.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:02 gibba023 bash[30844]: cephadm 2021-03-10T20:32:01.098619+0000 mgr.gibba044.wflcwh (mgr.34466) 1300 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:32:03.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:02 gibba023 bash[30844]: cephadm 2021-03-10T20:32:01.098766+0000 mgr.gibba044.wflcwh (mgr.34466) 1301 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:32:03.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:02 gibba023 bash[31815]: cephadm 2021-03-10T20:32:01.088241+0000 mgr.gibba044.wflcwh (mgr.34466) 1288 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:32:03.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:02 gibba023 bash[31815]: cephadm 2021-03-10T20:32:01.090350+0000 mgr.gibba044.wflcwh (mgr.34466) 1289 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:32:03.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:02 gibba023 bash[31815]: cephadm 2021-03-10T20:32:01.092117+0000 mgr.gibba044.wflcwh (mgr.34466) 1290 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:32:03.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:02 gibba023 bash[31815]: cephadm 2021-03-10T20:32:01.092165+0000 mgr.gibba044.wflcwh (mgr.34466) 1291 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:32:03.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:02 gibba023 bash[31815]: cephadm 2021-03-10T20:32:01.093741+0000 mgr.gibba044.wflcwh (mgr.34466) 1292 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:32:03.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:02 gibba023 bash[31815]: cephadm 2021-03-10T20:32:01.093792+0000 mgr.gibba044.wflcwh (mgr.34466) 1293 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:32:03.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:02 gibba023 bash[31815]: cephadm 2021-03-10T20:32:01.095160+0000 mgr.gibba044.wflcwh (mgr.34466) 1294 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:32:03.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:02 gibba023 bash[31815]: cephadm 2021-03-10T20:32:01.096126+0000 mgr.gibba044.wflcwh (mgr.34466) 1295 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:32:03.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:02 gibba023 bash[31815]: cephadm 2021-03-10T20:32:01.096167+0000 mgr.gibba044.wflcwh (mgr.34466) 1296 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:32:03.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:02 gibba023 bash[31815]: cephadm 2021-03-10T20:32:01.097272+0000 mgr.gibba044.wflcwh (mgr.34466) 1297 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:32:03.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:02 gibba023 bash[31815]: cephadm 2021-03-10T20:32:01.097622+0000 mgr.gibba044.wflcwh (mgr.34466) 1298 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:32:03.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:02 gibba023 bash[31815]: cephadm 2021-03-10T20:32:01.098578+0000 mgr.gibba044.wflcwh (mgr.34466) 1299 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:32:03.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:02 gibba023 bash[31815]: cephadm 2021-03-10T20:32:01.098619+0000 mgr.gibba044.wflcwh (mgr.34466) 1300 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:32:03.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:02 gibba023 bash[31815]: cephadm 2021-03-10T20:32:01.098766+0000 mgr.gibba044.wflcwh (mgr.34466) 1301 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:32:03.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:02 gibba044 bash[25485]: cephadm 2021-03-10T20:32:01.088241+0000 mgr.gibba044.wflcwh (mgr.34466) 1288 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:32:03.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:02 gibba044 bash[25485]: cephadm 2021-03-10T20:32:01.090350+0000 mgr.gibba044.wflcwh (mgr.34466) 1289 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:32:03.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:02 gibba044 bash[25485]: cephadm 2021-03-10T20:32:01.092117+0000 mgr.gibba044.wflcwh (mgr.34466) 1290 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:32:03.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:02 gibba044 bash[25485]: cephadm 2021-03-10T20:32:01.092165+0000 mgr.gibba044.wflcwh (mgr.34466) 1291 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:32:03.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:02 gibba044 bash[25485]: cephadm 2021-03-10T20:32:01.093741+0000 mgr.gibba044.wflcwh (mgr.34466) 1292 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:32:03.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:02 gibba044 bash[25485]: cephadm 2021-03-10T20:32:01.093792+0000 mgr.gibba044.wflcwh (mgr.34466) 1293 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:32:03.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:02 gibba044 bash[25485]: cephadm 2021-03-10T20:32:01.095160+0000 mgr.gibba044.wflcwh (mgr.34466) 1294 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:32:03.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:02 gibba044 bash[25485]: cephadm 2021-03-10T20:32:01.096126+0000 mgr.gibba044.wflcwh (mgr.34466) 1295 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:32:03.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:02 gibba044 bash[25485]: cephadm 2021-03-10T20:32:01.096167+0000 mgr.gibba044.wflcwh (mgr.34466) 1296 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:32:03.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:02 gibba044 bash[25485]: cephadm 2021-03-10T20:32:01.097272+0000 mgr.gibba044.wflcwh (mgr.34466) 1297 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:32:03.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:02 gibba044 bash[25485]: cephadm 2021-03-10T20:32:01.097622+0000 mgr.gibba044.wflcwh (mgr.34466) 1298 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:32:03.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:02 gibba044 bash[25485]: cephadm 2021-03-10T20:32:01.098578+0000 mgr.gibba044.wflcwh (mgr.34466) 1299 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:32:03.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:02 gibba044 bash[25485]: cephadm 2021-03-10T20:32:01.098619+0000 mgr.gibba044.wflcwh (mgr.34466) 1300 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:32:03.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:02 gibba044 bash[25485]: cephadm 2021-03-10T20:32:01.098766+0000 mgr.gibba044.wflcwh (mgr.34466) 1301 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:32:04.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:03 gibba023 bash[30844]: cluster 2021-03-10T20:32:02.214168+0000 mgr.gibba044.wflcwh (mgr.34466) 1302 : cluster [DBG] pgmap v722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:04.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:03 gibba023 bash[31815]: cluster 2021-03-10T20:32:02.214168+0000 mgr.gibba044.wflcwh (mgr.34466) 1302 : cluster [DBG] pgmap v722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:04.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:03 gibba044 bash[25485]: cluster 2021-03-10T20:32:02.214168+0000 mgr.gibba044.wflcwh (mgr.34466) 1302 : cluster [DBG] pgmap v722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:05.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:04 gibba044 bash[25485]: cluster 2021-03-10T20:32:04.215813+0000 mgr.gibba044.wflcwh (mgr.34466) 1303 : cluster [DBG] pgmap v723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:05.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:04 gibba023 bash[30844]: cluster 2021-03-10T20:32:04.215813+0000 mgr.gibba044.wflcwh (mgr.34466) 1303 : cluster [DBG] pgmap v723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:05.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:04 gibba023 bash[31815]: cluster 2021-03-10T20:32:04.215813+0000 mgr.gibba044.wflcwh (mgr.34466) 1303 : cluster [DBG] pgmap v723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:07.933 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:07 gibba023 bash[30844]: cluster 2021-03-10T20:32:06.217464+0000 mgr.gibba044.wflcwh (mgr.34466) 1304 : cluster [DBG] pgmap v724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:07.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:07 gibba023 bash[31815]: cluster 2021-03-10T20:32:06.217464+0000 mgr.gibba044.wflcwh (mgr.34466) 1304 : cluster [DBG] pgmap v724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:07.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:07 gibba044 bash[25485]: cluster 2021-03-10T20:32:06.217464+0000 mgr.gibba044.wflcwh (mgr.34466) 1304 : cluster [DBG] pgmap v724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:09.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:09 gibba023 bash[30844]: cluster 2021-03-10T20:32:08.219112+0000 mgr.gibba044.wflcwh (mgr.34466) 1305 : cluster [DBG] pgmap v725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:09.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:09 gibba023 bash[31815]: cluster 2021-03-10T20:32:08.219112+0000 mgr.gibba044.wflcwh (mgr.34466) 1305 : cluster [DBG] pgmap v725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:09.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:09 gibba044 bash[25485]: cluster 2021-03-10T20:32:08.219112+0000 mgr.gibba044.wflcwh (mgr.34466) 1305 : cluster [DBG] pgmap v725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:11.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:11 gibba023 bash[30844]: cluster 2021-03-10T20:32:10.220613+0000 mgr.gibba044.wflcwh (mgr.34466) 1306 : cluster [DBG] pgmap v726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:11.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:11 gibba023 bash[31815]: cluster 2021-03-10T20:32:10.220613+0000 mgr.gibba044.wflcwh (mgr.34466) 1306 : cluster [DBG] pgmap v726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:11.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:11 gibba044 bash[25485]: cluster 2021-03-10T20:32:10.220613+0000 mgr.gibba044.wflcwh (mgr.34466) 1306 : cluster [DBG] pgmap v726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:13.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:13 gibba023 bash[30844]: cluster 2021-03-10T20:32:12.221398+0000 mgr.gibba044.wflcwh (mgr.34466) 1307 : cluster [DBG] pgmap v727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:13.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:13 gibba023 bash[31815]: cluster 2021-03-10T20:32:12.221398+0000 mgr.gibba044.wflcwh (mgr.34466) 1307 : cluster [DBG] pgmap v727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:13.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:13 gibba044 bash[25485]: cluster 2021-03-10T20:32:12.221398+0000 mgr.gibba044.wflcwh (mgr.34466) 1307 : cluster [DBG] pgmap v727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:15.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:15 gibba023 bash[30844]: cluster 2021-03-10T20:32:14.222914+0000 mgr.gibba044.wflcwh (mgr.34466) 1308 : cluster [DBG] pgmap v728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:15.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:15 gibba023 bash[31815]: cluster 2021-03-10T20:32:14.222914+0000 mgr.gibba044.wflcwh (mgr.34466) 1308 : cluster [DBG] pgmap v728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:15.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:15 gibba044 bash[25485]: cluster 2021-03-10T20:32:14.222914+0000 mgr.gibba044.wflcwh (mgr.34466) 1308 : cluster [DBG] pgmap v728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:17.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:17 gibba023 bash[30844]: cephadm 2021-03-10T20:32:16.114673+0000 mgr.gibba044.wflcwh (mgr.34466) 1309 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:32:17.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:17 gibba023 bash[30844]: cluster 2021-03-10T20:32:16.224644+0000 mgr.gibba044.wflcwh (mgr.34466) 1310 : cluster [DBG] pgmap v729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:17.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:17 gibba023 bash[31815]: cephadm 2021-03-10T20:32:16.114673+0000 mgr.gibba044.wflcwh (mgr.34466) 1309 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:32:17.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:17 gibba023 bash[31815]: cluster 2021-03-10T20:32:16.224644+0000 mgr.gibba044.wflcwh (mgr.34466) 1310 : cluster [DBG] pgmap v729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:17.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:17 gibba044 bash[25485]: cephadm 2021-03-10T20:32:16.114673+0000 mgr.gibba044.wflcwh (mgr.34466) 1309 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:32:17.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:17 gibba044 bash[25485]: cluster 2021-03-10T20:32:16.224644+0000 mgr.gibba044.wflcwh (mgr.34466) 1310 : cluster [DBG] pgmap v729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:18.462 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:32:18.684 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:32:18.684 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (23m) 9m ago 29m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:32:18.685 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (28m) 8m ago 28m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:32:18.685 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (23m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:32:18.685 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (24m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:32:18.685 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (23m) 9m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:32:18.686 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (22m) 9m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:32:18.686 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (22m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:32:18.686 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (22m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:32:18.686 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (29m) 9m ago 29m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:32:18.686 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (29m) 8m ago 29m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:32:18.687 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (21m) 9m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:32:18.687 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (21m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:32:18.687 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (20m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:32:18.687 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (20m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:32:18.688 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (19m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:32:18.688 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (19m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:32:18.688 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (19m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:32:18.688 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (18m) 8m ago 29m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:32:18.688 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (28m) 8m ago 29m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:32:18.689 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 9m ago 26m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:32:18.689 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 8m ago 26m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:32:18.936 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:32:18.937 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:32:18.937 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:32:18.937 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:32:18.937 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:32:18.937 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:32:18.938 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:32:18.938 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:32:18.938 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:32:18.938 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:32:18.939 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:32:18.939 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:32:18.939 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:32:18.939 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:32:18.939 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:32:19.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:19 gibba023 bash[30844]: cluster 2021-03-10T20:32:18.226312+0000 mgr.gibba044.wflcwh (mgr.34466) 1311 : cluster [DBG] pgmap v730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:19.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:19 gibba023 bash[30844]: audit 2021-03-10T20:32:18.456261+0000 mgr.gibba044.wflcwh (mgr.34466) 1312 : audit [DBG] from='client.54919 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:32:19.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:19 gibba023 bash[30844]: audit 2021-03-10T20:32:18.679400+0000 mgr.gibba044.wflcwh (mgr.34466) 1313 : audit [DBG] from='client.54925 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:32:19.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:19 gibba023 bash[30844]: audit 2021-03-10T20:32:18.936835+0000 mon.c (mon.1) 37 : audit [DBG] from='client.? 172.21.2.123:0/2196949755' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:19.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:19 gibba023 bash[31815]: cluster 2021-03-10T20:32:18.226312+0000 mgr.gibba044.wflcwh (mgr.34466) 1311 : cluster [DBG] pgmap v730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:19.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:19 gibba023 bash[31815]: audit 2021-03-10T20:32:18.456261+0000 mgr.gibba044.wflcwh (mgr.34466) 1312 : audit [DBG] from='client.54919 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:32:19.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:19 gibba023 bash[31815]: audit 2021-03-10T20:32:18.679400+0000 mgr.gibba044.wflcwh (mgr.34466) 1313 : audit [DBG] from='client.54925 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:32:19.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:19 gibba023 bash[31815]: audit 2021-03-10T20:32:18.936835+0000 mon.c (mon.1) 37 : audit [DBG] from='client.? 172.21.2.123:0/2196949755' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:19.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:19 gibba044 bash[25485]: cluster 2021-03-10T20:32:18.226312+0000 mgr.gibba044.wflcwh (mgr.34466) 1311 : cluster [DBG] pgmap v730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:19.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:19 gibba044 bash[25485]: audit 2021-03-10T20:32:18.456261+0000 mgr.gibba044.wflcwh (mgr.34466) 1312 : audit [DBG] from='client.54919 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:32:19.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:19 gibba044 bash[25485]: audit 2021-03-10T20:32:18.679400+0000 mgr.gibba044.wflcwh (mgr.34466) 1313 : audit [DBG] from='client.54925 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:32:19.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:19 gibba044 bash[25485]: audit 2021-03-10T20:32:18.936835+0000 mon.c (mon.1) 37 : audit [DBG] from='client.? 172.21.2.123:0/2196949755' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:21.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:21 gibba023 bash[30844]: cluster 2021-03-10T20:32:20.227762+0000 mgr.gibba044.wflcwh (mgr.34466) 1314 : cluster [DBG] pgmap v731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:21.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:21 gibba023 bash[31815]: cluster 2021-03-10T20:32:20.227762+0000 mgr.gibba044.wflcwh (mgr.34466) 1314 : cluster [DBG] pgmap v731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:21.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:21 gibba044 bash[25485]: cluster 2021-03-10T20:32:20.227762+0000 mgr.gibba044.wflcwh (mgr.34466) 1314 : cluster [DBG] pgmap v731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:23.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:23 gibba023 bash[30844]: cluster 2021-03-10T20:32:22.228357+0000 mgr.gibba044.wflcwh (mgr.34466) 1315 : cluster [DBG] pgmap v732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:23.924 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:23 gibba023 bash[31815]: cluster 2021-03-10T20:32:22.228357+0000 mgr.gibba044.wflcwh (mgr.34466) 1315 : cluster [DBG] pgmap v732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:23.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:23 gibba044 bash[25485]: cluster 2021-03-10T20:32:22.228357+0000 mgr.gibba044.wflcwh (mgr.34466) 1315 : cluster [DBG] pgmap v732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:25.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:25 gibba044 bash[25485]: cluster 2021-03-10T20:32:24.230014+0000 mgr.gibba044.wflcwh (mgr.34466) 1316 : cluster [DBG] pgmap v733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:26.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:25 gibba023 bash[30844]: cluster 2021-03-10T20:32:24.230014+0000 mgr.gibba044.wflcwh (mgr.34466) 1316 : cluster [DBG] pgmap v733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:26.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:25 gibba023 bash[31815]: cluster 2021-03-10T20:32:24.230014+0000 mgr.gibba044.wflcwh (mgr.34466) 1316 : cluster [DBG] pgmap v733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:27.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:27 gibba044 bash[25485]: cluster 2021-03-10T20:32:26.231565+0000 mgr.gibba044.wflcwh (mgr.34466) 1317 : cluster [DBG] pgmap v734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:27.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:27 gibba044 bash[25485]: audit 2021-03-10T20:32:27.145935+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T20:32:27.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:27 gibba044 bash[25485]: audit 2021-03-10T20:32:27.146752+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:32:27.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:27 gibba044 bash[25485]: audit 2021-03-10T20:32:27.147509+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T20:32:27.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:27 gibba044 bash[25485]: audit 2021-03-10T20:32:27.148250+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:32:27.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:27 gibba044 bash[25485]: audit 2021-03-10T20:32:27.162887+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:32:27.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:27 gibba044 bash[25485]: audit 2021-03-10T20:32:27.163514+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:32:28.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:27 gibba023 bash[30844]: cluster 2021-03-10T20:32:26.231565+0000 mgr.gibba044.wflcwh (mgr.34466) 1317 : cluster [DBG] pgmap v734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:28.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:27 gibba023 bash[30844]: audit 2021-03-10T20:32:27.145935+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T20:32:28.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:27 gibba023 bash[30844]: audit 2021-03-10T20:32:27.146752+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:32:28.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:27 gibba023 bash[30844]: audit 2021-03-10T20:32:27.147509+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T20:32:28.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:27 gibba023 bash[30844]: audit 2021-03-10T20:32:27.148250+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:32:28.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:27 gibba023 bash[30844]: audit 2021-03-10T20:32:27.162887+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:32:28.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:27 gibba023 bash[30844]: audit 2021-03-10T20:32:27.163514+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:32:28.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:27 gibba023 bash[31815]: cluster 2021-03-10T20:32:26.231565+0000 mgr.gibba044.wflcwh (mgr.34466) 1317 : cluster [DBG] pgmap v734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:28.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:27 gibba023 bash[31815]: audit 2021-03-10T20:32:27.145935+0000 mon.a (mon.0) 899 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T20:32:28.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:27 gibba023 bash[31815]: audit 2021-03-10T20:32:27.146752+0000 mon.a (mon.0) 900 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:32:28.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:27 gibba023 bash[31815]: audit 2021-03-10T20:32:27.147509+0000 mon.a (mon.0) 901 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 5]}]: dispatch 2021-03-10T20:32:28.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:27 gibba023 bash[31815]: audit 2021-03-10T20:32:27.148250+0000 mon.a (mon.0) 902 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:32:28.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:27 gibba023 bash[31815]: audit 2021-03-10T20:32:27.162887+0000 mon.a (mon.0) 903 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:32:28.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:27 gibba023 bash[31815]: audit 2021-03-10T20:32:27.163514+0000 mon.a (mon.0) 904 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:32:29.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:29 gibba044 bash[25485]: cluster 2021-03-10T20:32:28.233310+0000 mgr.gibba044.wflcwh (mgr.34466) 1318 : cluster [DBG] pgmap v735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:30.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:29 gibba023 bash[30844]: cluster 2021-03-10T20:32:28.233310+0000 mgr.gibba044.wflcwh (mgr.34466) 1318 : cluster [DBG] pgmap v735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:30.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:29 gibba023 bash[31815]: cluster 2021-03-10T20:32:28.233310+0000 mgr.gibba044.wflcwh (mgr.34466) 1318 : cluster [DBG] pgmap v735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:31.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:31 gibba044 bash[25485]: cluster 2021-03-10T20:32:30.234659+0000 mgr.gibba044.wflcwh (mgr.34466) 1319 : cluster [DBG] pgmap v736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:32.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:31 gibba023 bash[30844]: cluster 2021-03-10T20:32:30.234659+0000 mgr.gibba044.wflcwh (mgr.34466) 1319 : cluster [DBG] pgmap v736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:32.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:31 gibba023 bash[31815]: cluster 2021-03-10T20:32:30.234659+0000 mgr.gibba044.wflcwh (mgr.34466) 1319 : cluster [DBG] pgmap v736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:32.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:32 gibba044 bash[25485]: cephadm 2021-03-10T20:32:31.130654+0000 mgr.gibba044.wflcwh (mgr.34466) 1320 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:32:33.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:32 gibba023 bash[30844]: cephadm 2021-03-10T20:32:31.130654+0000 mgr.gibba044.wflcwh (mgr.34466) 1320 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:32:33.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:32 gibba023 bash[31815]: cephadm 2021-03-10T20:32:31.130654+0000 mgr.gibba044.wflcwh (mgr.34466) 1320 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:32:33.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:33 gibba044 bash[25485]: cluster 2021-03-10T20:32:32.235353+0000 mgr.gibba044.wflcwh (mgr.34466) 1321 : cluster [DBG] pgmap v737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:34.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:33 gibba023 bash[30844]: cluster 2021-03-10T20:32:32.235353+0000 mgr.gibba044.wflcwh (mgr.34466) 1321 : cluster [DBG] pgmap v737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:34.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:33 gibba023 bash[31815]: cluster 2021-03-10T20:32:32.235353+0000 mgr.gibba044.wflcwh (mgr.34466) 1321 : cluster [DBG] pgmap v737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:35.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:35 gibba044 bash[25485]: cluster 2021-03-10T20:32:34.237016+0000 mgr.gibba044.wflcwh (mgr.34466) 1322 : cluster [DBG] pgmap v738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:36.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:35 gibba023 bash[30844]: cluster 2021-03-10T20:32:34.237016+0000 mgr.gibba044.wflcwh (mgr.34466) 1322 : cluster [DBG] pgmap v738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:36.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:35 gibba023 bash[31815]: cluster 2021-03-10T20:32:34.237016+0000 mgr.gibba044.wflcwh (mgr.34466) 1322 : cluster [DBG] pgmap v738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:37.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:37 gibba044 bash[25485]: cluster 2021-03-10T20:32:36.238657+0000 mgr.gibba044.wflcwh (mgr.34466) 1323 : cluster [DBG] pgmap v739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:38.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:37 gibba023 bash[30844]: cluster 2021-03-10T20:32:36.238657+0000 mgr.gibba044.wflcwh (mgr.34466) 1323 : cluster [DBG] pgmap v739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:38.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:37 gibba023 bash[31815]: cluster 2021-03-10T20:32:36.238657+0000 mgr.gibba044.wflcwh (mgr.34466) 1323 : cluster [DBG] pgmap v739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:39.997 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:39 gibba044 bash[25485]: cluster 2021-03-10T20:32:38.240319+0000 mgr.gibba044.wflcwh (mgr.34466) 1324 : cluster [DBG] pgmap v740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:40.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:39 gibba023 bash[30844]: cluster 2021-03-10T20:32:38.240319+0000 mgr.gibba044.wflcwh (mgr.34466) 1324 : cluster [DBG] pgmap v740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:40.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:39 gibba023 bash[31815]: cluster 2021-03-10T20:32:38.240319+0000 mgr.gibba044.wflcwh (mgr.34466) 1324 : cluster [DBG] pgmap v740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:42.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:41 gibba023 bash[30844]: cluster 2021-03-10T20:32:40.241713+0000 mgr.gibba044.wflcwh (mgr.34466) 1325 : cluster [DBG] pgmap v741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:42.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:41 gibba023 bash[31815]: cluster 2021-03-10T20:32:40.241713+0000 mgr.gibba044.wflcwh (mgr.34466) 1325 : cluster [DBG] pgmap v741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:42.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:41 gibba044 bash[25485]: cluster 2021-03-10T20:32:40.241713+0000 mgr.gibba044.wflcwh (mgr.34466) 1325 : cluster [DBG] pgmap v741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:44.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:43 gibba023 bash[30844]: cluster 2021-03-10T20:32:42.243502+0000 mgr.gibba044.wflcwh (mgr.34466) 1326 : cluster [DBG] pgmap v742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:44.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:43 gibba023 bash[31815]: cluster 2021-03-10T20:32:42.243502+0000 mgr.gibba044.wflcwh (mgr.34466) 1326 : cluster [DBG] pgmap v742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:44.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:43 gibba044 bash[25485]: cluster 2021-03-10T20:32:42.243502+0000 mgr.gibba044.wflcwh (mgr.34466) 1326 : cluster [DBG] pgmap v742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:46.143 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:45 gibba044 bash[25485]: cluster 2021-03-10T20:32:44.245289+0000 mgr.gibba044.wflcwh (mgr.34466) 1327 : cluster [DBG] pgmap v743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:46.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:45 gibba023 bash[30844]: cluster 2021-03-10T20:32:44.245289+0000 mgr.gibba044.wflcwh (mgr.34466) 1327 : cluster [DBG] pgmap v743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:46.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:45 gibba023 bash[31815]: cluster 2021-03-10T20:32:44.245289+0000 mgr.gibba044.wflcwh (mgr.34466) 1327 : cluster [DBG] pgmap v743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:48.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:47 gibba023 bash[30844]: cephadm 2021-03-10T20:32:46.146727+0000 mgr.gibba044.wflcwh (mgr.34466) 1328 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:32:48.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:47 gibba023 bash[30844]: cluster 2021-03-10T20:32:46.246841+0000 mgr.gibba044.wflcwh (mgr.34466) 1329 : cluster [DBG] pgmap v744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:48.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:47 gibba023 bash[31815]: cephadm 2021-03-10T20:32:46.146727+0000 mgr.gibba044.wflcwh (mgr.34466) 1328 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:32:48.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:47 gibba023 bash[31815]: cluster 2021-03-10T20:32:46.246841+0000 mgr.gibba044.wflcwh (mgr.34466) 1329 : cluster [DBG] pgmap v744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:48.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:47 gibba044 bash[25485]: cephadm 2021-03-10T20:32:46.146727+0000 mgr.gibba044.wflcwh (mgr.34466) 1328 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:32:48.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:47 gibba044 bash[25485]: cluster 2021-03-10T20:32:46.246841+0000 mgr.gibba044.wflcwh (mgr.34466) 1329 : cluster [DBG] pgmap v744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:49.199 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:32:49.457 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:32:49.458 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (23m) 10m ago 29m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:32:49.458 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (29m) 8m ago 29m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:32:49.459 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (24m) 8m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:32:49.459 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (24m) 8m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:32:49.459 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (23m) 10m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:32:49.460 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (23m) 10m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:32:49.460 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (23m) 8m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:32:49.461 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (23m) 10m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:32:49.461 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (29m) 10m ago 29m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:32:49.462 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (29m) 8m ago 29m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:32:49.462 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (22m) 10m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:32:49.462 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (21m) 10m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:32:49.463 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (21m) 10m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:32:49.463 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (20m) 10m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:32:49.464 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (20m) 8m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:32:49.464 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (20m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:32:49.464 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (19m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:32:49.465 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (19m) 8m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:32:49.465 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (29m) 8m ago 29m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:32:49.466 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 10m ago 27m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:32:49.466 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 8m ago 27m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:32:49.707 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:32:49.708 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:32:49.708 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:32:49.709 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:32:49.709 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:32:49.710 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:32:49.710 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:32:49.711 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:32:49.711 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:32:49.711 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:32:49.712 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:32:49.712 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:32:49.713 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:32:49.714 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:32:49.714 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:32:50.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:49 gibba023 bash[30844]: cluster 2021-03-10T20:32:48.248588+0000 mgr.gibba044.wflcwh (mgr.34466) 1330 : cluster [DBG] pgmap v745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:50.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:49 gibba023 bash[30844]: audit 2021-03-10T20:32:49.707711+0000 mon.a (mon.0) 905 : audit [DBG] from='client.? 172.21.2.123:0/1539802432' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:50.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:49 gibba023 bash[31815]: cluster 2021-03-10T20:32:48.248588+0000 mgr.gibba044.wflcwh (mgr.34466) 1330 : cluster [DBG] pgmap v745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:50.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:49 gibba023 bash[31815]: audit 2021-03-10T20:32:49.707711+0000 mon.a (mon.0) 905 : audit [DBG] from='client.? 172.21.2.123:0/1539802432' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:50.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:49 gibba044 bash[25485]: cluster 2021-03-10T20:32:48.248588+0000 mgr.gibba044.wflcwh (mgr.34466) 1330 : cluster [DBG] pgmap v745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:50.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:49 gibba044 bash[25485]: audit 2021-03-10T20:32:49.707711+0000 mon.a (mon.0) 905 : audit [DBG] from='client.? 172.21.2.123:0/1539802432' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:32:51.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:50 gibba023 bash[30844]: audit 2021-03-10T20:32:49.194647+0000 mgr.gibba044.wflcwh (mgr.34466) 1331 : audit [DBG] from='client.44958 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:32:51.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:50 gibba023 bash[30844]: audit 2021-03-10T20:32:49.420074+0000 mgr.gibba044.wflcwh (mgr.34466) 1332 : audit [DBG] from='client.44964 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:32:51.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:50 gibba023 bash[31815]: audit 2021-03-10T20:32:49.194647+0000 mgr.gibba044.wflcwh (mgr.34466) 1331 : audit [DBG] from='client.44958 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:32:51.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:50 gibba023 bash[31815]: audit 2021-03-10T20:32:49.420074+0000 mgr.gibba044.wflcwh (mgr.34466) 1332 : audit [DBG] from='client.44964 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:32:51.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:50 gibba044 bash[25485]: audit 2021-03-10T20:32:49.194647+0000 mgr.gibba044.wflcwh (mgr.34466) 1331 : audit [DBG] from='client.44958 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:32:51.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:50 gibba044 bash[25485]: audit 2021-03-10T20:32:49.420074+0000 mgr.gibba044.wflcwh (mgr.34466) 1332 : audit [DBG] from='client.44964 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:32:52.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:51 gibba023 bash[30844]: cluster 2021-03-10T20:32:50.249919+0000 mgr.gibba044.wflcwh (mgr.34466) 1333 : cluster [DBG] pgmap v746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:52.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:51 gibba023 bash[31815]: cluster 2021-03-10T20:32:50.249919+0000 mgr.gibba044.wflcwh (mgr.34466) 1333 : cluster [DBG] pgmap v746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:52.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:51 gibba044 bash[25485]: cluster 2021-03-10T20:32:50.249919+0000 mgr.gibba044.wflcwh (mgr.34466) 1333 : cluster [DBG] pgmap v746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:54.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:53 gibba023 bash[30844]: cluster 2021-03-10T20:32:52.250782+0000 mgr.gibba044.wflcwh (mgr.34466) 1334 : cluster [DBG] pgmap v747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:54.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:53 gibba023 bash[31815]: cluster 2021-03-10T20:32:52.250782+0000 mgr.gibba044.wflcwh (mgr.34466) 1334 : cluster [DBG] pgmap v747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:54.247 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:53 gibba044 bash[25485]: cluster 2021-03-10T20:32:52.250782+0000 mgr.gibba044.wflcwh (mgr.34466) 1334 : cluster [DBG] pgmap v747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:56.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:55 gibba023 bash[30844]: cluster 2021-03-10T20:32:54.252548+0000 mgr.gibba044.wflcwh (mgr.34466) 1335 : cluster [DBG] pgmap v748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:56.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:55 gibba023 bash[31815]: cluster 2021-03-10T20:32:54.252548+0000 mgr.gibba044.wflcwh (mgr.34466) 1335 : cluster [DBG] pgmap v748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:56.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:55 gibba044 bash[25485]: cluster 2021-03-10T20:32:54.252548+0000 mgr.gibba044.wflcwh (mgr.34466) 1335 : cluster [DBG] pgmap v748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:58.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:57 gibba023 bash[30844]: cluster 2021-03-10T20:32:56.253900+0000 mgr.gibba044.wflcwh (mgr.34466) 1336 : cluster [DBG] pgmap v749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:58.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:57 gibba023 bash[31815]: cluster 2021-03-10T20:32:56.253900+0000 mgr.gibba044.wflcwh (mgr.34466) 1336 : cluster [DBG] pgmap v749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:32:58.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:57 gibba044 bash[25485]: cluster 2021-03-10T20:32:56.253900+0000 mgr.gibba044.wflcwh (mgr.34466) 1336 : cluster [DBG] pgmap v749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:00.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:32:59 gibba023 bash[30844]: cluster 2021-03-10T20:32:58.255317+0000 mgr.gibba044.wflcwh (mgr.34466) 1337 : cluster [DBG] pgmap v750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:00.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:32:59 gibba023 bash[31815]: cluster 2021-03-10T20:32:58.255317+0000 mgr.gibba044.wflcwh (mgr.34466) 1337 : cluster [DBG] pgmap v750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:00.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:32:59 gibba044 bash[25485]: cluster 2021-03-10T20:32:58.255317+0000 mgr.gibba044.wflcwh (mgr.34466) 1337 : cluster [DBG] pgmap v750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:02.163 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:01 gibba044 bash[25485]: cluster 2021-03-10T20:33:00.256704+0000 mgr.gibba044.wflcwh (mgr.34466) 1338 : cluster [DBG] pgmap v751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:02.164 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:01 gibba044 bash[25485]: audit 2021-03-10T20:33:01.155679+0000 mon.a (mon.0) 906 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:33:02.164 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:01 gibba044 bash[25485]: audit 2021-03-10T20:33:01.156382+0000 mon.a (mon.0) 907 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T20:33:02.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:01 gibba023 bash[30844]: cluster 2021-03-10T20:33:00.256704+0000 mgr.gibba044.wflcwh (mgr.34466) 1338 : cluster [DBG] pgmap v751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:02.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:01 gibba023 bash[30844]: audit 2021-03-10T20:33:01.155679+0000 mon.a (mon.0) 906 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:33:02.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:01 gibba023 bash[30844]: audit 2021-03-10T20:33:01.156382+0000 mon.a (mon.0) 907 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T20:33:02.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:01 gibba023 bash[31815]: cluster 2021-03-10T20:33:00.256704+0000 mgr.gibba044.wflcwh (mgr.34466) 1338 : cluster [DBG] pgmap v751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:02.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:01 gibba023 bash[31815]: audit 2021-03-10T20:33:01.155679+0000 mon.a (mon.0) 906 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:33:02.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:01 gibba023 bash[31815]: audit 2021-03-10T20:33:01.156382+0000 mon.a (mon.0) 907 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T20:33:03.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:03 gibba044 bash[25485]: cluster 2021-03-10T20:33:02.257489+0000 mgr.gibba044.wflcwh (mgr.34466) 1339 : cluster [DBG] pgmap v752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:04.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:03 gibba023 bash[30844]: cluster 2021-03-10T20:33:02.257489+0000 mgr.gibba044.wflcwh (mgr.34466) 1339 : cluster [DBG] pgmap v752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:04.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:03 gibba023 bash[31815]: cluster 2021-03-10T20:33:02.257489+0000 mgr.gibba044.wflcwh (mgr.34466) 1339 : cluster [DBG] pgmap v752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:05.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:05 gibba044 bash[25485]: cluster 2021-03-10T20:33:04.258518+0000 mgr.gibba044.wflcwh (mgr.34466) 1340 : cluster [DBG] pgmap v753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:06.302 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:05 gibba044 bash[25485]: audit 2021-03-10T20:33:04.746805+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:33:06.303 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:05 gibba044 bash[25485]: cephadm 2021-03-10T20:33:04.750985+0000 mgr.gibba044.wflcwh (mgr.34466) 1341 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:33:06.303 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:05 gibba044 bash[25485]: audit 2021-03-10T20:33:05.344550+0000 mon.a (mon.0) 909 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:33:06.303 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:05 gibba044 bash[25485]: audit 2021-03-10T20:33:05.513781+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:33:06.303 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:05 gibba044 bash[25485]: audit 2021-03-10T20:33:05.699663+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:33:06.304 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:05 gibba044 bash[25485]: audit 2021-03-10T20:33:05.703210+0000 mon.a (mon.0) 912 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:33:06.304 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:05 gibba044 bash[25485]: audit 2021-03-10T20:33:05.705128+0000 mon.a (mon.0) 913 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:33:06.304 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:05 gibba044 bash[25485]: audit 2021-03-10T20:33:05.706739+0000 mon.a (mon.0) 914 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:33:06.304 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:05 gibba044 bash[25485]: audit 2021-03-10T20:33:05.708381+0000 mon.a (mon.0) 915 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:33:06.305 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:05 gibba044 bash[25485]: audit 2021-03-10T20:33:05.711465+0000 mon.a (mon.0) 916 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:33:06.305 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:05 gibba044 bash[25485]: audit 2021-03-10T20:33:05.713257+0000 mon.a (mon.0) 917 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:33:06.306 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:05 gibba023 bash[30844]: cluster 2021-03-10T20:33:04.258518+0000 mgr.gibba044.wflcwh (mgr.34466) 1340 : cluster [DBG] pgmap v753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:06.306 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:05 gibba023 bash[30844]: audit 2021-03-10T20:33:04.746805+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:33:06.306 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:05 gibba023 bash[30844]: cephadm 2021-03-10T20:33:04.750985+0000 mgr.gibba044.wflcwh (mgr.34466) 1341 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:33:06.307 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:05 gibba023 bash[30844]: audit 2021-03-10T20:33:05.344550+0000 mon.a (mon.0) 909 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:33:06.307 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:05 gibba023 bash[30844]: audit 2021-03-10T20:33:05.513781+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:33:06.307 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:05 gibba023 bash[30844]: audit 2021-03-10T20:33:05.699663+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:33:06.307 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:05 gibba023 bash[30844]: audit 2021-03-10T20:33:05.703210+0000 mon.a (mon.0) 912 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:33:06.308 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:05 gibba023 bash[30844]: audit 2021-03-10T20:33:05.705128+0000 mon.a (mon.0) 913 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:33:06.308 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:05 gibba023 bash[30844]: audit 2021-03-10T20:33:05.706739+0000 mon.a (mon.0) 914 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:33:06.308 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:05 gibba023 bash[30844]: audit 2021-03-10T20:33:05.708381+0000 mon.a (mon.0) 915 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:33:06.308 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:05 gibba023 bash[30844]: audit 2021-03-10T20:33:05.711465+0000 mon.a (mon.0) 916 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:33:06.308 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:05 gibba023 bash[30844]: audit 2021-03-10T20:33:05.713257+0000 mon.a (mon.0) 917 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:33:06.309 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:05 gibba023 bash[31815]: cluster 2021-03-10T20:33:04.258518+0000 mgr.gibba044.wflcwh (mgr.34466) 1340 : cluster [DBG] pgmap v753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:06.309 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:05 gibba023 bash[31815]: audit 2021-03-10T20:33:04.746805+0000 mon.a (mon.0) 908 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:33:06.309 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:05 gibba023 bash[31815]: cephadm 2021-03-10T20:33:04.750985+0000 mgr.gibba044.wflcwh (mgr.34466) 1341 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:33:06.309 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:05 gibba023 bash[31815]: audit 2021-03-10T20:33:05.344550+0000 mon.a (mon.0) 909 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:33:06.310 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:05 gibba023 bash[31815]: audit 2021-03-10T20:33:05.513781+0000 mon.a (mon.0) 910 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:33:06.310 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:05 gibba023 bash[31815]: audit 2021-03-10T20:33:05.699663+0000 mon.a (mon.0) 911 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:33:06.310 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:05 gibba023 bash[31815]: audit 2021-03-10T20:33:05.703210+0000 mon.a (mon.0) 912 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:33:06.310 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:05 gibba023 bash[31815]: audit 2021-03-10T20:33:05.705128+0000 mon.a (mon.0) 913 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:33:06.311 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:05 gibba023 bash[31815]: audit 2021-03-10T20:33:05.706739+0000 mon.a (mon.0) 914 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:33:06.311 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:05 gibba023 bash[31815]: audit 2021-03-10T20:33:05.708381+0000 mon.a (mon.0) 915 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:33:06.311 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:05 gibba023 bash[31815]: audit 2021-03-10T20:33:05.711465+0000 mon.a (mon.0) 916 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:33:06.311 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:05 gibba023 bash[31815]: audit 2021-03-10T20:33:05.713257+0000 mon.a (mon.0) 917 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:33:07.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[30844]: cephadm 2021-03-10T20:33:05.517859+0000 mgr.gibba044.wflcwh (mgr.34466) 1342 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:33:07.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[30844]: cephadm 2021-03-10T20:33:05.705789+0000 mgr.gibba044.wflcwh (mgr.34466) 1343 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:33:07.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[30844]: cephadm 2021-03-10T20:33:05.707822+0000 mgr.gibba044.wflcwh (mgr.34466) 1344 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:33:07.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[30844]: cephadm 2021-03-10T20:33:05.709624+0000 mgr.gibba044.wflcwh (mgr.34466) 1345 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:33:07.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[30844]: cephadm 2021-03-10T20:33:05.709659+0000 mgr.gibba044.wflcwh (mgr.34466) 1346 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:33:07.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[30844]: cephadm 2021-03-10T20:33:05.711239+0000 mgr.gibba044.wflcwh (mgr.34466) 1347 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:33:07.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[30844]: cephadm 2021-03-10T20:33:05.711275+0000 mgr.gibba044.wflcwh (mgr.34466) 1348 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:33:07.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[30844]: cephadm 2021-03-10T20:33:05.712850+0000 mgr.gibba044.wflcwh (mgr.34466) 1349 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:33:07.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[30844]: cephadm 2021-03-10T20:33:05.714253+0000 mgr.gibba044.wflcwh (mgr.34466) 1350 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:33:07.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[30844]: cephadm 2021-03-10T20:33:05.714287+0000 mgr.gibba044.wflcwh (mgr.34466) 1351 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:33:07.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[30844]: cephadm 2021-03-10T20:33:05.715854+0000 mgr.gibba044.wflcwh (mgr.34466) 1352 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:33:07.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[30844]: cephadm 2021-03-10T20:33:05.716166+0000 mgr.gibba044.wflcwh (mgr.34466) 1353 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:33:07.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[30844]: cephadm 2021-03-10T20:33:05.717570+0000 mgr.gibba044.wflcwh (mgr.34466) 1354 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:33:07.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[30844]: cephadm 2021-03-10T20:33:05.717608+0000 mgr.gibba044.wflcwh (mgr.34466) 1355 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:33:07.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[30844]: cephadm 2021-03-10T20:33:05.717740+0000 mgr.gibba044.wflcwh (mgr.34466) 1356 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:33:07.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[31815]: cephadm 2021-03-10T20:33:05.517859+0000 mgr.gibba044.wflcwh (mgr.34466) 1342 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:33:07.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[31815]: cephadm 2021-03-10T20:33:05.705789+0000 mgr.gibba044.wflcwh (mgr.34466) 1343 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:33:07.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[31815]: cephadm 2021-03-10T20:33:05.707822+0000 mgr.gibba044.wflcwh (mgr.34466) 1344 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:33:07.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[31815]: cephadm 2021-03-10T20:33:05.709624+0000 mgr.gibba044.wflcwh (mgr.34466) 1345 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:33:07.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[31815]: cephadm 2021-03-10T20:33:05.709659+0000 mgr.gibba044.wflcwh (mgr.34466) 1346 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:33:07.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[31815]: cephadm 2021-03-10T20:33:05.711239+0000 mgr.gibba044.wflcwh (mgr.34466) 1347 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:33:07.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[31815]: cephadm 2021-03-10T20:33:05.711275+0000 mgr.gibba044.wflcwh (mgr.34466) 1348 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:33:07.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[31815]: cephadm 2021-03-10T20:33:05.712850+0000 mgr.gibba044.wflcwh (mgr.34466) 1349 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:33:07.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[31815]: cephadm 2021-03-10T20:33:05.714253+0000 mgr.gibba044.wflcwh (mgr.34466) 1350 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:33:07.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[31815]: cephadm 2021-03-10T20:33:05.714287+0000 mgr.gibba044.wflcwh (mgr.34466) 1351 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:33:07.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[31815]: cephadm 2021-03-10T20:33:05.715854+0000 mgr.gibba044.wflcwh (mgr.34466) 1352 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:33:07.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[31815]: cephadm 2021-03-10T20:33:05.716166+0000 mgr.gibba044.wflcwh (mgr.34466) 1353 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:33:07.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[31815]: cephadm 2021-03-10T20:33:05.717570+0000 mgr.gibba044.wflcwh (mgr.34466) 1354 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:33:07.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[31815]: cephadm 2021-03-10T20:33:05.717608+0000 mgr.gibba044.wflcwh (mgr.34466) 1355 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:33:07.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:06 gibba023 bash[31815]: cephadm 2021-03-10T20:33:05.717740+0000 mgr.gibba044.wflcwh (mgr.34466) 1356 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:33:07.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:06 gibba044 bash[25485]: cephadm 2021-03-10T20:33:05.517859+0000 mgr.gibba044.wflcwh (mgr.34466) 1342 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:33:07.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:06 gibba044 bash[25485]: cephadm 2021-03-10T20:33:05.705789+0000 mgr.gibba044.wflcwh (mgr.34466) 1343 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:33:07.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:06 gibba044 bash[25485]: cephadm 2021-03-10T20:33:05.707822+0000 mgr.gibba044.wflcwh (mgr.34466) 1344 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:33:07.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:06 gibba044 bash[25485]: cephadm 2021-03-10T20:33:05.709624+0000 mgr.gibba044.wflcwh (mgr.34466) 1345 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:33:07.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:06 gibba044 bash[25485]: cephadm 2021-03-10T20:33:05.709659+0000 mgr.gibba044.wflcwh (mgr.34466) 1346 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:33:07.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:06 gibba044 bash[25485]: cephadm 2021-03-10T20:33:05.711239+0000 mgr.gibba044.wflcwh (mgr.34466) 1347 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:33:07.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:06 gibba044 bash[25485]: cephadm 2021-03-10T20:33:05.711275+0000 mgr.gibba044.wflcwh (mgr.34466) 1348 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:33:07.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:06 gibba044 bash[25485]: cephadm 2021-03-10T20:33:05.712850+0000 mgr.gibba044.wflcwh (mgr.34466) 1349 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:33:07.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:06 gibba044 bash[25485]: cephadm 2021-03-10T20:33:05.714253+0000 mgr.gibba044.wflcwh (mgr.34466) 1350 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:33:07.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:06 gibba044 bash[25485]: cephadm 2021-03-10T20:33:05.714287+0000 mgr.gibba044.wflcwh (mgr.34466) 1351 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:33:07.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:06 gibba044 bash[25485]: cephadm 2021-03-10T20:33:05.715854+0000 mgr.gibba044.wflcwh (mgr.34466) 1352 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:33:07.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:06 gibba044 bash[25485]: cephadm 2021-03-10T20:33:05.716166+0000 mgr.gibba044.wflcwh (mgr.34466) 1353 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:33:07.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:06 gibba044 bash[25485]: cephadm 2021-03-10T20:33:05.717570+0000 mgr.gibba044.wflcwh (mgr.34466) 1354 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:33:07.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:06 gibba044 bash[25485]: cephadm 2021-03-10T20:33:05.717608+0000 mgr.gibba044.wflcwh (mgr.34466) 1355 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:33:07.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:06 gibba044 bash[25485]: cephadm 2021-03-10T20:33:05.717740+0000 mgr.gibba044.wflcwh (mgr.34466) 1356 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:33:08.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:07 gibba023 bash[30844]: cluster 2021-03-10T20:33:06.260140+0000 mgr.gibba044.wflcwh (mgr.34466) 1357 : cluster [DBG] pgmap v754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:08.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:07 gibba023 bash[31815]: cluster 2021-03-10T20:33:06.260140+0000 mgr.gibba044.wflcwh (mgr.34466) 1357 : cluster [DBG] pgmap v754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:08.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:07 gibba044 bash[25485]: cluster 2021-03-10T20:33:06.260140+0000 mgr.gibba044.wflcwh (mgr.34466) 1357 : cluster [DBG] pgmap v754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:10.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:09 gibba023 bash[30844]: cluster 2021-03-10T20:33:08.261647+0000 mgr.gibba044.wflcwh (mgr.34466) 1358 : cluster [DBG] pgmap v755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:10.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:09 gibba023 bash[31815]: cluster 2021-03-10T20:33:08.261647+0000 mgr.gibba044.wflcwh (mgr.34466) 1358 : cluster [DBG] pgmap v755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:10.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:09 gibba044 bash[25485]: cluster 2021-03-10T20:33:08.261647+0000 mgr.gibba044.wflcwh (mgr.34466) 1358 : cluster [DBG] pgmap v755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:12.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:11 gibba023 bash[30844]: cluster 2021-03-10T20:33:10.263006+0000 mgr.gibba044.wflcwh (mgr.34466) 1359 : cluster [DBG] pgmap v756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:12.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:11 gibba023 bash[31815]: cluster 2021-03-10T20:33:10.263006+0000 mgr.gibba044.wflcwh (mgr.34466) 1359 : cluster [DBG] pgmap v756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:12.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:11 gibba044 bash[25485]: cluster 2021-03-10T20:33:10.263006+0000 mgr.gibba044.wflcwh (mgr.34466) 1359 : cluster [DBG] pgmap v756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:14.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:13 gibba023 bash[30844]: cluster 2021-03-10T20:33:12.263870+0000 mgr.gibba044.wflcwh (mgr.34466) 1360 : cluster [DBG] pgmap v757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:14.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:13 gibba023 bash[31815]: cluster 2021-03-10T20:33:12.263870+0000 mgr.gibba044.wflcwh (mgr.34466) 1360 : cluster [DBG] pgmap v757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:14.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:13 gibba044 bash[25485]: cluster 2021-03-10T20:33:12.263870+0000 mgr.gibba044.wflcwh (mgr.34466) 1360 : cluster [DBG] pgmap v757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:16.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:15 gibba023 bash[30844]: cluster 2021-03-10T20:33:14.265202+0000 mgr.gibba044.wflcwh (mgr.34466) 1361 : cluster [DBG] pgmap v758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:16.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:15 gibba023 bash[31815]: cluster 2021-03-10T20:33:14.265202+0000 mgr.gibba044.wflcwh (mgr.34466) 1361 : cluster [DBG] pgmap v758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:16.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:15 gibba044 bash[25485]: cluster 2021-03-10T20:33:14.265202+0000 mgr.gibba044.wflcwh (mgr.34466) 1361 : cluster [DBG] pgmap v758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:18.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:17 gibba023 bash[30844]: cluster 2021-03-10T20:33:16.266659+0000 mgr.gibba044.wflcwh (mgr.34466) 1362 : cluster [DBG] pgmap v759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:18.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:17 gibba023 bash[31815]: cluster 2021-03-10T20:33:16.266659+0000 mgr.gibba044.wflcwh (mgr.34466) 1362 : cluster [DBG] pgmap v759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:18.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:17 gibba044 bash[25485]: cluster 2021-03-10T20:33:16.266659+0000 mgr.gibba044.wflcwh (mgr.34466) 1362 : cluster [DBG] pgmap v759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:19.952 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:33:20.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:19 gibba023 bash[30844]: cluster 2021-03-10T20:33:18.268265+0000 mgr.gibba044.wflcwh (mgr.34466) 1363 : cluster [DBG] pgmap v760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:20.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:19 gibba023 bash[31815]: cluster 2021-03-10T20:33:18.268265+0000 mgr.gibba044.wflcwh (mgr.34466) 1363 : cluster [DBG] pgmap v760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:20.182 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:33:20.183 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (24m) 15s ago 30m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:33:20.183 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (29m) 9m ago 29m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:33:20.184 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (24m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:33:20.184 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (25m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:33:20.184 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (24m) 15s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:33:20.185 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (24m) 15s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:33:20.185 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (23m) 9m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:33:20.186 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (23m) 15s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:33:20.186 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (30m) 15s ago 30m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:33:20.187 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (30m) 9m ago 30m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:33:20.187 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (22m) 15s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:33:20.188 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (22m) 15s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:33:20.188 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (21m) 15s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:33:20.188 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (21m) 15s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:33:20.189 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (20m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:33:20.189 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (20m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:33:20.190 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (20m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:33:20.191 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (19m) 9m ago 30m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:33:20.191 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (29m) 9m ago 30m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:33:20.192 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 15s ago 27m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:33:20.192 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 9m ago 27m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:33:20.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:19 gibba044 bash[25485]: cluster 2021-03-10T20:33:18.268265+0000 mgr.gibba044.wflcwh (mgr.34466) 1363 : cluster [DBG] pgmap v760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:20.430 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:33:20.431 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:33:20.431 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:33:20.431 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:33:20.432 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:33:20.432 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:33:20.432 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:33:20.432 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:33:20.432 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:33:20.433 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:33:20.433 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:33:20.433 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:33:20.433 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:33:20.434 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:33:20.434 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:33:20.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:20 gibba044 bash[25485]: audit 2021-03-10T20:33:20.430660+0000 mon.a (mon.0) 918 : audit [DBG] from='client.? 172.21.2.123:0/3061383217' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:33:21.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:20 gibba023 bash[30844]: audit 2021-03-10T20:33:20.430660+0000 mon.a (mon.0) 918 : audit [DBG] from='client.? 172.21.2.123:0/3061383217' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:33:21.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:20 gibba023 bash[31815]: audit 2021-03-10T20:33:20.430660+0000 mon.a (mon.0) 918 : audit [DBG] from='client.? 172.21.2.123:0/3061383217' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:33:22.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:21 gibba023 bash[30844]: audit 2021-03-10T20:33:19.945869+0000 mgr.gibba044.wflcwh (mgr.34466) 1364 : audit [DBG] from='client.44976 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:33:22.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:21 gibba023 bash[30844]: audit 2021-03-10T20:33:20.173451+0000 mgr.gibba044.wflcwh (mgr.34466) 1365 : audit [DBG] from='client.54961 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:33:22.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:21 gibba023 bash[30844]: cluster 2021-03-10T20:33:20.269443+0000 mgr.gibba044.wflcwh (mgr.34466) 1366 : cluster [DBG] pgmap v761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:22.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:21 gibba023 bash[30844]: cephadm 2021-03-10T20:33:20.733652+0000 mgr.gibba044.wflcwh (mgr.34466) 1367 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:33:22.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:21 gibba023 bash[31815]: audit 2021-03-10T20:33:19.945869+0000 mgr.gibba044.wflcwh (mgr.34466) 1364 : audit [DBG] from='client.44976 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:33:22.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:21 gibba023 bash[31815]: audit 2021-03-10T20:33:20.173451+0000 mgr.gibba044.wflcwh (mgr.34466) 1365 : audit [DBG] from='client.54961 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:33:22.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:21 gibba023 bash[31815]: cluster 2021-03-10T20:33:20.269443+0000 mgr.gibba044.wflcwh (mgr.34466) 1366 : cluster [DBG] pgmap v761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:22.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:21 gibba023 bash[31815]: cephadm 2021-03-10T20:33:20.733652+0000 mgr.gibba044.wflcwh (mgr.34466) 1367 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:33:22.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:21 gibba044 bash[25485]: audit 2021-03-10T20:33:19.945869+0000 mgr.gibba044.wflcwh (mgr.34466) 1364 : audit [DBG] from='client.44976 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:33:22.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:21 gibba044 bash[25485]: audit 2021-03-10T20:33:20.173451+0000 mgr.gibba044.wflcwh (mgr.34466) 1365 : audit [DBG] from='client.54961 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:33:22.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:21 gibba044 bash[25485]: cluster 2021-03-10T20:33:20.269443+0000 mgr.gibba044.wflcwh (mgr.34466) 1366 : cluster [DBG] pgmap v761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:22.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:21 gibba044 bash[25485]: cephadm 2021-03-10T20:33:20.733652+0000 mgr.gibba044.wflcwh (mgr.34466) 1367 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:33:24.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:23 gibba023 bash[30844]: cluster 2021-03-10T20:33:22.270306+0000 mgr.gibba044.wflcwh (mgr.34466) 1368 : cluster [DBG] pgmap v762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:24.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:23 gibba023 bash[31815]: cluster 2021-03-10T20:33:22.270306+0000 mgr.gibba044.wflcwh (mgr.34466) 1368 : cluster [DBG] pgmap v762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:24.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:23 gibba044 bash[25485]: cluster 2021-03-10T20:33:22.270306+0000 mgr.gibba044.wflcwh (mgr.34466) 1368 : cluster [DBG] pgmap v762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:26.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:25 gibba023 bash[30844]: cluster 2021-03-10T20:33:24.271892+0000 mgr.gibba044.wflcwh (mgr.34466) 1369 : cluster [DBG] pgmap v763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:26.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:25 gibba023 bash[31815]: cluster 2021-03-10T20:33:24.271892+0000 mgr.gibba044.wflcwh (mgr.34466) 1369 : cluster [DBG] pgmap v763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:26.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:25 gibba044 bash[25485]: cluster 2021-03-10T20:33:24.271892+0000 mgr.gibba044.wflcwh (mgr.34466) 1369 : cluster [DBG] pgmap v763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:28.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:27 gibba023 bash[30844]: cluster 2021-03-10T20:33:26.273292+0000 mgr.gibba044.wflcwh (mgr.34466) 1370 : cluster [DBG] pgmap v764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:28.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:27 gibba023 bash[30844]: audit 2021-03-10T20:33:27.156597+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T20:33:28.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:27 gibba023 bash[30844]: audit 2021-03-10T20:33:27.157374+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T20:33:28.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:27 gibba023 bash[30844]: audit 2021-03-10T20:33:27.158153+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:33:28.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:27 gibba023 bash[30844]: audit 2021-03-10T20:33:27.158875+0000 mon.a (mon.0) 922 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:33:28.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:27 gibba023 bash[30844]: audit 2021-03-10T20:33:27.166073+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:33:28.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:27 gibba023 bash[30844]: audit 2021-03-10T20:33:27.166764+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:33:28.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:27 gibba023 bash[31815]: cluster 2021-03-10T20:33:26.273292+0000 mgr.gibba044.wflcwh (mgr.34466) 1370 : cluster [DBG] pgmap v764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:28.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:27 gibba023 bash[31815]: audit 2021-03-10T20:33:27.156597+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T20:33:28.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:27 gibba023 bash[31815]: audit 2021-03-10T20:33:27.157374+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T20:33:28.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:27 gibba023 bash[31815]: audit 2021-03-10T20:33:27.158153+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:33:28.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:27 gibba023 bash[31815]: audit 2021-03-10T20:33:27.158875+0000 mon.a (mon.0) 922 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:33:28.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:27 gibba023 bash[31815]: audit 2021-03-10T20:33:27.166073+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:33:28.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:27 gibba023 bash[31815]: audit 2021-03-10T20:33:27.166764+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:33:28.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:27 gibba044 bash[25485]: cluster 2021-03-10T20:33:26.273292+0000 mgr.gibba044.wflcwh (mgr.34466) 1370 : cluster [DBG] pgmap v764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:28.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:27 gibba044 bash[25485]: audit 2021-03-10T20:33:27.156597+0000 mon.a (mon.0) 919 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T20:33:28.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:27 gibba044 bash[25485]: audit 2021-03-10T20:33:27.157374+0000 mon.a (mon.0) 920 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T20:33:28.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:27 gibba044 bash[25485]: audit 2021-03-10T20:33:27.158153+0000 mon.a (mon.0) 921 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:33:28.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:27 gibba044 bash[25485]: audit 2021-03-10T20:33:27.158875+0000 mon.a (mon.0) 922 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:33:28.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:27 gibba044 bash[25485]: audit 2021-03-10T20:33:27.166073+0000 mon.a (mon.0) 923 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:33:28.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:27 gibba044 bash[25485]: audit 2021-03-10T20:33:27.166764+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:33:30.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:29 gibba023 bash[30844]: cluster 2021-03-10T20:33:28.274849+0000 mgr.gibba044.wflcwh (mgr.34466) 1371 : cluster [DBG] pgmap v765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:30.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:29 gibba023 bash[31815]: cluster 2021-03-10T20:33:28.274849+0000 mgr.gibba044.wflcwh (mgr.34466) 1371 : cluster [DBG] pgmap v765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:30.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:29 gibba044 bash[25485]: cluster 2021-03-10T20:33:28.274849+0000 mgr.gibba044.wflcwh (mgr.34466) 1371 : cluster [DBG] pgmap v765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:32.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:31 gibba023 bash[30844]: cluster 2021-03-10T20:33:30.276272+0000 mgr.gibba044.wflcwh (mgr.34466) 1372 : cluster [DBG] pgmap v766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:32.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:31 gibba023 bash[31815]: cluster 2021-03-10T20:33:30.276272+0000 mgr.gibba044.wflcwh (mgr.34466) 1372 : cluster [DBG] pgmap v766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:32.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:31 gibba044 bash[25485]: cluster 2021-03-10T20:33:30.276272+0000 mgr.gibba044.wflcwh (mgr.34466) 1372 : cluster [DBG] pgmap v766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:34.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:33 gibba023 bash[30844]: cluster 2021-03-10T20:33:32.277321+0000 mgr.gibba044.wflcwh (mgr.34466) 1373 : cluster [DBG] pgmap v767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:34.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:33 gibba023 bash[31815]: cluster 2021-03-10T20:33:32.277321+0000 mgr.gibba044.wflcwh (mgr.34466) 1373 : cluster [DBG] pgmap v767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:34.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:33 gibba044 bash[25485]: cluster 2021-03-10T20:33:32.277321+0000 mgr.gibba044.wflcwh (mgr.34466) 1373 : cluster [DBG] pgmap v767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:35.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:35 gibba044 bash[25485]: cluster 2021-03-10T20:33:34.278832+0000 mgr.gibba044.wflcwh (mgr.34466) 1374 : cluster [DBG] pgmap v768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:36.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:35 gibba023 bash[30844]: cluster 2021-03-10T20:33:34.278832+0000 mgr.gibba044.wflcwh (mgr.34466) 1374 : cluster [DBG] pgmap v768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:36.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:35 gibba023 bash[31815]: cluster 2021-03-10T20:33:34.278832+0000 mgr.gibba044.wflcwh (mgr.34466) 1374 : cluster [DBG] pgmap v768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:37.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:36 gibba023 bash[30844]: cephadm 2021-03-10T20:33:35.749664+0000 mgr.gibba044.wflcwh (mgr.34466) 1375 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:33:37.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:36 gibba023 bash[31815]: cephadm 2021-03-10T20:33:35.749664+0000 mgr.gibba044.wflcwh (mgr.34466) 1375 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:33:37.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:36 gibba044 bash[25485]: cephadm 2021-03-10T20:33:35.749664+0000 mgr.gibba044.wflcwh (mgr.34466) 1375 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:33:38.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:37 gibba023 bash[30844]: cluster 2021-03-10T20:33:36.280511+0000 mgr.gibba044.wflcwh (mgr.34466) 1376 : cluster [DBG] pgmap v769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:38.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:37 gibba023 bash[31815]: cluster 2021-03-10T20:33:36.280511+0000 mgr.gibba044.wflcwh (mgr.34466) 1376 : cluster [DBG] pgmap v769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:38.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:37 gibba044 bash[25485]: cluster 2021-03-10T20:33:36.280511+0000 mgr.gibba044.wflcwh (mgr.34466) 1376 : cluster [DBG] pgmap v769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:40.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:39 gibba023 bash[30844]: cluster 2021-03-10T20:33:38.281915+0000 mgr.gibba044.wflcwh (mgr.34466) 1377 : cluster [DBG] pgmap v770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:40.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:39 gibba023 bash[31815]: cluster 2021-03-10T20:33:38.281915+0000 mgr.gibba044.wflcwh (mgr.34466) 1377 : cluster [DBG] pgmap v770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:40.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:39 gibba044 bash[25485]: cluster 2021-03-10T20:33:38.281915+0000 mgr.gibba044.wflcwh (mgr.34466) 1377 : cluster [DBG] pgmap v770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:42.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:41 gibba044 bash[25485]: cluster 2021-03-10T20:33:40.283144+0000 mgr.gibba044.wflcwh (mgr.34466) 1378 : cluster [DBG] pgmap v771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:42.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:41 gibba023 bash[30844]: cluster 2021-03-10T20:33:40.283144+0000 mgr.gibba044.wflcwh (mgr.34466) 1378 : cluster [DBG] pgmap v771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:42.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:41 gibba023 bash[31815]: cluster 2021-03-10T20:33:40.283144+0000 mgr.gibba044.wflcwh (mgr.34466) 1378 : cluster [DBG] pgmap v771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:43.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:42 gibba044 bash[25485]: cluster 2021-03-10T20:33:42.284341+0000 mgr.gibba044.wflcwh (mgr.34466) 1379 : cluster [DBG] pgmap v772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:43.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:42 gibba023 bash[30844]: cluster 2021-03-10T20:33:42.284341+0000 mgr.gibba044.wflcwh (mgr.34466) 1379 : cluster [DBG] pgmap v772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:43.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:42 gibba023 bash[31815]: cluster 2021-03-10T20:33:42.284341+0000 mgr.gibba044.wflcwh (mgr.34466) 1379 : cluster [DBG] pgmap v772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:45.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:45 gibba023 bash[30844]: cluster 2021-03-10T20:33:44.285742+0000 mgr.gibba044.wflcwh (mgr.34466) 1380 : cluster [DBG] pgmap v773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:45.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:45 gibba023 bash[31815]: cluster 2021-03-10T20:33:44.285742+0000 mgr.gibba044.wflcwh (mgr.34466) 1380 : cluster [DBG] pgmap v773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:45.748 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:45 gibba044 bash[25485]: cluster 2021-03-10T20:33:44.285742+0000 mgr.gibba044.wflcwh (mgr.34466) 1380 : cluster [DBG] pgmap v773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:47.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:47 gibba023 bash[30844]: cluster 2021-03-10T20:33:46.287314+0000 mgr.gibba044.wflcwh (mgr.34466) 1381 : cluster [DBG] pgmap v774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:47.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:47 gibba023 bash[31815]: cluster 2021-03-10T20:33:46.287314+0000 mgr.gibba044.wflcwh (mgr.34466) 1381 : cluster [DBG] pgmap v774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:47.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:47 gibba044 bash[25485]: cluster 2021-03-10T20:33:46.287314+0000 mgr.gibba044.wflcwh (mgr.34466) 1381 : cluster [DBG] pgmap v774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:49.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:49 gibba023 bash[30844]: cluster 2021-03-10T20:33:48.288984+0000 mgr.gibba044.wflcwh (mgr.34466) 1382 : cluster [DBG] pgmap v775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:49.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:49 gibba023 bash[31815]: cluster 2021-03-10T20:33:48.288984+0000 mgr.gibba044.wflcwh (mgr.34466) 1382 : cluster [DBG] pgmap v775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:49.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:49 gibba044 bash[25485]: cluster 2021-03-10T20:33:48.288984+0000 mgr.gibba044.wflcwh (mgr.34466) 1382 : cluster [DBG] pgmap v775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:50.714 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:33:50.944 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:33:50.944 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (25m) 46s ago 30m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:33:50.944 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (30m) 9m ago 30m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:33:50.945 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (25m) 9m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:33:50.945 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (25m) 9m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:33:50.945 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (24m) 46s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:33:50.945 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (24m) 46s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:33:50.946 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (24m) 9m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:33:50.946 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (24m) 46s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:33:50.946 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (30m) 46s ago 30m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:33:50.946 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (30m) 9m ago 30m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:33:50.947 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (23m) 46s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:33:50.947 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (22m) 46s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:33:50.947 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (22m) 46s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:33:50.947 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (21m) 46s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:33:50.947 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (21m) 9m ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:33:50.948 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (21m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:33:50.948 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (20m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:33:50.948 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (20m) 9m ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:33:50.948 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (30m) 9m ago 30m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:33:50.949 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 46s ago 28m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:33:50.949 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 9m ago 28m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:33:51.192 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:33:51.192 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:33:51.192 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:33:51.193 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:33:51.193 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:33:51.193 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:33:51.193 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:33:51.194 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:33:51.194 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:33:51.194 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:33:51.194 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:33:51.194 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:33:51.195 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:33:51.195 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:33:51.195 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:33:51.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:51 gibba023 bash[30844]: cluster 2021-03-10T20:33:50.290127+0000 mgr.gibba044.wflcwh (mgr.34466) 1383 : cluster [DBG] pgmap v776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:51.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:51 gibba023 bash[30844]: audit 2021-03-10T20:33:50.709110+0000 mgr.gibba044.wflcwh (mgr.34466) 1384 : audit [DBG] from='client.54973 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:33:51.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:51 gibba023 bash[30844]: cephadm 2021-03-10T20:33:50.765736+0000 mgr.gibba044.wflcwh (mgr.34466) 1385 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:33:51.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:51 gibba023 bash[30844]: audit 2021-03-10T20:33:51.192280+0000 mon.a (mon.0) 925 : audit [DBG] from='client.? 172.21.2.123:0/3477310448' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:33:51.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:51 gibba023 bash[31815]: cluster 2021-03-10T20:33:50.290127+0000 mgr.gibba044.wflcwh (mgr.34466) 1383 : cluster [DBG] pgmap v776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:51.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:51 gibba023 bash[31815]: audit 2021-03-10T20:33:50.709110+0000 mgr.gibba044.wflcwh (mgr.34466) 1384 : audit [DBG] from='client.54973 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:33:51.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:51 gibba023 bash[31815]: cephadm 2021-03-10T20:33:50.765736+0000 mgr.gibba044.wflcwh (mgr.34466) 1385 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:33:51.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:51 gibba023 bash[31815]: audit 2021-03-10T20:33:51.192280+0000 mon.a (mon.0) 925 : audit [DBG] from='client.? 172.21.2.123:0/3477310448' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:33:51.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:51 gibba044 bash[25485]: cluster 2021-03-10T20:33:50.290127+0000 mgr.gibba044.wflcwh (mgr.34466) 1383 : cluster [DBG] pgmap v776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:51.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:51 gibba044 bash[25485]: audit 2021-03-10T20:33:50.709110+0000 mgr.gibba044.wflcwh (mgr.34466) 1384 : audit [DBG] from='client.54973 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:33:51.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:51 gibba044 bash[25485]: cephadm 2021-03-10T20:33:50.765736+0000 mgr.gibba044.wflcwh (mgr.34466) 1385 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:33:51.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:51 gibba044 bash[25485]: audit 2021-03-10T20:33:51.192280+0000 mon.a (mon.0) 925 : audit [DBG] from='client.? 172.21.2.123:0/3477310448' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:33:52.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:52 gibba044 bash[25485]: audit 2021-03-10T20:33:50.934607+0000 mgr.gibba044.wflcwh (mgr.34466) 1386 : audit [DBG] from='client.54979 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:33:53.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:52 gibba023 bash[30844]: audit 2021-03-10T20:33:50.934607+0000 mgr.gibba044.wflcwh (mgr.34466) 1386 : audit [DBG] from='client.54979 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:33:53.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:52 gibba023 bash[31815]: audit 2021-03-10T20:33:50.934607+0000 mgr.gibba044.wflcwh (mgr.34466) 1386 : audit [DBG] from='client.54979 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:33:53.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:53 gibba044 bash[25485]: cluster 2021-03-10T20:33:52.291213+0000 mgr.gibba044.wflcwh (mgr.34466) 1387 : cluster [DBG] pgmap v777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:54.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:53 gibba023 bash[30844]: cluster 2021-03-10T20:33:52.291213+0000 mgr.gibba044.wflcwh (mgr.34466) 1387 : cluster [DBG] pgmap v777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:54.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:53 gibba023 bash[31815]: cluster 2021-03-10T20:33:52.291213+0000 mgr.gibba044.wflcwh (mgr.34466) 1387 : cluster [DBG] pgmap v777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:55.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:55 gibba044 bash[25485]: cluster 2021-03-10T20:33:54.292631+0000 mgr.gibba044.wflcwh (mgr.34466) 1388 : cluster [DBG] pgmap v778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:56.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:55 gibba023 bash[30844]: cluster 2021-03-10T20:33:54.292631+0000 mgr.gibba044.wflcwh (mgr.34466) 1388 : cluster [DBG] pgmap v778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:56.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:55 gibba023 bash[31815]: cluster 2021-03-10T20:33:54.292631+0000 mgr.gibba044.wflcwh (mgr.34466) 1388 : cluster [DBG] pgmap v778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:57.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:57 gibba044 bash[25485]: cluster 2021-03-10T20:33:56.294080+0000 mgr.gibba044.wflcwh (mgr.34466) 1389 : cluster [DBG] pgmap v779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:58.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:57 gibba023 bash[30844]: cluster 2021-03-10T20:33:56.294080+0000 mgr.gibba044.wflcwh (mgr.34466) 1389 : cluster [DBG] pgmap v779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:58.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:57 gibba023 bash[31815]: cluster 2021-03-10T20:33:56.294080+0000 mgr.gibba044.wflcwh (mgr.34466) 1389 : cluster [DBG] pgmap v779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:33:59.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:33:59 gibba044 bash[25485]: cluster 2021-03-10T20:33:58.295750+0000 mgr.gibba044.wflcwh (mgr.34466) 1390 : cluster [DBG] pgmap v780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:00.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:33:59 gibba023 bash[30844]: cluster 2021-03-10T20:33:58.295750+0000 mgr.gibba044.wflcwh (mgr.34466) 1390 : cluster [DBG] pgmap v780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:00.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:33:59 gibba023 bash[31815]: cluster 2021-03-10T20:33:58.295750+0000 mgr.gibba044.wflcwh (mgr.34466) 1390 : cluster [DBG] pgmap v780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:01.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:01 gibba044 bash[25485]: cluster 2021-03-10T20:34:00.297041+0000 mgr.gibba044.wflcwh (mgr.34466) 1391 : cluster [DBG] pgmap v781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:02.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:01 gibba023 bash[30844]: cluster 2021-03-10T20:34:00.297041+0000 mgr.gibba044.wflcwh (mgr.34466) 1391 : cluster [DBG] pgmap v781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:02.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:01 gibba023 bash[31815]: cluster 2021-03-10T20:34:00.297041+0000 mgr.gibba044.wflcwh (mgr.34466) 1391 : cluster [DBG] pgmap v781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:03.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:03 gibba044 bash[25485]: cluster 2021-03-10T20:34:02.298191+0000 mgr.gibba044.wflcwh (mgr.34466) 1392 : cluster [DBG] pgmap v782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:04.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:03 gibba023 bash[30844]: cluster 2021-03-10T20:34:02.298191+0000 mgr.gibba044.wflcwh (mgr.34466) 1392 : cluster [DBG] pgmap v782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:04.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:03 gibba023 bash[31815]: cluster 2021-03-10T20:34:02.298191+0000 mgr.gibba044.wflcwh (mgr.34466) 1392 : cluster [DBG] pgmap v782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:05.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:05 gibba044 bash[25485]: cluster 2021-03-10T20:34:04.299935+0000 mgr.gibba044.wflcwh (mgr.34466) 1393 : cluster [DBG] pgmap v783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:06.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:05 gibba023 bash[30844]: cluster 2021-03-10T20:34:04.299935+0000 mgr.gibba044.wflcwh (mgr.34466) 1393 : cluster [DBG] pgmap v783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:06.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:05 gibba023 bash[31815]: cluster 2021-03-10T20:34:04.299935+0000 mgr.gibba044.wflcwh (mgr.34466) 1393 : cluster [DBG] pgmap v783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:06.998 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:06 gibba044 bash[25485]: audit 2021-03-10T20:34:05.778852+0000 mon.a (mon.0) 926 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:34:06.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:06 gibba044 bash[25485]: cephadm 2021-03-10T20:34:05.780620+0000 mgr.gibba044.wflcwh (mgr.34466) 1394 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:34:07.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:06 gibba023 bash[30844]: audit 2021-03-10T20:34:05.778852+0000 mon.a (mon.0) 926 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:34:07.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:06 gibba023 bash[30844]: cephadm 2021-03-10T20:34:05.780620+0000 mgr.gibba044.wflcwh (mgr.34466) 1394 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:34:07.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:06 gibba023 bash[31815]: audit 2021-03-10T20:34:05.778852+0000 mon.a (mon.0) 926 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:34:07.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:06 gibba023 bash[31815]: cephadm 2021-03-10T20:34:05.780620+0000 mgr.gibba044.wflcwh (mgr.34466) 1394 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:34:08.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:07 gibba023 bash[30844]: cluster 2021-03-10T20:34:06.301577+0000 mgr.gibba044.wflcwh (mgr.34466) 1395 : cluster [DBG] pgmap v784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:08.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:07 gibba023 bash[31815]: cluster 2021-03-10T20:34:06.301577+0000 mgr.gibba044.wflcwh (mgr.34466) 1395 : cluster [DBG] pgmap v784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:08.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:07 gibba044 bash[25485]: cluster 2021-03-10T20:34:06.301577+0000 mgr.gibba044.wflcwh (mgr.34466) 1395 : cluster [DBG] pgmap v784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:10.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:09 gibba023 bash[30844]: cluster 2021-03-10T20:34:08.303112+0000 mgr.gibba044.wflcwh (mgr.34466) 1396 : cluster [DBG] pgmap v785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:10.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:09 gibba023 bash[30844]: audit 2021-03-10T20:34:09.550285+0000 mon.a (mon.0) 927 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:34:10.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:09 gibba023 bash[31815]: cluster 2021-03-10T20:34:08.303112+0000 mgr.gibba044.wflcwh (mgr.34466) 1396 : cluster [DBG] pgmap v785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:10.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:09 gibba023 bash[31815]: audit 2021-03-10T20:34:09.550285+0000 mon.a (mon.0) 927 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:34:10.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:09 gibba044 bash[25485]: cluster 2021-03-10T20:34:08.303112+0000 mgr.gibba044.wflcwh (mgr.34466) 1396 : cluster [DBG] pgmap v785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:10.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:09 gibba044 bash[25485]: audit 2021-03-10T20:34:09.550285+0000 mon.a (mon.0) 927 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:34:11.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[30844]: cephadm 2021-03-10T20:34:09.553738+0000 mgr.gibba044.wflcwh (mgr.34466) 1397 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:34:11.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[30844]: audit 2021-03-10T20:34:09.767678+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:34:11.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[30844]: audit 2021-03-10T20:34:09.772610+0000 mon.a (mon.0) 929 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:34:11.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[30844]: audit 2021-03-10T20:34:09.774050+0000 mon.a (mon.0) 930 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:11.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[30844]: cephadm 2021-03-10T20:34:09.774458+0000 mgr.gibba044.wflcwh (mgr.34466) 1398 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:34:11.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[30844]: audit 2021-03-10T20:34:09.775434+0000 mon.a (mon.0) 931 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:11.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[30844]: cephadm 2021-03-10T20:34:09.776481+0000 mgr.gibba044.wflcwh (mgr.34466) 1399 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:34:11.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[30844]: audit 2021-03-10T20:34:09.776694+0000 mon.a (mon.0) 932 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:11.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[30844]: cephadm 2021-03-10T20:34:09.777653+0000 mgr.gibba044.wflcwh (mgr.34466) 1400 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:34:11.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[30844]: cephadm 2021-03-10T20:34:09.777690+0000 mgr.gibba044.wflcwh (mgr.34466) 1401 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:34:11.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[30844]: cephadm 2021-03-10T20:34:09.778986+0000 mgr.gibba044.wflcwh (mgr.34466) 1402 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:34:11.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[30844]: cephadm 2021-03-10T20:34:09.779023+0000 mgr.gibba044.wflcwh (mgr.34466) 1403 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:34:11.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[30844]: audit 2021-03-10T20:34:09.779472+0000 mon.a (mon.0) 933 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:11.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[30844]: cephadm 2021-03-10T20:34:09.780200+0000 mgr.gibba044.wflcwh (mgr.34466) 1404 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:34:11.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[30844]: audit 2021-03-10T20:34:09.781079+0000 mon.a (mon.0) 934 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:11.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[30844]: cephadm 2021-03-10T20:34:09.781604+0000 mgr.gibba044.wflcwh (mgr.34466) 1405 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:34:11.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[30844]: cephadm 2021-03-10T20:34:09.781656+0000 mgr.gibba044.wflcwh (mgr.34466) 1406 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:34:11.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[30844]: cephadm 2021-03-10T20:34:09.783077+0000 mgr.gibba044.wflcwh (mgr.34466) 1407 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:34:11.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[30844]: cephadm 2021-03-10T20:34:09.783395+0000 mgr.gibba044.wflcwh (mgr.34466) 1408 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:34:11.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[30844]: cephadm 2021-03-10T20:34:09.784694+0000 mgr.gibba044.wflcwh (mgr.34466) 1409 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:34:11.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[30844]: cephadm 2021-03-10T20:34:09.784748+0000 mgr.gibba044.wflcwh (mgr.34466) 1410 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:34:11.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[30844]: cephadm 2021-03-10T20:34:09.784873+0000 mgr.gibba044.wflcwh (mgr.34466) 1411 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:34:11.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[31815]: cephadm 2021-03-10T20:34:09.553738+0000 mgr.gibba044.wflcwh (mgr.34466) 1397 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:34:11.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[31815]: audit 2021-03-10T20:34:09.767678+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:34:11.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[31815]: audit 2021-03-10T20:34:09.772610+0000 mon.a (mon.0) 929 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:34:11.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[31815]: audit 2021-03-10T20:34:09.774050+0000 mon.a (mon.0) 930 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:11.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[31815]: cephadm 2021-03-10T20:34:09.774458+0000 mgr.gibba044.wflcwh (mgr.34466) 1398 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:34:11.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[31815]: audit 2021-03-10T20:34:09.775434+0000 mon.a (mon.0) 931 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:11.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[31815]: cephadm 2021-03-10T20:34:09.776481+0000 mgr.gibba044.wflcwh (mgr.34466) 1399 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:34:11.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[31815]: audit 2021-03-10T20:34:09.776694+0000 mon.a (mon.0) 932 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:11.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[31815]: cephadm 2021-03-10T20:34:09.777653+0000 mgr.gibba044.wflcwh (mgr.34466) 1400 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:34:11.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[31815]: cephadm 2021-03-10T20:34:09.777690+0000 mgr.gibba044.wflcwh (mgr.34466) 1401 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:34:11.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[31815]: cephadm 2021-03-10T20:34:09.778986+0000 mgr.gibba044.wflcwh (mgr.34466) 1402 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:34:11.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[31815]: cephadm 2021-03-10T20:34:09.779023+0000 mgr.gibba044.wflcwh (mgr.34466) 1403 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:34:11.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[31815]: audit 2021-03-10T20:34:09.779472+0000 mon.a (mon.0) 933 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:11.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[31815]: cephadm 2021-03-10T20:34:09.780200+0000 mgr.gibba044.wflcwh (mgr.34466) 1404 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:34:11.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[31815]: audit 2021-03-10T20:34:09.781079+0000 mon.a (mon.0) 934 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:11.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[31815]: cephadm 2021-03-10T20:34:09.781604+0000 mgr.gibba044.wflcwh (mgr.34466) 1405 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:34:11.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[31815]: cephadm 2021-03-10T20:34:09.781656+0000 mgr.gibba044.wflcwh (mgr.34466) 1406 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:34:11.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[31815]: cephadm 2021-03-10T20:34:09.783077+0000 mgr.gibba044.wflcwh (mgr.34466) 1407 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:34:11.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[31815]: cephadm 2021-03-10T20:34:09.783395+0000 mgr.gibba044.wflcwh (mgr.34466) 1408 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:34:11.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[31815]: cephadm 2021-03-10T20:34:09.784694+0000 mgr.gibba044.wflcwh (mgr.34466) 1409 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:34:11.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[31815]: cephadm 2021-03-10T20:34:09.784748+0000 mgr.gibba044.wflcwh (mgr.34466) 1410 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:34:11.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:10 gibba023 bash[31815]: cephadm 2021-03-10T20:34:09.784873+0000 mgr.gibba044.wflcwh (mgr.34466) 1411 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:34:11.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:10 gibba044 bash[25485]: cephadm 2021-03-10T20:34:09.553738+0000 mgr.gibba044.wflcwh (mgr.34466) 1397 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:34:11.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:10 gibba044 bash[25485]: audit 2021-03-10T20:34:09.767678+0000 mon.a (mon.0) 928 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:34:11.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:10 gibba044 bash[25485]: audit 2021-03-10T20:34:09.772610+0000 mon.a (mon.0) 929 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:34:11.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:10 gibba044 bash[25485]: audit 2021-03-10T20:34:09.774050+0000 mon.a (mon.0) 930 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:11.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:10 gibba044 bash[25485]: cephadm 2021-03-10T20:34:09.774458+0000 mgr.gibba044.wflcwh (mgr.34466) 1398 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:34:11.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:10 gibba044 bash[25485]: audit 2021-03-10T20:34:09.775434+0000 mon.a (mon.0) 931 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:11.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:10 gibba044 bash[25485]: cephadm 2021-03-10T20:34:09.776481+0000 mgr.gibba044.wflcwh (mgr.34466) 1399 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:34:11.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:10 gibba044 bash[25485]: audit 2021-03-10T20:34:09.776694+0000 mon.a (mon.0) 932 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:11.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:10 gibba044 bash[25485]: cephadm 2021-03-10T20:34:09.777653+0000 mgr.gibba044.wflcwh (mgr.34466) 1400 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:34:11.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:10 gibba044 bash[25485]: cephadm 2021-03-10T20:34:09.777690+0000 mgr.gibba044.wflcwh (mgr.34466) 1401 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:34:11.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:10 gibba044 bash[25485]: cephadm 2021-03-10T20:34:09.778986+0000 mgr.gibba044.wflcwh (mgr.34466) 1402 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:34:11.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:10 gibba044 bash[25485]: cephadm 2021-03-10T20:34:09.779023+0000 mgr.gibba044.wflcwh (mgr.34466) 1403 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:34:11.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:10 gibba044 bash[25485]: audit 2021-03-10T20:34:09.779472+0000 mon.a (mon.0) 933 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:11.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:10 gibba044 bash[25485]: cephadm 2021-03-10T20:34:09.780200+0000 mgr.gibba044.wflcwh (mgr.34466) 1404 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:34:11.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:10 gibba044 bash[25485]: audit 2021-03-10T20:34:09.781079+0000 mon.a (mon.0) 934 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:11.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:10 gibba044 bash[25485]: cephadm 2021-03-10T20:34:09.781604+0000 mgr.gibba044.wflcwh (mgr.34466) 1405 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:34:11.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:10 gibba044 bash[25485]: cephadm 2021-03-10T20:34:09.781656+0000 mgr.gibba044.wflcwh (mgr.34466) 1406 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:34:11.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:10 gibba044 bash[25485]: cephadm 2021-03-10T20:34:09.783077+0000 mgr.gibba044.wflcwh (mgr.34466) 1407 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:34:11.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:10 gibba044 bash[25485]: cephadm 2021-03-10T20:34:09.783395+0000 mgr.gibba044.wflcwh (mgr.34466) 1408 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:34:11.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:10 gibba044 bash[25485]: cephadm 2021-03-10T20:34:09.784694+0000 mgr.gibba044.wflcwh (mgr.34466) 1409 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:34:11.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:10 gibba044 bash[25485]: cephadm 2021-03-10T20:34:09.784748+0000 mgr.gibba044.wflcwh (mgr.34466) 1410 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:34:11.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:10 gibba044 bash[25485]: cephadm 2021-03-10T20:34:09.784873+0000 mgr.gibba044.wflcwh (mgr.34466) 1411 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:34:12.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:11 gibba023 bash[30844]: cluster 2021-03-10T20:34:10.304355+0000 mgr.gibba044.wflcwh (mgr.34466) 1412 : cluster [DBG] pgmap v786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:12.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:11 gibba023 bash[31815]: cluster 2021-03-10T20:34:10.304355+0000 mgr.gibba044.wflcwh (mgr.34466) 1412 : cluster [DBG] pgmap v786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:12.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:11 gibba044 bash[25485]: cluster 2021-03-10T20:34:10.304355+0000 mgr.gibba044.wflcwh (mgr.34466) 1412 : cluster [DBG] pgmap v786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:14.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:13 gibba023 bash[30844]: cluster 2021-03-10T20:34:12.305850+0000 mgr.gibba044.wflcwh (mgr.34466) 1413 : cluster [DBG] pgmap v787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:14.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:13 gibba023 bash[31815]: cluster 2021-03-10T20:34:12.305850+0000 mgr.gibba044.wflcwh (mgr.34466) 1413 : cluster [DBG] pgmap v787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:14.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:13 gibba044 bash[25485]: cluster 2021-03-10T20:34:12.305850+0000 mgr.gibba044.wflcwh (mgr.34466) 1413 : cluster [DBG] pgmap v787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:16.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:15 gibba023 bash[30844]: cluster 2021-03-10T20:34:14.307485+0000 mgr.gibba044.wflcwh (mgr.34466) 1414 : cluster [DBG] pgmap v788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:16.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:15 gibba023 bash[31815]: cluster 2021-03-10T20:34:14.307485+0000 mgr.gibba044.wflcwh (mgr.34466) 1414 : cluster [DBG] pgmap v788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:16.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:15 gibba044 bash[25485]: cluster 2021-03-10T20:34:14.307485+0000 mgr.gibba044.wflcwh (mgr.34466) 1414 : cluster [DBG] pgmap v788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:18.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:17 gibba023 bash[30844]: cluster 2021-03-10T20:34:16.309058+0000 mgr.gibba044.wflcwh (mgr.34466) 1415 : cluster [DBG] pgmap v789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:18.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:17 gibba023 bash[31815]: cluster 2021-03-10T20:34:16.309058+0000 mgr.gibba044.wflcwh (mgr.34466) 1415 : cluster [DBG] pgmap v789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:18.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:17 gibba044 bash[25485]: cluster 2021-03-10T20:34:16.309058+0000 mgr.gibba044.wflcwh (mgr.34466) 1415 : cluster [DBG] pgmap v789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:20.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:19 gibba023 bash[30844]: cluster 2021-03-10T20:34:18.310591+0000 mgr.gibba044.wflcwh (mgr.34466) 1416 : cluster [DBG] pgmap v790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:20.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:19 gibba023 bash[31815]: cluster 2021-03-10T20:34:18.310591+0000 mgr.gibba044.wflcwh (mgr.34466) 1416 : cluster [DBG] pgmap v790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:20.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:19 gibba044 bash[25485]: cluster 2021-03-10T20:34:18.310591+0000 mgr.gibba044.wflcwh (mgr.34466) 1416 : cluster [DBG] pgmap v790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:21.436 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:34:21.665 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:34:21.666 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (25m) 76s ago 31m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:34:21.666 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (30m) 12s ago 30m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:34:21.666 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (25m) 12s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:34:21.667 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (26m) 12s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:34:21.667 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (25m) 76s ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:34:21.668 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (25m) 76s ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:34:21.668 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (24m) 12s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:34:21.669 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (24m) 76s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:34:21.669 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (31m) 76s ago 31m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:34:21.669 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (31m) 12s ago 31m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:34:21.670 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (23m) 76s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:34:21.670 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (23m) 76s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:34:21.671 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (22m) 76s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:34:21.671 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (22m) 76s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:34:21.672 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (21m) 12s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:34:21.672 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (21m) 12s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:34:21.673 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (21m) 12s ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:34:21.673 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (20m) 12s ago 31m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:34:21.673 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (30m) 12s ago 31m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:34:21.674 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 76s ago 28m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:34:21.674 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 12s ago 29m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:34:21.920 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:34:21.921 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:34:21.921 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:34:21.922 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:34:21.922 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:34:21.922 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:34:21.923 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:34:21.923 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:34:21.923 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:34:21.923 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:34:21.924 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:34:21.924 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:34:21.924 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:34:21.924 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:34:21.924 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:34:22.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:21 gibba023 bash[30844]: cluster 2021-03-10T20:34:20.311874+0000 mgr.gibba044.wflcwh (mgr.34466) 1417 : cluster [DBG] pgmap v791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:22.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:21 gibba023 bash[31815]: cluster 2021-03-10T20:34:20.311874+0000 mgr.gibba044.wflcwh (mgr.34466) 1417 : cluster [DBG] pgmap v791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:22.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:21 gibba044 bash[25485]: cluster 2021-03-10T20:34:20.311874+0000 mgr.gibba044.wflcwh (mgr.34466) 1417 : cluster [DBG] pgmap v791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:23.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:22 gibba023 bash[30844]: audit 2021-03-10T20:34:21.429607+0000 mgr.gibba044.wflcwh (mgr.34466) 1418 : audit [DBG] from='client.54991 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:34:23.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:22 gibba023 bash[30844]: audit 2021-03-10T20:34:21.655665+0000 mgr.gibba044.wflcwh (mgr.34466) 1419 : audit [DBG] from='client.45018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:34:23.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:22 gibba023 bash[30844]: audit 2021-03-10T20:34:21.920699+0000 mon.c (mon.1) 38 : audit [DBG] from='client.? 172.21.2.123:0/3491822109' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:23.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:22 gibba023 bash[31815]: audit 2021-03-10T20:34:21.429607+0000 mgr.gibba044.wflcwh (mgr.34466) 1418 : audit [DBG] from='client.54991 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:34:23.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:22 gibba023 bash[31815]: audit 2021-03-10T20:34:21.655665+0000 mgr.gibba044.wflcwh (mgr.34466) 1419 : audit [DBG] from='client.45018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:34:23.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:22 gibba023 bash[31815]: audit 2021-03-10T20:34:21.920699+0000 mon.c (mon.1) 38 : audit [DBG] from='client.? 172.21.2.123:0/3491822109' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:23.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:22 gibba044 bash[25485]: audit 2021-03-10T20:34:21.429607+0000 mgr.gibba044.wflcwh (mgr.34466) 1418 : audit [DBG] from='client.54991 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:34:23.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:22 gibba044 bash[25485]: audit 2021-03-10T20:34:21.655665+0000 mgr.gibba044.wflcwh (mgr.34466) 1419 : audit [DBG] from='client.45018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:34:23.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:22 gibba044 bash[25485]: audit 2021-03-10T20:34:21.920699+0000 mon.c (mon.1) 38 : audit [DBG] from='client.? 172.21.2.123:0/3491822109' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:24.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:23 gibba023 bash[30844]: cluster 2021-03-10T20:34:22.313282+0000 mgr.gibba044.wflcwh (mgr.34466) 1420 : cluster [DBG] pgmap v792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:24.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:23 gibba023 bash[31815]: cluster 2021-03-10T20:34:22.313282+0000 mgr.gibba044.wflcwh (mgr.34466) 1420 : cluster [DBG] pgmap v792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:24.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:23 gibba044 bash[25485]: cluster 2021-03-10T20:34:22.313282+0000 mgr.gibba044.wflcwh (mgr.34466) 1420 : cluster [DBG] pgmap v792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:26.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:25 gibba023 bash[30844]: cluster 2021-03-10T20:34:24.314909+0000 mgr.gibba044.wflcwh (mgr.34466) 1421 : cluster [DBG] pgmap v793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:26.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:25 gibba023 bash[30844]: cephadm 2021-03-10T20:34:24.800614+0000 mgr.gibba044.wflcwh (mgr.34466) 1422 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:34:26.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:25 gibba023 bash[31815]: cluster 2021-03-10T20:34:24.314909+0000 mgr.gibba044.wflcwh (mgr.34466) 1421 : cluster [DBG] pgmap v793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:26.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:25 gibba023 bash[31815]: cephadm 2021-03-10T20:34:24.800614+0000 mgr.gibba044.wflcwh (mgr.34466) 1422 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:34:26.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:25 gibba044 bash[25485]: cluster 2021-03-10T20:34:24.314909+0000 mgr.gibba044.wflcwh (mgr.34466) 1421 : cluster [DBG] pgmap v793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:26.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:25 gibba044 bash[25485]: cephadm 2021-03-10T20:34:24.800614+0000 mgr.gibba044.wflcwh (mgr.34466) 1422 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:34:28.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:27 gibba023 bash[30844]: cluster 2021-03-10T20:34:26.316432+0000 mgr.gibba044.wflcwh (mgr.34466) 1423 : cluster [DBG] pgmap v794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:28.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:27 gibba023 bash[30844]: audit 2021-03-10T20:34:27.174404+0000 mon.a (mon.0) 935 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:34:28.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:27 gibba023 bash[30844]: audit 2021-03-10T20:34:27.175037+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:34:28.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:27 gibba023 bash[30844]: audit 2021-03-10T20:34:27.175644+0000 mon.a (mon.0) 937 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:34:28.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:27 gibba023 bash[30844]: audit 2021-03-10T20:34:27.176413+0000 mon.a (mon.0) 938 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:34:28.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:27 gibba023 bash[30844]: audit 2021-03-10T20:34:27.177105+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:34:28.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:27 gibba023 bash[30844]: audit 2021-03-10T20:34:27.177782+0000 mon.a (mon.0) 940 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:34:28.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:27 gibba023 bash[31815]: cluster 2021-03-10T20:34:26.316432+0000 mgr.gibba044.wflcwh (mgr.34466) 1423 : cluster [DBG] pgmap v794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:28.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:27 gibba023 bash[31815]: audit 2021-03-10T20:34:27.174404+0000 mon.a (mon.0) 935 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:34:28.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:27 gibba023 bash[31815]: audit 2021-03-10T20:34:27.175037+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:34:28.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:27 gibba023 bash[31815]: audit 2021-03-10T20:34:27.175644+0000 mon.a (mon.0) 937 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:34:28.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:27 gibba023 bash[31815]: audit 2021-03-10T20:34:27.176413+0000 mon.a (mon.0) 938 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:34:28.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:27 gibba023 bash[31815]: audit 2021-03-10T20:34:27.177105+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:34:28.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:27 gibba023 bash[31815]: audit 2021-03-10T20:34:27.177782+0000 mon.a (mon.0) 940 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:34:28.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:27 gibba044 bash[25485]: cluster 2021-03-10T20:34:26.316432+0000 mgr.gibba044.wflcwh (mgr.34466) 1423 : cluster [DBG] pgmap v794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:28.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:27 gibba044 bash[25485]: audit 2021-03-10T20:34:27.174404+0000 mon.a (mon.0) 935 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:34:28.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:27 gibba044 bash[25485]: audit 2021-03-10T20:34:27.175037+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:34:28.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:27 gibba044 bash[25485]: audit 2021-03-10T20:34:27.175644+0000 mon.a (mon.0) 937 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:34:28.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:27 gibba044 bash[25485]: audit 2021-03-10T20:34:27.176413+0000 mon.a (mon.0) 938 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:34:28.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:27 gibba044 bash[25485]: audit 2021-03-10T20:34:27.177105+0000 mon.a (mon.0) 939 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:34:28.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:27 gibba044 bash[25485]: audit 2021-03-10T20:34:27.177782+0000 mon.a (mon.0) 940 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:34:30.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:29 gibba023 bash[30844]: cluster 2021-03-10T20:34:28.318103+0000 mgr.gibba044.wflcwh (mgr.34466) 1424 : cluster [DBG] pgmap v795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:30.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:29 gibba023 bash[31815]: cluster 2021-03-10T20:34:28.318103+0000 mgr.gibba044.wflcwh (mgr.34466) 1424 : cluster [DBG] pgmap v795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:30.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:29 gibba044 bash[25485]: cluster 2021-03-10T20:34:28.318103+0000 mgr.gibba044.wflcwh (mgr.34466) 1424 : cluster [DBG] pgmap v795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:32.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:31 gibba023 bash[30844]: cluster 2021-03-10T20:34:30.319449+0000 mgr.gibba044.wflcwh (mgr.34466) 1425 : cluster [DBG] pgmap v796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:32.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:31 gibba023 bash[31815]: cluster 2021-03-10T20:34:30.319449+0000 mgr.gibba044.wflcwh (mgr.34466) 1425 : cluster [DBG] pgmap v796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:32.248 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:31 gibba044 bash[25485]: cluster 2021-03-10T20:34:30.319449+0000 mgr.gibba044.wflcwh (mgr.34466) 1425 : cluster [DBG] pgmap v796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:34.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:33 gibba023 bash[30844]: cluster 2021-03-10T20:34:32.321239+0000 mgr.gibba044.wflcwh (mgr.34466) 1426 : cluster [DBG] pgmap v797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:34.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:33 gibba023 bash[31815]: cluster 2021-03-10T20:34:32.321239+0000 mgr.gibba044.wflcwh (mgr.34466) 1426 : cluster [DBG] pgmap v797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:34.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:33 gibba044 bash[25485]: cluster 2021-03-10T20:34:32.321239+0000 mgr.gibba044.wflcwh (mgr.34466) 1426 : cluster [DBG] pgmap v797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:36.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:35 gibba023 bash[30844]: cluster 2021-03-10T20:34:34.323023+0000 mgr.gibba044.wflcwh (mgr.34466) 1427 : cluster [DBG] pgmap v798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:36.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:35 gibba023 bash[31815]: cluster 2021-03-10T20:34:34.323023+0000 mgr.gibba044.wflcwh (mgr.34466) 1427 : cluster [DBG] pgmap v798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:36.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:35 gibba044 bash[25485]: cluster 2021-03-10T20:34:34.323023+0000 mgr.gibba044.wflcwh (mgr.34466) 1427 : cluster [DBG] pgmap v798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:38.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:37 gibba023 bash[30844]: cluster 2021-03-10T20:34:36.324402+0000 mgr.gibba044.wflcwh (mgr.34466) 1428 : cluster [DBG] pgmap v799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:38.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:37 gibba023 bash[31815]: cluster 2021-03-10T20:34:36.324402+0000 mgr.gibba044.wflcwh (mgr.34466) 1428 : cluster [DBG] pgmap v799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:38.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:37 gibba044 bash[25485]: cluster 2021-03-10T20:34:36.324402+0000 mgr.gibba044.wflcwh (mgr.34466) 1428 : cluster [DBG] pgmap v799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:40.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:39 gibba023 bash[30844]: cluster 2021-03-10T20:34:38.326156+0000 mgr.gibba044.wflcwh (mgr.34466) 1429 : cluster [DBG] pgmap v800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:40.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:39 gibba023 bash[31815]: cluster 2021-03-10T20:34:38.326156+0000 mgr.gibba044.wflcwh (mgr.34466) 1429 : cluster [DBG] pgmap v800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:40.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:39 gibba044 bash[25485]: cluster 2021-03-10T20:34:38.326156+0000 mgr.gibba044.wflcwh (mgr.34466) 1429 : cluster [DBG] pgmap v800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:41.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:40 gibba023 bash[30844]: cephadm 2021-03-10T20:34:39.816374+0000 mgr.gibba044.wflcwh (mgr.34466) 1430 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:34:41.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:40 gibba023 bash[31815]: cephadm 2021-03-10T20:34:39.816374+0000 mgr.gibba044.wflcwh (mgr.34466) 1430 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:34:41.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:40 gibba044 bash[25485]: cephadm 2021-03-10T20:34:39.816374+0000 mgr.gibba044.wflcwh (mgr.34466) 1430 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:34:42.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:41 gibba044 bash[25485]: cluster 2021-03-10T20:34:40.327732+0000 mgr.gibba044.wflcwh (mgr.34466) 1431 : cluster [DBG] pgmap v801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:42.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:41 gibba023 bash[30844]: cluster 2021-03-10T20:34:40.327732+0000 mgr.gibba044.wflcwh (mgr.34466) 1431 : cluster [DBG] pgmap v801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:42.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:41 gibba023 bash[31815]: cluster 2021-03-10T20:34:40.327732+0000 mgr.gibba044.wflcwh (mgr.34466) 1431 : cluster [DBG] pgmap v801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:44.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:43 gibba044 bash[25485]: cluster 2021-03-10T20:34:42.329684+0000 mgr.gibba044.wflcwh (mgr.34466) 1432 : cluster [DBG] pgmap v802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:44.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:43 gibba023 bash[30844]: cluster 2021-03-10T20:34:42.329684+0000 mgr.gibba044.wflcwh (mgr.34466) 1432 : cluster [DBG] pgmap v802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:44.496 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:43 gibba023 bash[31815]: cluster 2021-03-10T20:34:42.329684+0000 mgr.gibba044.wflcwh (mgr.34466) 1432 : cluster [DBG] pgmap v802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:46.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:45 gibba044 bash[25485]: cluster 2021-03-10T20:34:44.331357+0000 mgr.gibba044.wflcwh (mgr.34466) 1433 : cluster [DBG] pgmap v803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:46.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:45 gibba023 bash[30844]: cluster 2021-03-10T20:34:44.331357+0000 mgr.gibba044.wflcwh (mgr.34466) 1433 : cluster [DBG] pgmap v803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:46.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:45 gibba023 bash[31815]: cluster 2021-03-10T20:34:44.331357+0000 mgr.gibba044.wflcwh (mgr.34466) 1433 : cluster [DBG] pgmap v803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:48.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:47 gibba044 bash[25485]: cluster 2021-03-10T20:34:46.332951+0000 mgr.gibba044.wflcwh (mgr.34466) 1434 : cluster [DBG] pgmap v804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:48.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:47 gibba023 bash[30844]: cluster 2021-03-10T20:34:46.332951+0000 mgr.gibba044.wflcwh (mgr.34466) 1434 : cluster [DBG] pgmap v804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:48.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:47 gibba023 bash[31815]: cluster 2021-03-10T20:34:46.332951+0000 mgr.gibba044.wflcwh (mgr.34466) 1434 : cluster [DBG] pgmap v804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:49.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:48 gibba044 bash[25485]: cluster 2021-03-10T20:34:48.334624+0000 mgr.gibba044.wflcwh (mgr.34466) 1435 : cluster [DBG] pgmap v805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:49.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:48 gibba023 bash[30844]: cluster 2021-03-10T20:34:48.334624+0000 mgr.gibba044.wflcwh (mgr.34466) 1435 : cluster [DBG] pgmap v805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:49.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:48 gibba023 bash[31815]: cluster 2021-03-10T20:34:48.334624+0000 mgr.gibba044.wflcwh (mgr.34466) 1435 : cluster [DBG] pgmap v805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:51.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:51 gibba023 bash[30844]: cluster 2021-03-10T20:34:50.336016+0000 mgr.gibba044.wflcwh (mgr.34466) 1436 : cluster [DBG] pgmap v806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:51.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:51 gibba023 bash[31815]: cluster 2021-03-10T20:34:50.336016+0000 mgr.gibba044.wflcwh (mgr.34466) 1436 : cluster [DBG] pgmap v806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:51.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:51 gibba044 bash[25485]: cluster 2021-03-10T20:34:50.336016+0000 mgr.gibba044.wflcwh (mgr.34466) 1436 : cluster [DBG] pgmap v806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:52.165 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:34:52.420 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:34:52.420 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (26m) 107s ago 31m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:34:52.420 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (31m) 42s ago 31m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:34:52.421 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (26m) 42s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:34:52.421 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (26m) 42s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:34:52.421 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (25m) 107s ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:34:52.421 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (25m) 107s ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:34:52.422 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (25m) 42s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:34:52.422 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (25m) 107s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:34:52.422 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (31m) 107s ago 31m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:34:52.422 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (31m) 42s ago 31m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:34:52.422 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (24m) 107s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:34:52.423 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (23m) 107s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:34:52.423 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (23m) 107s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:34:52.423 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (22m) 107s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:34:52.423 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (22m) 42s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:34:52.424 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (22m) 42s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:34:52.424 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (21m) 42s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:34:52.424 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (21m) 42s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:34:52.424 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (31m) 42s ago 31m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:34:52.424 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 107s ago 29m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:34:52.425 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 42s ago 29m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:34:52.668 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:34:52.668 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:34:52.668 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:34:52.669 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:34:52.669 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:34:52.669 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:34:52.669 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:34:52.670 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:34:52.670 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:34:52.670 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:34:52.670 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:34:52.670 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:34:52.671 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:34:52.671 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:34:52.671 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:34:52.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:52 gibba044 bash[25485]: audit 2021-03-10T20:34:52.668137+0000 mon.a (mon.0) 941 : audit [DBG] from='client.? 172.21.2.123:0/3855430220' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:53.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:52 gibba023 bash[30844]: audit 2021-03-10T20:34:52.668137+0000 mon.a (mon.0) 941 : audit [DBG] from='client.? 172.21.2.123:0/3855430220' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:53.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:52 gibba023 bash[31815]: audit 2021-03-10T20:34:52.668137+0000 mon.a (mon.0) 941 : audit [DBG] from='client.? 172.21.2.123:0/3855430220' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:34:53.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:53 gibba044 bash[25485]: audit 2021-03-10T20:34:52.158289+0000 mgr.gibba044.wflcwh (mgr.34466) 1437 : audit [DBG] from='client.55009 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:34:54.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:53 gibba044 bash[25485]: cluster 2021-03-10T20:34:52.337448+0000 mgr.gibba044.wflcwh (mgr.34466) 1438 : cluster [DBG] pgmap v807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:54.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:53 gibba044 bash[25485]: audit 2021-03-10T20:34:52.382294+0000 mgr.gibba044.wflcwh (mgr.34466) 1439 : audit [DBG] from='client.45036 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:34:54.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:53 gibba023 bash[30844]: audit 2021-03-10T20:34:52.158289+0000 mgr.gibba044.wflcwh (mgr.34466) 1437 : audit [DBG] from='client.55009 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:34:54.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:53 gibba023 bash[30844]: cluster 2021-03-10T20:34:52.337448+0000 mgr.gibba044.wflcwh (mgr.34466) 1438 : cluster [DBG] pgmap v807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:54.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:53 gibba023 bash[30844]: audit 2021-03-10T20:34:52.382294+0000 mgr.gibba044.wflcwh (mgr.34466) 1439 : audit [DBG] from='client.45036 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:34:54.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:53 gibba023 bash[31815]: audit 2021-03-10T20:34:52.158289+0000 mgr.gibba044.wflcwh (mgr.34466) 1437 : audit [DBG] from='client.55009 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:34:54.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:53 gibba023 bash[31815]: cluster 2021-03-10T20:34:52.337448+0000 mgr.gibba044.wflcwh (mgr.34466) 1438 : cluster [DBG] pgmap v807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:54.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:53 gibba023 bash[31815]: audit 2021-03-10T20:34:52.382294+0000 mgr.gibba044.wflcwh (mgr.34466) 1439 : audit [DBG] from='client.45036 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:34:55.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:55 gibba044 bash[25485]: cluster 2021-03-10T20:34:54.339153+0000 mgr.gibba044.wflcwh (mgr.34466) 1440 : cluster [DBG] pgmap v808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:55.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:55 gibba044 bash[25485]: cephadm 2021-03-10T20:34:54.832330+0000 mgr.gibba044.wflcwh (mgr.34466) 1441 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:34:56.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:55 gibba023 bash[30844]: cluster 2021-03-10T20:34:54.339153+0000 mgr.gibba044.wflcwh (mgr.34466) 1440 : cluster [DBG] pgmap v808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:56.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:55 gibba023 bash[30844]: cephadm 2021-03-10T20:34:54.832330+0000 mgr.gibba044.wflcwh (mgr.34466) 1441 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:34:56.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:55 gibba023 bash[31815]: cluster 2021-03-10T20:34:54.339153+0000 mgr.gibba044.wflcwh (mgr.34466) 1440 : cluster [DBG] pgmap v808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:56.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:55 gibba023 bash[31815]: cephadm 2021-03-10T20:34:54.832330+0000 mgr.gibba044.wflcwh (mgr.34466) 1441 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:34:57.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:57 gibba044 bash[25485]: cluster 2021-03-10T20:34:56.340754+0000 mgr.gibba044.wflcwh (mgr.34466) 1442 : cluster [DBG] pgmap v809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:58.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:57 gibba023 bash[30844]: cluster 2021-03-10T20:34:56.340754+0000 mgr.gibba044.wflcwh (mgr.34466) 1442 : cluster [DBG] pgmap v809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:58.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:57 gibba023 bash[31815]: cluster 2021-03-10T20:34:56.340754+0000 mgr.gibba044.wflcwh (mgr.34466) 1442 : cluster [DBG] pgmap v809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:34:59.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:34:59 gibba044 bash[25485]: cluster 2021-03-10T20:34:58.342283+0000 mgr.gibba044.wflcwh (mgr.34466) 1443 : cluster [DBG] pgmap v810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:00.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:34:59 gibba023 bash[30844]: cluster 2021-03-10T20:34:58.342283+0000 mgr.gibba044.wflcwh (mgr.34466) 1443 : cluster [DBG] pgmap v810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:00.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:34:59 gibba023 bash[31815]: cluster 2021-03-10T20:34:58.342283+0000 mgr.gibba044.wflcwh (mgr.34466) 1443 : cluster [DBG] pgmap v810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:01.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:01 gibba044 bash[25485]: cluster 2021-03-10T20:35:00.343588+0000 mgr.gibba044.wflcwh (mgr.34466) 1444 : cluster [DBG] pgmap v811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:02.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:01 gibba023 bash[30844]: cluster 2021-03-10T20:35:00.343588+0000 mgr.gibba044.wflcwh (mgr.34466) 1444 : cluster [DBG] pgmap v811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:02.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:01 gibba023 bash[31815]: cluster 2021-03-10T20:35:00.343588+0000 mgr.gibba044.wflcwh (mgr.34466) 1444 : cluster [DBG] pgmap v811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:03.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:03 gibba044 bash[25485]: cluster 2021-03-10T20:35:02.344179+0000 mgr.gibba044.wflcwh (mgr.34466) 1445 : cluster [DBG] pgmap v812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:04.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:03 gibba023 bash[30844]: cluster 2021-03-10T20:35:02.344179+0000 mgr.gibba044.wflcwh (mgr.34466) 1445 : cluster [DBG] pgmap v812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:04.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:03 gibba023 bash[31815]: cluster 2021-03-10T20:35:02.344179+0000 mgr.gibba044.wflcwh (mgr.34466) 1445 : cluster [DBG] pgmap v812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:06.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:05 gibba023 bash[30844]: cluster 2021-03-10T20:35:04.345788+0000 mgr.gibba044.wflcwh (mgr.34466) 1446 : cluster [DBG] pgmap v813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:06.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:05 gibba023 bash[31815]: cluster 2021-03-10T20:35:04.345788+0000 mgr.gibba044.wflcwh (mgr.34466) 1446 : cluster [DBG] pgmap v813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:06.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:05 gibba044 bash[25485]: cluster 2021-03-10T20:35:04.345788+0000 mgr.gibba044.wflcwh (mgr.34466) 1446 : cluster [DBG] pgmap v813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:08.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:07 gibba023 bash[30844]: cluster 2021-03-10T20:35:06.347261+0000 mgr.gibba044.wflcwh (mgr.34466) 1447 : cluster [DBG] pgmap v814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:08.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:07 gibba023 bash[31815]: cluster 2021-03-10T20:35:06.347261+0000 mgr.gibba044.wflcwh (mgr.34466) 1447 : cluster [DBG] pgmap v814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:08.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:07 gibba044 bash[25485]: cluster 2021-03-10T20:35:06.347261+0000 mgr.gibba044.wflcwh (mgr.34466) 1447 : cluster [DBG] pgmap v814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:10.066 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:09 gibba044 bash[25485]: cluster 2021-03-10T20:35:08.348926+0000 mgr.gibba044.wflcwh (mgr.34466) 1448 : cluster [DBG] pgmap v815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:10.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:09 gibba023 bash[30844]: cluster 2021-03-10T20:35:08.348926+0000 mgr.gibba044.wflcwh (mgr.34466) 1448 : cluster [DBG] pgmap v815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:10.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:09 gibba023 bash[31815]: cluster 2021-03-10T20:35:08.348926+0000 mgr.gibba044.wflcwh (mgr.34466) 1448 : cluster [DBG] pgmap v815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:11.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:10 gibba023 bash[30844]: cephadm 2021-03-10T20:35:09.844546+0000 mgr.gibba044.wflcwh (mgr.34466) 1449 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:35:11.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:10 gibba023 bash[30844]: cephadm 2021-03-10T20:35:09.845525+0000 mgr.gibba044.wflcwh (mgr.34466) 1450 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:35:11.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:10 gibba023 bash[30844]: audit 2021-03-10T20:35:10.052205+0000 mon.a (mon.0) 942 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:35:11.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:10 gibba023 bash[30844]: audit 2021-03-10T20:35:10.056326+0000 mon.a (mon.0) 943 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:35:11.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:10 gibba023 bash[30844]: audit 2021-03-10T20:35:10.057730+0000 mon.a (mon.0) 944 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:11.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:10 gibba023 bash[30844]: audit 2021-03-10T20:35:10.059612+0000 mon.a (mon.0) 945 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:11.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:10 gibba023 bash[30844]: audit 2021-03-10T20:35:10.061100+0000 mon.a (mon.0) 946 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:11.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:10 gibba023 bash[30844]: audit 2021-03-10T20:35:10.063815+0000 mon.a (mon.0) 947 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:11.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:10 gibba023 bash[30844]: audit 2021-03-10T20:35:10.065503+0000 mon.a (mon.0) 948 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:11.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:10 gibba023 bash[31815]: cephadm 2021-03-10T20:35:09.844546+0000 mgr.gibba044.wflcwh (mgr.34466) 1449 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:35:11.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:10 gibba023 bash[31815]: cephadm 2021-03-10T20:35:09.845525+0000 mgr.gibba044.wflcwh (mgr.34466) 1450 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:35:11.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:10 gibba023 bash[31815]: audit 2021-03-10T20:35:10.052205+0000 mon.a (mon.0) 942 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:35:11.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:10 gibba023 bash[31815]: audit 2021-03-10T20:35:10.056326+0000 mon.a (mon.0) 943 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:35:11.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:10 gibba023 bash[31815]: audit 2021-03-10T20:35:10.057730+0000 mon.a (mon.0) 944 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:11.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:10 gibba023 bash[31815]: audit 2021-03-10T20:35:10.059612+0000 mon.a (mon.0) 945 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:11.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:10 gibba023 bash[31815]: audit 2021-03-10T20:35:10.061100+0000 mon.a (mon.0) 946 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:11.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:10 gibba023 bash[31815]: audit 2021-03-10T20:35:10.063815+0000 mon.a (mon.0) 947 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:11.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:10 gibba023 bash[31815]: audit 2021-03-10T20:35:10.065503+0000 mon.a (mon.0) 948 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:11.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:10 gibba044 bash[25485]: cephadm 2021-03-10T20:35:09.844546+0000 mgr.gibba044.wflcwh (mgr.34466) 1449 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:35:11.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:10 gibba044 bash[25485]: cephadm 2021-03-10T20:35:09.845525+0000 mgr.gibba044.wflcwh (mgr.34466) 1450 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:35:11.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:10 gibba044 bash[25485]: audit 2021-03-10T20:35:10.052205+0000 mon.a (mon.0) 942 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:35:11.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:10 gibba044 bash[25485]: audit 2021-03-10T20:35:10.056326+0000 mon.a (mon.0) 943 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:35:11.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:10 gibba044 bash[25485]: audit 2021-03-10T20:35:10.057730+0000 mon.a (mon.0) 944 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:11.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:10 gibba044 bash[25485]: audit 2021-03-10T20:35:10.059612+0000 mon.a (mon.0) 945 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:11.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:10 gibba044 bash[25485]: audit 2021-03-10T20:35:10.061100+0000 mon.a (mon.0) 946 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:11.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:10 gibba044 bash[25485]: audit 2021-03-10T20:35:10.063815+0000 mon.a (mon.0) 947 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:11.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:10 gibba044 bash[25485]: audit 2021-03-10T20:35:10.065503+0000 mon.a (mon.0) 948 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:12.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[30844]: cephadm 2021-03-10T20:35:10.057759+0000 mgr.gibba044.wflcwh (mgr.34466) 1451 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:35:12.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[30844]: cephadm 2021-03-10T20:35:10.059692+0000 mgr.gibba044.wflcwh (mgr.34466) 1452 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:35:12.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[30844]: cephadm 2021-03-10T20:35:10.061389+0000 mgr.gibba044.wflcwh (mgr.34466) 1453 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:35:12.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[30844]: cephadm 2021-03-10T20:35:10.061425+0000 mgr.gibba044.wflcwh (mgr.34466) 1454 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:35:12.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[30844]: cephadm 2021-03-10T20:35:10.062917+0000 mgr.gibba044.wflcwh (mgr.34466) 1455 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:35:12.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[30844]: cephadm 2021-03-10T20:35:10.062954+0000 mgr.gibba044.wflcwh (mgr.34466) 1456 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:35:12.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[30844]: cephadm 2021-03-10T20:35:10.064220+0000 mgr.gibba044.wflcwh (mgr.34466) 1457 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:35:12.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[30844]: cephadm 2021-03-10T20:35:10.065531+0000 mgr.gibba044.wflcwh (mgr.34466) 1458 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:35:12.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[30844]: cephadm 2021-03-10T20:35:10.065566+0000 mgr.gibba044.wflcwh (mgr.34466) 1459 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:35:12.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[30844]: cephadm 2021-03-10T20:35:10.067088+0000 mgr.gibba044.wflcwh (mgr.34466) 1460 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:35:12.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[30844]: cephadm 2021-03-10T20:35:10.067399+0000 mgr.gibba044.wflcwh (mgr.34466) 1461 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:35:12.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[30844]: cephadm 2021-03-10T20:35:10.069107+0000 mgr.gibba044.wflcwh (mgr.34466) 1462 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:35:12.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[30844]: cephadm 2021-03-10T20:35:10.069145+0000 mgr.gibba044.wflcwh (mgr.34466) 1463 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:35:12.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[30844]: cephadm 2021-03-10T20:35:10.069279+0000 mgr.gibba044.wflcwh (mgr.34466) 1464 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:35:12.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[30844]: cluster 2021-03-10T20:35:10.350142+0000 mgr.gibba044.wflcwh (mgr.34466) 1465 : cluster [DBG] pgmap v816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:12.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[31815]: cephadm 2021-03-10T20:35:10.057759+0000 mgr.gibba044.wflcwh (mgr.34466) 1451 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:35:12.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[31815]: cephadm 2021-03-10T20:35:10.059692+0000 mgr.gibba044.wflcwh (mgr.34466) 1452 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:35:12.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[31815]: cephadm 2021-03-10T20:35:10.061389+0000 mgr.gibba044.wflcwh (mgr.34466) 1453 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:35:12.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[31815]: cephadm 2021-03-10T20:35:10.061425+0000 mgr.gibba044.wflcwh (mgr.34466) 1454 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:35:12.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[31815]: cephadm 2021-03-10T20:35:10.062917+0000 mgr.gibba044.wflcwh (mgr.34466) 1455 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:35:12.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[31815]: cephadm 2021-03-10T20:35:10.062954+0000 mgr.gibba044.wflcwh (mgr.34466) 1456 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:35:12.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[31815]: cephadm 2021-03-10T20:35:10.064220+0000 mgr.gibba044.wflcwh (mgr.34466) 1457 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:35:12.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[31815]: cephadm 2021-03-10T20:35:10.065531+0000 mgr.gibba044.wflcwh (mgr.34466) 1458 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:35:12.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[31815]: cephadm 2021-03-10T20:35:10.065566+0000 mgr.gibba044.wflcwh (mgr.34466) 1459 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:35:12.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[31815]: cephadm 2021-03-10T20:35:10.067088+0000 mgr.gibba044.wflcwh (mgr.34466) 1460 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:35:12.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[31815]: cephadm 2021-03-10T20:35:10.067399+0000 mgr.gibba044.wflcwh (mgr.34466) 1461 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:35:12.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[31815]: cephadm 2021-03-10T20:35:10.069107+0000 mgr.gibba044.wflcwh (mgr.34466) 1462 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:35:12.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[31815]: cephadm 2021-03-10T20:35:10.069145+0000 mgr.gibba044.wflcwh (mgr.34466) 1463 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:35:12.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[31815]: cephadm 2021-03-10T20:35:10.069279+0000 mgr.gibba044.wflcwh (mgr.34466) 1464 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:35:12.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:11 gibba023 bash[31815]: cluster 2021-03-10T20:35:10.350142+0000 mgr.gibba044.wflcwh (mgr.34466) 1465 : cluster [DBG] pgmap v816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:12.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:11 gibba044 bash[25485]: cephadm 2021-03-10T20:35:10.057759+0000 mgr.gibba044.wflcwh (mgr.34466) 1451 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:35:12.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:11 gibba044 bash[25485]: cephadm 2021-03-10T20:35:10.059692+0000 mgr.gibba044.wflcwh (mgr.34466) 1452 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:35:12.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:11 gibba044 bash[25485]: cephadm 2021-03-10T20:35:10.061389+0000 mgr.gibba044.wflcwh (mgr.34466) 1453 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:35:12.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:11 gibba044 bash[25485]: cephadm 2021-03-10T20:35:10.061425+0000 mgr.gibba044.wflcwh (mgr.34466) 1454 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:35:12.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:11 gibba044 bash[25485]: cephadm 2021-03-10T20:35:10.062917+0000 mgr.gibba044.wflcwh (mgr.34466) 1455 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:35:12.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:11 gibba044 bash[25485]: cephadm 2021-03-10T20:35:10.062954+0000 mgr.gibba044.wflcwh (mgr.34466) 1456 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:35:12.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:11 gibba044 bash[25485]: cephadm 2021-03-10T20:35:10.064220+0000 mgr.gibba044.wflcwh (mgr.34466) 1457 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:35:12.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:11 gibba044 bash[25485]: cephadm 2021-03-10T20:35:10.065531+0000 mgr.gibba044.wflcwh (mgr.34466) 1458 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:35:12.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:11 gibba044 bash[25485]: cephadm 2021-03-10T20:35:10.065566+0000 mgr.gibba044.wflcwh (mgr.34466) 1459 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:35:12.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:11 gibba044 bash[25485]: cephadm 2021-03-10T20:35:10.067088+0000 mgr.gibba044.wflcwh (mgr.34466) 1460 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:35:12.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:11 gibba044 bash[25485]: cephadm 2021-03-10T20:35:10.067399+0000 mgr.gibba044.wflcwh (mgr.34466) 1461 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:35:12.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:11 gibba044 bash[25485]: cephadm 2021-03-10T20:35:10.069107+0000 mgr.gibba044.wflcwh (mgr.34466) 1462 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:35:12.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:11 gibba044 bash[25485]: cephadm 2021-03-10T20:35:10.069145+0000 mgr.gibba044.wflcwh (mgr.34466) 1463 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:35:12.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:11 gibba044 bash[25485]: cephadm 2021-03-10T20:35:10.069279+0000 mgr.gibba044.wflcwh (mgr.34466) 1464 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:35:12.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:11 gibba044 bash[25485]: cluster 2021-03-10T20:35:10.350142+0000 mgr.gibba044.wflcwh (mgr.34466) 1465 : cluster [DBG] pgmap v816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:14.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:13 gibba023 bash[30844]: cluster 2021-03-10T20:35:12.351980+0000 mgr.gibba044.wflcwh (mgr.34466) 1466 : cluster [DBG] pgmap v817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:14.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:13 gibba023 bash[31815]: cluster 2021-03-10T20:35:12.351980+0000 mgr.gibba044.wflcwh (mgr.34466) 1466 : cluster [DBG] pgmap v817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:14.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:13 gibba044 bash[25485]: cluster 2021-03-10T20:35:12.351980+0000 mgr.gibba044.wflcwh (mgr.34466) 1466 : cluster [DBG] pgmap v817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:16.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:15 gibba023 bash[30844]: cluster 2021-03-10T20:35:14.353726+0000 mgr.gibba044.wflcwh (mgr.34466) 1467 : cluster [DBG] pgmap v818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:16.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:15 gibba023 bash[31815]: cluster 2021-03-10T20:35:14.353726+0000 mgr.gibba044.wflcwh (mgr.34466) 1467 : cluster [DBG] pgmap v818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:16.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:15 gibba044 bash[25485]: cluster 2021-03-10T20:35:14.353726+0000 mgr.gibba044.wflcwh (mgr.34466) 1467 : cluster [DBG] pgmap v818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:18.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:17 gibba023 bash[30844]: cluster 2021-03-10T20:35:16.355205+0000 mgr.gibba044.wflcwh (mgr.34466) 1468 : cluster [DBG] pgmap v819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:18.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:17 gibba023 bash[31815]: cluster 2021-03-10T20:35:16.355205+0000 mgr.gibba044.wflcwh (mgr.34466) 1468 : cluster [DBG] pgmap v819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:18.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:17 gibba044 bash[25485]: cluster 2021-03-10T20:35:16.355205+0000 mgr.gibba044.wflcwh (mgr.34466) 1468 : cluster [DBG] pgmap v819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:20.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:19 gibba023 bash[30844]: cluster 2021-03-10T20:35:18.356778+0000 mgr.gibba044.wflcwh (mgr.34466) 1469 : cluster [DBG] pgmap v820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:20.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:19 gibba023 bash[31815]: cluster 2021-03-10T20:35:18.356778+0000 mgr.gibba044.wflcwh (mgr.34466) 1469 : cluster [DBG] pgmap v820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:20.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:19 gibba044 bash[25485]: cluster 2021-03-10T20:35:18.356778+0000 mgr.gibba044.wflcwh (mgr.34466) 1469 : cluster [DBG] pgmap v820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:22.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:21 gibba023 bash[30844]: cluster 2021-03-10T20:35:20.358233+0000 mgr.gibba044.wflcwh (mgr.34466) 1470 : cluster [DBG] pgmap v821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:22.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:21 gibba023 bash[31815]: cluster 2021-03-10T20:35:20.358233+0000 mgr.gibba044.wflcwh (mgr.34466) 1470 : cluster [DBG] pgmap v821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:22.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:21 gibba044 bash[25485]: cluster 2021-03-10T20:35:20.358233+0000 mgr.gibba044.wflcwh (mgr.34466) 1470 : cluster [DBG] pgmap v821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:22.919 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:35:23.149 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:35:23.149 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (26m) 2m ago 32m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:35:23.149 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (31m) 73s ago 31m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:35:23.149 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (26m) 73s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:35:23.150 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (27m) 73s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:35:23.150 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (26m) 2m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:35:23.150 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (26m) 2m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:35:23.150 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (25m) 73s ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:35:23.150 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (25m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:35:23.151 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (32m) 2m ago 32m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:35:23.151 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (32m) 73s ago 32m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:35:23.151 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (24m) 2m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:35:23.151 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (24m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:35:23.152 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (23m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:35:23.152 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (23m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:35:23.152 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (23m) 73s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:35:23.152 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (22m) 73s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:35:23.152 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (22m) 73s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:35:23.153 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (21m) 73s ago 32m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:35:23.153 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (31m) 73s ago 32m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:35:23.153 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 2m ago 29m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:35:23.153 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 73s ago 30m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:35:23.396 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:35:23.397 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:35:23.397 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:35:23.397 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:35:23.397 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:35:23.398 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:35:23.398 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:35:23.398 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:35:23.398 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:35:23.398 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:35:23.399 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:35:23.399 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:35:23.399 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:35:23.399 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:35:23.400 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:35:24.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:23 gibba023 bash[30844]: cluster 2021-03-10T20:35:22.359911+0000 mgr.gibba044.wflcwh (mgr.34466) 1471 : cluster [DBG] pgmap v822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:24.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:23 gibba023 bash[30844]: audit 2021-03-10T20:35:22.912133+0000 mgr.gibba044.wflcwh (mgr.34466) 1472 : audit [DBG] from='client.45048 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:35:24.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:23 gibba023 bash[30844]: audit 2021-03-10T20:35:23.396461+0000 mon.c (mon.1) 39 : audit [DBG] from='client.? 172.21.2.123:0/2650163317' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:24.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:23 gibba023 bash[31815]: cluster 2021-03-10T20:35:22.359911+0000 mgr.gibba044.wflcwh (mgr.34466) 1471 : cluster [DBG] pgmap v822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:24.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:23 gibba023 bash[31815]: audit 2021-03-10T20:35:22.912133+0000 mgr.gibba044.wflcwh (mgr.34466) 1472 : audit [DBG] from='client.45048 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:35:24.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:23 gibba023 bash[31815]: audit 2021-03-10T20:35:23.396461+0000 mon.c (mon.1) 39 : audit [DBG] from='client.? 172.21.2.123:0/2650163317' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:24.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:23 gibba044 bash[25485]: cluster 2021-03-10T20:35:22.359911+0000 mgr.gibba044.wflcwh (mgr.34466) 1471 : cluster [DBG] pgmap v822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:24.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:23 gibba044 bash[25485]: audit 2021-03-10T20:35:22.912133+0000 mgr.gibba044.wflcwh (mgr.34466) 1472 : audit [DBG] from='client.45048 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:35:24.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:23 gibba044 bash[25485]: audit 2021-03-10T20:35:23.396461+0000 mon.c (mon.1) 39 : audit [DBG] from='client.? 172.21.2.123:0/2650163317' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:25.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:24 gibba023 bash[30844]: audit 2021-03-10T20:35:23.138378+0000 mgr.gibba044.wflcwh (mgr.34466) 1473 : audit [DBG] from='client.45054 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:35:25.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:24 gibba023 bash[31815]: audit 2021-03-10T20:35:23.138378+0000 mgr.gibba044.wflcwh (mgr.34466) 1473 : audit [DBG] from='client.45054 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:35:25.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:24 gibba044 bash[25485]: audit 2021-03-10T20:35:23.138378+0000 mgr.gibba044.wflcwh (mgr.34466) 1473 : audit [DBG] from='client.45054 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:35:26.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:25 gibba023 bash[30844]: cluster 2021-03-10T20:35:24.361613+0000 mgr.gibba044.wflcwh (mgr.34466) 1474 : cluster [DBG] pgmap v823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:26.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:25 gibba023 bash[31815]: cluster 2021-03-10T20:35:24.361613+0000 mgr.gibba044.wflcwh (mgr.34466) 1474 : cluster [DBG] pgmap v823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:26.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:25 gibba044 bash[25485]: cluster 2021-03-10T20:35:24.361613+0000 mgr.gibba044.wflcwh (mgr.34466) 1474 : cluster [DBG] pgmap v823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:27.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:26 gibba023 bash[30844]: cephadm 2021-03-10T20:35:25.085053+0000 mgr.gibba044.wflcwh (mgr.34466) 1475 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:35:27.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:26 gibba023 bash[31815]: cephadm 2021-03-10T20:35:25.085053+0000 mgr.gibba044.wflcwh (mgr.34466) 1475 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:35:27.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:26 gibba044 bash[25485]: cephadm 2021-03-10T20:35:25.085053+0000 mgr.gibba044.wflcwh (mgr.34466) 1475 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:35:28.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:27 gibba023 bash[30844]: cluster 2021-03-10T20:35:26.362917+0000 mgr.gibba044.wflcwh (mgr.34466) 1476 : cluster [DBG] pgmap v824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:28.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:27 gibba023 bash[30844]: audit 2021-03-10T20:35:27.180020+0000 mon.a (mon.0) 949 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:35:28.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:27 gibba023 bash[30844]: audit 2021-03-10T20:35:27.180668+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:35:28.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:27 gibba023 bash[30844]: audit 2021-03-10T20:35:27.181239+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T20:35:28.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:27 gibba023 bash[30844]: audit 2021-03-10T20:35:27.181952+0000 mon.a (mon.0) 952 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:35:28.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:27 gibba023 bash[30844]: audit 2021-03-10T20:35:27.182636+0000 mon.a (mon.0) 953 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:35:28.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:27 gibba023 bash[30844]: audit 2021-03-10T20:35:27.183399+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:35:28.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:27 gibba023 bash[31815]: cluster 2021-03-10T20:35:26.362917+0000 mgr.gibba044.wflcwh (mgr.34466) 1476 : cluster [DBG] pgmap v824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:28.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:27 gibba023 bash[31815]: audit 2021-03-10T20:35:27.180020+0000 mon.a (mon.0) 949 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:35:28.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:27 gibba023 bash[31815]: audit 2021-03-10T20:35:27.180668+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:35:28.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:27 gibba023 bash[31815]: audit 2021-03-10T20:35:27.181239+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T20:35:28.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:27 gibba023 bash[31815]: audit 2021-03-10T20:35:27.181952+0000 mon.a (mon.0) 952 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:35:28.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:27 gibba023 bash[31815]: audit 2021-03-10T20:35:27.182636+0000 mon.a (mon.0) 953 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:35:28.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:27 gibba023 bash[31815]: audit 2021-03-10T20:35:27.183399+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:35:28.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:27 gibba044 bash[25485]: cluster 2021-03-10T20:35:26.362917+0000 mgr.gibba044.wflcwh (mgr.34466) 1476 : cluster [DBG] pgmap v824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:28.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:27 gibba044 bash[25485]: audit 2021-03-10T20:35:27.180020+0000 mon.a (mon.0) 949 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:35:28.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:27 gibba044 bash[25485]: audit 2021-03-10T20:35:27.180668+0000 mon.a (mon.0) 950 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:35:28.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:27 gibba044 bash[25485]: audit 2021-03-10T20:35:27.181239+0000 mon.a (mon.0) 951 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T20:35:28.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:27 gibba044 bash[25485]: audit 2021-03-10T20:35:27.181952+0000 mon.a (mon.0) 952 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:35:28.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:27 gibba044 bash[25485]: audit 2021-03-10T20:35:27.182636+0000 mon.a (mon.0) 953 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:35:28.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:27 gibba044 bash[25485]: audit 2021-03-10T20:35:27.183399+0000 mon.a (mon.0) 954 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:35:30.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:29 gibba023 bash[30844]: cluster 2021-03-10T20:35:28.364525+0000 mgr.gibba044.wflcwh (mgr.34466) 1477 : cluster [DBG] pgmap v825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:30.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:29 gibba023 bash[31815]: cluster 2021-03-10T20:35:28.364525+0000 mgr.gibba044.wflcwh (mgr.34466) 1477 : cluster [DBG] pgmap v825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:30.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:29 gibba044 bash[25485]: cluster 2021-03-10T20:35:28.364525+0000 mgr.gibba044.wflcwh (mgr.34466) 1477 : cluster [DBG] pgmap v825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:32.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:31 gibba023 bash[30844]: cluster 2021-03-10T20:35:30.365993+0000 mgr.gibba044.wflcwh (mgr.34466) 1478 : cluster [DBG] pgmap v826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:32.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:31 gibba023 bash[31815]: cluster 2021-03-10T20:35:30.365993+0000 mgr.gibba044.wflcwh (mgr.34466) 1478 : cluster [DBG] pgmap v826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:32.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:31 gibba044 bash[25485]: cluster 2021-03-10T20:35:30.365993+0000 mgr.gibba044.wflcwh (mgr.34466) 1478 : cluster [DBG] pgmap v826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:34.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:33 gibba023 bash[30844]: cluster 2021-03-10T20:35:32.367846+0000 mgr.gibba044.wflcwh (mgr.34466) 1479 : cluster [DBG] pgmap v827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:34.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:33 gibba023 bash[31815]: cluster 2021-03-10T20:35:32.367846+0000 mgr.gibba044.wflcwh (mgr.34466) 1479 : cluster [DBG] pgmap v827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:34.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:33 gibba044 bash[25485]: cluster 2021-03-10T20:35:32.367846+0000 mgr.gibba044.wflcwh (mgr.34466) 1479 : cluster [DBG] pgmap v827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:36.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:35 gibba023 bash[30844]: cluster 2021-03-10T20:35:34.369633+0000 mgr.gibba044.wflcwh (mgr.34466) 1480 : cluster [DBG] pgmap v828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:36.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:35 gibba023 bash[31815]: cluster 2021-03-10T20:35:34.369633+0000 mgr.gibba044.wflcwh (mgr.34466) 1480 : cluster [DBG] pgmap v828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:36.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:35 gibba044 bash[25485]: cluster 2021-03-10T20:35:34.369633+0000 mgr.gibba044.wflcwh (mgr.34466) 1480 : cluster [DBG] pgmap v828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:38.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:37 gibba023 bash[30844]: cluster 2021-03-10T20:35:36.371269+0000 mgr.gibba044.wflcwh (mgr.34466) 1481 : cluster [DBG] pgmap v829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:38.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:37 gibba023 bash[31815]: cluster 2021-03-10T20:35:36.371269+0000 mgr.gibba044.wflcwh (mgr.34466) 1481 : cluster [DBG] pgmap v829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:38.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:37 gibba044 bash[25485]: cluster 2021-03-10T20:35:36.371269+0000 mgr.gibba044.wflcwh (mgr.34466) 1481 : cluster [DBG] pgmap v829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:40.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:39 gibba023 bash[30844]: cluster 2021-03-10T20:35:38.372972+0000 mgr.gibba044.wflcwh (mgr.34466) 1482 : cluster [DBG] pgmap v830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:40.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:39 gibba023 bash[31815]: cluster 2021-03-10T20:35:38.372972+0000 mgr.gibba044.wflcwh (mgr.34466) 1482 : cluster [DBG] pgmap v830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:40.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:39 gibba044 bash[25485]: cluster 2021-03-10T20:35:38.372972+0000 mgr.gibba044.wflcwh (mgr.34466) 1482 : cluster [DBG] pgmap v830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:42.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:41 gibba023 bash[30844]: cephadm 2021-03-10T20:35:40.100884+0000 mgr.gibba044.wflcwh (mgr.34466) 1483 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:35:42.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:41 gibba023 bash[30844]: cluster 2021-03-10T20:35:40.374207+0000 mgr.gibba044.wflcwh (mgr.34466) 1484 : cluster [DBG] pgmap v831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:42.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:41 gibba023 bash[31815]: cephadm 2021-03-10T20:35:40.100884+0000 mgr.gibba044.wflcwh (mgr.34466) 1483 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:35:42.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:41 gibba023 bash[31815]: cluster 2021-03-10T20:35:40.374207+0000 mgr.gibba044.wflcwh (mgr.34466) 1484 : cluster [DBG] pgmap v831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:42.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:41 gibba044 bash[25485]: cephadm 2021-03-10T20:35:40.100884+0000 mgr.gibba044.wflcwh (mgr.34466) 1483 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:35:42.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:41 gibba044 bash[25485]: cluster 2021-03-10T20:35:40.374207+0000 mgr.gibba044.wflcwh (mgr.34466) 1484 : cluster [DBG] pgmap v831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:44.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:43 gibba044 bash[25485]: cluster 2021-03-10T20:35:42.375996+0000 mgr.gibba044.wflcwh (mgr.34466) 1485 : cluster [DBG] pgmap v832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:44.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:43 gibba023 bash[30844]: cluster 2021-03-10T20:35:42.375996+0000 mgr.gibba044.wflcwh (mgr.34466) 1485 : cluster [DBG] pgmap v832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:44.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:43 gibba023 bash[31815]: cluster 2021-03-10T20:35:42.375996+0000 mgr.gibba044.wflcwh (mgr.34466) 1485 : cluster [DBG] pgmap v832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:46.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:45 gibba044 bash[25485]: cluster 2021-03-10T20:35:44.377720+0000 mgr.gibba044.wflcwh (mgr.34466) 1486 : cluster [DBG] pgmap v833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:46.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:45 gibba023 bash[30844]: cluster 2021-03-10T20:35:44.377720+0000 mgr.gibba044.wflcwh (mgr.34466) 1486 : cluster [DBG] pgmap v833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:46.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:45 gibba023 bash[31815]: cluster 2021-03-10T20:35:44.377720+0000 mgr.gibba044.wflcwh (mgr.34466) 1486 : cluster [DBG] pgmap v833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:48.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:47 gibba044 bash[25485]: cluster 2021-03-10T20:35:46.379155+0000 mgr.gibba044.wflcwh (mgr.34466) 1487 : cluster [DBG] pgmap v834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:48.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:47 gibba023 bash[30844]: cluster 2021-03-10T20:35:46.379155+0000 mgr.gibba044.wflcwh (mgr.34466) 1487 : cluster [DBG] pgmap v834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:48.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:47 gibba023 bash[31815]: cluster 2021-03-10T20:35:46.379155+0000 mgr.gibba044.wflcwh (mgr.34466) 1487 : cluster [DBG] pgmap v834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:50.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:49 gibba044 bash[25485]: cluster 2021-03-10T20:35:48.380756+0000 mgr.gibba044.wflcwh (mgr.34466) 1488 : cluster [DBG] pgmap v835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:50.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:49 gibba023 bash[30844]: cluster 2021-03-10T20:35:48.380756+0000 mgr.gibba044.wflcwh (mgr.34466) 1488 : cluster [DBG] pgmap v835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:50.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:49 gibba023 bash[31815]: cluster 2021-03-10T20:35:48.380756+0000 mgr.gibba044.wflcwh (mgr.34466) 1488 : cluster [DBG] pgmap v835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:52.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:51 gibba044 bash[25485]: cluster 2021-03-10T20:35:50.382281+0000 mgr.gibba044.wflcwh (mgr.34466) 1489 : cluster [DBG] pgmap v836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:52.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:51 gibba023 bash[30844]: cluster 2021-03-10T20:35:50.382281+0000 mgr.gibba044.wflcwh (mgr.34466) 1489 : cluster [DBG] pgmap v836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:52.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:51 gibba023 bash[31815]: cluster 2021-03-10T20:35:50.382281+0000 mgr.gibba044.wflcwh (mgr.34466) 1489 : cluster [DBG] pgmap v836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:53.639 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:35:53.867 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:35:53.868 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (27m) 2m ago 32m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:35:53.868 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (32m) 104s ago 32m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:35:53.869 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (27m) 104s ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:35:53.869 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (27m) 104s ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:35:53.870 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (26m) 2m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:35:53.870 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (26m) 2m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:35:53.870 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (26m) 104s ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:35:53.871 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (26m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:35:53.871 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (32m) 2m ago 32m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:35:53.872 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (32m) 104s ago 32m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:35:53.872 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (25m) 2m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:35:53.873 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (24m) 2m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:35:53.873 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (24m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:35:53.873 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (23m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:35:53.874 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (23m) 104s ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:35:53.874 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (23m) 104s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:35:53.875 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (22m) 104s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:35:53.875 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (22m) 104s ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:35:53.876 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (32m) 104s ago 32m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:35:53.876 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 2m ago 30m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:35:53.876 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 104s ago 30m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:35:54.125 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:35:54.125 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:35:54.125 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:35:54.126 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:35:54.126 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:35:54.126 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:35:54.126 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:35:54.127 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:35:54.127 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:35:54.127 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:35:54.127 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:35:54.127 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:35:54.128 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:35:54.128 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:35:54.128 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:35:54.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:53 gibba044 bash[25485]: cluster 2021-03-10T20:35:52.383933+0000 mgr.gibba044.wflcwh (mgr.34466) 1490 : cluster [DBG] pgmap v837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:54.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:53 gibba023 bash[30844]: cluster 2021-03-10T20:35:52.383933+0000 mgr.gibba044.wflcwh (mgr.34466) 1490 : cluster [DBG] pgmap v837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:54.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:53 gibba023 bash[31815]: cluster 2021-03-10T20:35:52.383933+0000 mgr.gibba044.wflcwh (mgr.34466) 1490 : cluster [DBG] pgmap v837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:55.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:54 gibba044 bash[25485]: audit 2021-03-10T20:35:53.632308+0000 mgr.gibba044.wflcwh (mgr.34466) 1491 : audit [DBG] from='client.55045 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:35:55.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:54 gibba044 bash[25485]: audit 2021-03-10T20:35:53.857265+0000 mgr.gibba044.wflcwh (mgr.34466) 1492 : audit [DBG] from='client.55051 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:35:55.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:54 gibba044 bash[25485]: audit 2021-03-10T20:35:54.125201+0000 mon.c (mon.1) 40 : audit [DBG] from='client.? 172.21.2.123:0/547748164' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:55.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:54 gibba023 bash[30844]: audit 2021-03-10T20:35:53.632308+0000 mgr.gibba044.wflcwh (mgr.34466) 1491 : audit [DBG] from='client.55045 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:35:55.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:54 gibba023 bash[30844]: audit 2021-03-10T20:35:53.857265+0000 mgr.gibba044.wflcwh (mgr.34466) 1492 : audit [DBG] from='client.55051 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:35:55.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:54 gibba023 bash[30844]: audit 2021-03-10T20:35:54.125201+0000 mon.c (mon.1) 40 : audit [DBG] from='client.? 172.21.2.123:0/547748164' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:55.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:54 gibba023 bash[31815]: audit 2021-03-10T20:35:53.632308+0000 mgr.gibba044.wflcwh (mgr.34466) 1491 : audit [DBG] from='client.55045 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:35:55.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:54 gibba023 bash[31815]: audit 2021-03-10T20:35:53.857265+0000 mgr.gibba044.wflcwh (mgr.34466) 1492 : audit [DBG] from='client.55051 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:35:55.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:54 gibba023 bash[31815]: audit 2021-03-10T20:35:54.125201+0000 mon.c (mon.1) 40 : audit [DBG] from='client.? 172.21.2.123:0/547748164' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:35:56.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:55 gibba044 bash[25485]: cluster 2021-03-10T20:35:54.385501+0000 mgr.gibba044.wflcwh (mgr.34466) 1493 : cluster [DBG] pgmap v838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:56.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:55 gibba023 bash[30844]: cluster 2021-03-10T20:35:54.385501+0000 mgr.gibba044.wflcwh (mgr.34466) 1493 : cluster [DBG] pgmap v838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:56.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:55 gibba023 bash[31815]: cluster 2021-03-10T20:35:54.385501+0000 mgr.gibba044.wflcwh (mgr.34466) 1493 : cluster [DBG] pgmap v838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:57.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:56 gibba044 bash[25485]: cephadm 2021-03-10T20:35:55.116384+0000 mgr.gibba044.wflcwh (mgr.34466) 1494 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:35:57.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:56 gibba023 bash[30844]: cephadm 2021-03-10T20:35:55.116384+0000 mgr.gibba044.wflcwh (mgr.34466) 1494 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:35:57.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:56 gibba023 bash[31815]: cephadm 2021-03-10T20:35:55.116384+0000 mgr.gibba044.wflcwh (mgr.34466) 1494 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:35:58.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:57 gibba044 bash[25485]: cluster 2021-03-10T20:35:56.386966+0000 mgr.gibba044.wflcwh (mgr.34466) 1495 : cluster [DBG] pgmap v839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:58.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:57 gibba023 bash[30844]: cluster 2021-03-10T20:35:56.386966+0000 mgr.gibba044.wflcwh (mgr.34466) 1495 : cluster [DBG] pgmap v839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:58.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:57 gibba023 bash[31815]: cluster 2021-03-10T20:35:56.386966+0000 mgr.gibba044.wflcwh (mgr.34466) 1495 : cluster [DBG] pgmap v839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:59.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:35:59 gibba044 bash[25485]: cluster 2021-03-10T20:35:58.388553+0000 mgr.gibba044.wflcwh (mgr.34466) 1496 : cluster [DBG] pgmap v840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:59.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:35:58 gibba023 bash[30844]: cluster 2021-03-10T20:35:58.388553+0000 mgr.gibba044.wflcwh (mgr.34466) 1496 : cluster [DBG] pgmap v840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:35:59.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:35:58 gibba023 bash[31815]: cluster 2021-03-10T20:35:58.388553+0000 mgr.gibba044.wflcwh (mgr.34466) 1496 : cluster [DBG] pgmap v840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:01.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:01 gibba044 bash[25485]: cluster 2021-03-10T20:36:00.389772+0000 mgr.gibba044.wflcwh (mgr.34466) 1497 : cluster [DBG] pgmap v841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:01.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:01 gibba023 bash[30844]: cluster 2021-03-10T20:36:00.389772+0000 mgr.gibba044.wflcwh (mgr.34466) 1497 : cluster [DBG] pgmap v841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:01.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:01 gibba023 bash[31815]: cluster 2021-03-10T20:36:00.389772+0000 mgr.gibba044.wflcwh (mgr.34466) 1497 : cluster [DBG] pgmap v841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:03.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:03 gibba044 bash[25485]: cluster 2021-03-10T20:36:02.391556+0000 mgr.gibba044.wflcwh (mgr.34466) 1498 : cluster [DBG] pgmap v842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:04.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:03 gibba023 bash[30844]: cluster 2021-03-10T20:36:02.391556+0000 mgr.gibba044.wflcwh (mgr.34466) 1498 : cluster [DBG] pgmap v842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:04.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:03 gibba023 bash[31815]: cluster 2021-03-10T20:36:02.391556+0000 mgr.gibba044.wflcwh (mgr.34466) 1498 : cluster [DBG] pgmap v842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:05.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:05 gibba044 bash[25485]: cluster 2021-03-10T20:36:04.393025+0000 mgr.gibba044.wflcwh (mgr.34466) 1499 : cluster [DBG] pgmap v843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:06.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:05 gibba023 bash[30844]: cluster 2021-03-10T20:36:04.393025+0000 mgr.gibba044.wflcwh (mgr.34466) 1499 : cluster [DBG] pgmap v843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:06.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:05 gibba023 bash[31815]: cluster 2021-03-10T20:36:04.393025+0000 mgr.gibba044.wflcwh (mgr.34466) 1499 : cluster [DBG] pgmap v843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:07.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:07 gibba044 bash[25485]: cluster 2021-03-10T20:36:06.394487+0000 mgr.gibba044.wflcwh (mgr.34466) 1500 : cluster [DBG] pgmap v844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:08.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:07 gibba023 bash[30844]: cluster 2021-03-10T20:36:06.394487+0000 mgr.gibba044.wflcwh (mgr.34466) 1500 : cluster [DBG] pgmap v844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:08.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:07 gibba023 bash[31815]: cluster 2021-03-10T20:36:06.394487+0000 mgr.gibba044.wflcwh (mgr.34466) 1500 : cluster [DBG] pgmap v844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:10.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:09 gibba023 bash[30844]: cluster 2021-03-10T20:36:08.396213+0000 mgr.gibba044.wflcwh (mgr.34466) 1501 : cluster [DBG] pgmap v845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:10.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:09 gibba023 bash[31815]: cluster 2021-03-10T20:36:08.396213+0000 mgr.gibba044.wflcwh (mgr.34466) 1501 : cluster [DBG] pgmap v845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:10.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:09 gibba044 bash[25485]: cluster 2021-03-10T20:36:08.396213+0000 mgr.gibba044.wflcwh (mgr.34466) 1501 : cluster [DBG] pgmap v845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:11.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[30844]: cephadm 2021-03-10T20:36:10.121129+0000 mgr.gibba044.wflcwh (mgr.34466) 1502 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:36:11.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[30844]: cephadm 2021-03-10T20:36:10.122652+0000 mgr.gibba044.wflcwh (mgr.34466) 1503 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:36:11.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[30844]: audit 2021-03-10T20:36:10.333251+0000 mon.a (mon.0) 955 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:36:11.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[30844]: audit 2021-03-10T20:36:10.337140+0000 mon.a (mon.0) 956 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:36:11.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[30844]: cephadm 2021-03-10T20:36:10.338071+0000 mgr.gibba044.wflcwh (mgr.34466) 1504 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:36:11.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[30844]: audit 2021-03-10T20:36:10.338582+0000 mon.a (mon.0) 957 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:11.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[30844]: cephadm 2021-03-10T20:36:10.340086+0000 mgr.gibba044.wflcwh (mgr.34466) 1505 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:36:11.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[30844]: audit 2021-03-10T20:36:10.340367+0000 mon.a (mon.0) 958 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:11.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[30844]: cephadm 2021-03-10T20:36:10.341635+0000 mgr.gibba044.wflcwh (mgr.34466) 1506 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:36:11.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[30844]: cephadm 2021-03-10T20:36:10.341673+0000 mgr.gibba044.wflcwh (mgr.34466) 1507 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:36:11.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[30844]: audit 2021-03-10T20:36:10.341973+0000 mon.a (mon.0) 959 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:11.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[30844]: cephadm 2021-03-10T20:36:10.343421+0000 mgr.gibba044.wflcwh (mgr.34466) 1508 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:36:11.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[30844]: cephadm 2021-03-10T20:36:10.343459+0000 mgr.gibba044.wflcwh (mgr.34466) 1509 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:36:11.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[30844]: cephadm 2021-03-10T20:36:10.344828+0000 mgr.gibba044.wflcwh (mgr.34466) 1510 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:36:11.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[30844]: audit 2021-03-10T20:36:10.345099+0000 mon.a (mon.0) 960 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:11.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[30844]: cephadm 2021-03-10T20:36:10.346387+0000 mgr.gibba044.wflcwh (mgr.34466) 1511 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:36:11.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[30844]: cephadm 2021-03-10T20:36:10.346426+0000 mgr.gibba044.wflcwh (mgr.34466) 1512 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:36:11.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[30844]: audit 2021-03-10T20:36:10.347105+0000 mon.a (mon.0) 961 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:11.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[30844]: cephadm 2021-03-10T20:36:10.348282+0000 mgr.gibba044.wflcwh (mgr.34466) 1513 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:36:11.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[30844]: cephadm 2021-03-10T20:36:10.348614+0000 mgr.gibba044.wflcwh (mgr.34466) 1514 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:36:11.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[30844]: cephadm 2021-03-10T20:36:10.350239+0000 mgr.gibba044.wflcwh (mgr.34466) 1515 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:36:11.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[31815]: cephadm 2021-03-10T20:36:10.121129+0000 mgr.gibba044.wflcwh (mgr.34466) 1502 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:36:11.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[31815]: cephadm 2021-03-10T20:36:10.122652+0000 mgr.gibba044.wflcwh (mgr.34466) 1503 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:36:11.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[31815]: audit 2021-03-10T20:36:10.333251+0000 mon.a (mon.0) 955 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:36:11.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[31815]: audit 2021-03-10T20:36:10.337140+0000 mon.a (mon.0) 956 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:36:11.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[31815]: cephadm 2021-03-10T20:36:10.338071+0000 mgr.gibba044.wflcwh (mgr.34466) 1504 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:36:11.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[31815]: audit 2021-03-10T20:36:10.338582+0000 mon.a (mon.0) 957 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:11.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[31815]: cephadm 2021-03-10T20:36:10.340086+0000 mgr.gibba044.wflcwh (mgr.34466) 1505 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:36:11.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[31815]: audit 2021-03-10T20:36:10.340367+0000 mon.a (mon.0) 958 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:11.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[31815]: cephadm 2021-03-10T20:36:10.341635+0000 mgr.gibba044.wflcwh (mgr.34466) 1506 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:36:11.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[31815]: cephadm 2021-03-10T20:36:10.341673+0000 mgr.gibba044.wflcwh (mgr.34466) 1507 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:36:11.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[31815]: audit 2021-03-10T20:36:10.341973+0000 mon.a (mon.0) 959 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:11.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[31815]: cephadm 2021-03-10T20:36:10.343421+0000 mgr.gibba044.wflcwh (mgr.34466) 1508 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:36:11.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[31815]: cephadm 2021-03-10T20:36:10.343459+0000 mgr.gibba044.wflcwh (mgr.34466) 1509 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:36:11.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[31815]: cephadm 2021-03-10T20:36:10.344828+0000 mgr.gibba044.wflcwh (mgr.34466) 1510 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:36:11.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[31815]: audit 2021-03-10T20:36:10.345099+0000 mon.a (mon.0) 960 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:11.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[31815]: cephadm 2021-03-10T20:36:10.346387+0000 mgr.gibba044.wflcwh (mgr.34466) 1511 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:36:11.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[31815]: cephadm 2021-03-10T20:36:10.346426+0000 mgr.gibba044.wflcwh (mgr.34466) 1512 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:36:11.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[31815]: audit 2021-03-10T20:36:10.347105+0000 mon.a (mon.0) 961 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:11.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[31815]: cephadm 2021-03-10T20:36:10.348282+0000 mgr.gibba044.wflcwh (mgr.34466) 1513 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:36:11.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[31815]: cephadm 2021-03-10T20:36:10.348614+0000 mgr.gibba044.wflcwh (mgr.34466) 1514 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:36:11.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[31815]: cephadm 2021-03-10T20:36:10.350239+0000 mgr.gibba044.wflcwh (mgr.34466) 1515 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:36:11.686 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[30844]: cephadm 2021-03-10T20:36:10.350283+0000 mgr.gibba044.wflcwh (mgr.34466) 1516 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:36:11.686 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[30844]: cephadm 2021-03-10T20:36:10.350427+0000 mgr.gibba044.wflcwh (mgr.34466) 1517 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:36:11.686 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[30844]: cluster 2021-03-10T20:36:10.397468+0000 mgr.gibba044.wflcwh (mgr.34466) 1518 : cluster [DBG] pgmap v846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:11.686 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[31815]: cephadm 2021-03-10T20:36:10.350283+0000 mgr.gibba044.wflcwh (mgr.34466) 1516 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:36:11.687 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[31815]: cephadm 2021-03-10T20:36:10.350427+0000 mgr.gibba044.wflcwh (mgr.34466) 1517 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:36:11.687 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:11 gibba023 bash[31815]: cluster 2021-03-10T20:36:10.397468+0000 mgr.gibba044.wflcwh (mgr.34466) 1518 : cluster [DBG] pgmap v846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:11.749 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:11 gibba044 bash[25485]: cephadm 2021-03-10T20:36:10.121129+0000 mgr.gibba044.wflcwh (mgr.34466) 1502 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:36:11.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:11 gibba044 bash[25485]: cephadm 2021-03-10T20:36:10.122652+0000 mgr.gibba044.wflcwh (mgr.34466) 1503 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:36:11.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:11 gibba044 bash[25485]: audit 2021-03-10T20:36:10.333251+0000 mon.a (mon.0) 955 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:36:11.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:11 gibba044 bash[25485]: audit 2021-03-10T20:36:10.337140+0000 mon.a (mon.0) 956 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:36:11.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:11 gibba044 bash[25485]: cephadm 2021-03-10T20:36:10.338071+0000 mgr.gibba044.wflcwh (mgr.34466) 1504 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:36:11.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:11 gibba044 bash[25485]: audit 2021-03-10T20:36:10.338582+0000 mon.a (mon.0) 957 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:11.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:11 gibba044 bash[25485]: cephadm 2021-03-10T20:36:10.340086+0000 mgr.gibba044.wflcwh (mgr.34466) 1505 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:36:11.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:11 gibba044 bash[25485]: audit 2021-03-10T20:36:10.340367+0000 mon.a (mon.0) 958 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:11.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:11 gibba044 bash[25485]: cephadm 2021-03-10T20:36:10.341635+0000 mgr.gibba044.wflcwh (mgr.34466) 1506 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:36:11.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:11 gibba044 bash[25485]: cephadm 2021-03-10T20:36:10.341673+0000 mgr.gibba044.wflcwh (mgr.34466) 1507 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:36:11.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:11 gibba044 bash[25485]: audit 2021-03-10T20:36:10.341973+0000 mon.a (mon.0) 959 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:11.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:11 gibba044 bash[25485]: cephadm 2021-03-10T20:36:10.343421+0000 mgr.gibba044.wflcwh (mgr.34466) 1508 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:36:11.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:11 gibba044 bash[25485]: cephadm 2021-03-10T20:36:10.343459+0000 mgr.gibba044.wflcwh (mgr.34466) 1509 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:36:11.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:11 gibba044 bash[25485]: cephadm 2021-03-10T20:36:10.344828+0000 mgr.gibba044.wflcwh (mgr.34466) 1510 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:36:11.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:11 gibba044 bash[25485]: audit 2021-03-10T20:36:10.345099+0000 mon.a (mon.0) 960 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:11.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:11 gibba044 bash[25485]: cephadm 2021-03-10T20:36:10.346387+0000 mgr.gibba044.wflcwh (mgr.34466) 1511 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:36:11.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:11 gibba044 bash[25485]: cephadm 2021-03-10T20:36:10.346426+0000 mgr.gibba044.wflcwh (mgr.34466) 1512 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:36:11.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:11 gibba044 bash[25485]: audit 2021-03-10T20:36:10.347105+0000 mon.a (mon.0) 961 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:11.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:11 gibba044 bash[25485]: cephadm 2021-03-10T20:36:10.348282+0000 mgr.gibba044.wflcwh (mgr.34466) 1513 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:36:11.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:11 gibba044 bash[25485]: cephadm 2021-03-10T20:36:10.348614+0000 mgr.gibba044.wflcwh (mgr.34466) 1514 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:36:11.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:11 gibba044 bash[25485]: cephadm 2021-03-10T20:36:10.350239+0000 mgr.gibba044.wflcwh (mgr.34466) 1515 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:36:11.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:11 gibba044 bash[25485]: cephadm 2021-03-10T20:36:10.350283+0000 mgr.gibba044.wflcwh (mgr.34466) 1516 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:36:11.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:11 gibba044 bash[25485]: cephadm 2021-03-10T20:36:10.350427+0000 mgr.gibba044.wflcwh (mgr.34466) 1517 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:36:11.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:11 gibba044 bash[25485]: cluster 2021-03-10T20:36:10.397468+0000 mgr.gibba044.wflcwh (mgr.34466) 1518 : cluster [DBG] pgmap v846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:14.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:13 gibba044 bash[25485]: cluster 2021-03-10T20:36:12.399088+0000 mgr.gibba044.wflcwh (mgr.34466) 1519 : cluster [DBG] pgmap v847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:14.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:13 gibba023 bash[30844]: cluster 2021-03-10T20:36:12.399088+0000 mgr.gibba044.wflcwh (mgr.34466) 1519 : cluster [DBG] pgmap v847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:14.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:13 gibba023 bash[31815]: cluster 2021-03-10T20:36:12.399088+0000 mgr.gibba044.wflcwh (mgr.34466) 1519 : cluster [DBG] pgmap v847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:15.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:15 gibba044 bash[25485]: cluster 2021-03-10T20:36:14.400238+0000 mgr.gibba044.wflcwh (mgr.34466) 1520 : cluster [DBG] pgmap v848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:16.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:15 gibba023 bash[30844]: cluster 2021-03-10T20:36:14.400238+0000 mgr.gibba044.wflcwh (mgr.34466) 1520 : cluster [DBG] pgmap v848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:16.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:15 gibba023 bash[31815]: cluster 2021-03-10T20:36:14.400238+0000 mgr.gibba044.wflcwh (mgr.34466) 1520 : cluster [DBG] pgmap v848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:18.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:17 gibba023 bash[30844]: cluster 2021-03-10T20:36:16.401781+0000 mgr.gibba044.wflcwh (mgr.34466) 1521 : cluster [DBG] pgmap v849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:18.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:17 gibba023 bash[31815]: cluster 2021-03-10T20:36:16.401781+0000 mgr.gibba044.wflcwh (mgr.34466) 1521 : cluster [DBG] pgmap v849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:18.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:17 gibba044 bash[25485]: cluster 2021-03-10T20:36:16.401781+0000 mgr.gibba044.wflcwh (mgr.34466) 1521 : cluster [DBG] pgmap v849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:20.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:19 gibba023 bash[30844]: cluster 2021-03-10T20:36:18.403393+0000 mgr.gibba044.wflcwh (mgr.34466) 1522 : cluster [DBG] pgmap v850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:20.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:19 gibba023 bash[31815]: cluster 2021-03-10T20:36:18.403393+0000 mgr.gibba044.wflcwh (mgr.34466) 1522 : cluster [DBG] pgmap v850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:20.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:19 gibba044 bash[25485]: cluster 2021-03-10T20:36:18.403393+0000 mgr.gibba044.wflcwh (mgr.34466) 1522 : cluster [DBG] pgmap v850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:22.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:21 gibba023 bash[30844]: cluster 2021-03-10T20:36:20.404880+0000 mgr.gibba044.wflcwh (mgr.34466) 1523 : cluster [DBG] pgmap v851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:22.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:21 gibba023 bash[31815]: cluster 2021-03-10T20:36:20.404880+0000 mgr.gibba044.wflcwh (mgr.34466) 1523 : cluster [DBG] pgmap v851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:22.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:21 gibba044 bash[25485]: cluster 2021-03-10T20:36:20.404880+0000 mgr.gibba044.wflcwh (mgr.34466) 1523 : cluster [DBG] pgmap v851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:24.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:23 gibba023 bash[30844]: cluster 2021-03-10T20:36:22.406404+0000 mgr.gibba044.wflcwh (mgr.34466) 1524 : cluster [DBG] pgmap v852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:24.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:23 gibba023 bash[31815]: cluster 2021-03-10T20:36:22.406404+0000 mgr.gibba044.wflcwh (mgr.34466) 1524 : cluster [DBG] pgmap v852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:24.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:23 gibba044 bash[25485]: cluster 2021-03-10T20:36:22.406404+0000 mgr.gibba044.wflcwh (mgr.34466) 1524 : cluster [DBG] pgmap v852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:24.373 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:36:24.601 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:36:24.601 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (27m) 3m ago 33m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:36:24.602 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (32m) 2m ago 32m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:36:24.602 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (27m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:36:24.602 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (28m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:36:24.603 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (27m) 3m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:36:24.603 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (27m) 3m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:36:24.603 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (26m) 2m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:36:24.604 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (26m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:36:24.604 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (33m) 3m ago 33m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:36:24.605 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (33m) 2m ago 33m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:36:24.605 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (25m) 3m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:36:24.606 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (25m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:36:24.606 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (24m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:36:24.606 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (24m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:36:24.607 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (24m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:36:24.607 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (23m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:36:24.607 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (23m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:36:24.608 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (22m) 2m ago 33m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:36:24.608 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (32m) 2m ago 33m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:36:24.609 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 3m ago 31m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:36:24.609 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 2m ago 31m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:36:24.849 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:36:24.849 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:36:24.850 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:36:24.850 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:36:24.850 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:36:24.850 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:36:24.851 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:36:24.851 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:36:24.851 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:36:24.851 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:36:24.851 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:36:24.852 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:36:24.852 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:36:24.852 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:36:24.852 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:36:26.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:25 gibba023 bash[30844]: audit 2021-03-10T20:36:24.366865+0000 mgr.gibba044.wflcwh (mgr.34466) 1525 : audit [DBG] from='client.45084 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:36:26.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:25 gibba023 bash[30844]: cluster 2021-03-10T20:36:24.408188+0000 mgr.gibba044.wflcwh (mgr.34466) 1526 : cluster [DBG] pgmap v853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:26.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:25 gibba023 bash[30844]: audit 2021-03-10T20:36:24.590699+0000 mgr.gibba044.wflcwh (mgr.34466) 1527 : audit [DBG] from='client.55069 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:36:26.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:25 gibba023 bash[30844]: audit 2021-03-10T20:36:24.849451+0000 mon.a (mon.0) 962 : audit [DBG] from='client.? 172.21.2.123:0/3181523242' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:26.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:25 gibba023 bash[31815]: audit 2021-03-10T20:36:24.366865+0000 mgr.gibba044.wflcwh (mgr.34466) 1525 : audit [DBG] from='client.45084 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:36:26.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:25 gibba023 bash[31815]: cluster 2021-03-10T20:36:24.408188+0000 mgr.gibba044.wflcwh (mgr.34466) 1526 : cluster [DBG] pgmap v853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:26.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:25 gibba023 bash[31815]: audit 2021-03-10T20:36:24.590699+0000 mgr.gibba044.wflcwh (mgr.34466) 1527 : audit [DBG] from='client.55069 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:36:26.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:25 gibba023 bash[31815]: audit 2021-03-10T20:36:24.849451+0000 mon.a (mon.0) 962 : audit [DBG] from='client.? 172.21.2.123:0/3181523242' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:26.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:25 gibba044 bash[25485]: audit 2021-03-10T20:36:24.366865+0000 mgr.gibba044.wflcwh (mgr.34466) 1525 : audit [DBG] from='client.45084 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:36:26.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:25 gibba044 bash[25485]: cluster 2021-03-10T20:36:24.408188+0000 mgr.gibba044.wflcwh (mgr.34466) 1526 : cluster [DBG] pgmap v853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:26.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:25 gibba044 bash[25485]: audit 2021-03-10T20:36:24.590699+0000 mgr.gibba044.wflcwh (mgr.34466) 1527 : audit [DBG] from='client.55069 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:36:26.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:25 gibba044 bash[25485]: audit 2021-03-10T20:36:24.849451+0000 mon.a (mon.0) 962 : audit [DBG] from='client.? 172.21.2.123:0/3181523242' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:27.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:26 gibba023 bash[30844]: cephadm 2021-03-10T20:36:25.366505+0000 mgr.gibba044.wflcwh (mgr.34466) 1528 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:36:27.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:26 gibba023 bash[31815]: cephadm 2021-03-10T20:36:25.366505+0000 mgr.gibba044.wflcwh (mgr.34466) 1528 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:36:27.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:26 gibba044 bash[25485]: cephadm 2021-03-10T20:36:25.366505+0000 mgr.gibba044.wflcwh (mgr.34466) 1528 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:36:28.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:27 gibba023 bash[30844]: cluster 2021-03-10T20:36:26.409705+0000 mgr.gibba044.wflcwh (mgr.34466) 1529 : cluster [DBG] pgmap v854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:28.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:27 gibba023 bash[30844]: audit 2021-03-10T20:36:27.185847+0000 mon.a (mon.0) 963 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:36:28.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:27 gibba023 bash[30844]: audit 2021-03-10T20:36:27.186543+0000 mon.a (mon.0) 964 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:36:28.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:27 gibba023 bash[30844]: audit 2021-03-10T20:36:27.187843+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T20:36:28.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:27 gibba023 bash[30844]: audit 2021-03-10T20:36:27.188606+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:36:28.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:27 gibba023 bash[30844]: audit 2021-03-10T20:36:27.189280+0000 mon.a (mon.0) 967 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:36:28.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:27 gibba023 bash[30844]: audit 2021-03-10T20:36:27.190041+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:36:28.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:27 gibba023 bash[31815]: cluster 2021-03-10T20:36:26.409705+0000 mgr.gibba044.wflcwh (mgr.34466) 1529 : cluster [DBG] pgmap v854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:28.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:27 gibba023 bash[31815]: audit 2021-03-10T20:36:27.185847+0000 mon.a (mon.0) 963 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:36:28.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:27 gibba023 bash[31815]: audit 2021-03-10T20:36:27.186543+0000 mon.a (mon.0) 964 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:36:28.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:27 gibba023 bash[31815]: audit 2021-03-10T20:36:27.187843+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T20:36:28.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:27 gibba023 bash[31815]: audit 2021-03-10T20:36:27.188606+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:36:28.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:27 gibba023 bash[31815]: audit 2021-03-10T20:36:27.189280+0000 mon.a (mon.0) 967 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:36:28.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:27 gibba023 bash[31815]: audit 2021-03-10T20:36:27.190041+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:36:28.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:27 gibba044 bash[25485]: cluster 2021-03-10T20:36:26.409705+0000 mgr.gibba044.wflcwh (mgr.34466) 1529 : cluster [DBG] pgmap v854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:28.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:27 gibba044 bash[25485]: audit 2021-03-10T20:36:27.185847+0000 mon.a (mon.0) 963 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:36:28.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:27 gibba044 bash[25485]: audit 2021-03-10T20:36:27.186543+0000 mon.a (mon.0) 964 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:36:28.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:27 gibba044 bash[25485]: audit 2021-03-10T20:36:27.187843+0000 mon.a (mon.0) 965 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T20:36:28.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:27 gibba044 bash[25485]: audit 2021-03-10T20:36:27.188606+0000 mon.a (mon.0) 966 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:36:28.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:27 gibba044 bash[25485]: audit 2021-03-10T20:36:27.189280+0000 mon.a (mon.0) 967 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:36:28.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:27 gibba044 bash[25485]: audit 2021-03-10T20:36:27.190041+0000 mon.a (mon.0) 968 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:36:30.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:29 gibba023 bash[30844]: cluster 2021-03-10T20:36:28.411398+0000 mgr.gibba044.wflcwh (mgr.34466) 1530 : cluster [DBG] pgmap v855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:30.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:29 gibba023 bash[31815]: cluster 2021-03-10T20:36:28.411398+0000 mgr.gibba044.wflcwh (mgr.34466) 1530 : cluster [DBG] pgmap v855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:30.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:29 gibba044 bash[25485]: cluster 2021-03-10T20:36:28.411398+0000 mgr.gibba044.wflcwh (mgr.34466) 1530 : cluster [DBG] pgmap v855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:32.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:31 gibba023 bash[30844]: cluster 2021-03-10T20:36:30.412935+0000 mgr.gibba044.wflcwh (mgr.34466) 1531 : cluster [DBG] pgmap v856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:32.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:31 gibba023 bash[31815]: cluster 2021-03-10T20:36:30.412935+0000 mgr.gibba044.wflcwh (mgr.34466) 1531 : cluster [DBG] pgmap v856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:32.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:31 gibba044 bash[25485]: cluster 2021-03-10T20:36:30.412935+0000 mgr.gibba044.wflcwh (mgr.34466) 1531 : cluster [DBG] pgmap v856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:34.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:33 gibba023 bash[30844]: cluster 2021-03-10T20:36:32.414655+0000 mgr.gibba044.wflcwh (mgr.34466) 1532 : cluster [DBG] pgmap v857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:34.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:33 gibba023 bash[31815]: cluster 2021-03-10T20:36:32.414655+0000 mgr.gibba044.wflcwh (mgr.34466) 1532 : cluster [DBG] pgmap v857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:34.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:33 gibba044 bash[25485]: cluster 2021-03-10T20:36:32.414655+0000 mgr.gibba044.wflcwh (mgr.34466) 1532 : cluster [DBG] pgmap v857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:36.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:35 gibba023 bash[30844]: cluster 2021-03-10T20:36:34.416469+0000 mgr.gibba044.wflcwh (mgr.34466) 1533 : cluster [DBG] pgmap v858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:36.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:35 gibba023 bash[31815]: cluster 2021-03-10T20:36:34.416469+0000 mgr.gibba044.wflcwh (mgr.34466) 1533 : cluster [DBG] pgmap v858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:36.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:35 gibba044 bash[25485]: cluster 2021-03-10T20:36:34.416469+0000 mgr.gibba044.wflcwh (mgr.34466) 1533 : cluster [DBG] pgmap v858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:38.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:37 gibba023 bash[30844]: cluster 2021-03-10T20:36:36.418095+0000 mgr.gibba044.wflcwh (mgr.34466) 1534 : cluster [DBG] pgmap v859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:38.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:37 gibba023 bash[31815]: cluster 2021-03-10T20:36:36.418095+0000 mgr.gibba044.wflcwh (mgr.34466) 1534 : cluster [DBG] pgmap v859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:38.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:37 gibba044 bash[25485]: cluster 2021-03-10T20:36:36.418095+0000 mgr.gibba044.wflcwh (mgr.34466) 1534 : cluster [DBG] pgmap v859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:40.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:39 gibba023 bash[30844]: cluster 2021-03-10T20:36:38.419647+0000 mgr.gibba044.wflcwh (mgr.34466) 1535 : cluster [DBG] pgmap v860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:40.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:39 gibba023 bash[31815]: cluster 2021-03-10T20:36:38.419647+0000 mgr.gibba044.wflcwh (mgr.34466) 1535 : cluster [DBG] pgmap v860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:40.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:39 gibba044 bash[25485]: cluster 2021-03-10T20:36:38.419647+0000 mgr.gibba044.wflcwh (mgr.34466) 1535 : cluster [DBG] pgmap v860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:42.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:41 gibba023 bash[30844]: cephadm 2021-03-10T20:36:40.380371+0000 mgr.gibba044.wflcwh (mgr.34466) 1536 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:36:42.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:41 gibba023 bash[30844]: cluster 2021-03-10T20:36:40.421191+0000 mgr.gibba044.wflcwh (mgr.34466) 1537 : cluster [DBG] pgmap v861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:42.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:41 gibba023 bash[31815]: cephadm 2021-03-10T20:36:40.380371+0000 mgr.gibba044.wflcwh (mgr.34466) 1536 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:36:42.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:41 gibba023 bash[31815]: cluster 2021-03-10T20:36:40.421191+0000 mgr.gibba044.wflcwh (mgr.34466) 1537 : cluster [DBG] pgmap v861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:42.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:41 gibba044 bash[25485]: cephadm 2021-03-10T20:36:40.380371+0000 mgr.gibba044.wflcwh (mgr.34466) 1536 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:36:42.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:41 gibba044 bash[25485]: cluster 2021-03-10T20:36:40.421191+0000 mgr.gibba044.wflcwh (mgr.34466) 1537 : cluster [DBG] pgmap v861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:44.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:43 gibba023 bash[30844]: cluster 2021-03-10T20:36:42.422896+0000 mgr.gibba044.wflcwh (mgr.34466) 1538 : cluster [DBG] pgmap v862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:44.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:43 gibba023 bash[31815]: cluster 2021-03-10T20:36:42.422896+0000 mgr.gibba044.wflcwh (mgr.34466) 1538 : cluster [DBG] pgmap v862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:44.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:43 gibba044 bash[25485]: cluster 2021-03-10T20:36:42.422896+0000 mgr.gibba044.wflcwh (mgr.34466) 1538 : cluster [DBG] pgmap v862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:46.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:45 gibba023 bash[30844]: cluster 2021-03-10T20:36:44.424680+0000 mgr.gibba044.wflcwh (mgr.34466) 1539 : cluster [DBG] pgmap v863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:46.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:45 gibba023 bash[31815]: cluster 2021-03-10T20:36:44.424680+0000 mgr.gibba044.wflcwh (mgr.34466) 1539 : cluster [DBG] pgmap v863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:46.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:45 gibba044 bash[25485]: cluster 2021-03-10T20:36:44.424680+0000 mgr.gibba044.wflcwh (mgr.34466) 1539 : cluster [DBG] pgmap v863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:48.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:47 gibba023 bash[30844]: cluster 2021-03-10T20:36:46.426314+0000 mgr.gibba044.wflcwh (mgr.34466) 1540 : cluster [DBG] pgmap v864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:48.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:47 gibba023 bash[31815]: cluster 2021-03-10T20:36:46.426314+0000 mgr.gibba044.wflcwh (mgr.34466) 1540 : cluster [DBG] pgmap v864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:48.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:47 gibba044 bash[25485]: cluster 2021-03-10T20:36:46.426314+0000 mgr.gibba044.wflcwh (mgr.34466) 1540 : cluster [DBG] pgmap v864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:50.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:49 gibba023 bash[30844]: cluster 2021-03-10T20:36:48.427955+0000 mgr.gibba044.wflcwh (mgr.34466) 1541 : cluster [DBG] pgmap v865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:50.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:49 gibba023 bash[31815]: cluster 2021-03-10T20:36:48.427955+0000 mgr.gibba044.wflcwh (mgr.34466) 1541 : cluster [DBG] pgmap v865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:50.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:49 gibba044 bash[25485]: cluster 2021-03-10T20:36:48.427955+0000 mgr.gibba044.wflcwh (mgr.34466) 1541 : cluster [DBG] pgmap v865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:52.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:51 gibba023 bash[30844]: cluster 2021-03-10T20:36:50.429252+0000 mgr.gibba044.wflcwh (mgr.34466) 1542 : cluster [DBG] pgmap v866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:52.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:51 gibba023 bash[31815]: cluster 2021-03-10T20:36:50.429252+0000 mgr.gibba044.wflcwh (mgr.34466) 1542 : cluster [DBG] pgmap v866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:52.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:51 gibba044 bash[25485]: cluster 2021-03-10T20:36:50.429252+0000 mgr.gibba044.wflcwh (mgr.34466) 1542 : cluster [DBG] pgmap v866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:54.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:53 gibba023 bash[30844]: cluster 2021-03-10T20:36:52.430725+0000 mgr.gibba044.wflcwh (mgr.34466) 1543 : cluster [DBG] pgmap v867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:54.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:53 gibba023 bash[31815]: cluster 2021-03-10T20:36:52.430725+0000 mgr.gibba044.wflcwh (mgr.34466) 1543 : cluster [DBG] pgmap v867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:54.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:53 gibba044 bash[25485]: cluster 2021-03-10T20:36:52.430725+0000 mgr.gibba044.wflcwh (mgr.34466) 1543 : cluster [DBG] pgmap v867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:55.095 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:36:55.320 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:36:55.321 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (28m) 3m ago 33m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:36:55.321 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (33m) 2m ago 33m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:36:55.321 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (28m) 2m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:36:55.321 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (28m) 2m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:36:55.322 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (27m) 3m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:36:55.322 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (27m) 3m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:36:55.322 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (27m) 2m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:36:55.322 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (27m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:36:55.323 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (33m) 3m ago 33m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:36:55.323 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (33m) 2m ago 33m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:36:55.323 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (26m) 3m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:36:55.323 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (25m) 3m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:36:55.324 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (25m) 3m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:36:55.324 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (24m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:36:55.324 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (24m) 2m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:36:55.324 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (24m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:36:55.324 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (23m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:36:55.325 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (23m) 2m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:36:55.325 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (33m) 2m ago 33m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:36:55.325 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 3m ago 31m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:36:55.326 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 2m ago 31m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:36:55.569 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:36:55.569 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:36:55.570 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:36:55.570 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:36:55.570 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:36:55.570 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:36:55.570 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:36:55.571 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:36:55.571 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:36:55.571 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:36:55.571 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:36:55.572 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:36:55.572 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:36:55.572 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:36:55.573 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:36:56.187 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:55 gibba023 bash[30844]: cluster 2021-03-10T20:36:54.432519+0000 mgr.gibba044.wflcwh (mgr.34466) 1544 : cluster [DBG] pgmap v868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:56.187 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:55 gibba023 bash[30844]: audit 2021-03-10T20:36:55.569232+0000 mon.c (mon.1) 41 : audit [DBG] from='client.? 172.21.2.123:0/1196600679' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:56.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:55 gibba023 bash[31815]: cluster 2021-03-10T20:36:54.432519+0000 mgr.gibba044.wflcwh (mgr.34466) 1544 : cluster [DBG] pgmap v868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:56.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:55 gibba023 bash[31815]: audit 2021-03-10T20:36:55.569232+0000 mon.c (mon.1) 41 : audit [DBG] from='client.? 172.21.2.123:0/1196600679' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:56.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:55 gibba044 bash[25485]: cluster 2021-03-10T20:36:54.432519+0000 mgr.gibba044.wflcwh (mgr.34466) 1544 : cluster [DBG] pgmap v868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:56.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:55 gibba044 bash[25485]: audit 2021-03-10T20:36:55.569232+0000 mon.c (mon.1) 41 : audit [DBG] from='client.? 172.21.2.123:0/1196600679' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:36:57.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:56 gibba023 bash[30844]: audit 2021-03-10T20:36:55.088179+0000 mgr.gibba044.wflcwh (mgr.34466) 1545 : audit [DBG] from='client.45102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:36:57.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:56 gibba023 bash[30844]: audit 2021-03-10T20:36:55.309822+0000 mgr.gibba044.wflcwh (mgr.34466) 1546 : audit [DBG] from='client.55087 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:36:57.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:56 gibba023 bash[30844]: cephadm 2021-03-10T20:36:55.392159+0000 mgr.gibba044.wflcwh (mgr.34466) 1547 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:36:57.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:56 gibba023 bash[31815]: audit 2021-03-10T20:36:55.088179+0000 mgr.gibba044.wflcwh (mgr.34466) 1545 : audit [DBG] from='client.45102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:36:57.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:56 gibba023 bash[31815]: audit 2021-03-10T20:36:55.309822+0000 mgr.gibba044.wflcwh (mgr.34466) 1546 : audit [DBG] from='client.55087 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:36:57.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:56 gibba023 bash[31815]: cephadm 2021-03-10T20:36:55.392159+0000 mgr.gibba044.wflcwh (mgr.34466) 1547 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:36:57.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:56 gibba044 bash[25485]: audit 2021-03-10T20:36:55.088179+0000 mgr.gibba044.wflcwh (mgr.34466) 1545 : audit [DBG] from='client.45102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:36:57.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:56 gibba044 bash[25485]: audit 2021-03-10T20:36:55.309822+0000 mgr.gibba044.wflcwh (mgr.34466) 1546 : audit [DBG] from='client.55087 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:36:57.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:56 gibba044 bash[25485]: cephadm 2021-03-10T20:36:55.392159+0000 mgr.gibba044.wflcwh (mgr.34466) 1547 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:36:58.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:57 gibba023 bash[30844]: cluster 2021-03-10T20:36:56.433945+0000 mgr.gibba044.wflcwh (mgr.34466) 1548 : cluster [DBG] pgmap v869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:58.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:57 gibba023 bash[31815]: cluster 2021-03-10T20:36:56.433945+0000 mgr.gibba044.wflcwh (mgr.34466) 1548 : cluster [DBG] pgmap v869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:36:58.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:57 gibba044 bash[25485]: cluster 2021-03-10T20:36:56.433945+0000 mgr.gibba044.wflcwh (mgr.34466) 1548 : cluster [DBG] pgmap v869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:00.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:36:59 gibba044 bash[25485]: cluster 2021-03-10T20:36:58.435690+0000 mgr.gibba044.wflcwh (mgr.34466) 1549 : cluster [DBG] pgmap v870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:00.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:36:59 gibba023 bash[30844]: cluster 2021-03-10T20:36:58.435690+0000 mgr.gibba044.wflcwh (mgr.34466) 1549 : cluster [DBG] pgmap v870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:00.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:36:59 gibba023 bash[31815]: cluster 2021-03-10T20:36:58.435690+0000 mgr.gibba044.wflcwh (mgr.34466) 1549 : cluster [DBG] pgmap v870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:02.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:01 gibba044 bash[25485]: cluster 2021-03-10T20:37:00.437215+0000 mgr.gibba044.wflcwh (mgr.34466) 1550 : cluster [DBG] pgmap v871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:02.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:01 gibba023 bash[30844]: cluster 2021-03-10T20:37:00.437215+0000 mgr.gibba044.wflcwh (mgr.34466) 1550 : cluster [DBG] pgmap v871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:02.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:01 gibba023 bash[31815]: cluster 2021-03-10T20:37:00.437215+0000 mgr.gibba044.wflcwh (mgr.34466) 1550 : cluster [DBG] pgmap v871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:04.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:03 gibba044 bash[25485]: cluster 2021-03-10T20:37:02.438866+0000 mgr.gibba044.wflcwh (mgr.34466) 1551 : cluster [DBG] pgmap v872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:04.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:03 gibba023 bash[30844]: cluster 2021-03-10T20:37:02.438866+0000 mgr.gibba044.wflcwh (mgr.34466) 1551 : cluster [DBG] pgmap v872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:04.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:03 gibba023 bash[31815]: cluster 2021-03-10T20:37:02.438866+0000 mgr.gibba044.wflcwh (mgr.34466) 1551 : cluster [DBG] pgmap v872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:06.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:05 gibba044 bash[25485]: cluster 2021-03-10T20:37:04.440403+0000 mgr.gibba044.wflcwh (mgr.34466) 1552 : cluster [DBG] pgmap v873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:06.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:05 gibba023 bash[30844]: cluster 2021-03-10T20:37:04.440403+0000 mgr.gibba044.wflcwh (mgr.34466) 1552 : cluster [DBG] pgmap v873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:06.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:05 gibba023 bash[31815]: cluster 2021-03-10T20:37:04.440403+0000 mgr.gibba044.wflcwh (mgr.34466) 1552 : cluster [DBG] pgmap v873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:08.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:07 gibba044 bash[25485]: cluster 2021-03-10T20:37:06.441828+0000 mgr.gibba044.wflcwh (mgr.34466) 1553 : cluster [DBG] pgmap v874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:08.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:07 gibba023 bash[30844]: cluster 2021-03-10T20:37:06.441828+0000 mgr.gibba044.wflcwh (mgr.34466) 1553 : cluster [DBG] pgmap v874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:08.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:07 gibba023 bash[31815]: cluster 2021-03-10T20:37:06.441828+0000 mgr.gibba044.wflcwh (mgr.34466) 1553 : cluster [DBG] pgmap v874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:10.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:09 gibba044 bash[25485]: cluster 2021-03-10T20:37:08.443464+0000 mgr.gibba044.wflcwh (mgr.34466) 1554 : cluster [DBG] pgmap v875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:10.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:09 gibba023 bash[30844]: cluster 2021-03-10T20:37:08.443464+0000 mgr.gibba044.wflcwh (mgr.34466) 1554 : cluster [DBG] pgmap v875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:10.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:09 gibba023 bash[31815]: cluster 2021-03-10T20:37:08.443464+0000 mgr.gibba044.wflcwh (mgr.34466) 1554 : cluster [DBG] pgmap v875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:11.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[30844]: cephadm 2021-03-10T20:37:10.408901+0000 mgr.gibba044.wflcwh (mgr.34466) 1555 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:37:11.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[30844]: cephadm 2021-03-10T20:37:10.410445+0000 mgr.gibba044.wflcwh (mgr.34466) 1556 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:37:11.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[30844]: cluster 2021-03-10T20:37:10.444003+0000 mgr.gibba044.wflcwh (mgr.34466) 1557 : cluster [DBG] pgmap v876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:11.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[30844]: audit 2021-03-10T20:37:10.628592+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:37:11.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[30844]: audit 2021-03-10T20:37:10.632378+0000 mon.a (mon.0) 970 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:37:11.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[30844]: cephadm 2021-03-10T20:37:10.633156+0000 mgr.gibba044.wflcwh (mgr.34466) 1558 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:37:11.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[30844]: audit 2021-03-10T20:37:10.635399+0000 mon.a (mon.0) 971 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:11.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[30844]: cephadm 2021-03-10T20:37:10.636421+0000 mgr.gibba044.wflcwh (mgr.34466) 1559 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:37:11.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[30844]: audit 2021-03-10T20:37:10.638112+0000 mon.a (mon.0) 972 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:11.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[30844]: cephadm 2021-03-10T20:37:10.639289+0000 mgr.gibba044.wflcwh (mgr.34466) 1560 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:37:11.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[30844]: cephadm 2021-03-10T20:37:10.639328+0000 mgr.gibba044.wflcwh (mgr.34466) 1561 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:37:11.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[30844]: audit 2021-03-10T20:37:10.641166+0000 mon.a (mon.0) 973 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:11.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[30844]: cephadm 2021-03-10T20:37:10.642203+0000 mgr.gibba044.wflcwh (mgr.34466) 1562 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:37:11.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[30844]: cephadm 2021-03-10T20:37:10.642270+0000 mgr.gibba044.wflcwh (mgr.34466) 1563 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:37:11.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[30844]: cephadm 2021-03-10T20:37:10.645104+0000 mgr.gibba044.wflcwh (mgr.34466) 1564 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:37:11.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[30844]: audit 2021-03-10T20:37:10.646768+0000 mon.a (mon.0) 974 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:11.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[30844]: cephadm 2021-03-10T20:37:10.647749+0000 mgr.gibba044.wflcwh (mgr.34466) 1565 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:37:11.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[30844]: cephadm 2021-03-10T20:37:10.647790+0000 mgr.gibba044.wflcwh (mgr.34466) 1566 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:37:11.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[30844]: audit 2021-03-10T20:37:10.650168+0000 mon.a (mon.0) 975 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:11.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[30844]: cephadm 2021-03-10T20:37:10.650676+0000 mgr.gibba044.wflcwh (mgr.34466) 1567 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:37:11.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[30844]: cephadm 2021-03-10T20:37:10.651165+0000 mgr.gibba044.wflcwh (mgr.34466) 1568 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:37:11.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[30844]: cephadm 2021-03-10T20:37:10.654757+0000 mgr.gibba044.wflcwh (mgr.34466) 1569 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:37:11.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[30844]: cephadm 2021-03-10T20:37:10.654807+0000 mgr.gibba044.wflcwh (mgr.34466) 1570 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:37:11.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[30844]: cephadm 2021-03-10T20:37:10.654986+0000 mgr.gibba044.wflcwh (mgr.34466) 1571 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:37:11.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[31815]: cephadm 2021-03-10T20:37:10.408901+0000 mgr.gibba044.wflcwh (mgr.34466) 1555 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:37:11.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[31815]: cephadm 2021-03-10T20:37:10.410445+0000 mgr.gibba044.wflcwh (mgr.34466) 1556 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:37:11.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[31815]: cluster 2021-03-10T20:37:10.444003+0000 mgr.gibba044.wflcwh (mgr.34466) 1557 : cluster [DBG] pgmap v876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:11.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[31815]: audit 2021-03-10T20:37:10.628592+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:37:11.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[31815]: audit 2021-03-10T20:37:10.632378+0000 mon.a (mon.0) 970 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:37:11.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[31815]: cephadm 2021-03-10T20:37:10.633156+0000 mgr.gibba044.wflcwh (mgr.34466) 1558 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:37:11.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[31815]: audit 2021-03-10T20:37:10.635399+0000 mon.a (mon.0) 971 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:11.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[31815]: cephadm 2021-03-10T20:37:10.636421+0000 mgr.gibba044.wflcwh (mgr.34466) 1559 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:37:11.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[31815]: audit 2021-03-10T20:37:10.638112+0000 mon.a (mon.0) 972 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:11.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[31815]: cephadm 2021-03-10T20:37:10.639289+0000 mgr.gibba044.wflcwh (mgr.34466) 1560 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:37:11.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[31815]: cephadm 2021-03-10T20:37:10.639328+0000 mgr.gibba044.wflcwh (mgr.34466) 1561 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:37:11.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[31815]: audit 2021-03-10T20:37:10.641166+0000 mon.a (mon.0) 973 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:11.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[31815]: cephadm 2021-03-10T20:37:10.642203+0000 mgr.gibba044.wflcwh (mgr.34466) 1562 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:37:11.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[31815]: cephadm 2021-03-10T20:37:10.642270+0000 mgr.gibba044.wflcwh (mgr.34466) 1563 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:37:11.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[31815]: cephadm 2021-03-10T20:37:10.645104+0000 mgr.gibba044.wflcwh (mgr.34466) 1564 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:37:11.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[31815]: audit 2021-03-10T20:37:10.646768+0000 mon.a (mon.0) 974 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:11.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[31815]: cephadm 2021-03-10T20:37:10.647749+0000 mgr.gibba044.wflcwh (mgr.34466) 1565 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:37:11.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[31815]: cephadm 2021-03-10T20:37:10.647790+0000 mgr.gibba044.wflcwh (mgr.34466) 1566 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:37:11.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[31815]: audit 2021-03-10T20:37:10.650168+0000 mon.a (mon.0) 975 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:11.936 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[31815]: cephadm 2021-03-10T20:37:10.650676+0000 mgr.gibba044.wflcwh (mgr.34466) 1567 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:37:11.936 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[31815]: cephadm 2021-03-10T20:37:10.651165+0000 mgr.gibba044.wflcwh (mgr.34466) 1568 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:37:11.936 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[31815]: cephadm 2021-03-10T20:37:10.654757+0000 mgr.gibba044.wflcwh (mgr.34466) 1569 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:37:11.936 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[31815]: cephadm 2021-03-10T20:37:10.654807+0000 mgr.gibba044.wflcwh (mgr.34466) 1570 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:37:11.936 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:11 gibba023 bash[31815]: cephadm 2021-03-10T20:37:10.654986+0000 mgr.gibba044.wflcwh (mgr.34466) 1571 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:37:12.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:11 gibba044 bash[25485]: cephadm 2021-03-10T20:37:10.408901+0000 mgr.gibba044.wflcwh (mgr.34466) 1555 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:37:12.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:11 gibba044 bash[25485]: cephadm 2021-03-10T20:37:10.410445+0000 mgr.gibba044.wflcwh (mgr.34466) 1556 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:37:12.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:11 gibba044 bash[25485]: cluster 2021-03-10T20:37:10.444003+0000 mgr.gibba044.wflcwh (mgr.34466) 1557 : cluster [DBG] pgmap v876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:12.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:11 gibba044 bash[25485]: audit 2021-03-10T20:37:10.628592+0000 mon.a (mon.0) 969 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:37:12.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:11 gibba044 bash[25485]: audit 2021-03-10T20:37:10.632378+0000 mon.a (mon.0) 970 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:37:12.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:11 gibba044 bash[25485]: cephadm 2021-03-10T20:37:10.633156+0000 mgr.gibba044.wflcwh (mgr.34466) 1558 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:37:12.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:11 gibba044 bash[25485]: audit 2021-03-10T20:37:10.635399+0000 mon.a (mon.0) 971 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:12.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:11 gibba044 bash[25485]: cephadm 2021-03-10T20:37:10.636421+0000 mgr.gibba044.wflcwh (mgr.34466) 1559 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:37:12.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:11 gibba044 bash[25485]: audit 2021-03-10T20:37:10.638112+0000 mon.a (mon.0) 972 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:12.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:11 gibba044 bash[25485]: cephadm 2021-03-10T20:37:10.639289+0000 mgr.gibba044.wflcwh (mgr.34466) 1560 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:37:12.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:11 gibba044 bash[25485]: cephadm 2021-03-10T20:37:10.639328+0000 mgr.gibba044.wflcwh (mgr.34466) 1561 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:37:12.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:11 gibba044 bash[25485]: audit 2021-03-10T20:37:10.641166+0000 mon.a (mon.0) 973 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:12.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:11 gibba044 bash[25485]: cephadm 2021-03-10T20:37:10.642203+0000 mgr.gibba044.wflcwh (mgr.34466) 1562 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:37:12.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:11 gibba044 bash[25485]: cephadm 2021-03-10T20:37:10.642270+0000 mgr.gibba044.wflcwh (mgr.34466) 1563 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:37:12.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:11 gibba044 bash[25485]: cephadm 2021-03-10T20:37:10.645104+0000 mgr.gibba044.wflcwh (mgr.34466) 1564 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:37:12.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:11 gibba044 bash[25485]: audit 2021-03-10T20:37:10.646768+0000 mon.a (mon.0) 974 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:12.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:11 gibba044 bash[25485]: cephadm 2021-03-10T20:37:10.647749+0000 mgr.gibba044.wflcwh (mgr.34466) 1565 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:37:12.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:11 gibba044 bash[25485]: cephadm 2021-03-10T20:37:10.647790+0000 mgr.gibba044.wflcwh (mgr.34466) 1566 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:37:12.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:11 gibba044 bash[25485]: audit 2021-03-10T20:37:10.650168+0000 mon.a (mon.0) 975 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:12.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:11 gibba044 bash[25485]: cephadm 2021-03-10T20:37:10.650676+0000 mgr.gibba044.wflcwh (mgr.34466) 1567 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:37:12.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:11 gibba044 bash[25485]: cephadm 2021-03-10T20:37:10.651165+0000 mgr.gibba044.wflcwh (mgr.34466) 1568 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:37:12.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:11 gibba044 bash[25485]: cephadm 2021-03-10T20:37:10.654757+0000 mgr.gibba044.wflcwh (mgr.34466) 1569 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:37:12.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:11 gibba044 bash[25485]: cephadm 2021-03-10T20:37:10.654807+0000 mgr.gibba044.wflcwh (mgr.34466) 1570 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:37:12.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:11 gibba044 bash[25485]: cephadm 2021-03-10T20:37:10.654986+0000 mgr.gibba044.wflcwh (mgr.34466) 1571 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:37:14.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:13 gibba023 bash[30844]: cluster 2021-03-10T20:37:12.445561+0000 mgr.gibba044.wflcwh (mgr.34466) 1572 : cluster [DBG] pgmap v877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:14.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:13 gibba023 bash[31815]: cluster 2021-03-10T20:37:12.445561+0000 mgr.gibba044.wflcwh (mgr.34466) 1572 : cluster [DBG] pgmap v877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:14.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:13 gibba044 bash[25485]: cluster 2021-03-10T20:37:12.445561+0000 mgr.gibba044.wflcwh (mgr.34466) 1572 : cluster [DBG] pgmap v877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:16.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:15 gibba023 bash[30844]: cluster 2021-03-10T20:37:14.447250+0000 mgr.gibba044.wflcwh (mgr.34466) 1573 : cluster [DBG] pgmap v878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:16.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:15 gibba023 bash[31815]: cluster 2021-03-10T20:37:14.447250+0000 mgr.gibba044.wflcwh (mgr.34466) 1573 : cluster [DBG] pgmap v878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:16.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:15 gibba044 bash[25485]: cluster 2021-03-10T20:37:14.447250+0000 mgr.gibba044.wflcwh (mgr.34466) 1573 : cluster [DBG] pgmap v878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:18.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:17 gibba023 bash[30844]: cluster 2021-03-10T20:37:16.448782+0000 mgr.gibba044.wflcwh (mgr.34466) 1574 : cluster [DBG] pgmap v879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:18.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:17 gibba023 bash[31815]: cluster 2021-03-10T20:37:16.448782+0000 mgr.gibba044.wflcwh (mgr.34466) 1574 : cluster [DBG] pgmap v879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:18.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:17 gibba044 bash[25485]: cluster 2021-03-10T20:37:16.448782+0000 mgr.gibba044.wflcwh (mgr.34466) 1574 : cluster [DBG] pgmap v879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:20.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:19 gibba023 bash[30844]: cluster 2021-03-10T20:37:18.450324+0000 mgr.gibba044.wflcwh (mgr.34466) 1575 : cluster [DBG] pgmap v880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:20.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:19 gibba023 bash[31815]: cluster 2021-03-10T20:37:18.450324+0000 mgr.gibba044.wflcwh (mgr.34466) 1575 : cluster [DBG] pgmap v880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:20.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:19 gibba044 bash[25485]: cluster 2021-03-10T20:37:18.450324+0000 mgr.gibba044.wflcwh (mgr.34466) 1575 : cluster [DBG] pgmap v880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:22.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:21 gibba023 bash[30844]: cluster 2021-03-10T20:37:20.451952+0000 mgr.gibba044.wflcwh (mgr.34466) 1576 : cluster [DBG] pgmap v881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:22.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:21 gibba023 bash[31815]: cluster 2021-03-10T20:37:20.451952+0000 mgr.gibba044.wflcwh (mgr.34466) 1576 : cluster [DBG] pgmap v881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:22.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:21 gibba044 bash[25485]: cluster 2021-03-10T20:37:20.451952+0000 mgr.gibba044.wflcwh (mgr.34466) 1576 : cluster [DBG] pgmap v881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:24.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:23 gibba023 bash[30844]: cluster 2021-03-10T20:37:22.453631+0000 mgr.gibba044.wflcwh (mgr.34466) 1577 : cluster [DBG] pgmap v882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:24.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:23 gibba023 bash[31815]: cluster 2021-03-10T20:37:22.453631+0000 mgr.gibba044.wflcwh (mgr.34466) 1577 : cluster [DBG] pgmap v882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:24.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:23 gibba044 bash[25485]: cluster 2021-03-10T20:37:22.453631+0000 mgr.gibba044.wflcwh (mgr.34466) 1577 : cluster [DBG] pgmap v882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:25.815 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:37:25.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:25 gibba044 bash[25485]: cluster 2021-03-10T20:37:24.455367+0000 mgr.gibba044.wflcwh (mgr.34466) 1578 : cluster [DBG] pgmap v883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:26.045 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:37:26.045 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (28m) 4m ago 34m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:37:26.046 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (33m) 3m ago 33m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:37:26.046 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (28m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:37:26.046 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (29m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:37:26.047 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (28m) 4m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:37:26.047 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (28m) 4m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:37:26.047 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (27m) 3m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:37:26.047 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (27m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:37:26.048 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (34m) 4m ago 34m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:37:26.048 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (34m) 3m ago 34m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:37:26.048 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (26m) 4m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:37:26.048 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (26m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:37:26.048 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (25m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:37:26.049 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (25m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:37:26.049 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (25m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:37:26.049 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (24m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:37:26.049 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (24m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:37:26.050 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (23m) 3m ago 34m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:37:26.050 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (33m) 3m ago 34m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:37:26.050 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 4m ago 32m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:37:26.050 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 3m ago 32m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:37:26.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:25 gibba023 bash[30844]: cluster 2021-03-10T20:37:24.455367+0000 mgr.gibba044.wflcwh (mgr.34466) 1578 : cluster [DBG] pgmap v883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:26.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:25 gibba023 bash[31815]: cluster 2021-03-10T20:37:24.455367+0000 mgr.gibba044.wflcwh (mgr.34466) 1578 : cluster [DBG] pgmap v883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:26.294 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:37:26.294 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:37:26.294 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:37:26.295 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:37:26.295 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:37:26.295 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:37:26.295 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:37:26.296 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:37:26.296 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:37:26.296 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:37:26.296 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:37:26.297 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:37:26.297 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:37:26.297 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:37:26.297 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:37:27.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:26 gibba023 bash[30844]: cephadm 2021-03-10T20:37:25.670905+0000 mgr.gibba044.wflcwh (mgr.34466) 1579 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:37:27.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:26 gibba023 bash[30844]: audit 2021-03-10T20:37:25.806440+0000 mgr.gibba044.wflcwh (mgr.34466) 1580 : audit [DBG] from='client.45120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:37:27.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:26 gibba023 bash[30844]: audit 2021-03-10T20:37:26.293987+0000 mon.c (mon.1) 42 : audit [DBG] from='client.? 172.21.2.123:0/921870757' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:27.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:26 gibba023 bash[31815]: cephadm 2021-03-10T20:37:25.670905+0000 mgr.gibba044.wflcwh (mgr.34466) 1579 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:37:27.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:26 gibba023 bash[31815]: audit 2021-03-10T20:37:25.806440+0000 mgr.gibba044.wflcwh (mgr.34466) 1580 : audit [DBG] from='client.45120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:37:27.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:26 gibba023 bash[31815]: audit 2021-03-10T20:37:26.293987+0000 mon.c (mon.1) 42 : audit [DBG] from='client.? 172.21.2.123:0/921870757' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:27.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:26 gibba044 bash[25485]: cephadm 2021-03-10T20:37:25.670905+0000 mgr.gibba044.wflcwh (mgr.34466) 1579 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:37:27.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:26 gibba044 bash[25485]: audit 2021-03-10T20:37:25.806440+0000 mgr.gibba044.wflcwh (mgr.34466) 1580 : audit [DBG] from='client.45120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:37:27.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:26 gibba044 bash[25485]: audit 2021-03-10T20:37:26.293987+0000 mon.c (mon.1) 42 : audit [DBG] from='client.? 172.21.2.123:0/921870757' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:28.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:27 gibba023 bash[30844]: audit 2021-03-10T20:37:26.033997+0000 mgr.gibba044.wflcwh (mgr.34466) 1581 : audit [DBG] from='client.55105 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:37:28.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:27 gibba023 bash[30844]: cluster 2021-03-10T20:37:26.456994+0000 mgr.gibba044.wflcwh (mgr.34466) 1582 : cluster [DBG] pgmap v884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:28.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:27 gibba023 bash[30844]: audit 2021-03-10T20:37:27.195079+0000 mon.a (mon.0) 976 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:37:28.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:27 gibba023 bash[30844]: audit 2021-03-10T20:37:27.195870+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:37:28.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:27 gibba023 bash[30844]: audit 2021-03-10T20:37:27.196534+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T20:37:28.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:27 gibba023 bash[30844]: audit 2021-03-10T20:37:27.197329+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:37:28.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:27 gibba023 bash[30844]: audit 2021-03-10T20:37:27.198016+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:37:28.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:27 gibba023 bash[30844]: audit 2021-03-10T20:37:27.198837+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T20:37:28.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:27 gibba023 bash[31815]: audit 2021-03-10T20:37:26.033997+0000 mgr.gibba044.wflcwh (mgr.34466) 1581 : audit [DBG] from='client.55105 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:37:28.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:27 gibba023 bash[31815]: cluster 2021-03-10T20:37:26.456994+0000 mgr.gibba044.wflcwh (mgr.34466) 1582 : cluster [DBG] pgmap v884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:28.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:27 gibba023 bash[31815]: audit 2021-03-10T20:37:27.195079+0000 mon.a (mon.0) 976 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:37:28.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:27 gibba023 bash[31815]: audit 2021-03-10T20:37:27.195870+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:37:28.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:27 gibba023 bash[31815]: audit 2021-03-10T20:37:27.196534+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T20:37:28.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:27 gibba023 bash[31815]: audit 2021-03-10T20:37:27.197329+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:37:28.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:27 gibba023 bash[31815]: audit 2021-03-10T20:37:27.198016+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:37:28.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:27 gibba023 bash[31815]: audit 2021-03-10T20:37:27.198837+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T20:37:28.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:27 gibba044 bash[25485]: audit 2021-03-10T20:37:26.033997+0000 mgr.gibba044.wflcwh (mgr.34466) 1581 : audit [DBG] from='client.55105 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:37:28.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:27 gibba044 bash[25485]: cluster 2021-03-10T20:37:26.456994+0000 mgr.gibba044.wflcwh (mgr.34466) 1582 : cluster [DBG] pgmap v884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:28.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:27 gibba044 bash[25485]: audit 2021-03-10T20:37:27.195079+0000 mon.a (mon.0) 976 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:37:28.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:27 gibba044 bash[25485]: audit 2021-03-10T20:37:27.195870+0000 mon.a (mon.0) 977 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:37:28.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:27 gibba044 bash[25485]: audit 2021-03-10T20:37:27.196534+0000 mon.a (mon.0) 978 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T20:37:28.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:27 gibba044 bash[25485]: audit 2021-03-10T20:37:27.197329+0000 mon.a (mon.0) 979 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:37:28.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:27 gibba044 bash[25485]: audit 2021-03-10T20:37:27.198016+0000 mon.a (mon.0) 980 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:37:28.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:27 gibba044 bash[25485]: audit 2021-03-10T20:37:27.198837+0000 mon.a (mon.0) 981 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T20:37:30.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:29 gibba023 bash[30844]: cluster 2021-03-10T20:37:28.458690+0000 mgr.gibba044.wflcwh (mgr.34466) 1583 : cluster [DBG] pgmap v885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:30.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:29 gibba023 bash[31815]: cluster 2021-03-10T20:37:28.458690+0000 mgr.gibba044.wflcwh (mgr.34466) 1583 : cluster [DBG] pgmap v885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:30.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:29 gibba044 bash[25485]: cluster 2021-03-10T20:37:28.458690+0000 mgr.gibba044.wflcwh (mgr.34466) 1583 : cluster [DBG] pgmap v885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:32.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:31 gibba023 bash[30844]: cluster 2021-03-10T20:37:30.460281+0000 mgr.gibba044.wflcwh (mgr.34466) 1584 : cluster [DBG] pgmap v886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:32.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:31 gibba023 bash[31815]: cluster 2021-03-10T20:37:30.460281+0000 mgr.gibba044.wflcwh (mgr.34466) 1584 : cluster [DBG] pgmap v886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:32.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:31 gibba044 bash[25485]: cluster 2021-03-10T20:37:30.460281+0000 mgr.gibba044.wflcwh (mgr.34466) 1584 : cluster [DBG] pgmap v886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:34.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:33 gibba023 bash[30844]: cluster 2021-03-10T20:37:32.461922+0000 mgr.gibba044.wflcwh (mgr.34466) 1585 : cluster [DBG] pgmap v887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:34.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:33 gibba023 bash[31815]: cluster 2021-03-10T20:37:32.461922+0000 mgr.gibba044.wflcwh (mgr.34466) 1585 : cluster [DBG] pgmap v887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:34.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:33 gibba044 bash[25485]: cluster 2021-03-10T20:37:32.461922+0000 mgr.gibba044.wflcwh (mgr.34466) 1585 : cluster [DBG] pgmap v887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:36.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:35 gibba023 bash[30844]: cluster 2021-03-10T20:37:34.463403+0000 mgr.gibba044.wflcwh (mgr.34466) 1586 : cluster [DBG] pgmap v888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:36.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:35 gibba023 bash[31815]: cluster 2021-03-10T20:37:34.463403+0000 mgr.gibba044.wflcwh (mgr.34466) 1586 : cluster [DBG] pgmap v888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:36.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:35 gibba044 bash[25485]: cluster 2021-03-10T20:37:34.463403+0000 mgr.gibba044.wflcwh (mgr.34466) 1586 : cluster [DBG] pgmap v888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:38.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:37 gibba023 bash[30844]: cluster 2021-03-10T20:37:36.464757+0000 mgr.gibba044.wflcwh (mgr.34466) 1587 : cluster [DBG] pgmap v889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:38.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:37 gibba023 bash[31815]: cluster 2021-03-10T20:37:36.464757+0000 mgr.gibba044.wflcwh (mgr.34466) 1587 : cluster [DBG] pgmap v889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:38.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:37 gibba044 bash[25485]: cluster 2021-03-10T20:37:36.464757+0000 mgr.gibba044.wflcwh (mgr.34466) 1587 : cluster [DBG] pgmap v889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:40.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:39 gibba023 bash[30844]: cluster 2021-03-10T20:37:38.466124+0000 mgr.gibba044.wflcwh (mgr.34466) 1588 : cluster [DBG] pgmap v890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:40.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:39 gibba023 bash[31815]: cluster 2021-03-10T20:37:38.466124+0000 mgr.gibba044.wflcwh (mgr.34466) 1588 : cluster [DBG] pgmap v890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:40.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:39 gibba044 bash[25485]: cluster 2021-03-10T20:37:38.466124+0000 mgr.gibba044.wflcwh (mgr.34466) 1588 : cluster [DBG] pgmap v890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:42.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:41 gibba023 bash[30844]: cluster 2021-03-10T20:37:40.467690+0000 mgr.gibba044.wflcwh (mgr.34466) 1589 : cluster [DBG] pgmap v891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:42.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:41 gibba023 bash[30844]: cephadm 2021-03-10T20:37:40.686987+0000 mgr.gibba044.wflcwh (mgr.34466) 1590 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:37:42.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:41 gibba023 bash[31815]: cluster 2021-03-10T20:37:40.467690+0000 mgr.gibba044.wflcwh (mgr.34466) 1589 : cluster [DBG] pgmap v891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:42.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:41 gibba023 bash[31815]: cephadm 2021-03-10T20:37:40.686987+0000 mgr.gibba044.wflcwh (mgr.34466) 1590 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:37:42.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:41 gibba044 bash[25485]: cluster 2021-03-10T20:37:40.467690+0000 mgr.gibba044.wflcwh (mgr.34466) 1589 : cluster [DBG] pgmap v891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:42.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:41 gibba044 bash[25485]: cephadm 2021-03-10T20:37:40.686987+0000 mgr.gibba044.wflcwh (mgr.34466) 1590 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:37:44.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:43 gibba023 bash[30844]: cluster 2021-03-10T20:37:42.468980+0000 mgr.gibba044.wflcwh (mgr.34466) 1591 : cluster [DBG] pgmap v892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:44.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:43 gibba023 bash[31815]: cluster 2021-03-10T20:37:42.468980+0000 mgr.gibba044.wflcwh (mgr.34466) 1591 : cluster [DBG] pgmap v892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:44.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:43 gibba044 bash[25485]: cluster 2021-03-10T20:37:42.468980+0000 mgr.gibba044.wflcwh (mgr.34466) 1591 : cluster [DBG] pgmap v892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:46.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:45 gibba023 bash[30844]: cluster 2021-03-10T20:37:44.470723+0000 mgr.gibba044.wflcwh (mgr.34466) 1592 : cluster [DBG] pgmap v893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:46.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:45 gibba023 bash[31815]: cluster 2021-03-10T20:37:44.470723+0000 mgr.gibba044.wflcwh (mgr.34466) 1592 : cluster [DBG] pgmap v893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:46.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:45 gibba044 bash[25485]: cluster 2021-03-10T20:37:44.470723+0000 mgr.gibba044.wflcwh (mgr.34466) 1592 : cluster [DBG] pgmap v893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:48.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:47 gibba023 bash[30844]: cluster 2021-03-10T20:37:46.472116+0000 mgr.gibba044.wflcwh (mgr.34466) 1593 : cluster [DBG] pgmap v894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:48.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:47 gibba023 bash[31815]: cluster 2021-03-10T20:37:46.472116+0000 mgr.gibba044.wflcwh (mgr.34466) 1593 : cluster [DBG] pgmap v894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:48.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:47 gibba044 bash[25485]: cluster 2021-03-10T20:37:46.472116+0000 mgr.gibba044.wflcwh (mgr.34466) 1593 : cluster [DBG] pgmap v894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:50.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:49 gibba023 bash[30844]: cluster 2021-03-10T20:37:48.473538+0000 mgr.gibba044.wflcwh (mgr.34466) 1594 : cluster [DBG] pgmap v895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:50.237 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:49 gibba023 bash[31815]: cluster 2021-03-10T20:37:48.473538+0000 mgr.gibba044.wflcwh (mgr.34466) 1594 : cluster [DBG] pgmap v895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:50.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:49 gibba044 bash[25485]: cluster 2021-03-10T20:37:48.473538+0000 mgr.gibba044.wflcwh (mgr.34466) 1594 : cluster [DBG] pgmap v895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:52.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:51 gibba044 bash[25485]: cluster 2021-03-10T20:37:50.475082+0000 mgr.gibba044.wflcwh (mgr.34466) 1595 : cluster [DBG] pgmap v896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:52.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:51 gibba023 bash[30844]: cluster 2021-03-10T20:37:50.475082+0000 mgr.gibba044.wflcwh (mgr.34466) 1595 : cluster [DBG] pgmap v896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:52.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:51 gibba023 bash[31815]: cluster 2021-03-10T20:37:50.475082+0000 mgr.gibba044.wflcwh (mgr.34466) 1595 : cluster [DBG] pgmap v896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:54.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:53 gibba044 bash[25485]: cluster 2021-03-10T20:37:52.476475+0000 mgr.gibba044.wflcwh (mgr.34466) 1596 : cluster [DBG] pgmap v897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:54.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:53 gibba023 bash[30844]: cluster 2021-03-10T20:37:52.476475+0000 mgr.gibba044.wflcwh (mgr.34466) 1596 : cluster [DBG] pgmap v897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:54.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:53 gibba023 bash[31815]: cluster 2021-03-10T20:37:52.476475+0000 mgr.gibba044.wflcwh (mgr.34466) 1596 : cluster [DBG] pgmap v897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:55.999 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:55 gibba044 bash[25485]: cluster 2021-03-10T20:37:54.478060+0000 mgr.gibba044.wflcwh (mgr.34466) 1597 : cluster [DBG] pgmap v898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:56.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:55 gibba023 bash[30844]: cluster 2021-03-10T20:37:54.478060+0000 mgr.gibba044.wflcwh (mgr.34466) 1597 : cluster [DBG] pgmap v898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:56.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:55 gibba023 bash[31815]: cluster 2021-03-10T20:37:54.478060+0000 mgr.gibba044.wflcwh (mgr.34466) 1597 : cluster [DBG] pgmap v898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:56.538 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:37:56.764 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:37:56.765 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (29m) 4m ago 34m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:37:56.765 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (34m) 3m ago 34m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:37:56.765 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (29m) 3m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:37:56.765 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (29m) 3m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:37:56.766 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (28m) 4m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:37:56.766 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (28m) 4m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:37:56.766 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (28m) 3m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:37:56.766 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (28m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:37:56.767 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (34m) 4m ago 34m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:37:56.767 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (34m) 3m ago 34m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:37:56.767 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (27m) 4m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:37:56.767 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (26m) 4m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:37:56.767 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (26m) 4m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:37:56.768 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (26m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:37:56.768 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (25m) 3m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:37:56.768 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (25m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:37:56.768 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (24m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:37:56.769 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (24m) 3m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:37:56.769 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (34m) 3m ago 34m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:37:56.769 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 4m ago 32m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:37:56.769 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 3m ago 32m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:37:57.016 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:37:57.016 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:37:57.017 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:37:57.017 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:37:57.017 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:37:57.017 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:37:57.018 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:37:57.018 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:37:57.018 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:37:57.018 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:37:57.019 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:37:57.019 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:37:57.019 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:37:57.019 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:37:57.019 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:37:57.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:56 gibba044 bash[25485]: cephadm 2021-03-10T20:37:55.703104+0000 mgr.gibba044.wflcwh (mgr.34466) 1598 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:37:57.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:56 gibba023 bash[30844]: cephadm 2021-03-10T20:37:55.703104+0000 mgr.gibba044.wflcwh (mgr.34466) 1598 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:37:57.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:56 gibba023 bash[31815]: cephadm 2021-03-10T20:37:55.703104+0000 mgr.gibba044.wflcwh (mgr.34466) 1598 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:37:58.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:57 gibba044 bash[25485]: cluster 2021-03-10T20:37:56.479681+0000 mgr.gibba044.wflcwh (mgr.34466) 1599 : cluster [DBG] pgmap v899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:58.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:57 gibba044 bash[25485]: audit 2021-03-10T20:37:56.530659+0000 mgr.gibba044.wflcwh (mgr.34466) 1600 : audit [DBG] from='client.45138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:37:58.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:57 gibba044 bash[25485]: audit 2021-03-10T20:37:56.754198+0000 mgr.gibba044.wflcwh (mgr.34466) 1601 : audit [DBG] from='client.45144 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:37:58.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:57 gibba044 bash[25485]: audit 2021-03-10T20:37:57.016443+0000 mon.a (mon.0) 982 : audit [DBG] from='client.? 172.21.2.123:0/2570680483' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:58.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:57 gibba023 bash[30844]: cluster 2021-03-10T20:37:56.479681+0000 mgr.gibba044.wflcwh (mgr.34466) 1599 : cluster [DBG] pgmap v899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:58.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:57 gibba023 bash[30844]: audit 2021-03-10T20:37:56.530659+0000 mgr.gibba044.wflcwh (mgr.34466) 1600 : audit [DBG] from='client.45138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:37:58.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:57 gibba023 bash[30844]: audit 2021-03-10T20:37:56.754198+0000 mgr.gibba044.wflcwh (mgr.34466) 1601 : audit [DBG] from='client.45144 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:37:58.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:57 gibba023 bash[30844]: audit 2021-03-10T20:37:57.016443+0000 mon.a (mon.0) 982 : audit [DBG] from='client.? 172.21.2.123:0/2570680483' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:37:58.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:57 gibba023 bash[31815]: cluster 2021-03-10T20:37:56.479681+0000 mgr.gibba044.wflcwh (mgr.34466) 1599 : cluster [DBG] pgmap v899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:37:58.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:57 gibba023 bash[31815]: audit 2021-03-10T20:37:56.530659+0000 mgr.gibba044.wflcwh (mgr.34466) 1600 : audit [DBG] from='client.45138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:37:58.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:57 gibba023 bash[31815]: audit 2021-03-10T20:37:56.754198+0000 mgr.gibba044.wflcwh (mgr.34466) 1601 : audit [DBG] from='client.45144 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:37:58.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:57 gibba023 bash[31815]: audit 2021-03-10T20:37:57.016443+0000 mon.a (mon.0) 982 : audit [DBG] from='client.? 172.21.2.123:0/2570680483' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:00.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:37:59 gibba044 bash[25485]: cluster 2021-03-10T20:37:58.481335+0000 mgr.gibba044.wflcwh (mgr.34466) 1602 : cluster [DBG] pgmap v900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:00.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:37:59 gibba023 bash[30844]: cluster 2021-03-10T20:37:58.481335+0000 mgr.gibba044.wflcwh (mgr.34466) 1602 : cluster [DBG] pgmap v900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:00.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:37:59 gibba023 bash[31815]: cluster 2021-03-10T20:37:58.481335+0000 mgr.gibba044.wflcwh (mgr.34466) 1602 : cluster [DBG] pgmap v900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:02.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:01 gibba044 bash[25485]: cluster 2021-03-10T20:38:00.483003+0000 mgr.gibba044.wflcwh (mgr.34466) 1603 : cluster [DBG] pgmap v901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:02.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:01 gibba023 bash[30844]: cluster 2021-03-10T20:38:00.483003+0000 mgr.gibba044.wflcwh (mgr.34466) 1603 : cluster [DBG] pgmap v901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:02.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:01 gibba023 bash[31815]: cluster 2021-03-10T20:38:00.483003+0000 mgr.gibba044.wflcwh (mgr.34466) 1603 : cluster [DBG] pgmap v901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:04.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:03 gibba044 bash[25485]: cluster 2021-03-10T20:38:02.484557+0000 mgr.gibba044.wflcwh (mgr.34466) 1604 : cluster [DBG] pgmap v902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:04.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:03 gibba023 bash[30844]: cluster 2021-03-10T20:38:02.484557+0000 mgr.gibba044.wflcwh (mgr.34466) 1604 : cluster [DBG] pgmap v902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:04.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:03 gibba023 bash[31815]: cluster 2021-03-10T20:38:02.484557+0000 mgr.gibba044.wflcwh (mgr.34466) 1604 : cluster [DBG] pgmap v902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:06.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:05 gibba044 bash[25485]: cluster 2021-03-10T20:38:04.486173+0000 mgr.gibba044.wflcwh (mgr.34466) 1605 : cluster [DBG] pgmap v903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:06.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:05 gibba023 bash[30844]: cluster 2021-03-10T20:38:04.486173+0000 mgr.gibba044.wflcwh (mgr.34466) 1605 : cluster [DBG] pgmap v903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:06.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:05 gibba023 bash[31815]: cluster 2021-03-10T20:38:04.486173+0000 mgr.gibba044.wflcwh (mgr.34466) 1605 : cluster [DBG] pgmap v903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:08.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:07 gibba044 bash[25485]: cluster 2021-03-10T20:38:06.487777+0000 mgr.gibba044.wflcwh (mgr.34466) 1606 : cluster [DBG] pgmap v904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:08.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:07 gibba023 bash[30844]: cluster 2021-03-10T20:38:06.487777+0000 mgr.gibba044.wflcwh (mgr.34466) 1606 : cluster [DBG] pgmap v904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:08.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:07 gibba023 bash[31815]: cluster 2021-03-10T20:38:06.487777+0000 mgr.gibba044.wflcwh (mgr.34466) 1606 : cluster [DBG] pgmap v904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:10.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:10 gibba023 bash[30844]: cluster 2021-03-10T20:38:08.489408+0000 mgr.gibba044.wflcwh (mgr.34466) 1607 : cluster [DBG] pgmap v905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:10.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:10 gibba023 bash[31815]: cluster 2021-03-10T20:38:08.489408+0000 mgr.gibba044.wflcwh (mgr.34466) 1607 : cluster [DBG] pgmap v905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:10.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:10 gibba044 bash[25485]: cluster 2021-03-10T20:38:08.489408+0000 mgr.gibba044.wflcwh (mgr.34466) 1607 : cluster [DBG] pgmap v905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:12.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:11 gibba044 bash[25485]: cluster 2021-03-10T20:38:10.491036+0000 mgr.gibba044.wflcwh (mgr.34466) 1608 : cluster [DBG] pgmap v906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:12.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:11 gibba044 bash[25485]: cephadm 2021-03-10T20:38:10.719973+0000 mgr.gibba044.wflcwh (mgr.34466) 1609 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:38:12.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:11 gibba044 bash[25485]: cephadm 2021-03-10T20:38:10.721507+0000 mgr.gibba044.wflcwh (mgr.34466) 1610 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:38:12.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:11 gibba044 bash[25485]: audit 2021-03-10T20:38:10.940701+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:38:12.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:11 gibba044 bash[25485]: audit 2021-03-10T20:38:10.944568+0000 mon.a (mon.0) 984 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:38:12.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:11 gibba044 bash[25485]: cephadm 2021-03-10T20:38:10.945173+0000 mgr.gibba044.wflcwh (mgr.34466) 1611 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:38:12.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:11 gibba044 bash[25485]: audit 2021-03-10T20:38:10.946517+0000 mon.a (mon.0) 985 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:12.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:11 gibba044 bash[25485]: cephadm 2021-03-10T20:38:10.947578+0000 mgr.gibba044.wflcwh (mgr.34466) 1612 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:38:12.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:11 gibba044 bash[25485]: audit 2021-03-10T20:38:10.948040+0000 mon.a (mon.0) 986 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:12.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:11 gibba044 bash[25485]: cephadm 2021-03-10T20:38:10.949199+0000 mgr.gibba044.wflcwh (mgr.34466) 1613 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:38:12.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:11 gibba044 bash[25485]: cephadm 2021-03-10T20:38:10.949234+0000 mgr.gibba044.wflcwh (mgr.34466) 1614 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:38:12.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:11 gibba044 bash[25485]: audit 2021-03-10T20:38:10.949519+0000 mon.a (mon.0) 987 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:12.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:11 gibba044 bash[25485]: cephadm 2021-03-10T20:38:10.950691+0000 mgr.gibba044.wflcwh (mgr.34466) 1615 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:38:12.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:11 gibba044 bash[25485]: cephadm 2021-03-10T20:38:10.950728+0000 mgr.gibba044.wflcwh (mgr.34466) 1616 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:38:12.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:11 gibba044 bash[25485]: cephadm 2021-03-10T20:38:10.952132+0000 mgr.gibba044.wflcwh (mgr.34466) 1617 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:38:12.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:11 gibba044 bash[25485]: audit 2021-03-10T20:38:10.952853+0000 mon.a (mon.0) 988 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:12.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:11 gibba044 bash[25485]: cephadm 2021-03-10T20:38:10.953904+0000 mgr.gibba044.wflcwh (mgr.34466) 1618 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:38:12.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:11 gibba044 bash[25485]: cephadm 2021-03-10T20:38:10.953941+0000 mgr.gibba044.wflcwh (mgr.34466) 1619 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:38:12.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:11 gibba044 bash[25485]: audit 2021-03-10T20:38:10.954637+0000 mon.a (mon.0) 989 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:12.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:11 gibba044 bash[25485]: cephadm 2021-03-10T20:38:10.955519+0000 mgr.gibba044.wflcwh (mgr.34466) 1620 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:38:12.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:11 gibba044 bash[25485]: cephadm 2021-03-10T20:38:10.955890+0000 mgr.gibba044.wflcwh (mgr.34466) 1621 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:38:12.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:11 gibba044 bash[25485]: cephadm 2021-03-10T20:38:10.957477+0000 mgr.gibba044.wflcwh (mgr.34466) 1622 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:38:12.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:11 gibba044 bash[25485]: cephadm 2021-03-10T20:38:10.957517+0000 mgr.gibba044.wflcwh (mgr.34466) 1623 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:38:12.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:11 gibba044 bash[25485]: cephadm 2021-03-10T20:38:10.957714+0000 mgr.gibba044.wflcwh (mgr.34466) 1624 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:38:12.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[30844]: cluster 2021-03-10T20:38:10.491036+0000 mgr.gibba044.wflcwh (mgr.34466) 1608 : cluster [DBG] pgmap v906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:12.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[30844]: cephadm 2021-03-10T20:38:10.719973+0000 mgr.gibba044.wflcwh (mgr.34466) 1609 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:38:12.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[30844]: cephadm 2021-03-10T20:38:10.721507+0000 mgr.gibba044.wflcwh (mgr.34466) 1610 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:38:12.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[30844]: audit 2021-03-10T20:38:10.940701+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:38:12.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[30844]: audit 2021-03-10T20:38:10.944568+0000 mon.a (mon.0) 984 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:38:12.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[30844]: cephadm 2021-03-10T20:38:10.945173+0000 mgr.gibba044.wflcwh (mgr.34466) 1611 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:38:12.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[30844]: audit 2021-03-10T20:38:10.946517+0000 mon.a (mon.0) 985 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:12.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[30844]: cephadm 2021-03-10T20:38:10.947578+0000 mgr.gibba044.wflcwh (mgr.34466) 1612 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:38:12.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[30844]: audit 2021-03-10T20:38:10.948040+0000 mon.a (mon.0) 986 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:12.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[30844]: cephadm 2021-03-10T20:38:10.949199+0000 mgr.gibba044.wflcwh (mgr.34466) 1613 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:38:12.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[30844]: cephadm 2021-03-10T20:38:10.949234+0000 mgr.gibba044.wflcwh (mgr.34466) 1614 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:38:12.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[30844]: audit 2021-03-10T20:38:10.949519+0000 mon.a (mon.0) 987 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:12.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[30844]: cephadm 2021-03-10T20:38:10.950691+0000 mgr.gibba044.wflcwh (mgr.34466) 1615 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:38:12.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[30844]: cephadm 2021-03-10T20:38:10.950728+0000 mgr.gibba044.wflcwh (mgr.34466) 1616 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:38:12.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[30844]: cephadm 2021-03-10T20:38:10.952132+0000 mgr.gibba044.wflcwh (mgr.34466) 1617 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:38:12.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[30844]: audit 2021-03-10T20:38:10.952853+0000 mon.a (mon.0) 988 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:12.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[30844]: cephadm 2021-03-10T20:38:10.953904+0000 mgr.gibba044.wflcwh (mgr.34466) 1618 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:38:12.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[30844]: cephadm 2021-03-10T20:38:10.953941+0000 mgr.gibba044.wflcwh (mgr.34466) 1619 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:38:12.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[30844]: audit 2021-03-10T20:38:10.954637+0000 mon.a (mon.0) 989 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:12.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[30844]: cephadm 2021-03-10T20:38:10.955519+0000 mgr.gibba044.wflcwh (mgr.34466) 1620 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:38:12.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[31815]: cluster 2021-03-10T20:38:10.491036+0000 mgr.gibba044.wflcwh (mgr.34466) 1608 : cluster [DBG] pgmap v906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:12.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[31815]: cephadm 2021-03-10T20:38:10.719973+0000 mgr.gibba044.wflcwh (mgr.34466) 1609 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:38:12.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[31815]: cephadm 2021-03-10T20:38:10.721507+0000 mgr.gibba044.wflcwh (mgr.34466) 1610 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:38:12.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[31815]: audit 2021-03-10T20:38:10.940701+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:38:12.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[31815]: audit 2021-03-10T20:38:10.944568+0000 mon.a (mon.0) 984 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:38:12.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[31815]: cephadm 2021-03-10T20:38:10.945173+0000 mgr.gibba044.wflcwh (mgr.34466) 1611 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:38:12.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[31815]: audit 2021-03-10T20:38:10.946517+0000 mon.a (mon.0) 985 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:12.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[31815]: cephadm 2021-03-10T20:38:10.947578+0000 mgr.gibba044.wflcwh (mgr.34466) 1612 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:38:12.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[31815]: audit 2021-03-10T20:38:10.948040+0000 mon.a (mon.0) 986 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:12.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[31815]: cephadm 2021-03-10T20:38:10.949199+0000 mgr.gibba044.wflcwh (mgr.34466) 1613 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:38:12.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[31815]: cephadm 2021-03-10T20:38:10.949234+0000 mgr.gibba044.wflcwh (mgr.34466) 1614 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:38:12.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[31815]: audit 2021-03-10T20:38:10.949519+0000 mon.a (mon.0) 987 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:12.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[31815]: cephadm 2021-03-10T20:38:10.950691+0000 mgr.gibba044.wflcwh (mgr.34466) 1615 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:38:12.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[31815]: cephadm 2021-03-10T20:38:10.950728+0000 mgr.gibba044.wflcwh (mgr.34466) 1616 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:38:12.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[31815]: cephadm 2021-03-10T20:38:10.952132+0000 mgr.gibba044.wflcwh (mgr.34466) 1617 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:38:12.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[31815]: audit 2021-03-10T20:38:10.952853+0000 mon.a (mon.0) 988 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:12.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[31815]: cephadm 2021-03-10T20:38:10.953904+0000 mgr.gibba044.wflcwh (mgr.34466) 1618 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:38:12.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[31815]: cephadm 2021-03-10T20:38:10.953941+0000 mgr.gibba044.wflcwh (mgr.34466) 1619 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:38:12.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[31815]: audit 2021-03-10T20:38:10.954637+0000 mon.a (mon.0) 989 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:12.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[31815]: cephadm 2021-03-10T20:38:10.955519+0000 mgr.gibba044.wflcwh (mgr.34466) 1620 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:38:12.436 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[30844]: cephadm 2021-03-10T20:38:10.955890+0000 mgr.gibba044.wflcwh (mgr.34466) 1621 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:38:12.436 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[30844]: cephadm 2021-03-10T20:38:10.957477+0000 mgr.gibba044.wflcwh (mgr.34466) 1622 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:38:12.436 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[30844]: cephadm 2021-03-10T20:38:10.957517+0000 mgr.gibba044.wflcwh (mgr.34466) 1623 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:38:12.437 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[30844]: cephadm 2021-03-10T20:38:10.957714+0000 mgr.gibba044.wflcwh (mgr.34466) 1624 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:38:12.437 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[31815]: cephadm 2021-03-10T20:38:10.955890+0000 mgr.gibba044.wflcwh (mgr.34466) 1621 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:38:12.437 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[31815]: cephadm 2021-03-10T20:38:10.957477+0000 mgr.gibba044.wflcwh (mgr.34466) 1622 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:38:12.438 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[31815]: cephadm 2021-03-10T20:38:10.957517+0000 mgr.gibba044.wflcwh (mgr.34466) 1623 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:38:12.438 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:11 gibba023 bash[31815]: cephadm 2021-03-10T20:38:10.957714+0000 mgr.gibba044.wflcwh (mgr.34466) 1624 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:38:14.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:13 gibba044 bash[25485]: cluster 2021-03-10T20:38:12.492598+0000 mgr.gibba044.wflcwh (mgr.34466) 1625 : cluster [DBG] pgmap v907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:14.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:13 gibba023 bash[30844]: cluster 2021-03-10T20:38:12.492598+0000 mgr.gibba044.wflcwh (mgr.34466) 1625 : cluster [DBG] pgmap v907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:14.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:13 gibba023 bash[31815]: cluster 2021-03-10T20:38:12.492598+0000 mgr.gibba044.wflcwh (mgr.34466) 1625 : cluster [DBG] pgmap v907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:16.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:15 gibba044 bash[25485]: cluster 2021-03-10T20:38:14.494063+0000 mgr.gibba044.wflcwh (mgr.34466) 1626 : cluster [DBG] pgmap v908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:16.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:15 gibba023 bash[30844]: cluster 2021-03-10T20:38:14.494063+0000 mgr.gibba044.wflcwh (mgr.34466) 1626 : cluster [DBG] pgmap v908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:16.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:15 gibba023 bash[31815]: cluster 2021-03-10T20:38:14.494063+0000 mgr.gibba044.wflcwh (mgr.34466) 1626 : cluster [DBG] pgmap v908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:18.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:17 gibba044 bash[25485]: cluster 2021-03-10T20:38:16.495753+0000 mgr.gibba044.wflcwh (mgr.34466) 1627 : cluster [DBG] pgmap v909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:18.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:17 gibba023 bash[30844]: cluster 2021-03-10T20:38:16.495753+0000 mgr.gibba044.wflcwh (mgr.34466) 1627 : cluster [DBG] pgmap v909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:18.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:17 gibba023 bash[31815]: cluster 2021-03-10T20:38:16.495753+0000 mgr.gibba044.wflcwh (mgr.34466) 1627 : cluster [DBG] pgmap v909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:20.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:19 gibba044 bash[25485]: cluster 2021-03-10T20:38:18.497232+0000 mgr.gibba044.wflcwh (mgr.34466) 1628 : cluster [DBG] pgmap v910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:20.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:19 gibba023 bash[30844]: cluster 2021-03-10T20:38:18.497232+0000 mgr.gibba044.wflcwh (mgr.34466) 1628 : cluster [DBG] pgmap v910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:20.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:19 gibba023 bash[31815]: cluster 2021-03-10T20:38:18.497232+0000 mgr.gibba044.wflcwh (mgr.34466) 1628 : cluster [DBG] pgmap v910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:22.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:21 gibba044 bash[25485]: cluster 2021-03-10T20:38:20.498756+0000 mgr.gibba044.wflcwh (mgr.34466) 1629 : cluster [DBG] pgmap v911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:22.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:21 gibba023 bash[30844]: cluster 2021-03-10T20:38:20.498756+0000 mgr.gibba044.wflcwh (mgr.34466) 1629 : cluster [DBG] pgmap v911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:22.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:21 gibba023 bash[31815]: cluster 2021-03-10T20:38:20.498756+0000 mgr.gibba044.wflcwh (mgr.34466) 1629 : cluster [DBG] pgmap v911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:24.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:23 gibba044 bash[25485]: cluster 2021-03-10T20:38:22.500397+0000 mgr.gibba044.wflcwh (mgr.34466) 1630 : cluster [DBG] pgmap v912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:24.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:23 gibba023 bash[30844]: cluster 2021-03-10T20:38:22.500397+0000 mgr.gibba044.wflcwh (mgr.34466) 1630 : cluster [DBG] pgmap v912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:24.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:23 gibba023 bash[31815]: cluster 2021-03-10T20:38:22.500397+0000 mgr.gibba044.wflcwh (mgr.34466) 1630 : cluster [DBG] pgmap v912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:26.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:26 gibba044 bash[25485]: cluster 2021-03-10T20:38:24.501847+0000 mgr.gibba044.wflcwh (mgr.34466) 1631 : cluster [DBG] pgmap v913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:26.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:26 gibba023 bash[30844]: cluster 2021-03-10T20:38:24.501847+0000 mgr.gibba044.wflcwh (mgr.34466) 1631 : cluster [DBG] pgmap v913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:26.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:26 gibba023 bash[31815]: cluster 2021-03-10T20:38:24.501847+0000 mgr.gibba044.wflcwh (mgr.34466) 1631 : cluster [DBG] pgmap v913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:27.254 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:38:27.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:27 gibba023 bash[30844]: cephadm 2021-03-10T20:38:25.968423+0000 mgr.gibba044.wflcwh (mgr.34466) 1632 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:38:27.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:27 gibba023 bash[31815]: cephadm 2021-03-10T20:38:25.968423+0000 mgr.gibba044.wflcwh (mgr.34466) 1632 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:38:27.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:27 gibba044 bash[25485]: cephadm 2021-03-10T20:38:25.968423+0000 mgr.gibba044.wflcwh (mgr.34466) 1632 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:38:27.509 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:38:27.509 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (29m) 5m ago 35m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:38:27.509 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (34m) 4m ago 34m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:38:27.510 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (29m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:38:27.510 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (30m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:38:27.510 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (29m) 5m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:38:27.510 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (29m) 5m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:38:27.511 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (28m) 4m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:38:27.511 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (28m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:38:27.511 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (35m) 5m ago 35m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:38:27.511 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (35m) 4m ago 35m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:38:27.512 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (27m) 5m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:38:27.512 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (27m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:38:27.512 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (26m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:38:27.512 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (26m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:38:27.512 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (26m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:38:27.513 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (25m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:38:27.513 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (25m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:38:27.513 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (24m) 4m ago 35m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:38:27.513 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (34m) 4m ago 35m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:38:27.514 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 5m ago 33m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:38:27.514 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 4m ago 33m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:38:27.758 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:38:27.759 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:38:27.759 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:38:27.759 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:38:27.759 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:38:27.760 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:38:27.760 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:38:27.760 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:38:27.760 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:38:27.761 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:38:27.761 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:38:27.761 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:38:27.761 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:38:27.761 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:38:27.762 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:38:28.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:28 gibba023 bash[30844]: cluster 2021-03-10T20:38:26.503358+0000 mgr.gibba044.wflcwh (mgr.34466) 1633 : cluster [DBG] pgmap v914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:28.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:28 gibba023 bash[30844]: audit 2021-03-10T20:38:27.200597+0000 mon.a (mon.0) 990 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:38:28.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:28 gibba023 bash[30844]: audit 2021-03-10T20:38:27.200760+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:38:28.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:28 gibba023 bash[30844]: audit 2021-03-10T20:38:27.203035+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T20:38:28.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:28 gibba023 bash[30844]: audit 2021-03-10T20:38:27.203180+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:38:28.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:28 gibba023 bash[30844]: audit 2021-03-10T20:38:27.203303+0000 mon.a (mon.0) 994 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:38:28.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:28 gibba023 bash[30844]: audit 2021-03-10T20:38:27.203436+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:38:28.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:28 gibba023 bash[30844]: audit 2021-03-10T20:38:27.758823+0000 mon.c (mon.1) 43 : audit [DBG] from='client.? 172.21.2.123:0/277904579' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:28.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:28 gibba023 bash[31815]: cluster 2021-03-10T20:38:26.503358+0000 mgr.gibba044.wflcwh (mgr.34466) 1633 : cluster [DBG] pgmap v914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:28.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:28 gibba023 bash[31815]: audit 2021-03-10T20:38:27.200597+0000 mon.a (mon.0) 990 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:38:28.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:28 gibba023 bash[31815]: audit 2021-03-10T20:38:27.200760+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:38:28.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:28 gibba023 bash[31815]: audit 2021-03-10T20:38:27.203035+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T20:38:28.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:28 gibba023 bash[31815]: audit 2021-03-10T20:38:27.203180+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:38:28.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:28 gibba023 bash[31815]: audit 2021-03-10T20:38:27.203303+0000 mon.a (mon.0) 994 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:38:28.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:28 gibba023 bash[31815]: audit 2021-03-10T20:38:27.203436+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:38:28.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:28 gibba023 bash[31815]: audit 2021-03-10T20:38:27.758823+0000 mon.c (mon.1) 43 : audit [DBG] from='client.? 172.21.2.123:0/277904579' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:28.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:28 gibba044 bash[25485]: cluster 2021-03-10T20:38:26.503358+0000 mgr.gibba044.wflcwh (mgr.34466) 1633 : cluster [DBG] pgmap v914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:28.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:28 gibba044 bash[25485]: audit 2021-03-10T20:38:27.200597+0000 mon.a (mon.0) 990 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:38:28.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:28 gibba044 bash[25485]: audit 2021-03-10T20:38:27.200760+0000 mon.a (mon.0) 991 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:38:28.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:28 gibba044 bash[25485]: audit 2021-03-10T20:38:27.203035+0000 mon.a (mon.0) 992 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T20:38:28.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:28 gibba044 bash[25485]: audit 2021-03-10T20:38:27.203180+0000 mon.a (mon.0) 993 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:38:28.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:28 gibba044 bash[25485]: audit 2021-03-10T20:38:27.203303+0000 mon.a (mon.0) 994 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:38:28.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:28 gibba044 bash[25485]: audit 2021-03-10T20:38:27.203436+0000 mon.a (mon.0) 995 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:38:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:28 gibba044 bash[25485]: audit 2021-03-10T20:38:27.758823+0000 mon.c (mon.1) 43 : audit [DBG] from='client.? 172.21.2.123:0/277904579' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:29.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:29 gibba023 bash[30844]: audit 2021-03-10T20:38:27.247579+0000 mgr.gibba044.wflcwh (mgr.34466) 1634 : audit [DBG] from='client.55135 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:38:29.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:29 gibba023 bash[30844]: audit 2021-03-10T20:38:27.468971+0000 mgr.gibba044.wflcwh (mgr.34466) 1635 : audit [DBG] from='client.55141 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:38:29.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:29 gibba023 bash[31815]: audit 2021-03-10T20:38:27.247579+0000 mgr.gibba044.wflcwh (mgr.34466) 1634 : audit [DBG] from='client.55135 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:38:29.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:29 gibba023 bash[31815]: audit 2021-03-10T20:38:27.468971+0000 mgr.gibba044.wflcwh (mgr.34466) 1635 : audit [DBG] from='client.55141 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:38:29.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:29 gibba044 bash[25485]: audit 2021-03-10T20:38:27.247579+0000 mgr.gibba044.wflcwh (mgr.34466) 1634 : audit [DBG] from='client.55135 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:38:29.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:29 gibba044 bash[25485]: audit 2021-03-10T20:38:27.468971+0000 mgr.gibba044.wflcwh (mgr.34466) 1635 : audit [DBG] from='client.55141 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:38:30.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:30 gibba023 bash[30844]: cluster 2021-03-10T20:38:28.504945+0000 mgr.gibba044.wflcwh (mgr.34466) 1636 : cluster [DBG] pgmap v915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:30.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:30 gibba023 bash[31815]: cluster 2021-03-10T20:38:28.504945+0000 mgr.gibba044.wflcwh (mgr.34466) 1636 : cluster [DBG] pgmap v915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:30.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:30 gibba044 bash[25485]: cluster 2021-03-10T20:38:28.504945+0000 mgr.gibba044.wflcwh (mgr.34466) 1636 : cluster [DBG] pgmap v915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:31.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:31 gibba023 bash[30844]: cluster 2021-03-10T20:38:30.506479+0000 mgr.gibba044.wflcwh (mgr.34466) 1637 : cluster [DBG] pgmap v916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:31.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:31 gibba023 bash[31815]: cluster 2021-03-10T20:38:30.506479+0000 mgr.gibba044.wflcwh (mgr.34466) 1637 : cluster [DBG] pgmap v916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:31.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:31 gibba044 bash[25485]: cluster 2021-03-10T20:38:30.506479+0000 mgr.gibba044.wflcwh (mgr.34466) 1637 : cluster [DBG] pgmap v916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:34.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:33 gibba023 bash[30844]: cluster 2021-03-10T20:38:32.508198+0000 mgr.gibba044.wflcwh (mgr.34466) 1638 : cluster [DBG] pgmap v917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:34.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:33 gibba023 bash[31815]: cluster 2021-03-10T20:38:32.508198+0000 mgr.gibba044.wflcwh (mgr.34466) 1638 : cluster [DBG] pgmap v917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:34.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:33 gibba044 bash[25485]: cluster 2021-03-10T20:38:32.508198+0000 mgr.gibba044.wflcwh (mgr.34466) 1638 : cluster [DBG] pgmap v917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:36.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:35 gibba023 bash[30844]: cluster 2021-03-10T20:38:34.509664+0000 mgr.gibba044.wflcwh (mgr.34466) 1639 : cluster [DBG] pgmap v918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:36.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:35 gibba023 bash[31815]: cluster 2021-03-10T20:38:34.509664+0000 mgr.gibba044.wflcwh (mgr.34466) 1639 : cluster [DBG] pgmap v918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:36.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:35 gibba044 bash[25485]: cluster 2021-03-10T20:38:34.509664+0000 mgr.gibba044.wflcwh (mgr.34466) 1639 : cluster [DBG] pgmap v918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:38.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:37 gibba023 bash[30844]: cluster 2021-03-10T20:38:36.511138+0000 mgr.gibba044.wflcwh (mgr.34466) 1640 : cluster [DBG] pgmap v919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:38.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:37 gibba023 bash[31815]: cluster 2021-03-10T20:38:36.511138+0000 mgr.gibba044.wflcwh (mgr.34466) 1640 : cluster [DBG] pgmap v919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:38.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:37 gibba044 bash[25485]: cluster 2021-03-10T20:38:36.511138+0000 mgr.gibba044.wflcwh (mgr.34466) 1640 : cluster [DBG] pgmap v919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:40.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:39 gibba023 bash[30844]: cluster 2021-03-10T20:38:38.512752+0000 mgr.gibba044.wflcwh (mgr.34466) 1641 : cluster [DBG] pgmap v920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:40.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:39 gibba023 bash[31815]: cluster 2021-03-10T20:38:38.512752+0000 mgr.gibba044.wflcwh (mgr.34466) 1641 : cluster [DBG] pgmap v920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:40.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:39 gibba044 bash[25485]: cluster 2021-03-10T20:38:38.512752+0000 mgr.gibba044.wflcwh (mgr.34466) 1641 : cluster [DBG] pgmap v920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:42.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:41 gibba023 bash[30844]: cluster 2021-03-10T20:38:40.514485+0000 mgr.gibba044.wflcwh (mgr.34466) 1642 : cluster [DBG] pgmap v921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:42.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:41 gibba023 bash[30844]: cephadm 2021-03-10T20:38:40.980592+0000 mgr.gibba044.wflcwh (mgr.34466) 1643 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:38:42.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:41 gibba023 bash[31815]: cluster 2021-03-10T20:38:40.514485+0000 mgr.gibba044.wflcwh (mgr.34466) 1642 : cluster [DBG] pgmap v921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:42.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:41 gibba023 bash[31815]: cephadm 2021-03-10T20:38:40.980592+0000 mgr.gibba044.wflcwh (mgr.34466) 1643 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:38:42.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:41 gibba044 bash[25485]: cluster 2021-03-10T20:38:40.514485+0000 mgr.gibba044.wflcwh (mgr.34466) 1642 : cluster [DBG] pgmap v921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:42.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:41 gibba044 bash[25485]: cephadm 2021-03-10T20:38:40.980592+0000 mgr.gibba044.wflcwh (mgr.34466) 1643 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:38:44.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:43 gibba023 bash[30844]: cluster 2021-03-10T20:38:42.516187+0000 mgr.gibba044.wflcwh (mgr.34466) 1644 : cluster [DBG] pgmap v922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:44.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:43 gibba023 bash[31815]: cluster 2021-03-10T20:38:42.516187+0000 mgr.gibba044.wflcwh (mgr.34466) 1644 : cluster [DBG] pgmap v922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:44.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:43 gibba044 bash[25485]: cluster 2021-03-10T20:38:42.516187+0000 mgr.gibba044.wflcwh (mgr.34466) 1644 : cluster [DBG] pgmap v922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:46.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:45 gibba023 bash[30844]: cluster 2021-03-10T20:38:44.517652+0000 mgr.gibba044.wflcwh (mgr.34466) 1645 : cluster [DBG] pgmap v923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:46.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:45 gibba023 bash[31815]: cluster 2021-03-10T20:38:44.517652+0000 mgr.gibba044.wflcwh (mgr.34466) 1645 : cluster [DBG] pgmap v923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:46.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:45 gibba044 bash[25485]: cluster 2021-03-10T20:38:44.517652+0000 mgr.gibba044.wflcwh (mgr.34466) 1645 : cluster [DBG] pgmap v923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:48.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:47 gibba023 bash[30844]: cluster 2021-03-10T20:38:46.519289+0000 mgr.gibba044.wflcwh (mgr.34466) 1646 : cluster [DBG] pgmap v924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:48.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:47 gibba023 bash[31815]: cluster 2021-03-10T20:38:46.519289+0000 mgr.gibba044.wflcwh (mgr.34466) 1646 : cluster [DBG] pgmap v924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:48.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:47 gibba044 bash[25485]: cluster 2021-03-10T20:38:46.519289+0000 mgr.gibba044.wflcwh (mgr.34466) 1646 : cluster [DBG] pgmap v924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:50.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:49 gibba023 bash[30844]: cluster 2021-03-10T20:38:48.520944+0000 mgr.gibba044.wflcwh (mgr.34466) 1647 : cluster [DBG] pgmap v925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:50.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:49 gibba023 bash[31815]: cluster 2021-03-10T20:38:48.520944+0000 mgr.gibba044.wflcwh (mgr.34466) 1647 : cluster [DBG] pgmap v925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:50.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:49 gibba044 bash[25485]: cluster 2021-03-10T20:38:48.520944+0000 mgr.gibba044.wflcwh (mgr.34466) 1647 : cluster [DBG] pgmap v925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:52.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:51 gibba023 bash[30844]: cluster 2021-03-10T20:38:50.522373+0000 mgr.gibba044.wflcwh (mgr.34466) 1648 : cluster [DBG] pgmap v926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:52.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:51 gibba023 bash[31815]: cluster 2021-03-10T20:38:50.522373+0000 mgr.gibba044.wflcwh (mgr.34466) 1648 : cluster [DBG] pgmap v926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:52.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:51 gibba044 bash[25485]: cluster 2021-03-10T20:38:50.522373+0000 mgr.gibba044.wflcwh (mgr.34466) 1648 : cluster [DBG] pgmap v926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:54.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:53 gibba023 bash[30844]: cluster 2021-03-10T20:38:52.524093+0000 mgr.gibba044.wflcwh (mgr.34466) 1649 : cluster [DBG] pgmap v927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:54.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:53 gibba023 bash[31815]: cluster 2021-03-10T20:38:52.524093+0000 mgr.gibba044.wflcwh (mgr.34466) 1649 : cluster [DBG] pgmap v927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:54.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:53 gibba044 bash[25485]: cluster 2021-03-10T20:38:52.524093+0000 mgr.gibba044.wflcwh (mgr.34466) 1649 : cluster [DBG] pgmap v927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:56.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:55 gibba023 bash[30844]: cluster 2021-03-10T20:38:54.525682+0000 mgr.gibba044.wflcwh (mgr.34466) 1650 : cluster [DBG] pgmap v928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:56.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:55 gibba023 bash[31815]: cluster 2021-03-10T20:38:54.525682+0000 mgr.gibba044.wflcwh (mgr.34466) 1650 : cluster [DBG] pgmap v928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:56.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:55 gibba044 bash[25485]: cluster 2021-03-10T20:38:54.525682+0000 mgr.gibba044.wflcwh (mgr.34466) 1650 : cluster [DBG] pgmap v928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:57.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:56 gibba023 bash[30844]: cephadm 2021-03-10T20:38:55.990013+0000 mgr.gibba044.wflcwh (mgr.34466) 1651 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:38:57.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:56 gibba023 bash[31815]: cephadm 2021-03-10T20:38:55.990013+0000 mgr.gibba044.wflcwh (mgr.34466) 1651 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:38:57.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:56 gibba044 bash[25485]: cephadm 2021-03-10T20:38:55.990013+0000 mgr.gibba044.wflcwh (mgr.34466) 1651 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:38:58.005 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:38:58.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:57 gibba023 bash[30844]: cluster 2021-03-10T20:38:56.527321+0000 mgr.gibba044.wflcwh (mgr.34466) 1652 : cluster [DBG] pgmap v929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:58.177 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:57 gibba023 bash[31815]: cluster 2021-03-10T20:38:56.527321+0000 mgr.gibba044.wflcwh (mgr.34466) 1652 : cluster [DBG] pgmap v929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:58.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:57 gibba044 bash[25485]: cluster 2021-03-10T20:38:56.527321+0000 mgr.gibba044.wflcwh (mgr.34466) 1652 : cluster [DBG] pgmap v929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:38:58.262 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:38:58.263 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (30m) 5m ago 35m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:38:58.263 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (35m) 4m ago 35m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:38:58.263 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (30m) 4m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:38:58.263 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (30m) 4m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:38:58.264 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (29m) 5m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:38:58.264 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (29m) 5m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:38:58.264 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (29m) 4m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:38:58.264 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (29m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:38:58.264 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (35m) 5m ago 35m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:38:58.265 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (35m) 4m ago 35m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:38:58.265 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (28m) 5m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:38:58.265 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (27m) 5m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:38:58.265 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (27m) 5m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:38:58.266 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (27m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:38:58.266 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (26m) 4m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:38:58.266 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (26m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:38:58.266 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (25m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:38:58.266 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (25m) 4m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:38:58.267 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (35m) 4m ago 35m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:38:58.267 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 5m ago 33m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:38:58.267 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 4m ago 33m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:38:58.519 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:38:58.520 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:38:58.520 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:38:58.520 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:38:58.521 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:38:58.521 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:38:58.521 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:38:58.521 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:38:58.521 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:38:58.522 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:38:58.522 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:38:58.522 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:38:58.522 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:38:58.523 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:38:58.523 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:38:59.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:58 gibba023 bash[30844]: audit 2021-03-10T20:38:57.997776+0000 mgr.gibba044.wflcwh (mgr.34466) 1653 : audit [DBG] from='client.45174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:38:59.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:58 gibba023 bash[30844]: audit 2021-03-10T20:38:58.519765+0000 mon.a (mon.0) 996 : audit [DBG] from='client.? 172.21.2.123:0/1451065683' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:59.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:58 gibba023 bash[31815]: audit 2021-03-10T20:38:57.997776+0000 mgr.gibba044.wflcwh (mgr.34466) 1653 : audit [DBG] from='client.45174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:38:59.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:58 gibba023 bash[31815]: audit 2021-03-10T20:38:58.519765+0000 mon.a (mon.0) 996 : audit [DBG] from='client.? 172.21.2.123:0/1451065683' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:38:59.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:58 gibba044 bash[25485]: audit 2021-03-10T20:38:57.997776+0000 mgr.gibba044.wflcwh (mgr.34466) 1653 : audit [DBG] from='client.45174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:38:59.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:58 gibba044 bash[25485]: audit 2021-03-10T20:38:58.519765+0000 mon.a (mon.0) 996 : audit [DBG] from='client.? 172.21.2.123:0/1451065683' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:00.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:59 gibba023 bash[30844]: audit 2021-03-10T20:38:58.222175+0000 mgr.gibba044.wflcwh (mgr.34466) 1654 : audit [DBG] from='client.45180 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:39:00.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:38:59 gibba023 bash[30844]: cluster 2021-03-10T20:38:58.528897+0000 mgr.gibba044.wflcwh (mgr.34466) 1655 : cluster [DBG] pgmap v930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:00.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:59 gibba023 bash[31815]: audit 2021-03-10T20:38:58.222175+0000 mgr.gibba044.wflcwh (mgr.34466) 1654 : audit [DBG] from='client.45180 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:39:00.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:38:59 gibba023 bash[31815]: cluster 2021-03-10T20:38:58.528897+0000 mgr.gibba044.wflcwh (mgr.34466) 1655 : cluster [DBG] pgmap v930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:00.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:59 gibba044 bash[25485]: audit 2021-03-10T20:38:58.222175+0000 mgr.gibba044.wflcwh (mgr.34466) 1654 : audit [DBG] from='client.45180 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:39:00.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:38:59 gibba044 bash[25485]: cluster 2021-03-10T20:38:58.528897+0000 mgr.gibba044.wflcwh (mgr.34466) 1655 : cluster [DBG] pgmap v930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:02.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:01 gibba044 bash[25485]: cluster 2021-03-10T20:39:00.530711+0000 mgr.gibba044.wflcwh (mgr.34466) 1656 : cluster [DBG] pgmap v931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:02.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:01 gibba023 bash[30844]: cluster 2021-03-10T20:39:00.530711+0000 mgr.gibba044.wflcwh (mgr.34466) 1656 : cluster [DBG] pgmap v931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:02.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:01 gibba023 bash[31815]: cluster 2021-03-10T20:39:00.530711+0000 mgr.gibba044.wflcwh (mgr.34466) 1656 : cluster [DBG] pgmap v931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:04.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:03 gibba044 bash[25485]: cluster 2021-03-10T20:39:02.532351+0000 mgr.gibba044.wflcwh (mgr.34466) 1657 : cluster [DBG] pgmap v932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:04.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:03 gibba023 bash[30844]: cluster 2021-03-10T20:39:02.532351+0000 mgr.gibba044.wflcwh (mgr.34466) 1657 : cluster [DBG] pgmap v932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:04.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:03 gibba023 bash[31815]: cluster 2021-03-10T20:39:02.532351+0000 mgr.gibba044.wflcwh (mgr.34466) 1657 : cluster [DBG] pgmap v932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:06.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:05 gibba044 bash[25485]: cluster 2021-03-10T20:39:04.533821+0000 mgr.gibba044.wflcwh (mgr.34466) 1658 : cluster [DBG] pgmap v933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:06.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:05 gibba023 bash[30844]: cluster 2021-03-10T20:39:04.533821+0000 mgr.gibba044.wflcwh (mgr.34466) 1658 : cluster [DBG] pgmap v933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:06.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:05 gibba023 bash[31815]: cluster 2021-03-10T20:39:04.533821+0000 mgr.gibba044.wflcwh (mgr.34466) 1658 : cluster [DBG] pgmap v933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:08.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:07 gibba044 bash[25485]: cluster 2021-03-10T20:39:06.535193+0000 mgr.gibba044.wflcwh (mgr.34466) 1659 : cluster [DBG] pgmap v934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:08.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:07 gibba023 bash[30844]: cluster 2021-03-10T20:39:06.535193+0000 mgr.gibba044.wflcwh (mgr.34466) 1659 : cluster [DBG] pgmap v934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:08.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:07 gibba023 bash[31815]: cluster 2021-03-10T20:39:06.535193+0000 mgr.gibba044.wflcwh (mgr.34466) 1659 : cluster [DBG] pgmap v934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:10.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:09 gibba044 bash[25485]: cluster 2021-03-10T20:39:08.536891+0000 mgr.gibba044.wflcwh (mgr.34466) 1660 : cluster [DBG] pgmap v935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:10.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:09 gibba023 bash[30844]: cluster 2021-03-10T20:39:08.536891+0000 mgr.gibba044.wflcwh (mgr.34466) 1660 : cluster [DBG] pgmap v935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:10.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:09 gibba023 bash[31815]: cluster 2021-03-10T20:39:08.536891+0000 mgr.gibba044.wflcwh (mgr.34466) 1660 : cluster [DBG] pgmap v935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:12.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:11 gibba044 bash[25485]: cluster 2021-03-10T20:39:10.538763+0000 mgr.gibba044.wflcwh (mgr.34466) 1661 : cluster [DBG] pgmap v936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:12.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:11 gibba044 bash[25485]: cephadm 2021-03-10T20:39:11.006153+0000 mgr.gibba044.wflcwh (mgr.34466) 1662 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:39:12.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:11 gibba044 bash[25485]: audit 2021-03-10T20:39:11.191226+0000 mon.a (mon.0) 997 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:39:12.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:11 gibba044 bash[25485]: audit 2021-03-10T20:39:11.398276+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:39:12.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:11 gibba044 bash[25485]: audit 2021-03-10T20:39:11.415476+0000 mon.a (mon.0) 999 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:39:12.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:11 gibba044 bash[25485]: audit 2021-03-10T20:39:11.419684+0000 mon.a (mon.0) 1000 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:12.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:11 gibba044 bash[25485]: audit 2021-03-10T20:39:11.423689+0000 mon.a (mon.0) 1001 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:12.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:11 gibba044 bash[25485]: audit 2021-03-10T20:39:11.426687+0000 mon.a (mon.0) 1002 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:12.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:11 gibba044 bash[25485]: audit 2021-03-10T20:39:11.433284+0000 mon.a (mon.0) 1003 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:12.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:11 gibba044 bash[25485]: audit 2021-03-10T20:39:11.438354+0000 mon.a (mon.0) 1004 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:12.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:11 gibba023 bash[30844]: cluster 2021-03-10T20:39:10.538763+0000 mgr.gibba044.wflcwh (mgr.34466) 1661 : cluster [DBG] pgmap v936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:12.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:11 gibba023 bash[30844]: cephadm 2021-03-10T20:39:11.006153+0000 mgr.gibba044.wflcwh (mgr.34466) 1662 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:39:12.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:11 gibba023 bash[30844]: audit 2021-03-10T20:39:11.191226+0000 mon.a (mon.0) 997 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:39:12.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:11 gibba023 bash[30844]: audit 2021-03-10T20:39:11.398276+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:39:12.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:11 gibba023 bash[30844]: audit 2021-03-10T20:39:11.415476+0000 mon.a (mon.0) 999 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:39:12.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:11 gibba023 bash[30844]: audit 2021-03-10T20:39:11.419684+0000 mon.a (mon.0) 1000 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:12.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:11 gibba023 bash[30844]: audit 2021-03-10T20:39:11.423689+0000 mon.a (mon.0) 1001 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:12.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:11 gibba023 bash[30844]: audit 2021-03-10T20:39:11.426687+0000 mon.a (mon.0) 1002 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:12.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:11 gibba023 bash[30844]: audit 2021-03-10T20:39:11.433284+0000 mon.a (mon.0) 1003 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:12.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:11 gibba023 bash[30844]: audit 2021-03-10T20:39:11.438354+0000 mon.a (mon.0) 1004 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:12.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:11 gibba023 bash[31815]: cluster 2021-03-10T20:39:10.538763+0000 mgr.gibba044.wflcwh (mgr.34466) 1661 : cluster [DBG] pgmap v936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:12.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:11 gibba023 bash[31815]: cephadm 2021-03-10T20:39:11.006153+0000 mgr.gibba044.wflcwh (mgr.34466) 1662 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:39:12.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:11 gibba023 bash[31815]: audit 2021-03-10T20:39:11.191226+0000 mon.a (mon.0) 997 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:39:12.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:11 gibba023 bash[31815]: audit 2021-03-10T20:39:11.398276+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:39:12.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:11 gibba023 bash[31815]: audit 2021-03-10T20:39:11.415476+0000 mon.a (mon.0) 999 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:39:12.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:11 gibba023 bash[31815]: audit 2021-03-10T20:39:11.419684+0000 mon.a (mon.0) 1000 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:12.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:11 gibba023 bash[31815]: audit 2021-03-10T20:39:11.423689+0000 mon.a (mon.0) 1001 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:12.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:11 gibba023 bash[31815]: audit 2021-03-10T20:39:11.426687+0000 mon.a (mon.0) 1002 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:12.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:11 gibba023 bash[31815]: audit 2021-03-10T20:39:11.433284+0000 mon.a (mon.0) 1003 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:12.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:11 gibba023 bash[31815]: audit 2021-03-10T20:39:11.438354+0000 mon.a (mon.0) 1004 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:13.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:12 gibba044 bash[25485]: cephadm 2021-03-10T20:39:11.193419+0000 mgr.gibba044.wflcwh (mgr.34466) 1663 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:39:13.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:12 gibba044 bash[25485]: cephadm 2021-03-10T20:39:11.414174+0000 mgr.gibba044.wflcwh (mgr.34466) 1664 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:39:13.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:12 gibba044 bash[25485]: cephadm 2021-03-10T20:39:11.419978+0000 mgr.gibba044.wflcwh (mgr.34466) 1665 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:39:13.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:12 gibba044 bash[25485]: cephadm 2021-03-10T20:39:11.423569+0000 mgr.gibba044.wflcwh (mgr.34466) 1666 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:39:13.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:12 gibba044 bash[25485]: cephadm 2021-03-10T20:39:11.423831+0000 mgr.gibba044.wflcwh (mgr.34466) 1667 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:39:13.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:12 gibba044 bash[25485]: cephadm 2021-03-10T20:39:11.427251+0000 mgr.gibba044.wflcwh (mgr.34466) 1668 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:39:13.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:12 gibba044 bash[25485]: cephadm 2021-03-10T20:39:11.427500+0000 mgr.gibba044.wflcwh (mgr.34466) 1669 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:39:13.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:12 gibba044 bash[25485]: cephadm 2021-03-10T20:39:11.430183+0000 mgr.gibba044.wflcwh (mgr.34466) 1670 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:39:13.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:12 gibba044 bash[25485]: cephadm 2021-03-10T20:39:11.432623+0000 mgr.gibba044.wflcwh (mgr.34466) 1671 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:39:13.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:12 gibba044 bash[25485]: cephadm 2021-03-10T20:39:11.433214+0000 mgr.gibba044.wflcwh (mgr.34466) 1672 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:39:13.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:12 gibba044 bash[25485]: cephadm 2021-03-10T20:39:11.436997+0000 mgr.gibba044.wflcwh (mgr.34466) 1673 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:39:13.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:12 gibba044 bash[25485]: cephadm 2021-03-10T20:39:11.439095+0000 mgr.gibba044.wflcwh (mgr.34466) 1674 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:39:13.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:12 gibba044 bash[25485]: cephadm 2021-03-10T20:39:11.442222+0000 mgr.gibba044.wflcwh (mgr.34466) 1675 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:39:13.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:12 gibba044 bash[25485]: cephadm 2021-03-10T20:39:11.442585+0000 mgr.gibba044.wflcwh (mgr.34466) 1676 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:39:13.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:12 gibba044 bash[25485]: cephadm 2021-03-10T20:39:11.443494+0000 mgr.gibba044.wflcwh (mgr.34466) 1677 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:39:13.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[30844]: cephadm 2021-03-10T20:39:11.193419+0000 mgr.gibba044.wflcwh (mgr.34466) 1663 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:39:13.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[30844]: cephadm 2021-03-10T20:39:11.414174+0000 mgr.gibba044.wflcwh (mgr.34466) 1664 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:39:13.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[30844]: cephadm 2021-03-10T20:39:11.419978+0000 mgr.gibba044.wflcwh (mgr.34466) 1665 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:39:13.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[30844]: cephadm 2021-03-10T20:39:11.423569+0000 mgr.gibba044.wflcwh (mgr.34466) 1666 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:39:13.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[30844]: cephadm 2021-03-10T20:39:11.423831+0000 mgr.gibba044.wflcwh (mgr.34466) 1667 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:39:13.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[30844]: cephadm 2021-03-10T20:39:11.427251+0000 mgr.gibba044.wflcwh (mgr.34466) 1668 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:39:13.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[30844]: cephadm 2021-03-10T20:39:11.427500+0000 mgr.gibba044.wflcwh (mgr.34466) 1669 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:39:13.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[30844]: cephadm 2021-03-10T20:39:11.430183+0000 mgr.gibba044.wflcwh (mgr.34466) 1670 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:39:13.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[30844]: cephadm 2021-03-10T20:39:11.432623+0000 mgr.gibba044.wflcwh (mgr.34466) 1671 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:39:13.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[30844]: cephadm 2021-03-10T20:39:11.433214+0000 mgr.gibba044.wflcwh (mgr.34466) 1672 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:39:13.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[30844]: cephadm 2021-03-10T20:39:11.436997+0000 mgr.gibba044.wflcwh (mgr.34466) 1673 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:39:13.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[30844]: cephadm 2021-03-10T20:39:11.439095+0000 mgr.gibba044.wflcwh (mgr.34466) 1674 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:39:13.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[30844]: cephadm 2021-03-10T20:39:11.442222+0000 mgr.gibba044.wflcwh (mgr.34466) 1675 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:39:13.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[30844]: cephadm 2021-03-10T20:39:11.442585+0000 mgr.gibba044.wflcwh (mgr.34466) 1676 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:39:13.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[30844]: cephadm 2021-03-10T20:39:11.443494+0000 mgr.gibba044.wflcwh (mgr.34466) 1677 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:39:13.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[31815]: cephadm 2021-03-10T20:39:11.193419+0000 mgr.gibba044.wflcwh (mgr.34466) 1663 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:39:13.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[31815]: cephadm 2021-03-10T20:39:11.414174+0000 mgr.gibba044.wflcwh (mgr.34466) 1664 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:39:13.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[31815]: cephadm 2021-03-10T20:39:11.419978+0000 mgr.gibba044.wflcwh (mgr.34466) 1665 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:39:13.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[31815]: cephadm 2021-03-10T20:39:11.423569+0000 mgr.gibba044.wflcwh (mgr.34466) 1666 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:39:13.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[31815]: cephadm 2021-03-10T20:39:11.423831+0000 mgr.gibba044.wflcwh (mgr.34466) 1667 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:39:13.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[31815]: cephadm 2021-03-10T20:39:11.427251+0000 mgr.gibba044.wflcwh (mgr.34466) 1668 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:39:13.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[31815]: cephadm 2021-03-10T20:39:11.427500+0000 mgr.gibba044.wflcwh (mgr.34466) 1669 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:39:13.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[31815]: cephadm 2021-03-10T20:39:11.430183+0000 mgr.gibba044.wflcwh (mgr.34466) 1670 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:39:13.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[31815]: cephadm 2021-03-10T20:39:11.432623+0000 mgr.gibba044.wflcwh (mgr.34466) 1671 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:39:13.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[31815]: cephadm 2021-03-10T20:39:11.433214+0000 mgr.gibba044.wflcwh (mgr.34466) 1672 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:39:13.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[31815]: cephadm 2021-03-10T20:39:11.436997+0000 mgr.gibba044.wflcwh (mgr.34466) 1673 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:39:13.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[31815]: cephadm 2021-03-10T20:39:11.439095+0000 mgr.gibba044.wflcwh (mgr.34466) 1674 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:39:13.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[31815]: cephadm 2021-03-10T20:39:11.442222+0000 mgr.gibba044.wflcwh (mgr.34466) 1675 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:39:13.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[31815]: cephadm 2021-03-10T20:39:11.442585+0000 mgr.gibba044.wflcwh (mgr.34466) 1676 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:39:13.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:12 gibba023 bash[31815]: cephadm 2021-03-10T20:39:11.443494+0000 mgr.gibba044.wflcwh (mgr.34466) 1677 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:39:14.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:13 gibba044 bash[25485]: cluster 2021-03-10T20:39:12.540325+0000 mgr.gibba044.wflcwh (mgr.34466) 1678 : cluster [DBG] pgmap v937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:14.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:13 gibba023 bash[30844]: cluster 2021-03-10T20:39:12.540325+0000 mgr.gibba044.wflcwh (mgr.34466) 1678 : cluster [DBG] pgmap v937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:14.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:13 gibba023 bash[31815]: cluster 2021-03-10T20:39:12.540325+0000 mgr.gibba044.wflcwh (mgr.34466) 1678 : cluster [DBG] pgmap v937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:16.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:15 gibba044 bash[25485]: cluster 2021-03-10T20:39:14.541656+0000 mgr.gibba044.wflcwh (mgr.34466) 1679 : cluster [DBG] pgmap v938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:16.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:15 gibba023 bash[30844]: cluster 2021-03-10T20:39:14.541656+0000 mgr.gibba044.wflcwh (mgr.34466) 1679 : cluster [DBG] pgmap v938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:16.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:16 gibba023 bash[31815]: cluster 2021-03-10T20:39:14.541656+0000 mgr.gibba044.wflcwh (mgr.34466) 1679 : cluster [DBG] pgmap v938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:18.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:18 gibba023 bash[30844]: cluster 2021-03-10T20:39:16.543250+0000 mgr.gibba044.wflcwh (mgr.34466) 1680 : cluster [DBG] pgmap v939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:18.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:18 gibba023 bash[31815]: cluster 2021-03-10T20:39:16.543250+0000 mgr.gibba044.wflcwh (mgr.34466) 1680 : cluster [DBG] pgmap v939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:18.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:18 gibba044 bash[25485]: cluster 2021-03-10T20:39:16.543250+0000 mgr.gibba044.wflcwh (mgr.34466) 1680 : cluster [DBG] pgmap v939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:20.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:20 gibba023 bash[30844]: cluster 2021-03-10T20:39:18.544809+0000 mgr.gibba044.wflcwh (mgr.34466) 1681 : cluster [DBG] pgmap v940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:20.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:20 gibba023 bash[31815]: cluster 2021-03-10T20:39:18.544809+0000 mgr.gibba044.wflcwh (mgr.34466) 1681 : cluster [DBG] pgmap v940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:20.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:20 gibba044 bash[25485]: cluster 2021-03-10T20:39:18.544809+0000 mgr.gibba044.wflcwh (mgr.34466) 1681 : cluster [DBG] pgmap v940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:22.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:22 gibba023 bash[30844]: cluster 2021-03-10T20:39:20.546634+0000 mgr.gibba044.wflcwh (mgr.34466) 1682 : cluster [DBG] pgmap v941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:22.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:22 gibba023 bash[31815]: cluster 2021-03-10T20:39:20.546634+0000 mgr.gibba044.wflcwh (mgr.34466) 1682 : cluster [DBG] pgmap v941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:22.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:22 gibba044 bash[25485]: cluster 2021-03-10T20:39:20.546634+0000 mgr.gibba044.wflcwh (mgr.34466) 1682 : cluster [DBG] pgmap v941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:24.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:24 gibba023 bash[30844]: cluster 2021-03-10T20:39:22.548217+0000 mgr.gibba044.wflcwh (mgr.34466) 1683 : cluster [DBG] pgmap v942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:24.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:24 gibba023 bash[31815]: cluster 2021-03-10T20:39:22.548217+0000 mgr.gibba044.wflcwh (mgr.34466) 1683 : cluster [DBG] pgmap v942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:24.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:24 gibba044 bash[25485]: cluster 2021-03-10T20:39:22.548217+0000 mgr.gibba044.wflcwh (mgr.34466) 1683 : cluster [DBG] pgmap v942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:26.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:26 gibba023 bash[30844]: cluster 2021-03-10T20:39:24.549789+0000 mgr.gibba044.wflcwh (mgr.34466) 1684 : cluster [DBG] pgmap v943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:26.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:26 gibba023 bash[31815]: cluster 2021-03-10T20:39:24.549789+0000 mgr.gibba044.wflcwh (mgr.34466) 1684 : cluster [DBG] pgmap v943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:26.458 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:26 gibba044 bash[25485]: cluster 2021-03-10T20:39:24.549789+0000 mgr.gibba044.wflcwh (mgr.34466) 1684 : cluster [DBG] pgmap v943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:28.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:28 gibba023 bash[30844]: cephadm 2021-03-10T20:39:26.459610+0000 mgr.gibba044.wflcwh (mgr.34466) 1685 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:39:28.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:28 gibba023 bash[30844]: cluster 2021-03-10T20:39:26.551139+0000 mgr.gibba044.wflcwh (mgr.34466) 1686 : cluster [DBG] pgmap v944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:28.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:28 gibba023 bash[30844]: audit 2021-03-10T20:39:27.206941+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:39:28.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:28 gibba023 bash[30844]: audit 2021-03-10T20:39:27.207712+0000 mon.a (mon.0) 1006 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:39:28.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:28 gibba023 bash[30844]: audit 2021-03-10T20:39:27.208749+0000 mon.a (mon.0) 1007 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T20:39:28.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:28 gibba023 bash[30844]: audit 2021-03-10T20:39:27.209581+0000 mon.a (mon.0) 1008 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:39:28.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:28 gibba023 bash[30844]: audit 2021-03-10T20:39:27.210427+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:39:28.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:28 gibba023 bash[30844]: audit 2021-03-10T20:39:27.211173+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:39:28.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:28 gibba023 bash[31815]: cephadm 2021-03-10T20:39:26.459610+0000 mgr.gibba044.wflcwh (mgr.34466) 1685 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:39:28.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:28 gibba023 bash[31815]: cluster 2021-03-10T20:39:26.551139+0000 mgr.gibba044.wflcwh (mgr.34466) 1686 : cluster [DBG] pgmap v944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:28.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:28 gibba023 bash[31815]: audit 2021-03-10T20:39:27.206941+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:39:28.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:28 gibba023 bash[31815]: audit 2021-03-10T20:39:27.207712+0000 mon.a (mon.0) 1006 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:39:28.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:28 gibba023 bash[31815]: audit 2021-03-10T20:39:27.208749+0000 mon.a (mon.0) 1007 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T20:39:28.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:28 gibba023 bash[31815]: audit 2021-03-10T20:39:27.209581+0000 mon.a (mon.0) 1008 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:39:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:28 gibba023 bash[31815]: audit 2021-03-10T20:39:27.210427+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:39:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:28 gibba023 bash[31815]: audit 2021-03-10T20:39:27.211173+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:39:28.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:28 gibba044 bash[25485]: cephadm 2021-03-10T20:39:26.459610+0000 mgr.gibba044.wflcwh (mgr.34466) 1685 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:39:28.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:28 gibba044 bash[25485]: cluster 2021-03-10T20:39:26.551139+0000 mgr.gibba044.wflcwh (mgr.34466) 1686 : cluster [DBG] pgmap v944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:28.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:28 gibba044 bash[25485]: audit 2021-03-10T20:39:27.206941+0000 mon.a (mon.0) 1005 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:39:28.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:28 gibba044 bash[25485]: audit 2021-03-10T20:39:27.207712+0000 mon.a (mon.0) 1006 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:39:28.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:28 gibba044 bash[25485]: audit 2021-03-10T20:39:27.208749+0000 mon.a (mon.0) 1007 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T20:39:28.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:28 gibba044 bash[25485]: audit 2021-03-10T20:39:27.209581+0000 mon.a (mon.0) 1008 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:39:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:28 gibba044 bash[25485]: audit 2021-03-10T20:39:27.210427+0000 mon.a (mon.0) 1009 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:39:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:28 gibba044 bash[25485]: audit 2021-03-10T20:39:27.211173+0000 mon.a (mon.0) 1010 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:39:28.762 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:39:28.993 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:39:28.994 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (30m) 6m ago 36m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:39:28.994 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (35m) 5m ago 35m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:39:28.995 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (30m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:39:28.995 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (31m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:39:28.996 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (30m) 6m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:39:28.996 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (30m) 6m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:39:28.997 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (29m) 5m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:39:28.997 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (29m) 6m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:39:28.997 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (36m) 6m ago 36m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:39:28.998 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (36m) 5m ago 36m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:39:28.998 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (28m) 6m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:39:28.999 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (28m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:39:28.999 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (27m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:39:29.000 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (27m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:39:29.000 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (27m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:39:29.001 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (26m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:39:29.001 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (26m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:39:29.001 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (25m) 5m ago 36m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:39:29.002 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (35m) 5m ago 36m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:39:29.003 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 6m ago 34m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:39:29.003 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 5m ago 34m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:39:29.244 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:39:29.245 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:39:29.245 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:39:29.245 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:39:29.245 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:39:29.246 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:39:29.246 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:39:29.246 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:39:29.246 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:39:29.247 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:39:29.247 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:39:29.247 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:39:29.247 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:39:29.247 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:39:29.248 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:39:30.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:30 gibba023 bash[30844]: cluster 2021-03-10T20:39:28.552741+0000 mgr.gibba044.wflcwh (mgr.34466) 1687 : cluster [DBG] pgmap v945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:30.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:30 gibba023 bash[30844]: audit 2021-03-10T20:39:28.753941+0000 mgr.gibba044.wflcwh (mgr.34466) 1688 : audit [DBG] from='client.55171 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:39:30.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:30 gibba023 bash[30844]: audit 2021-03-10T20:39:28.982672+0000 mgr.gibba044.wflcwh (mgr.34466) 1689 : audit [DBG] from='client.55177 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:39:30.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:30 gibba023 bash[30844]: audit 2021-03-10T20:39:29.244614+0000 mon.a (mon.0) 1011 : audit [DBG] from='client.? 172.21.2.123:0/2996170583' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:30.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:30 gibba023 bash[31815]: cluster 2021-03-10T20:39:28.552741+0000 mgr.gibba044.wflcwh (mgr.34466) 1687 : cluster [DBG] pgmap v945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:30.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:30 gibba023 bash[31815]: audit 2021-03-10T20:39:28.753941+0000 mgr.gibba044.wflcwh (mgr.34466) 1688 : audit [DBG] from='client.55171 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:39:30.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:30 gibba023 bash[31815]: audit 2021-03-10T20:39:28.982672+0000 mgr.gibba044.wflcwh (mgr.34466) 1689 : audit [DBG] from='client.55177 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:39:30.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:30 gibba023 bash[31815]: audit 2021-03-10T20:39:29.244614+0000 mon.a (mon.0) 1011 : audit [DBG] from='client.? 172.21.2.123:0/2996170583' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:30.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:30 gibba044 bash[25485]: cluster 2021-03-10T20:39:28.552741+0000 mgr.gibba044.wflcwh (mgr.34466) 1687 : cluster [DBG] pgmap v945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:30.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:30 gibba044 bash[25485]: audit 2021-03-10T20:39:28.753941+0000 mgr.gibba044.wflcwh (mgr.34466) 1688 : audit [DBG] from='client.55171 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:39:30.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:30 gibba044 bash[25485]: audit 2021-03-10T20:39:28.982672+0000 mgr.gibba044.wflcwh (mgr.34466) 1689 : audit [DBG] from='client.55177 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:39:30.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:30 gibba044 bash[25485]: audit 2021-03-10T20:39:29.244614+0000 mon.a (mon.0) 1011 : audit [DBG] from='client.? 172.21.2.123:0/2996170583' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:39:32.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:32 gibba023 bash[30844]: cluster 2021-03-10T20:39:30.554444+0000 mgr.gibba044.wflcwh (mgr.34466) 1690 : cluster [DBG] pgmap v946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:32.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:32 gibba023 bash[31815]: cluster 2021-03-10T20:39:30.554444+0000 mgr.gibba044.wflcwh (mgr.34466) 1690 : cluster [DBG] pgmap v946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:32.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:32 gibba044 bash[25485]: cluster 2021-03-10T20:39:30.554444+0000 mgr.gibba044.wflcwh (mgr.34466) 1690 : cluster [DBG] pgmap v946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:33.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:33 gibba023 bash[30844]: cluster 2021-03-10T20:39:32.555896+0000 mgr.gibba044.wflcwh (mgr.34466) 1691 : cluster [DBG] pgmap v947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:33.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:33 gibba023 bash[31815]: cluster 2021-03-10T20:39:32.555896+0000 mgr.gibba044.wflcwh (mgr.34466) 1691 : cluster [DBG] pgmap v947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:33.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:33 gibba044 bash[25485]: cluster 2021-03-10T20:39:32.555896+0000 mgr.gibba044.wflcwh (mgr.34466) 1691 : cluster [DBG] pgmap v947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:35.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:35 gibba023 bash[30844]: cluster 2021-03-10T20:39:34.557582+0000 mgr.gibba044.wflcwh (mgr.34466) 1692 : cluster [DBG] pgmap v948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:35.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:35 gibba023 bash[31815]: cluster 2021-03-10T20:39:34.557582+0000 mgr.gibba044.wflcwh (mgr.34466) 1692 : cluster [DBG] pgmap v948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:36.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:35 gibba044 bash[25485]: cluster 2021-03-10T20:39:34.557582+0000 mgr.gibba044.wflcwh (mgr.34466) 1692 : cluster [DBG] pgmap v948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:38.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:37 gibba023 bash[30844]: cluster 2021-03-10T20:39:36.559223+0000 mgr.gibba044.wflcwh (mgr.34466) 1693 : cluster [DBG] pgmap v949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:38.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:37 gibba023 bash[31815]: cluster 2021-03-10T20:39:36.559223+0000 mgr.gibba044.wflcwh (mgr.34466) 1693 : cluster [DBG] pgmap v949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:38.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:37 gibba044 bash[25485]: cluster 2021-03-10T20:39:36.559223+0000 mgr.gibba044.wflcwh (mgr.34466) 1693 : cluster [DBG] pgmap v949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:40.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:39 gibba023 bash[30844]: cluster 2021-03-10T20:39:38.560800+0000 mgr.gibba044.wflcwh (mgr.34466) 1694 : cluster [DBG] pgmap v950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:40.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:39 gibba023 bash[31815]: cluster 2021-03-10T20:39:38.560800+0000 mgr.gibba044.wflcwh (mgr.34466) 1694 : cluster [DBG] pgmap v950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:40.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:39 gibba044 bash[25485]: cluster 2021-03-10T20:39:38.560800+0000 mgr.gibba044.wflcwh (mgr.34466) 1694 : cluster [DBG] pgmap v950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:42.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:41 gibba023 bash[30844]: cluster 2021-03-10T20:39:40.562609+0000 mgr.gibba044.wflcwh (mgr.34466) 1695 : cluster [DBG] pgmap v951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:42.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:41 gibba023 bash[31815]: cluster 2021-03-10T20:39:40.562609+0000 mgr.gibba044.wflcwh (mgr.34466) 1695 : cluster [DBG] pgmap v951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:42.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:41 gibba044 bash[25485]: cluster 2021-03-10T20:39:40.562609+0000 mgr.gibba044.wflcwh (mgr.34466) 1695 : cluster [DBG] pgmap v951: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:43.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:42 gibba023 bash[30844]: cephadm 2021-03-10T20:39:41.464585+0000 mgr.gibba044.wflcwh (mgr.34466) 1696 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:39:43.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:42 gibba023 bash[31815]: cephadm 2021-03-10T20:39:41.464585+0000 mgr.gibba044.wflcwh (mgr.34466) 1696 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:39:43.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:42 gibba044 bash[25485]: cephadm 2021-03-10T20:39:41.464585+0000 mgr.gibba044.wflcwh (mgr.34466) 1696 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:39:44.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:43 gibba023 bash[30844]: cluster 2021-03-10T20:39:42.564053+0000 mgr.gibba044.wflcwh (mgr.34466) 1697 : cluster [DBG] pgmap v952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:44.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:43 gibba023 bash[31815]: cluster 2021-03-10T20:39:42.564053+0000 mgr.gibba044.wflcwh (mgr.34466) 1697 : cluster [DBG] pgmap v952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:44.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:43 gibba044 bash[25485]: cluster 2021-03-10T20:39:42.564053+0000 mgr.gibba044.wflcwh (mgr.34466) 1697 : cluster [DBG] pgmap v952: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:46.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:45 gibba023 bash[30844]: cluster 2021-03-10T20:39:44.565685+0000 mgr.gibba044.wflcwh (mgr.34466) 1698 : cluster [DBG] pgmap v953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:46.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:45 gibba023 bash[31815]: cluster 2021-03-10T20:39:44.565685+0000 mgr.gibba044.wflcwh (mgr.34466) 1698 : cluster [DBG] pgmap v953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:46.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:45 gibba044 bash[25485]: cluster 2021-03-10T20:39:44.565685+0000 mgr.gibba044.wflcwh (mgr.34466) 1698 : cluster [DBG] pgmap v953: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:48.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:47 gibba023 bash[30844]: cluster 2021-03-10T20:39:46.567004+0000 mgr.gibba044.wflcwh (mgr.34466) 1699 : cluster [DBG] pgmap v954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:48.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:47 gibba023 bash[31815]: cluster 2021-03-10T20:39:46.567004+0000 mgr.gibba044.wflcwh (mgr.34466) 1699 : cluster [DBG] pgmap v954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:48.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:47 gibba044 bash[25485]: cluster 2021-03-10T20:39:46.567004+0000 mgr.gibba044.wflcwh (mgr.34466) 1699 : cluster [DBG] pgmap v954: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:50.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:49 gibba023 bash[30844]: cluster 2021-03-10T20:39:48.568609+0000 mgr.gibba044.wflcwh (mgr.34466) 1700 : cluster [DBG] pgmap v955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:50.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:49 gibba023 bash[31815]: cluster 2021-03-10T20:39:48.568609+0000 mgr.gibba044.wflcwh (mgr.34466) 1700 : cluster [DBG] pgmap v955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:50.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:49 gibba044 bash[25485]: cluster 2021-03-10T20:39:48.568609+0000 mgr.gibba044.wflcwh (mgr.34466) 1700 : cluster [DBG] pgmap v955: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:52.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:51 gibba023 bash[30844]: cluster 2021-03-10T20:39:50.570296+0000 mgr.gibba044.wflcwh (mgr.34466) 1701 : cluster [DBG] pgmap v956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:52.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:51 gibba023 bash[31815]: cluster 2021-03-10T20:39:50.570296+0000 mgr.gibba044.wflcwh (mgr.34466) 1701 : cluster [DBG] pgmap v956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:52.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:51 gibba044 bash[25485]: cluster 2021-03-10T20:39:50.570296+0000 mgr.gibba044.wflcwh (mgr.34466) 1701 : cluster [DBG] pgmap v956: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:54.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:53 gibba023 bash[30844]: cluster 2021-03-10T20:39:52.571594+0000 mgr.gibba044.wflcwh (mgr.34466) 1702 : cluster [DBG] pgmap v957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:54.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:53 gibba023 bash[31815]: cluster 2021-03-10T20:39:52.571594+0000 mgr.gibba044.wflcwh (mgr.34466) 1702 : cluster [DBG] pgmap v957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:54.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:53 gibba044 bash[25485]: cluster 2021-03-10T20:39:52.571594+0000 mgr.gibba044.wflcwh (mgr.34466) 1702 : cluster [DBG] pgmap v957: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:56.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:55 gibba044 bash[25485]: cluster 2021-03-10T20:39:54.573290+0000 mgr.gibba044.wflcwh (mgr.34466) 1703 : cluster [DBG] pgmap v958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:56.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:55 gibba023 bash[30844]: cluster 2021-03-10T20:39:54.573290+0000 mgr.gibba044.wflcwh (mgr.34466) 1703 : cluster [DBG] pgmap v958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:56.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:55 gibba023 bash[31815]: cluster 2021-03-10T20:39:54.573290+0000 mgr.gibba044.wflcwh (mgr.34466) 1703 : cluster [DBG] pgmap v958: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:58.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:57 gibba044 bash[25485]: cephadm 2021-03-10T20:39:56.480691+0000 mgr.gibba044.wflcwh (mgr.34466) 1704 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:39:58.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:57 gibba044 bash[25485]: cluster 2021-03-10T20:39:56.574949+0000 mgr.gibba044.wflcwh (mgr.34466) 1705 : cluster [DBG] pgmap v959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:58.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:57 gibba023 bash[30844]: cephadm 2021-03-10T20:39:56.480691+0000 mgr.gibba044.wflcwh (mgr.34466) 1704 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:39:58.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:57 gibba023 bash[30844]: cluster 2021-03-10T20:39:56.574949+0000 mgr.gibba044.wflcwh (mgr.34466) 1705 : cluster [DBG] pgmap v959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:58.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:57 gibba023 bash[31815]: cephadm 2021-03-10T20:39:56.480691+0000 mgr.gibba044.wflcwh (mgr.34466) 1704 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:39:58.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:57 gibba023 bash[31815]: cluster 2021-03-10T20:39:56.574949+0000 mgr.gibba044.wflcwh (mgr.34466) 1705 : cluster [DBG] pgmap v959: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:39:59.490 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:39:59.711 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:39:59.712 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (31m) 6m ago 36m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:39:59.712 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (36m) 5m ago 36m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:39:59.712 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (31m) 5m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:39:59.713 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (31m) 5m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:39:59.713 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (30m) 6m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:39:59.713 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (30m) 6m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:39:59.713 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (30m) 5m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:39:59.713 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (30m) 6m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:39:59.714 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (36m) 6m ago 36m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:39:59.714 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (36m) 5m ago 36m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:39:59.714 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (29m) 6m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:39:59.714 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (28m) 6m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:39:59.715 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (28m) 6m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:39:59.715 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (28m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:39:59.715 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (27m) 5m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:39:59.715 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (27m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:39:59.715 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (26m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:39:59.716 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (26m) 5m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:39:59.716 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (36m) 5m ago 36m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:39:59.716 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 6m ago 34m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:39:59.716 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 5m ago 34m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:39:59.960 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:39:59.960 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:39:59.960 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:39:59.961 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:39:59.961 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:39:59.961 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:39:59.961 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:39:59.962 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:39:59.962 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:39:59.962 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:39:59.962 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:39:59.963 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:39:59.963 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:39:59.963 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:39:59.964 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:40:00.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:39:59 gibba044 bash[25485]: cluster 2021-03-10T20:39:58.576543+0000 mgr.gibba044.wflcwh (mgr.34466) 1706 : cluster [DBG] pgmap v960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:00.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:39:59 gibba023 bash[30844]: cluster 2021-03-10T20:39:58.576543+0000 mgr.gibba044.wflcwh (mgr.34466) 1706 : cluster [DBG] pgmap v960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:00.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:00 gibba023 bash[30844]: debug 2021-03-10T20:39:59.996+0000 7fa7fde59700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:40:00.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:39:59 gibba023 bash[31815]: cluster 2021-03-10T20:39:58.576543+0000 mgr.gibba044.wflcwh (mgr.34466) 1706 : cluster [DBG] pgmap v960: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:01.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:00 gibba044 bash[25485]: audit 2021-03-10T20:39:59.483150+0000 mgr.gibba044.wflcwh (mgr.34466) 1707 : audit [DBG] from='client.45210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:40:01.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:00 gibba044 bash[25485]: audit 2021-03-10T20:39:59.703234+0000 mgr.gibba044.wflcwh (mgr.34466) 1708 : audit [DBG] from='client.55195 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:40:01.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:00 gibba044 bash[25485]: audit 2021-03-10T20:39:59.960136+0000 mon.c (mon.1) 44 : audit [DBG] from='client.? 172.21.2.123:0/1447986201' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:01.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:00 gibba044 bash[25485]: cluster 2021-03-10T20:40:00.000317+0000 mon.a (mon.0) 1012 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:40:01.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:00 gibba023 bash[30844]: audit 2021-03-10T20:39:59.483150+0000 mgr.gibba044.wflcwh (mgr.34466) 1707 : audit [DBG] from='client.45210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:40:01.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:00 gibba023 bash[30844]: audit 2021-03-10T20:39:59.703234+0000 mgr.gibba044.wflcwh (mgr.34466) 1708 : audit [DBG] from='client.55195 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:40:01.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:00 gibba023 bash[30844]: audit 2021-03-10T20:39:59.960136+0000 mon.c (mon.1) 44 : audit [DBG] from='client.? 172.21.2.123:0/1447986201' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:01.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:00 gibba023 bash[30844]: cluster 2021-03-10T20:40:00.000317+0000 mon.a (mon.0) 1012 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:40:01.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:00 gibba023 bash[31815]: audit 2021-03-10T20:39:59.483150+0000 mgr.gibba044.wflcwh (mgr.34466) 1707 : audit [DBG] from='client.45210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:40:01.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:00 gibba023 bash[31815]: audit 2021-03-10T20:39:59.703234+0000 mgr.gibba044.wflcwh (mgr.34466) 1708 : audit [DBG] from='client.55195 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:40:01.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:00 gibba023 bash[31815]: audit 2021-03-10T20:39:59.960136+0000 mon.c (mon.1) 44 : audit [DBG] from='client.? 172.21.2.123:0/1447986201' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:01.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:00 gibba023 bash[31815]: cluster 2021-03-10T20:40:00.000317+0000 mon.a (mon.0) 1012 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:40:02.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:01 gibba044 bash[25485]: cluster 2021-03-10T20:40:00.578418+0000 mgr.gibba044.wflcwh (mgr.34466) 1709 : cluster [DBG] pgmap v961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:02.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:01 gibba023 bash[30844]: cluster 2021-03-10T20:40:00.578418+0000 mgr.gibba044.wflcwh (mgr.34466) 1709 : cluster [DBG] pgmap v961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:02.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:01 gibba023 bash[31815]: cluster 2021-03-10T20:40:00.578418+0000 mgr.gibba044.wflcwh (mgr.34466) 1709 : cluster [DBG] pgmap v961: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:04.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:03 gibba044 bash[25485]: cluster 2021-03-10T20:40:02.579943+0000 mgr.gibba044.wflcwh (mgr.34466) 1710 : cluster [DBG] pgmap v962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:04.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:03 gibba023 bash[30844]: cluster 2021-03-10T20:40:02.579943+0000 mgr.gibba044.wflcwh (mgr.34466) 1710 : cluster [DBG] pgmap v962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:04.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:03 gibba023 bash[31815]: cluster 2021-03-10T20:40:02.579943+0000 mgr.gibba044.wflcwh (mgr.34466) 1710 : cluster [DBG] pgmap v962: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:06.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:05 gibba044 bash[25485]: cluster 2021-03-10T20:40:04.581521+0000 mgr.gibba044.wflcwh (mgr.34466) 1711 : cluster [DBG] pgmap v963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:06.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:05 gibba023 bash[30844]: cluster 2021-03-10T20:40:04.581521+0000 mgr.gibba044.wflcwh (mgr.34466) 1711 : cluster [DBG] pgmap v963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:06.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:05 gibba023 bash[31815]: cluster 2021-03-10T20:40:04.581521+0000 mgr.gibba044.wflcwh (mgr.34466) 1711 : cluster [DBG] pgmap v963: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:08.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:07 gibba044 bash[25485]: cluster 2021-03-10T20:40:06.583005+0000 mgr.gibba044.wflcwh (mgr.34466) 1712 : cluster [DBG] pgmap v964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:08.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:07 gibba023 bash[30844]: cluster 2021-03-10T20:40:06.583005+0000 mgr.gibba044.wflcwh (mgr.34466) 1712 : cluster [DBG] pgmap v964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:08.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:07 gibba023 bash[31815]: cluster 2021-03-10T20:40:06.583005+0000 mgr.gibba044.wflcwh (mgr.34466) 1712 : cluster [DBG] pgmap v964: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:10.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:09 gibba044 bash[25485]: cluster 2021-03-10T20:40:08.584696+0000 mgr.gibba044.wflcwh (mgr.34466) 1713 : cluster [DBG] pgmap v965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:10.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:09 gibba023 bash[30844]: cluster 2021-03-10T20:40:08.584696+0000 mgr.gibba044.wflcwh (mgr.34466) 1713 : cluster [DBG] pgmap v965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:10.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:09 gibba023 bash[31815]: cluster 2021-03-10T20:40:08.584696+0000 mgr.gibba044.wflcwh (mgr.34466) 1713 : cluster [DBG] pgmap v965: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:12.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:12 gibba044 bash[25485]: cluster 2021-03-10T20:40:10.586273+0000 mgr.gibba044.wflcwh (mgr.34466) 1714 : cluster [DBG] pgmap v966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:12.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:12 gibba044 bash[25485]: audit 2021-03-10T20:40:11.686055+0000 mon.a (mon.0) 1013 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:40:12.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:12 gibba044 bash[25485]: audit 2021-03-10T20:40:11.895430+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:40:12.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:12 gibba044 bash[25485]: audit 2021-03-10T20:40:11.899082+0000 mon.a (mon.0) 1015 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:40:12.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:12 gibba044 bash[25485]: audit 2021-03-10T20:40:11.900828+0000 mon.a (mon.0) 1016 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:12.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:12 gibba044 bash[25485]: audit 2021-03-10T20:40:11.902464+0000 mon.a (mon.0) 1017 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:12.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:12 gibba044 bash[25485]: audit 2021-03-10T20:40:11.904246+0000 mon.a (mon.0) 1018 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:12.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:12 gibba044 bash[25485]: audit 2021-03-10T20:40:11.907387+0000 mon.a (mon.0) 1019 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:12.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:12 gibba044 bash[25485]: audit 2021-03-10T20:40:11.909232+0000 mon.a (mon.0) 1020 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:12.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:12 gibba023 bash[30844]: cluster 2021-03-10T20:40:10.586273+0000 mgr.gibba044.wflcwh (mgr.34466) 1714 : cluster [DBG] pgmap v966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:12.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:12 gibba023 bash[30844]: audit 2021-03-10T20:40:11.686055+0000 mon.a (mon.0) 1013 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:40:12.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:12 gibba023 bash[30844]: audit 2021-03-10T20:40:11.895430+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:40:12.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:12 gibba023 bash[30844]: audit 2021-03-10T20:40:11.899082+0000 mon.a (mon.0) 1015 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:40:12.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:12 gibba023 bash[30844]: audit 2021-03-10T20:40:11.900828+0000 mon.a (mon.0) 1016 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:12.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:12 gibba023 bash[30844]: audit 2021-03-10T20:40:11.902464+0000 mon.a (mon.0) 1017 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:12.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:12 gibba023 bash[30844]: audit 2021-03-10T20:40:11.904246+0000 mon.a (mon.0) 1018 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:12.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:12 gibba023 bash[30844]: audit 2021-03-10T20:40:11.907387+0000 mon.a (mon.0) 1019 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:12.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:12 gibba023 bash[30844]: audit 2021-03-10T20:40:11.909232+0000 mon.a (mon.0) 1020 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:12.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:12 gibba023 bash[31815]: cluster 2021-03-10T20:40:10.586273+0000 mgr.gibba044.wflcwh (mgr.34466) 1714 : cluster [DBG] pgmap v966: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:12.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:12 gibba023 bash[31815]: audit 2021-03-10T20:40:11.686055+0000 mon.a (mon.0) 1013 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:40:12.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:12 gibba023 bash[31815]: audit 2021-03-10T20:40:11.895430+0000 mon.a (mon.0) 1014 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:40:12.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:12 gibba023 bash[31815]: audit 2021-03-10T20:40:11.899082+0000 mon.a (mon.0) 1015 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:40:12.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:12 gibba023 bash[31815]: audit 2021-03-10T20:40:11.900828+0000 mon.a (mon.0) 1016 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:12.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:12 gibba023 bash[31815]: audit 2021-03-10T20:40:11.902464+0000 mon.a (mon.0) 1017 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:12.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:12 gibba023 bash[31815]: audit 2021-03-10T20:40:11.904246+0000 mon.a (mon.0) 1018 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:12.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:12 gibba023 bash[31815]: audit 2021-03-10T20:40:11.907387+0000 mon.a (mon.0) 1019 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:12.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:12 gibba023 bash[31815]: audit 2021-03-10T20:40:11.909232+0000 mon.a (mon.0) 1020 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:13.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[30844]: cephadm 2021-03-10T20:40:11.497563+0000 mgr.gibba044.wflcwh (mgr.34466) 1715 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:40:13.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[30844]: cephadm 2021-03-10T20:40:11.688212+0000 mgr.gibba044.wflcwh (mgr.34466) 1716 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:40:13.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[30844]: cephadm 2021-03-10T20:40:11.899972+0000 mgr.gibba044.wflcwh (mgr.34466) 1717 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:40:13.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[30844]: cephadm 2021-03-10T20:40:11.901733+0000 mgr.gibba044.wflcwh (mgr.34466) 1718 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:40:13.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[30844]: cephadm 2021-03-10T20:40:11.903451+0000 mgr.gibba044.wflcwh (mgr.34466) 1719 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:40:13.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[30844]: cephadm 2021-03-10T20:40:11.903491+0000 mgr.gibba044.wflcwh (mgr.34466) 1720 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:40:13.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[30844]: cephadm 2021-03-10T20:40:11.905216+0000 mgr.gibba044.wflcwh (mgr.34466) 1721 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:40:13.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[30844]: cephadm 2021-03-10T20:40:11.905257+0000 mgr.gibba044.wflcwh (mgr.34466) 1722 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:40:13.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[30844]: cephadm 2021-03-10T20:40:11.906787+0000 mgr.gibba044.wflcwh (mgr.34466) 1723 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:40:13.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[30844]: cephadm 2021-03-10T20:40:11.908300+0000 mgr.gibba044.wflcwh (mgr.34466) 1724 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:40:13.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[30844]: cephadm 2021-03-10T20:40:11.908344+0000 mgr.gibba044.wflcwh (mgr.34466) 1725 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:40:13.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[30844]: cephadm 2021-03-10T20:40:11.910102+0000 mgr.gibba044.wflcwh (mgr.34466) 1726 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:40:13.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[30844]: cephadm 2021-03-10T20:40:11.910494+0000 mgr.gibba044.wflcwh (mgr.34466) 1727 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:40:13.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[30844]: cephadm 2021-03-10T20:40:11.911754+0000 mgr.gibba044.wflcwh (mgr.34466) 1728 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:40:13.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[30844]: cephadm 2021-03-10T20:40:11.911797+0000 mgr.gibba044.wflcwh (mgr.34466) 1729 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:40:13.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[30844]: cephadm 2021-03-10T20:40:11.911958+0000 mgr.gibba044.wflcwh (mgr.34466) 1730 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:40:13.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[31815]: cephadm 2021-03-10T20:40:11.497563+0000 mgr.gibba044.wflcwh (mgr.34466) 1715 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:40:13.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[31815]: cephadm 2021-03-10T20:40:11.688212+0000 mgr.gibba044.wflcwh (mgr.34466) 1716 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:40:13.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[31815]: cephadm 2021-03-10T20:40:11.899972+0000 mgr.gibba044.wflcwh (mgr.34466) 1717 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:40:13.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[31815]: cephadm 2021-03-10T20:40:11.901733+0000 mgr.gibba044.wflcwh (mgr.34466) 1718 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:40:13.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[31815]: cephadm 2021-03-10T20:40:11.903451+0000 mgr.gibba044.wflcwh (mgr.34466) 1719 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:40:13.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[31815]: cephadm 2021-03-10T20:40:11.903491+0000 mgr.gibba044.wflcwh (mgr.34466) 1720 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:40:13.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[31815]: cephadm 2021-03-10T20:40:11.905216+0000 mgr.gibba044.wflcwh (mgr.34466) 1721 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:40:13.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[31815]: cephadm 2021-03-10T20:40:11.905257+0000 mgr.gibba044.wflcwh (mgr.34466) 1722 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:40:13.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[31815]: cephadm 2021-03-10T20:40:11.906787+0000 mgr.gibba044.wflcwh (mgr.34466) 1723 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:40:13.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[31815]: cephadm 2021-03-10T20:40:11.908300+0000 mgr.gibba044.wflcwh (mgr.34466) 1724 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:40:13.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[31815]: cephadm 2021-03-10T20:40:11.908344+0000 mgr.gibba044.wflcwh (mgr.34466) 1725 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:40:13.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[31815]: cephadm 2021-03-10T20:40:11.910102+0000 mgr.gibba044.wflcwh (mgr.34466) 1726 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:40:13.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[31815]: cephadm 2021-03-10T20:40:11.910494+0000 mgr.gibba044.wflcwh (mgr.34466) 1727 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:40:13.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[31815]: cephadm 2021-03-10T20:40:11.911754+0000 mgr.gibba044.wflcwh (mgr.34466) 1728 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:40:13.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[31815]: cephadm 2021-03-10T20:40:11.911797+0000 mgr.gibba044.wflcwh (mgr.34466) 1729 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:40:13.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:13 gibba023 bash[31815]: cephadm 2021-03-10T20:40:11.911958+0000 mgr.gibba044.wflcwh (mgr.34466) 1730 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:40:13.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:13 gibba044 bash[25485]: cephadm 2021-03-10T20:40:11.497563+0000 mgr.gibba044.wflcwh (mgr.34466) 1715 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:40:13.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:13 gibba044 bash[25485]: cephadm 2021-03-10T20:40:11.688212+0000 mgr.gibba044.wflcwh (mgr.34466) 1716 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:40:13.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:13 gibba044 bash[25485]: cephadm 2021-03-10T20:40:11.899972+0000 mgr.gibba044.wflcwh (mgr.34466) 1717 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:40:13.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:13 gibba044 bash[25485]: cephadm 2021-03-10T20:40:11.901733+0000 mgr.gibba044.wflcwh (mgr.34466) 1718 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:40:13.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:13 gibba044 bash[25485]: cephadm 2021-03-10T20:40:11.903451+0000 mgr.gibba044.wflcwh (mgr.34466) 1719 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:40:13.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:13 gibba044 bash[25485]: cephadm 2021-03-10T20:40:11.903491+0000 mgr.gibba044.wflcwh (mgr.34466) 1720 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:40:13.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:13 gibba044 bash[25485]: cephadm 2021-03-10T20:40:11.905216+0000 mgr.gibba044.wflcwh (mgr.34466) 1721 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:40:13.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:13 gibba044 bash[25485]: cephadm 2021-03-10T20:40:11.905257+0000 mgr.gibba044.wflcwh (mgr.34466) 1722 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:40:13.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:13 gibba044 bash[25485]: cephadm 2021-03-10T20:40:11.906787+0000 mgr.gibba044.wflcwh (mgr.34466) 1723 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:40:13.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:13 gibba044 bash[25485]: cephadm 2021-03-10T20:40:11.908300+0000 mgr.gibba044.wflcwh (mgr.34466) 1724 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:40:13.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:13 gibba044 bash[25485]: cephadm 2021-03-10T20:40:11.908344+0000 mgr.gibba044.wflcwh (mgr.34466) 1725 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:40:13.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:13 gibba044 bash[25485]: cephadm 2021-03-10T20:40:11.910102+0000 mgr.gibba044.wflcwh (mgr.34466) 1726 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:40:13.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:13 gibba044 bash[25485]: cephadm 2021-03-10T20:40:11.910494+0000 mgr.gibba044.wflcwh (mgr.34466) 1727 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:40:13.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:13 gibba044 bash[25485]: cephadm 2021-03-10T20:40:11.911754+0000 mgr.gibba044.wflcwh (mgr.34466) 1728 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:40:13.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:13 gibba044 bash[25485]: cephadm 2021-03-10T20:40:11.911797+0000 mgr.gibba044.wflcwh (mgr.34466) 1729 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:40:13.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:13 gibba044 bash[25485]: cephadm 2021-03-10T20:40:11.911958+0000 mgr.gibba044.wflcwh (mgr.34466) 1730 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:40:14.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:14 gibba023 bash[30844]: cluster 2021-03-10T20:40:12.587747+0000 mgr.gibba044.wflcwh (mgr.34466) 1731 : cluster [DBG] pgmap v967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:14.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:14 gibba023 bash[31815]: cluster 2021-03-10T20:40:12.587747+0000 mgr.gibba044.wflcwh (mgr.34466) 1731 : cluster [DBG] pgmap v967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:14.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:14 gibba044 bash[25485]: cluster 2021-03-10T20:40:12.587747+0000 mgr.gibba044.wflcwh (mgr.34466) 1731 : cluster [DBG] pgmap v967: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:16.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:16 gibba023 bash[30844]: cluster 2021-03-10T20:40:14.589107+0000 mgr.gibba044.wflcwh (mgr.34466) 1732 : cluster [DBG] pgmap v968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:16.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:16 gibba023 bash[31815]: cluster 2021-03-10T20:40:14.589107+0000 mgr.gibba044.wflcwh (mgr.34466) 1732 : cluster [DBG] pgmap v968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:16.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:16 gibba044 bash[25485]: cluster 2021-03-10T20:40:14.589107+0000 mgr.gibba044.wflcwh (mgr.34466) 1732 : cluster [DBG] pgmap v968: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:18.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:18 gibba023 bash[30844]: cluster 2021-03-10T20:40:16.590573+0000 mgr.gibba044.wflcwh (mgr.34466) 1733 : cluster [DBG] pgmap v969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:18.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:18 gibba023 bash[31815]: cluster 2021-03-10T20:40:16.590573+0000 mgr.gibba044.wflcwh (mgr.34466) 1733 : cluster [DBG] pgmap v969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:18.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:18 gibba044 bash[25485]: cluster 2021-03-10T20:40:16.590573+0000 mgr.gibba044.wflcwh (mgr.34466) 1733 : cluster [DBG] pgmap v969: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:20.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:20 gibba023 bash[30844]: cluster 2021-03-10T20:40:18.592169+0000 mgr.gibba044.wflcwh (mgr.34466) 1734 : cluster [DBG] pgmap v970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:20.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:20 gibba023 bash[31815]: cluster 2021-03-10T20:40:18.592169+0000 mgr.gibba044.wflcwh (mgr.34466) 1734 : cluster [DBG] pgmap v970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:20.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:20 gibba044 bash[25485]: cluster 2021-03-10T20:40:18.592169+0000 mgr.gibba044.wflcwh (mgr.34466) 1734 : cluster [DBG] pgmap v970: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:22.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:22 gibba023 bash[30844]: cluster 2021-03-10T20:40:20.593863+0000 mgr.gibba044.wflcwh (mgr.34466) 1735 : cluster [DBG] pgmap v971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:22.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:22 gibba023 bash[31815]: cluster 2021-03-10T20:40:20.593863+0000 mgr.gibba044.wflcwh (mgr.34466) 1735 : cluster [DBG] pgmap v971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:22.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:22 gibba044 bash[25485]: cluster 2021-03-10T20:40:20.593863+0000 mgr.gibba044.wflcwh (mgr.34466) 1735 : cluster [DBG] pgmap v971: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:24.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:24 gibba023 bash[30844]: cluster 2021-03-10T20:40:22.595078+0000 mgr.gibba044.wflcwh (mgr.34466) 1736 : cluster [DBG] pgmap v972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:24.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:24 gibba023 bash[31815]: cluster 2021-03-10T20:40:22.595078+0000 mgr.gibba044.wflcwh (mgr.34466) 1736 : cluster [DBG] pgmap v972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:24.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:24 gibba044 bash[25485]: cluster 2021-03-10T20:40:22.595078+0000 mgr.gibba044.wflcwh (mgr.34466) 1736 : cluster [DBG] pgmap v972: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:26.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:26 gibba023 bash[30844]: cluster 2021-03-10T20:40:24.596636+0000 mgr.gibba044.wflcwh (mgr.34466) 1737 : cluster [DBG] pgmap v973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:26.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:26 gibba023 bash[31815]: cluster 2021-03-10T20:40:24.596636+0000 mgr.gibba044.wflcwh (mgr.34466) 1737 : cluster [DBG] pgmap v973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:26.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:26 gibba044 bash[25485]: cluster 2021-03-10T20:40:24.596636+0000 mgr.gibba044.wflcwh (mgr.34466) 1737 : cluster [DBG] pgmap v973: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:28.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:28 gibba023 bash[30844]: cluster 2021-03-10T20:40:26.597987+0000 mgr.gibba044.wflcwh (mgr.34466) 1738 : cluster [DBG] pgmap v974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:28.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:28 gibba023 bash[30844]: cephadm 2021-03-10T20:40:26.928079+0000 mgr.gibba044.wflcwh (mgr.34466) 1739 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:40:28.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:28 gibba023 bash[30844]: audit 2021-03-10T20:40:27.214705+0000 mon.a (mon.0) 1021 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:40:28.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:28 gibba023 bash[30844]: audit 2021-03-10T20:40:27.215371+0000 mon.a (mon.0) 1022 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:40:28.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:28 gibba023 bash[30844]: audit 2021-03-10T20:40:27.215955+0000 mon.a (mon.0) 1023 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T20:40:28.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:28 gibba023 bash[30844]: audit 2021-03-10T20:40:27.216694+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:40:28.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:28 gibba023 bash[30844]: audit 2021-03-10T20:40:27.217362+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:40:28.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:28 gibba023 bash[30844]: audit 2021-03-10T20:40:27.218037+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:40:28.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:28 gibba023 bash[31815]: cluster 2021-03-10T20:40:26.597987+0000 mgr.gibba044.wflcwh (mgr.34466) 1738 : cluster [DBG] pgmap v974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:28.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:28 gibba023 bash[31815]: cephadm 2021-03-10T20:40:26.928079+0000 mgr.gibba044.wflcwh (mgr.34466) 1739 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:40:28.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:28 gibba023 bash[31815]: audit 2021-03-10T20:40:27.214705+0000 mon.a (mon.0) 1021 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:40:28.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:28 gibba023 bash[31815]: audit 2021-03-10T20:40:27.215371+0000 mon.a (mon.0) 1022 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:40:28.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:28 gibba023 bash[31815]: audit 2021-03-10T20:40:27.215955+0000 mon.a (mon.0) 1023 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T20:40:28.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:28 gibba023 bash[31815]: audit 2021-03-10T20:40:27.216694+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:40:28.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:28 gibba023 bash[31815]: audit 2021-03-10T20:40:27.217362+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:40:28.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:28 gibba023 bash[31815]: audit 2021-03-10T20:40:27.218037+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:40:28.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:28 gibba044 bash[25485]: cluster 2021-03-10T20:40:26.597987+0000 mgr.gibba044.wflcwh (mgr.34466) 1738 : cluster [DBG] pgmap v974: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:28.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:28 gibba044 bash[25485]: cephadm 2021-03-10T20:40:26.928079+0000 mgr.gibba044.wflcwh (mgr.34466) 1739 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:40:28.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:28 gibba044 bash[25485]: audit 2021-03-10T20:40:27.214705+0000 mon.a (mon.0) 1021 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:40:28.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:28 gibba044 bash[25485]: audit 2021-03-10T20:40:27.215371+0000 mon.a (mon.0) 1022 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:40:28.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:28 gibba044 bash[25485]: audit 2021-03-10T20:40:27.215955+0000 mon.a (mon.0) 1023 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T20:40:28.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:28 gibba044 bash[25485]: audit 2021-03-10T20:40:27.216694+0000 mon.a (mon.0) 1024 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:40:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:28 gibba044 bash[25485]: audit 2021-03-10T20:40:27.217362+0000 mon.a (mon.0) 1025 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:40:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:28 gibba044 bash[25485]: audit 2021-03-10T20:40:27.218037+0000 mon.a (mon.0) 1026 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:40:29.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:29 gibba023 bash[30844]: cluster 2021-03-10T20:40:28.599575+0000 mgr.gibba044.wflcwh (mgr.34466) 1740 : cluster [DBG] pgmap v975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:29.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:29 gibba023 bash[31815]: cluster 2021-03-10T20:40:28.599575+0000 mgr.gibba044.wflcwh (mgr.34466) 1740 : cluster [DBG] pgmap v975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:29.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:29 gibba044 bash[25485]: cluster 2021-03-10T20:40:28.599575+0000 mgr.gibba044.wflcwh (mgr.34466) 1740 : cluster [DBG] pgmap v975: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:30.202 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:40:30.429 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:40:30.429 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (31m) 7m ago 37m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:40:30.430 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (36m) 6m ago 36m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:40:30.430 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (32m) 6m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:40:30.430 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (32m) 6m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:40:30.430 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (31m) 7m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:40:30.430 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (31m) 7m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:40:30.431 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (30m) 6m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:40:30.431 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (30m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:40:30.431 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (37m) 7m ago 37m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:40:30.431 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (37m) 6m ago 37m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:40:30.432 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (29m) 7m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:40:30.432 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (29m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:40:30.432 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (29m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:40:30.432 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (28m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:40:30.432 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (28m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:40:30.433 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (27m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:40:30.433 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (27m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:40:30.433 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (26m) 6m ago 37m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:40:30.433 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (36m) 6m ago 37m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:40:30.434 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 7m ago 35m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:40:30.434 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 6m ago 35m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:40:30.677 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:40:30.677 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:40:30.678 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:40:30.678 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:40:30.678 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:40:30.683 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:40:30.683 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:40:30.683 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:40:30.684 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:40:30.684 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:40:30.684 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:40:30.684 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:40:30.685 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:40:30.685 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:40:30.685 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:40:31.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:31 gibba023 bash[30844]: audit 2021-03-10T20:40:30.195441+0000 mgr.gibba044.wflcwh (mgr.34466) 1741 : audit [DBG] from='client.45228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:40:31.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:31 gibba023 bash[30844]: audit 2021-03-10T20:40:30.418265+0000 mgr.gibba044.wflcwh (mgr.34466) 1742 : audit [DBG] from='client.45234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:40:31.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:31 gibba023 bash[30844]: cluster 2021-03-10T20:40:30.601427+0000 mgr.gibba044.wflcwh (mgr.34466) 1743 : cluster [DBG] pgmap v976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:31.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:31 gibba023 bash[30844]: audit 2021-03-10T20:40:30.677006+0000 mon.c (mon.1) 45 : audit [DBG] from='client.? 172.21.2.123:0/3090388419' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:31.925 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:31 gibba023 bash[31815]: audit 2021-03-10T20:40:30.195441+0000 mgr.gibba044.wflcwh (mgr.34466) 1741 : audit [DBG] from='client.45228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:40:31.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:31 gibba023 bash[31815]: audit 2021-03-10T20:40:30.418265+0000 mgr.gibba044.wflcwh (mgr.34466) 1742 : audit [DBG] from='client.45234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:40:31.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:31 gibba023 bash[31815]: cluster 2021-03-10T20:40:30.601427+0000 mgr.gibba044.wflcwh (mgr.34466) 1743 : cluster [DBG] pgmap v976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:31.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:31 gibba023 bash[31815]: audit 2021-03-10T20:40:30.677006+0000 mon.c (mon.1) 45 : audit [DBG] from='client.? 172.21.2.123:0/3090388419' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:32.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:31 gibba044 bash[25485]: audit 2021-03-10T20:40:30.195441+0000 mgr.gibba044.wflcwh (mgr.34466) 1741 : audit [DBG] from='client.45228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:40:32.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:31 gibba044 bash[25485]: audit 2021-03-10T20:40:30.418265+0000 mgr.gibba044.wflcwh (mgr.34466) 1742 : audit [DBG] from='client.45234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:40:32.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:31 gibba044 bash[25485]: cluster 2021-03-10T20:40:30.601427+0000 mgr.gibba044.wflcwh (mgr.34466) 1743 : cluster [DBG] pgmap v976: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:32.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:31 gibba044 bash[25485]: audit 2021-03-10T20:40:30.677006+0000 mon.c (mon.1) 45 : audit [DBG] from='client.? 172.21.2.123:0/3090388419' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:40:34.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:33 gibba023 bash[30844]: cluster 2021-03-10T20:40:32.602899+0000 mgr.gibba044.wflcwh (mgr.34466) 1744 : cluster [DBG] pgmap v977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:34.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:33 gibba023 bash[31815]: cluster 2021-03-10T20:40:32.602899+0000 mgr.gibba044.wflcwh (mgr.34466) 1744 : cluster [DBG] pgmap v977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:34.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:33 gibba044 bash[25485]: cluster 2021-03-10T20:40:32.602899+0000 mgr.gibba044.wflcwh (mgr.34466) 1744 : cluster [DBG] pgmap v977: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:36.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:35 gibba023 bash[30844]: cluster 2021-03-10T20:40:34.604314+0000 mgr.gibba044.wflcwh (mgr.34466) 1745 : cluster [DBG] pgmap v978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:36.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:35 gibba023 bash[31815]: cluster 2021-03-10T20:40:34.604314+0000 mgr.gibba044.wflcwh (mgr.34466) 1745 : cluster [DBG] pgmap v978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:36.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:35 gibba044 bash[25485]: cluster 2021-03-10T20:40:34.604314+0000 mgr.gibba044.wflcwh (mgr.34466) 1745 : cluster [DBG] pgmap v978: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:38.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:37 gibba023 bash[30844]: cluster 2021-03-10T20:40:36.605651+0000 mgr.gibba044.wflcwh (mgr.34466) 1746 : cluster [DBG] pgmap v979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:38.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:37 gibba023 bash[31815]: cluster 2021-03-10T20:40:36.605651+0000 mgr.gibba044.wflcwh (mgr.34466) 1746 : cluster [DBG] pgmap v979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:38.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:37 gibba044 bash[25485]: cluster 2021-03-10T20:40:36.605651+0000 mgr.gibba044.wflcwh (mgr.34466) 1746 : cluster [DBG] pgmap v979: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:40.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:39 gibba023 bash[30844]: cluster 2021-03-10T20:40:38.607250+0000 mgr.gibba044.wflcwh (mgr.34466) 1747 : cluster [DBG] pgmap v980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:40.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:39 gibba023 bash[31815]: cluster 2021-03-10T20:40:38.607250+0000 mgr.gibba044.wflcwh (mgr.34466) 1747 : cluster [DBG] pgmap v980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:40.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:39 gibba044 bash[25485]: cluster 2021-03-10T20:40:38.607250+0000 mgr.gibba044.wflcwh (mgr.34466) 1747 : cluster [DBG] pgmap v980: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:42.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:41 gibba023 bash[30844]: cluster 2021-03-10T20:40:40.609096+0000 mgr.gibba044.wflcwh (mgr.34466) 1748 : cluster [DBG] pgmap v981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:42.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:41 gibba023 bash[31815]: cluster 2021-03-10T20:40:40.609096+0000 mgr.gibba044.wflcwh (mgr.34466) 1748 : cluster [DBG] pgmap v981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:42.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:41 gibba044 bash[25485]: cluster 2021-03-10T20:40:40.609096+0000 mgr.gibba044.wflcwh (mgr.34466) 1748 : cluster [DBG] pgmap v981: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:43.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:42 gibba044 bash[25485]: cephadm 2021-03-10T20:40:41.943588+0000 mgr.gibba044.wflcwh (mgr.34466) 1749 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:40:43.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:42 gibba023 bash[30844]: cephadm 2021-03-10T20:40:41.943588+0000 mgr.gibba044.wflcwh (mgr.34466) 1749 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:40:43.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:42 gibba023 bash[31815]: cephadm 2021-03-10T20:40:41.943588+0000 mgr.gibba044.wflcwh (mgr.34466) 1749 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:40:44.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:43 gibba044 bash[25485]: cluster 2021-03-10T20:40:42.610631+0000 mgr.gibba044.wflcwh (mgr.34466) 1750 : cluster [DBG] pgmap v982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:44.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:43 gibba023 bash[30844]: cluster 2021-03-10T20:40:42.610631+0000 mgr.gibba044.wflcwh (mgr.34466) 1750 : cluster [DBG] pgmap v982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:44.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:43 gibba023 bash[31815]: cluster 2021-03-10T20:40:42.610631+0000 mgr.gibba044.wflcwh (mgr.34466) 1750 : cluster [DBG] pgmap v982: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:46.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:45 gibba044 bash[25485]: cluster 2021-03-10T20:40:44.612271+0000 mgr.gibba044.wflcwh (mgr.34466) 1751 : cluster [DBG] pgmap v983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:46.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:45 gibba023 bash[30844]: cluster 2021-03-10T20:40:44.612271+0000 mgr.gibba044.wflcwh (mgr.34466) 1751 : cluster [DBG] pgmap v983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:46.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:45 gibba023 bash[31815]: cluster 2021-03-10T20:40:44.612271+0000 mgr.gibba044.wflcwh (mgr.34466) 1751 : cluster [DBG] pgmap v983: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:48.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:47 gibba044 bash[25485]: cluster 2021-03-10T20:40:46.613592+0000 mgr.gibba044.wflcwh (mgr.34466) 1752 : cluster [DBG] pgmap v984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:48.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:47 gibba023 bash[30844]: cluster 2021-03-10T20:40:46.613592+0000 mgr.gibba044.wflcwh (mgr.34466) 1752 : cluster [DBG] pgmap v984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:48.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:47 gibba023 bash[31815]: cluster 2021-03-10T20:40:46.613592+0000 mgr.gibba044.wflcwh (mgr.34466) 1752 : cluster [DBG] pgmap v984: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:50.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:49 gibba044 bash[25485]: cluster 2021-03-10T20:40:48.615408+0000 mgr.gibba044.wflcwh (mgr.34466) 1753 : cluster [DBG] pgmap v985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:50.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:49 gibba023 bash[30844]: cluster 2021-03-10T20:40:48.615408+0000 mgr.gibba044.wflcwh (mgr.34466) 1753 : cluster [DBG] pgmap v985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:50.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:49 gibba023 bash[31815]: cluster 2021-03-10T20:40:48.615408+0000 mgr.gibba044.wflcwh (mgr.34466) 1753 : cluster [DBG] pgmap v985: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:52.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:51 gibba044 bash[25485]: cluster 2021-03-10T20:40:50.616980+0000 mgr.gibba044.wflcwh (mgr.34466) 1754 : cluster [DBG] pgmap v986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:52.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:51 gibba023 bash[30844]: cluster 2021-03-10T20:40:50.616980+0000 mgr.gibba044.wflcwh (mgr.34466) 1754 : cluster [DBG] pgmap v986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:52.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:51 gibba023 bash[31815]: cluster 2021-03-10T20:40:50.616980+0000 mgr.gibba044.wflcwh (mgr.34466) 1754 : cluster [DBG] pgmap v986: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:54.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:53 gibba044 bash[25485]: cluster 2021-03-10T20:40:52.618389+0000 mgr.gibba044.wflcwh (mgr.34466) 1755 : cluster [DBG] pgmap v987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:54.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:53 gibba023 bash[30844]: cluster 2021-03-10T20:40:52.618389+0000 mgr.gibba044.wflcwh (mgr.34466) 1755 : cluster [DBG] pgmap v987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:54.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:53 gibba023 bash[31815]: cluster 2021-03-10T20:40:52.618389+0000 mgr.gibba044.wflcwh (mgr.34466) 1755 : cluster [DBG] pgmap v987: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:56.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:55 gibba044 bash[25485]: cluster 2021-03-10T20:40:54.620040+0000 mgr.gibba044.wflcwh (mgr.34466) 1756 : cluster [DBG] pgmap v988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:56.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:55 gibba023 bash[30844]: cluster 2021-03-10T20:40:54.620040+0000 mgr.gibba044.wflcwh (mgr.34466) 1756 : cluster [DBG] pgmap v988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:56.527 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:55 gibba023 bash[31815]: cluster 2021-03-10T20:40:54.620040+0000 mgr.gibba044.wflcwh (mgr.34466) 1756 : cluster [DBG] pgmap v988: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:58.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:57 gibba044 bash[25485]: cluster 2021-03-10T20:40:56.621623+0000 mgr.gibba044.wflcwh (mgr.34466) 1757 : cluster [DBG] pgmap v989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:58.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:40:57 gibba044 bash[25485]: cephadm 2021-03-10T20:40:56.959391+0000 mgr.gibba044.wflcwh (mgr.34466) 1758 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:40:58.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:57 gibba023 bash[30844]: cluster 2021-03-10T20:40:56.621623+0000 mgr.gibba044.wflcwh (mgr.34466) 1757 : cluster [DBG] pgmap v989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:58.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:57 gibba023 bash[30844]: cephadm 2021-03-10T20:40:56.959391+0000 mgr.gibba044.wflcwh (mgr.34466) 1758 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:40:58.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:57 gibba023 bash[31815]: cluster 2021-03-10T20:40:56.621623+0000 mgr.gibba044.wflcwh (mgr.34466) 1757 : cluster [DBG] pgmap v989: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:40:58.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:57 gibba023 bash[31815]: cephadm 2021-03-10T20:40:56.959391+0000 mgr.gibba044.wflcwh (mgr.34466) 1758 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:41:00.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:00 gibba044 bash[25485]: cluster 2021-03-10T20:40:58.623154+0000 mgr.gibba044.wflcwh (mgr.34466) 1759 : cluster [DBG] pgmap v990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:00.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:40:59 gibba023 bash[30844]: cluster 2021-03-10T20:40:58.623154+0000 mgr.gibba044.wflcwh (mgr.34466) 1759 : cluster [DBG] pgmap v990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:00.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:40:59 gibba023 bash[31815]: cluster 2021-03-10T20:40:58.623154+0000 mgr.gibba044.wflcwh (mgr.34466) 1759 : cluster [DBG] pgmap v990: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:00.920 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:41:01.147 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:41:01.147 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (32m) 7m ago 37m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:41:01.147 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (37m) 6m ago 37m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:41:01.148 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (32m) 6m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:41:01.148 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (32m) 6m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:41:01.148 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (31m) 7m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:41:01.148 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (31m) 7m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:41:01.149 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (31m) 6m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:41:01.149 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (31m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:41:01.149 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (37m) 7m ago 37m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:41:01.149 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (37m) 6m ago 37m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:41:01.149 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (30m) 7m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:41:01.150 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (29m) 7m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:41:01.150 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (29m) 7m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:41:01.150 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (29m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:41:01.150 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (28m) 6m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:41:01.150 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (28m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:41:01.151 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (27m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:41:01.151 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (27m) 6m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:41:01.151 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (37m) 6m ago 37m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:41:01.151 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 7m ago 35m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:41:01.152 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 6m ago 35m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:41:01.393 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:41:01.393 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:41:01.393 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:41:01.394 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:41:01.394 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:41:01.394 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:41:01.394 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:41:01.394 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:41:01.395 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:41:01.395 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:41:01.395 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:41:01.395 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:41:01.396 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:41:01.396 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:41:01.396 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:41:02.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:02 gibba023 bash[30844]: cluster 2021-03-10T20:41:00.624803+0000 mgr.gibba044.wflcwh (mgr.34466) 1760 : cluster [DBG] pgmap v991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:02.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:02 gibba023 bash[30844]: audit 2021-03-10T20:41:00.913137+0000 mgr.gibba044.wflcwh (mgr.34466) 1761 : audit [DBG] from='client.55225 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:41:02.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:02 gibba023 bash[30844]: audit 2021-03-10T20:41:01.393024+0000 mon.c (mon.1) 46 : audit [DBG] from='client.? 172.21.2.123:0/3588382401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:02.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:02 gibba023 bash[31815]: cluster 2021-03-10T20:41:00.624803+0000 mgr.gibba044.wflcwh (mgr.34466) 1760 : cluster [DBG] pgmap v991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:02.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:02 gibba023 bash[31815]: audit 2021-03-10T20:41:00.913137+0000 mgr.gibba044.wflcwh (mgr.34466) 1761 : audit [DBG] from='client.55225 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:41:02.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:02 gibba023 bash[31815]: audit 2021-03-10T20:41:01.393024+0000 mon.c (mon.1) 46 : audit [DBG] from='client.? 172.21.2.123:0/3588382401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:02.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:02 gibba044 bash[25485]: cluster 2021-03-10T20:41:00.624803+0000 mgr.gibba044.wflcwh (mgr.34466) 1760 : cluster [DBG] pgmap v991: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:02.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:02 gibba044 bash[25485]: audit 2021-03-10T20:41:00.913137+0000 mgr.gibba044.wflcwh (mgr.34466) 1761 : audit [DBG] from='client.55225 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:41:02.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:02 gibba044 bash[25485]: audit 2021-03-10T20:41:01.393024+0000 mon.c (mon.1) 46 : audit [DBG] from='client.? 172.21.2.123:0/3588382401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:03.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:03 gibba023 bash[30844]: audit 2021-03-10T20:41:01.136046+0000 mgr.gibba044.wflcwh (mgr.34466) 1762 : audit [DBG] from='client.55231 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:41:03.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:03 gibba023 bash[31815]: audit 2021-03-10T20:41:01.136046+0000 mgr.gibba044.wflcwh (mgr.34466) 1762 : audit [DBG] from='client.55231 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:41:03.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:03 gibba044 bash[25485]: audit 2021-03-10T20:41:01.136046+0000 mgr.gibba044.wflcwh (mgr.34466) 1762 : audit [DBG] from='client.55231 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:41:04.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:04 gibba023 bash[30844]: cluster 2021-03-10T20:41:02.626164+0000 mgr.gibba044.wflcwh (mgr.34466) 1763 : cluster [DBG] pgmap v992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:04.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:04 gibba023 bash[31815]: cluster 2021-03-10T20:41:02.626164+0000 mgr.gibba044.wflcwh (mgr.34466) 1763 : cluster [DBG] pgmap v992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:04.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:04 gibba044 bash[25485]: cluster 2021-03-10T20:41:02.626164+0000 mgr.gibba044.wflcwh (mgr.34466) 1763 : cluster [DBG] pgmap v992: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:06.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:06 gibba023 bash[30844]: cluster 2021-03-10T20:41:04.627665+0000 mgr.gibba044.wflcwh (mgr.34466) 1764 : cluster [DBG] pgmap v993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:06.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:06 gibba023 bash[31815]: cluster 2021-03-10T20:41:04.627665+0000 mgr.gibba044.wflcwh (mgr.34466) 1764 : cluster [DBG] pgmap v993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:06.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:06 gibba044 bash[25485]: cluster 2021-03-10T20:41:04.627665+0000 mgr.gibba044.wflcwh (mgr.34466) 1764 : cluster [DBG] pgmap v993: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:08.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:08 gibba023 bash[30844]: cluster 2021-03-10T20:41:06.629245+0000 mgr.gibba044.wflcwh (mgr.34466) 1765 : cluster [DBG] pgmap v994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:08.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:08 gibba023 bash[31815]: cluster 2021-03-10T20:41:06.629245+0000 mgr.gibba044.wflcwh (mgr.34466) 1765 : cluster [DBG] pgmap v994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:08.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:08 gibba044 bash[25485]: cluster 2021-03-10T20:41:06.629245+0000 mgr.gibba044.wflcwh (mgr.34466) 1765 : cluster [DBG] pgmap v994: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:10.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:10 gibba023 bash[30844]: cluster 2021-03-10T20:41:08.631103+0000 mgr.gibba044.wflcwh (mgr.34466) 1766 : cluster [DBG] pgmap v995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:10.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:10 gibba023 bash[31815]: cluster 2021-03-10T20:41:08.631103+0000 mgr.gibba044.wflcwh (mgr.34466) 1766 : cluster [DBG] pgmap v995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:10.499 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:10 gibba044 bash[25485]: cluster 2021-03-10T20:41:08.631103+0000 mgr.gibba044.wflcwh (mgr.34466) 1766 : cluster [DBG] pgmap v995: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:12.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:12 gibba023 bash[30844]: cluster 2021-03-10T20:41:10.632804+0000 mgr.gibba044.wflcwh (mgr.34466) 1767 : cluster [DBG] pgmap v996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:12.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:12 gibba023 bash[31815]: cluster 2021-03-10T20:41:10.632804+0000 mgr.gibba044.wflcwh (mgr.34466) 1767 : cluster [DBG] pgmap v996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:12.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:12 gibba044 bash[25485]: cluster 2021-03-10T20:41:10.632804+0000 mgr.gibba044.wflcwh (mgr.34466) 1767 : cluster [DBG] pgmap v996: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:13.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:13 gibba023 bash[30844]: cephadm 2021-03-10T20:41:11.976036+0000 mgr.gibba044.wflcwh (mgr.34466) 1768 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:41:13.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:13 gibba023 bash[30844]: cephadm 2021-03-10T20:41:11.977304+0000 mgr.gibba044.wflcwh (mgr.34466) 1769 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:41:13.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:13 gibba023 bash[30844]: audit 2021-03-10T20:41:12.204485+0000 mon.a (mon.0) 1027 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:41:13.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:13 gibba023 bash[30844]: audit 2021-03-10T20:41:12.208162+0000 mon.a (mon.0) 1028 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:41:13.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:13 gibba023 bash[30844]: audit 2021-03-10T20:41:12.209671+0000 mon.a (mon.0) 1029 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:13.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:13 gibba023 bash[30844]: audit 2021-03-10T20:41:12.210985+0000 mon.a (mon.0) 1030 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:13.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:13 gibba023 bash[30844]: audit 2021-03-10T20:41:12.212206+0000 mon.a (mon.0) 1031 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:13.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:13 gibba023 bash[30844]: audit 2021-03-10T20:41:12.214634+0000 mon.a (mon.0) 1032 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:13.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:13 gibba023 bash[30844]: audit 2021-03-10T20:41:12.215915+0000 mon.a (mon.0) 1033 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:13.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:13 gibba023 bash[31815]: cephadm 2021-03-10T20:41:11.976036+0000 mgr.gibba044.wflcwh (mgr.34466) 1768 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:41:13.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:13 gibba023 bash[31815]: cephadm 2021-03-10T20:41:11.977304+0000 mgr.gibba044.wflcwh (mgr.34466) 1769 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:41:13.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:13 gibba023 bash[31815]: audit 2021-03-10T20:41:12.204485+0000 mon.a (mon.0) 1027 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:41:13.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:13 gibba023 bash[31815]: audit 2021-03-10T20:41:12.208162+0000 mon.a (mon.0) 1028 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:41:13.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:13 gibba023 bash[31815]: audit 2021-03-10T20:41:12.209671+0000 mon.a (mon.0) 1029 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:13.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:13 gibba023 bash[31815]: audit 2021-03-10T20:41:12.210985+0000 mon.a (mon.0) 1030 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:13.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:13 gibba023 bash[31815]: audit 2021-03-10T20:41:12.212206+0000 mon.a (mon.0) 1031 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:13.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:13 gibba023 bash[31815]: audit 2021-03-10T20:41:12.214634+0000 mon.a (mon.0) 1032 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:13.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:13 gibba023 bash[31815]: audit 2021-03-10T20:41:12.215915+0000 mon.a (mon.0) 1033 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:13.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:13 gibba044 bash[25485]: cephadm 2021-03-10T20:41:11.976036+0000 mgr.gibba044.wflcwh (mgr.34466) 1768 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:41:13.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:13 gibba044 bash[25485]: cephadm 2021-03-10T20:41:11.977304+0000 mgr.gibba044.wflcwh (mgr.34466) 1769 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:41:13.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:13 gibba044 bash[25485]: audit 2021-03-10T20:41:12.204485+0000 mon.a (mon.0) 1027 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:41:13.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:13 gibba044 bash[25485]: audit 2021-03-10T20:41:12.208162+0000 mon.a (mon.0) 1028 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:41:13.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:13 gibba044 bash[25485]: audit 2021-03-10T20:41:12.209671+0000 mon.a (mon.0) 1029 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:13.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:13 gibba044 bash[25485]: audit 2021-03-10T20:41:12.210985+0000 mon.a (mon.0) 1030 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:13.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:13 gibba044 bash[25485]: audit 2021-03-10T20:41:12.212206+0000 mon.a (mon.0) 1031 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:13.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:13 gibba044 bash[25485]: audit 2021-03-10T20:41:12.214634+0000 mon.a (mon.0) 1032 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:13.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:13 gibba044 bash[25485]: audit 2021-03-10T20:41:12.215915+0000 mon.a (mon.0) 1033 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:14.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[30844]: cephadm 2021-03-10T20:41:12.209068+0000 mgr.gibba044.wflcwh (mgr.34466) 1770 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:41:14.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[30844]: cephadm 2021-03-10T20:41:12.210754+0000 mgr.gibba044.wflcwh (mgr.34466) 1771 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:41:14.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[30844]: cephadm 2021-03-10T20:41:12.212029+0000 mgr.gibba044.wflcwh (mgr.34466) 1772 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:41:14.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[30844]: cephadm 2021-03-10T20:41:12.212074+0000 mgr.gibba044.wflcwh (mgr.34466) 1773 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:41:14.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[30844]: cephadm 2021-03-10T20:41:12.213410+0000 mgr.gibba044.wflcwh (mgr.34466) 1774 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:41:14.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[30844]: cephadm 2021-03-10T20:41:12.213454+0000 mgr.gibba044.wflcwh (mgr.34466) 1775 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:41:14.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[30844]: cephadm 2021-03-10T20:41:12.214567+0000 mgr.gibba044.wflcwh (mgr.34466) 1776 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:41:14.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[30844]: cephadm 2021-03-10T20:41:12.215689+0000 mgr.gibba044.wflcwh (mgr.34466) 1777 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:41:14.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[30844]: cephadm 2021-03-10T20:41:12.215733+0000 mgr.gibba044.wflcwh (mgr.34466) 1778 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:41:14.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[30844]: cephadm 2021-03-10T20:41:12.216892+0000 mgr.gibba044.wflcwh (mgr.34466) 1779 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:41:14.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[30844]: cephadm 2021-03-10T20:41:12.217215+0000 mgr.gibba044.wflcwh (mgr.34466) 1780 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:41:14.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[30844]: cephadm 2021-03-10T20:41:12.218149+0000 mgr.gibba044.wflcwh (mgr.34466) 1781 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:41:14.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[30844]: cephadm 2021-03-10T20:41:12.218194+0000 mgr.gibba044.wflcwh (mgr.34466) 1782 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:41:14.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[30844]: cephadm 2021-03-10T20:41:12.218339+0000 mgr.gibba044.wflcwh (mgr.34466) 1783 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:41:14.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[30844]: cluster 2021-03-10T20:41:12.634169+0000 mgr.gibba044.wflcwh (mgr.34466) 1784 : cluster [DBG] pgmap v997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:14.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[31815]: cephadm 2021-03-10T20:41:12.209068+0000 mgr.gibba044.wflcwh (mgr.34466) 1770 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:41:14.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[31815]: cephadm 2021-03-10T20:41:12.210754+0000 mgr.gibba044.wflcwh (mgr.34466) 1771 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:41:14.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[31815]: cephadm 2021-03-10T20:41:12.212029+0000 mgr.gibba044.wflcwh (mgr.34466) 1772 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:41:14.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[31815]: cephadm 2021-03-10T20:41:12.212074+0000 mgr.gibba044.wflcwh (mgr.34466) 1773 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:41:14.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[31815]: cephadm 2021-03-10T20:41:12.213410+0000 mgr.gibba044.wflcwh (mgr.34466) 1774 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:41:14.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[31815]: cephadm 2021-03-10T20:41:12.213454+0000 mgr.gibba044.wflcwh (mgr.34466) 1775 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:41:14.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[31815]: cephadm 2021-03-10T20:41:12.214567+0000 mgr.gibba044.wflcwh (mgr.34466) 1776 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:41:14.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[31815]: cephadm 2021-03-10T20:41:12.215689+0000 mgr.gibba044.wflcwh (mgr.34466) 1777 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:41:14.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[31815]: cephadm 2021-03-10T20:41:12.215733+0000 mgr.gibba044.wflcwh (mgr.34466) 1778 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:41:14.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[31815]: cephadm 2021-03-10T20:41:12.216892+0000 mgr.gibba044.wflcwh (mgr.34466) 1779 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:41:14.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[31815]: cephadm 2021-03-10T20:41:12.217215+0000 mgr.gibba044.wflcwh (mgr.34466) 1780 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:41:14.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[31815]: cephadm 2021-03-10T20:41:12.218149+0000 mgr.gibba044.wflcwh (mgr.34466) 1781 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:41:14.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[31815]: cephadm 2021-03-10T20:41:12.218194+0000 mgr.gibba044.wflcwh (mgr.34466) 1782 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:41:14.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[31815]: cephadm 2021-03-10T20:41:12.218339+0000 mgr.gibba044.wflcwh (mgr.34466) 1783 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:41:14.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:14 gibba023 bash[31815]: cluster 2021-03-10T20:41:12.634169+0000 mgr.gibba044.wflcwh (mgr.34466) 1784 : cluster [DBG] pgmap v997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:14.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:14 gibba044 bash[25485]: cephadm 2021-03-10T20:41:12.209068+0000 mgr.gibba044.wflcwh (mgr.34466) 1770 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:41:14.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:14 gibba044 bash[25485]: cephadm 2021-03-10T20:41:12.210754+0000 mgr.gibba044.wflcwh (mgr.34466) 1771 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:41:14.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:14 gibba044 bash[25485]: cephadm 2021-03-10T20:41:12.212029+0000 mgr.gibba044.wflcwh (mgr.34466) 1772 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:41:14.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:14 gibba044 bash[25485]: cephadm 2021-03-10T20:41:12.212074+0000 mgr.gibba044.wflcwh (mgr.34466) 1773 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:41:14.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:14 gibba044 bash[25485]: cephadm 2021-03-10T20:41:12.213410+0000 mgr.gibba044.wflcwh (mgr.34466) 1774 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:41:14.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:14 gibba044 bash[25485]: cephadm 2021-03-10T20:41:12.213454+0000 mgr.gibba044.wflcwh (mgr.34466) 1775 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:41:14.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:14 gibba044 bash[25485]: cephadm 2021-03-10T20:41:12.214567+0000 mgr.gibba044.wflcwh (mgr.34466) 1776 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:41:14.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:14 gibba044 bash[25485]: cephadm 2021-03-10T20:41:12.215689+0000 mgr.gibba044.wflcwh (mgr.34466) 1777 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:41:14.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:14 gibba044 bash[25485]: cephadm 2021-03-10T20:41:12.215733+0000 mgr.gibba044.wflcwh (mgr.34466) 1778 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:41:14.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:14 gibba044 bash[25485]: cephadm 2021-03-10T20:41:12.216892+0000 mgr.gibba044.wflcwh (mgr.34466) 1779 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:41:14.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:14 gibba044 bash[25485]: cephadm 2021-03-10T20:41:12.217215+0000 mgr.gibba044.wflcwh (mgr.34466) 1780 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:41:14.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:14 gibba044 bash[25485]: cephadm 2021-03-10T20:41:12.218149+0000 mgr.gibba044.wflcwh (mgr.34466) 1781 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:41:14.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:14 gibba044 bash[25485]: cephadm 2021-03-10T20:41:12.218194+0000 mgr.gibba044.wflcwh (mgr.34466) 1782 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:41:14.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:14 gibba044 bash[25485]: cephadm 2021-03-10T20:41:12.218339+0000 mgr.gibba044.wflcwh (mgr.34466) 1783 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:41:14.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:14 gibba044 bash[25485]: cluster 2021-03-10T20:41:12.634169+0000 mgr.gibba044.wflcwh (mgr.34466) 1784 : cluster [DBG] pgmap v997: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:16.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:16 gibba023 bash[30844]: cluster 2021-03-10T20:41:14.635731+0000 mgr.gibba044.wflcwh (mgr.34466) 1785 : cluster [DBG] pgmap v998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:16.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:16 gibba023 bash[31815]: cluster 2021-03-10T20:41:14.635731+0000 mgr.gibba044.wflcwh (mgr.34466) 1785 : cluster [DBG] pgmap v998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:16.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:16 gibba044 bash[25485]: cluster 2021-03-10T20:41:14.635731+0000 mgr.gibba044.wflcwh (mgr.34466) 1785 : cluster [DBG] pgmap v998: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:18.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:18 gibba023 bash[30844]: cluster 2021-03-10T20:41:16.637363+0000 mgr.gibba044.wflcwh (mgr.34466) 1786 : cluster [DBG] pgmap v999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:18.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:18 gibba023 bash[31815]: cluster 2021-03-10T20:41:16.637363+0000 mgr.gibba044.wflcwh (mgr.34466) 1786 : cluster [DBG] pgmap v999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:18.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:18 gibba044 bash[25485]: cluster 2021-03-10T20:41:16.637363+0000 mgr.gibba044.wflcwh (mgr.34466) 1786 : cluster [DBG] pgmap v999: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:20.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:20 gibba023 bash[30844]: cluster 2021-03-10T20:41:18.639185+0000 mgr.gibba044.wflcwh (mgr.34466) 1787 : cluster [DBG] pgmap v1000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:20.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:20 gibba023 bash[31815]: cluster 2021-03-10T20:41:18.639185+0000 mgr.gibba044.wflcwh (mgr.34466) 1787 : cluster [DBG] pgmap v1000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:20.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:20 gibba044 bash[25485]: cluster 2021-03-10T20:41:18.639185+0000 mgr.gibba044.wflcwh (mgr.34466) 1787 : cluster [DBG] pgmap v1000: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:22.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:22 gibba023 bash[30844]: cluster 2021-03-10T20:41:20.640823+0000 mgr.gibba044.wflcwh (mgr.34466) 1788 : cluster [DBG] pgmap v1001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:22.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:22 gibba023 bash[31815]: cluster 2021-03-10T20:41:20.640823+0000 mgr.gibba044.wflcwh (mgr.34466) 1788 : cluster [DBG] pgmap v1001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:22.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:22 gibba044 bash[25485]: cluster 2021-03-10T20:41:20.640823+0000 mgr.gibba044.wflcwh (mgr.34466) 1788 : cluster [DBG] pgmap v1001: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:24.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:24 gibba023 bash[30844]: cluster 2021-03-10T20:41:22.642179+0000 mgr.gibba044.wflcwh (mgr.34466) 1789 : cluster [DBG] pgmap v1002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:24.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:24 gibba023 bash[31815]: cluster 2021-03-10T20:41:22.642179+0000 mgr.gibba044.wflcwh (mgr.34466) 1789 : cluster [DBG] pgmap v1002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:24.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:24 gibba044 bash[25485]: cluster 2021-03-10T20:41:22.642179+0000 mgr.gibba044.wflcwh (mgr.34466) 1789 : cluster [DBG] pgmap v1002: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:25.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:25 gibba023 bash[30844]: cluster 2021-03-10T20:41:24.643738+0000 mgr.gibba044.wflcwh (mgr.34466) 1790 : cluster [DBG] pgmap v1003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:25.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:25 gibba023 bash[31815]: cluster 2021-03-10T20:41:24.643738+0000 mgr.gibba044.wflcwh (mgr.34466) 1790 : cluster [DBG] pgmap v1003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:25.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:25 gibba044 bash[25485]: cluster 2021-03-10T20:41:24.643738+0000 mgr.gibba044.wflcwh (mgr.34466) 1790 : cluster [DBG] pgmap v1003: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:28.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:27 gibba023 bash[30844]: cluster 2021-03-10T20:41:26.645371+0000 mgr.gibba044.wflcwh (mgr.34466) 1791 : cluster [DBG] pgmap v1004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:28.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:27 gibba023 bash[30844]: audit 2021-03-10T20:41:27.220447+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:41:28.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:27 gibba023 bash[30844]: audit 2021-03-10T20:41:27.221043+0000 mon.a (mon.0) 1035 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:41:28.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:27 gibba023 bash[30844]: audit 2021-03-10T20:41:27.221682+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:41:28.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:27 gibba023 bash[30844]: audit 2021-03-10T20:41:27.222418+0000 mon.a (mon.0) 1037 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T20:41:28.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:27 gibba023 bash[30844]: audit 2021-03-10T20:41:27.223091+0000 mon.a (mon.0) 1038 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:41:28.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:27 gibba023 bash[30844]: audit 2021-03-10T20:41:27.223750+0000 mon.a (mon.0) 1039 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:41:28.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:27 gibba023 bash[31815]: cluster 2021-03-10T20:41:26.645371+0000 mgr.gibba044.wflcwh (mgr.34466) 1791 : cluster [DBG] pgmap v1004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:28.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:27 gibba023 bash[31815]: audit 2021-03-10T20:41:27.220447+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:41:28.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:27 gibba023 bash[31815]: audit 2021-03-10T20:41:27.221043+0000 mon.a (mon.0) 1035 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:41:28.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:27 gibba023 bash[31815]: audit 2021-03-10T20:41:27.221682+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:41:28.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:27 gibba023 bash[31815]: audit 2021-03-10T20:41:27.222418+0000 mon.a (mon.0) 1037 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T20:41:28.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:27 gibba023 bash[31815]: audit 2021-03-10T20:41:27.223091+0000 mon.a (mon.0) 1038 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:41:28.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:27 gibba023 bash[31815]: audit 2021-03-10T20:41:27.223750+0000 mon.a (mon.0) 1039 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:41:28.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:27 gibba044 bash[25485]: cluster 2021-03-10T20:41:26.645371+0000 mgr.gibba044.wflcwh (mgr.34466) 1791 : cluster [DBG] pgmap v1004: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:28.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:27 gibba044 bash[25485]: audit 2021-03-10T20:41:27.220447+0000 mon.a (mon.0) 1034 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:41:28.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:27 gibba044 bash[25485]: audit 2021-03-10T20:41:27.221043+0000 mon.a (mon.0) 1035 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:41:28.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:27 gibba044 bash[25485]: audit 2021-03-10T20:41:27.221682+0000 mon.a (mon.0) 1036 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:41:28.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:27 gibba044 bash[25485]: audit 2021-03-10T20:41:27.222418+0000 mon.a (mon.0) 1037 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T20:41:28.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:27 gibba044 bash[25485]: audit 2021-03-10T20:41:27.223091+0000 mon.a (mon.0) 1038 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:41:28.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:27 gibba044 bash[25485]: audit 2021-03-10T20:41:27.223750+0000 mon.a (mon.0) 1039 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:41:29.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:28 gibba023 bash[30844]: cephadm 2021-03-10T20:41:27.232060+0000 mgr.gibba044.wflcwh (mgr.34466) 1792 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:41:29.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:28 gibba023 bash[31815]: cephadm 2021-03-10T20:41:27.232060+0000 mgr.gibba044.wflcwh (mgr.34466) 1792 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:41:29.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:28 gibba044 bash[25485]: cephadm 2021-03-10T20:41:27.232060+0000 mgr.gibba044.wflcwh (mgr.34466) 1792 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:41:30.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:29 gibba023 bash[30844]: cluster 2021-03-10T20:41:28.647197+0000 mgr.gibba044.wflcwh (mgr.34466) 1793 : cluster [DBG] pgmap v1005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:30.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:29 gibba023 bash[31815]: cluster 2021-03-10T20:41:28.647197+0000 mgr.gibba044.wflcwh (mgr.34466) 1793 : cluster [DBG] pgmap v1005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:30.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:29 gibba044 bash[25485]: cluster 2021-03-10T20:41:28.647197+0000 mgr.gibba044.wflcwh (mgr.34466) 1793 : cluster [DBG] pgmap v1005: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:31.637 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:41:31.864 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:41:31.865 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (32m) 8m ago 38m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:41:31.865 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (37m) 7m ago 37m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:41:31.865 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (33m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:41:31.865 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (33m) 7m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:41:31.866 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (32m) 8m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:41:31.866 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (32m) 8m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:41:31.867 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (31m) 7m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:41:31.867 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (31m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:41:31.867 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (38m) 8m ago 38m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:41:31.867 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (38m) 7m ago 38m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:41:31.868 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (30m) 8m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:41:31.868 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (30m) 8m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:41:31.868 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (30m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:41:31.868 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (29m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:41:31.868 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (29m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:41:31.869 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (28m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:41:31.869 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (28m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:41:31.869 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (27m) 7m ago 38m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:41:31.869 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (37m) 7m ago 38m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:41:31.870 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 8m ago 36m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:41:31.870 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 7m ago 36m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:41:32.121 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:41:32.122 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:41:32.122 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:41:32.122 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:41:32.122 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:41:32.123 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:41:32.123 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:41:32.123 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:41:32.123 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:41:32.124 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:41:32.124 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:41:32.124 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:41:32.125 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:41:32.125 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:41:32.125 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:41:32.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:31 gibba044 bash[25485]: cluster 2021-03-10T20:41:30.648923+0000 mgr.gibba044.wflcwh (mgr.34466) 1794 : cluster [DBG] pgmap v1006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:32.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:31 gibba023 bash[30844]: cluster 2021-03-10T20:41:30.648923+0000 mgr.gibba044.wflcwh (mgr.34466) 1794 : cluster [DBG] pgmap v1006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:32.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:31 gibba023 bash[31815]: cluster 2021-03-10T20:41:30.648923+0000 mgr.gibba044.wflcwh (mgr.34466) 1794 : cluster [DBG] pgmap v1006: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:33.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:32 gibba044 bash[25485]: audit 2021-03-10T20:41:31.629556+0000 mgr.gibba044.wflcwh (mgr.34466) 1795 : audit [DBG] from='client.55243 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:41:33.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:32 gibba044 bash[25485]: audit 2021-03-10T20:41:31.853356+0000 mgr.gibba044.wflcwh (mgr.34466) 1796 : audit [DBG] from='client.55249 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:41:33.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:32 gibba044 bash[25485]: audit 2021-03-10T20:41:32.121507+0000 mon.a (mon.0) 1040 : audit [DBG] from='client.? 172.21.2.123:0/3066873717' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:33.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:32 gibba023 bash[30844]: audit 2021-03-10T20:41:31.629556+0000 mgr.gibba044.wflcwh (mgr.34466) 1795 : audit [DBG] from='client.55243 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:41:33.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:32 gibba023 bash[30844]: audit 2021-03-10T20:41:31.853356+0000 mgr.gibba044.wflcwh (mgr.34466) 1796 : audit [DBG] from='client.55249 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:41:33.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:32 gibba023 bash[30844]: audit 2021-03-10T20:41:32.121507+0000 mon.a (mon.0) 1040 : audit [DBG] from='client.? 172.21.2.123:0/3066873717' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:33.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:32 gibba023 bash[31815]: audit 2021-03-10T20:41:31.629556+0000 mgr.gibba044.wflcwh (mgr.34466) 1795 : audit [DBG] from='client.55243 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:41:33.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:32 gibba023 bash[31815]: audit 2021-03-10T20:41:31.853356+0000 mgr.gibba044.wflcwh (mgr.34466) 1796 : audit [DBG] from='client.55249 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:41:33.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:32 gibba023 bash[31815]: audit 2021-03-10T20:41:32.121507+0000 mon.a (mon.0) 1040 : audit [DBG] from='client.? 172.21.2.123:0/3066873717' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:41:34.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:33 gibba044 bash[25485]: cluster 2021-03-10T20:41:32.650345+0000 mgr.gibba044.wflcwh (mgr.34466) 1797 : cluster [DBG] pgmap v1007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:34.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:33 gibba023 bash[30844]: cluster 2021-03-10T20:41:32.650345+0000 mgr.gibba044.wflcwh (mgr.34466) 1797 : cluster [DBG] pgmap v1007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:34.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:33 gibba023 bash[31815]: cluster 2021-03-10T20:41:32.650345+0000 mgr.gibba044.wflcwh (mgr.34466) 1797 : cluster [DBG] pgmap v1007: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:36.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:35 gibba044 bash[25485]: cluster 2021-03-10T20:41:34.651863+0000 mgr.gibba044.wflcwh (mgr.34466) 1798 : cluster [DBG] pgmap v1008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:36.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:35 gibba023 bash[30844]: cluster 2021-03-10T20:41:34.651863+0000 mgr.gibba044.wflcwh (mgr.34466) 1798 : cluster [DBG] pgmap v1008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:36.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:35 gibba023 bash[31815]: cluster 2021-03-10T20:41:34.651863+0000 mgr.gibba044.wflcwh (mgr.34466) 1798 : cluster [DBG] pgmap v1008: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:38.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:37 gibba044 bash[25485]: cluster 2021-03-10T20:41:36.653486+0000 mgr.gibba044.wflcwh (mgr.34466) 1799 : cluster [DBG] pgmap v1009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:38.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:37 gibba023 bash[30844]: cluster 2021-03-10T20:41:36.653486+0000 mgr.gibba044.wflcwh (mgr.34466) 1799 : cluster [DBG] pgmap v1009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:38.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:37 gibba023 bash[31815]: cluster 2021-03-10T20:41:36.653486+0000 mgr.gibba044.wflcwh (mgr.34466) 1799 : cluster [DBG] pgmap v1009: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:40.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:39 gibba044 bash[25485]: cluster 2021-03-10T20:41:38.655266+0000 mgr.gibba044.wflcwh (mgr.34466) 1800 : cluster [DBG] pgmap v1010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:40.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:39 gibba023 bash[30844]: cluster 2021-03-10T20:41:38.655266+0000 mgr.gibba044.wflcwh (mgr.34466) 1800 : cluster [DBG] pgmap v1010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:40.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:39 gibba023 bash[31815]: cluster 2021-03-10T20:41:38.655266+0000 mgr.gibba044.wflcwh (mgr.34466) 1800 : cluster [DBG] pgmap v1010: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:42.249 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:41 gibba044 bash[25485]: cluster 2021-03-10T20:41:40.657032+0000 mgr.gibba044.wflcwh (mgr.34466) 1801 : cluster [DBG] pgmap v1011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:42.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:41 gibba023 bash[30844]: cluster 2021-03-10T20:41:40.657032+0000 mgr.gibba044.wflcwh (mgr.34466) 1801 : cluster [DBG] pgmap v1011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:42.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:41 gibba023 bash[31815]: cluster 2021-03-10T20:41:40.657032+0000 mgr.gibba044.wflcwh (mgr.34466) 1801 : cluster [DBG] pgmap v1011: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:44.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:43 gibba044 bash[25485]: cephadm 2021-03-10T20:41:42.244757+0000 mgr.gibba044.wflcwh (mgr.34466) 1802 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:41:44.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:43 gibba044 bash[25485]: cluster 2021-03-10T20:41:42.658445+0000 mgr.gibba044.wflcwh (mgr.34466) 1803 : cluster [DBG] pgmap v1012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:44.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:43 gibba023 bash[30844]: cephadm 2021-03-10T20:41:42.244757+0000 mgr.gibba044.wflcwh (mgr.34466) 1802 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:41:44.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:43 gibba023 bash[30844]: cluster 2021-03-10T20:41:42.658445+0000 mgr.gibba044.wflcwh (mgr.34466) 1803 : cluster [DBG] pgmap v1012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:44.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:43 gibba023 bash[31815]: cephadm 2021-03-10T20:41:42.244757+0000 mgr.gibba044.wflcwh (mgr.34466) 1802 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:41:44.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:43 gibba023 bash[31815]: cluster 2021-03-10T20:41:42.658445+0000 mgr.gibba044.wflcwh (mgr.34466) 1803 : cluster [DBG] pgmap v1012: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:46.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:45 gibba044 bash[25485]: cluster 2021-03-10T20:41:44.660003+0000 mgr.gibba044.wflcwh (mgr.34466) 1804 : cluster [DBG] pgmap v1013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:46.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:45 gibba023 bash[30844]: cluster 2021-03-10T20:41:44.660003+0000 mgr.gibba044.wflcwh (mgr.34466) 1804 : cluster [DBG] pgmap v1013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:46.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:45 gibba023 bash[31815]: cluster 2021-03-10T20:41:44.660003+0000 mgr.gibba044.wflcwh (mgr.34466) 1804 : cluster [DBG] pgmap v1013: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:48.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:48 gibba023 bash[30844]: cluster 2021-03-10T20:41:46.661650+0000 mgr.gibba044.wflcwh (mgr.34466) 1805 : cluster [DBG] pgmap v1014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:48.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:48 gibba023 bash[31815]: cluster 2021-03-10T20:41:46.661650+0000 mgr.gibba044.wflcwh (mgr.34466) 1805 : cluster [DBG] pgmap v1014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:48.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:48 gibba044 bash[25485]: cluster 2021-03-10T20:41:46.661650+0000 mgr.gibba044.wflcwh (mgr.34466) 1805 : cluster [DBG] pgmap v1014: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:50.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:50 gibba023 bash[30844]: cluster 2021-03-10T20:41:48.663331+0000 mgr.gibba044.wflcwh (mgr.34466) 1806 : cluster [DBG] pgmap v1015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:50.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:50 gibba023 bash[31815]: cluster 2021-03-10T20:41:48.663331+0000 mgr.gibba044.wflcwh (mgr.34466) 1806 : cluster [DBG] pgmap v1015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:50.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:50 gibba044 bash[25485]: cluster 2021-03-10T20:41:48.663331+0000 mgr.gibba044.wflcwh (mgr.34466) 1806 : cluster [DBG] pgmap v1015: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:52.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:52 gibba023 bash[30844]: cluster 2021-03-10T20:41:50.664989+0000 mgr.gibba044.wflcwh (mgr.34466) 1807 : cluster [DBG] pgmap v1016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:52.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:52 gibba023 bash[31815]: cluster 2021-03-10T20:41:50.664989+0000 mgr.gibba044.wflcwh (mgr.34466) 1807 : cluster [DBG] pgmap v1016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:52.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:52 gibba044 bash[25485]: cluster 2021-03-10T20:41:50.664989+0000 mgr.gibba044.wflcwh (mgr.34466) 1807 : cluster [DBG] pgmap v1016: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:54.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:54 gibba023 bash[30844]: cluster 2021-03-10T20:41:52.666377+0000 mgr.gibba044.wflcwh (mgr.34466) 1808 : cluster [DBG] pgmap v1017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:54.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:54 gibba023 bash[31815]: cluster 2021-03-10T20:41:52.666377+0000 mgr.gibba044.wflcwh (mgr.34466) 1808 : cluster [DBG] pgmap v1017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:54.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:54 gibba044 bash[25485]: cluster 2021-03-10T20:41:52.666377+0000 mgr.gibba044.wflcwh (mgr.34466) 1808 : cluster [DBG] pgmap v1017: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:56.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:56 gibba023 bash[30844]: cluster 2021-03-10T20:41:54.668077+0000 mgr.gibba044.wflcwh (mgr.34466) 1809 : cluster [DBG] pgmap v1018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:56.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:56 gibba023 bash[31815]: cluster 2021-03-10T20:41:54.668077+0000 mgr.gibba044.wflcwh (mgr.34466) 1809 : cluster [DBG] pgmap v1018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:56.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:56 gibba044 bash[25485]: cluster 2021-03-10T20:41:54.668077+0000 mgr.gibba044.wflcwh (mgr.34466) 1809 : cluster [DBG] pgmap v1018: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:58.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:58 gibba023 bash[30844]: cluster 2021-03-10T20:41:56.669717+0000 mgr.gibba044.wflcwh (mgr.34466) 1810 : cluster [DBG] pgmap v1019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:58.482 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:58 gibba023 bash[31815]: cluster 2021-03-10T20:41:56.669717+0000 mgr.gibba044.wflcwh (mgr.34466) 1810 : cluster [DBG] pgmap v1019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:58.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:58 gibba044 bash[25485]: cluster 2021-03-10T20:41:56.669717+0000 mgr.gibba044.wflcwh (mgr.34466) 1810 : cluster [DBG] pgmap v1019: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:41:59.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:41:59 gibba023 bash[30844]: cephadm 2021-03-10T20:41:57.249642+0000 mgr.gibba044.wflcwh (mgr.34466) 1811 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:41:59.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:41:59 gibba023 bash[31815]: cephadm 2021-03-10T20:41:57.249642+0000 mgr.gibba044.wflcwh (mgr.34466) 1811 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:41:59.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:41:59 gibba044 bash[25485]: cephadm 2021-03-10T20:41:57.249642+0000 mgr.gibba044.wflcwh (mgr.34466) 1811 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:42:00.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:00 gibba023 bash[30844]: cluster 2021-03-10T20:41:58.671486+0000 mgr.gibba044.wflcwh (mgr.34466) 1812 : cluster [DBG] pgmap v1020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:00.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:00 gibba023 bash[31815]: cluster 2021-03-10T20:41:58.671486+0000 mgr.gibba044.wflcwh (mgr.34466) 1812 : cluster [DBG] pgmap v1020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:00.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:00 gibba044 bash[25485]: cluster 2021-03-10T20:41:58.671486+0000 mgr.gibba044.wflcwh (mgr.34466) 1812 : cluster [DBG] pgmap v1020: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:02.361 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:42:02.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:02 gibba023 bash[30844]: cluster 2021-03-10T20:42:00.673208+0000 mgr.gibba044.wflcwh (mgr.34466) 1813 : cluster [DBG] pgmap v1021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:02.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:02 gibba023 bash[31815]: cluster 2021-03-10T20:42:00.673208+0000 mgr.gibba044.wflcwh (mgr.34466) 1813 : cluster [DBG] pgmap v1021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:02.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:02 gibba044 bash[25485]: cluster 2021-03-10T20:42:00.673208+0000 mgr.gibba044.wflcwh (mgr.34466) 1813 : cluster [DBG] pgmap v1021: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:02.614 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:42:02.614 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (33m) 8m ago 38m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:42:02.615 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (38m) 7m ago 38m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:42:02.615 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (33m) 7m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:42:02.615 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (33m) 7m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:42:02.615 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (32m) 8m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:42:02.616 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (32m) 8m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:42:02.616 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (32m) 7m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:42:02.616 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (32m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:42:02.616 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (38m) 8m ago 38m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:42:02.616 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (38m) 7m ago 38m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:42:02.617 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (31m) 8m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:42:02.617 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (30m) 8m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:42:02.617 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (30m) 8m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:42:02.617 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (30m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:42:02.617 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (29m) 7m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:42:02.618 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (29m) 7m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:42:02.618 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (28m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:42:02.618 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (28m) 7m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:42:02.618 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (38m) 7m ago 38m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:42:02.619 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 8m ago 36m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:42:02.619 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 7m ago 36m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:42:02.862 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:42:02.863 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:42:02.863 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:42:02.864 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:42:02.864 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:42:02.865 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:42:02.865 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:42:02.865 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:42:02.866 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:42:02.866 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:42:02.867 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:42:02.867 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:42:02.868 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:42:02.868 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:42:02.869 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:42:03.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:03 gibba023 bash[30844]: audit 2021-03-10T20:42:02.862477+0000 mon.a (mon.0) 1041 : audit [DBG] from='client.? 172.21.2.123:0/2974869374' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:03.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:03 gibba023 bash[31815]: audit 2021-03-10T20:42:02.862477+0000 mon.a (mon.0) 1041 : audit [DBG] from='client.? 172.21.2.123:0/2974869374' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:03.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:03 gibba044 bash[25485]: audit 2021-03-10T20:42:02.862477+0000 mon.a (mon.0) 1041 : audit [DBG] from='client.? 172.21.2.123:0/2974869374' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:04.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:04 gibba023 bash[30844]: audit 2021-03-10T20:42:02.353804+0000 mgr.gibba044.wflcwh (mgr.34466) 1814 : audit [DBG] from='client.45282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:42:04.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:04 gibba023 bash[30844]: audit 2021-03-10T20:42:02.577614+0000 mgr.gibba044.wflcwh (mgr.34466) 1815 : audit [DBG] from='client.55267 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:42:04.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:04 gibba023 bash[30844]: cluster 2021-03-10T20:42:02.674608+0000 mgr.gibba044.wflcwh (mgr.34466) 1816 : cluster [DBG] pgmap v1022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:04.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:04 gibba023 bash[31815]: audit 2021-03-10T20:42:02.353804+0000 mgr.gibba044.wflcwh (mgr.34466) 1814 : audit [DBG] from='client.45282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:42:04.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:04 gibba023 bash[31815]: audit 2021-03-10T20:42:02.577614+0000 mgr.gibba044.wflcwh (mgr.34466) 1815 : audit [DBG] from='client.55267 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:42:04.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:04 gibba023 bash[31815]: cluster 2021-03-10T20:42:02.674608+0000 mgr.gibba044.wflcwh (mgr.34466) 1816 : cluster [DBG] pgmap v1022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:04.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:04 gibba044 bash[25485]: audit 2021-03-10T20:42:02.353804+0000 mgr.gibba044.wflcwh (mgr.34466) 1814 : audit [DBG] from='client.45282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:42:04.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:04 gibba044 bash[25485]: audit 2021-03-10T20:42:02.577614+0000 mgr.gibba044.wflcwh (mgr.34466) 1815 : audit [DBG] from='client.55267 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:42:04.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:04 gibba044 bash[25485]: cluster 2021-03-10T20:42:02.674608+0000 mgr.gibba044.wflcwh (mgr.34466) 1816 : cluster [DBG] pgmap v1022: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:06.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:06 gibba023 bash[30844]: cluster 2021-03-10T20:42:04.676097+0000 mgr.gibba044.wflcwh (mgr.34466) 1817 : cluster [DBG] pgmap v1023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:06.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:06 gibba023 bash[31815]: cluster 2021-03-10T20:42:04.676097+0000 mgr.gibba044.wflcwh (mgr.34466) 1817 : cluster [DBG] pgmap v1023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:06.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:06 gibba044 bash[25485]: cluster 2021-03-10T20:42:04.676097+0000 mgr.gibba044.wflcwh (mgr.34466) 1817 : cluster [DBG] pgmap v1023: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:08.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:08 gibba023 bash[30844]: cluster 2021-03-10T20:42:06.677850+0000 mgr.gibba044.wflcwh (mgr.34466) 1818 : cluster [DBG] pgmap v1024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:08.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:08 gibba023 bash[31815]: cluster 2021-03-10T20:42:06.677850+0000 mgr.gibba044.wflcwh (mgr.34466) 1818 : cluster [DBG] pgmap v1024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:08.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:08 gibba044 bash[25485]: cluster 2021-03-10T20:42:06.677850+0000 mgr.gibba044.wflcwh (mgr.34466) 1818 : cluster [DBG] pgmap v1024: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:10.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:10 gibba023 bash[30844]: cluster 2021-03-10T20:42:08.679865+0000 mgr.gibba044.wflcwh (mgr.34466) 1819 : cluster [DBG] pgmap v1025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:10.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:10 gibba023 bash[31815]: cluster 2021-03-10T20:42:08.679865+0000 mgr.gibba044.wflcwh (mgr.34466) 1819 : cluster [DBG] pgmap v1025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:10.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:10 gibba044 bash[25485]: cluster 2021-03-10T20:42:08.679865+0000 mgr.gibba044.wflcwh (mgr.34466) 1819 : cluster [DBG] pgmap v1025: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:12.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:12 gibba023 bash[30844]: cluster 2021-03-10T20:42:10.681486+0000 mgr.gibba044.wflcwh (mgr.34466) 1820 : cluster [DBG] pgmap v1026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:12.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:12 gibba023 bash[31815]: cluster 2021-03-10T20:42:10.681486+0000 mgr.gibba044.wflcwh (mgr.34466) 1820 : cluster [DBG] pgmap v1026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:12.493 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:12 gibba044 bash[25485]: cluster 2021-03-10T20:42:10.681486+0000 mgr.gibba044.wflcwh (mgr.34466) 1820 : cluster [DBG] pgmap v1026: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:13.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:13 gibba044 bash[25485]: cephadm 2021-03-10T20:42:12.257428+0000 mgr.gibba044.wflcwh (mgr.34466) 1821 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:42:13.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:13 gibba044 bash[25485]: cephadm 2021-03-10T20:42:12.259088+0000 mgr.gibba044.wflcwh (mgr.34466) 1822 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:42:13.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:13 gibba044 bash[25485]: audit 2021-03-10T20:42:12.480952+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:42:13.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:13 gibba044 bash[25485]: audit 2021-03-10T20:42:12.484847+0000 mon.a (mon.0) 1043 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:42:13.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:13 gibba044 bash[25485]: cephadm 2021-03-10T20:42:12.484980+0000 mgr.gibba044.wflcwh (mgr.34466) 1823 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:42:13.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:13 gibba044 bash[25485]: audit 2021-03-10T20:42:12.486435+0000 mon.a (mon.0) 1044 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:13.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:13 gibba044 bash[25485]: cephadm 2021-03-10T20:42:12.487150+0000 mgr.gibba044.wflcwh (mgr.34466) 1824 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:42:13.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:13 gibba044 bash[25485]: audit 2021-03-10T20:42:12.487834+0000 mon.a (mon.0) 1045 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:13.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:13 gibba044 bash[25485]: cephadm 2021-03-10T20:42:12.488643+0000 mgr.gibba044.wflcwh (mgr.34466) 1825 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:42:13.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:13 gibba044 bash[25485]: cephadm 2021-03-10T20:42:12.488682+0000 mgr.gibba044.wflcwh (mgr.34466) 1826 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:42:13.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:13 gibba044 bash[25485]: audit 2021-03-10T20:42:12.489041+0000 mon.a (mon.0) 1046 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:13.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:13 gibba044 bash[25485]: cephadm 2021-03-10T20:42:12.489824+0000 mgr.gibba044.wflcwh (mgr.34466) 1827 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:42:13.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:13 gibba044 bash[25485]: cephadm 2021-03-10T20:42:12.489862+0000 mgr.gibba044.wflcwh (mgr.34466) 1828 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:42:13.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:13 gibba044 bash[25485]: cephadm 2021-03-10T20:42:12.491213+0000 mgr.gibba044.wflcwh (mgr.34466) 1829 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:42:13.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:13 gibba044 bash[25485]: audit 2021-03-10T20:42:12.491685+0000 mon.a (mon.0) 1047 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:13.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:13 gibba044 bash[25485]: cephadm 2021-03-10T20:42:12.492404+0000 mgr.gibba044.wflcwh (mgr.34466) 1830 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:42:13.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:13 gibba044 bash[25485]: cephadm 2021-03-10T20:42:12.492438+0000 mgr.gibba044.wflcwh (mgr.34466) 1831 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:42:13.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:13 gibba044 bash[25485]: audit 2021-03-10T20:42:12.493339+0000 mon.a (mon.0) 1048 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:13.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:13 gibba044 bash[25485]: cephadm 2021-03-10T20:42:12.493821+0000 mgr.gibba044.wflcwh (mgr.34466) 1832 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:42:13.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:13 gibba044 bash[25485]: cephadm 2021-03-10T20:42:12.494136+0000 mgr.gibba044.wflcwh (mgr.34466) 1833 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:42:13.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:13 gibba044 bash[25485]: cephadm 2021-03-10T20:42:12.495267+0000 mgr.gibba044.wflcwh (mgr.34466) 1834 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:42:13.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:13 gibba044 bash[25485]: cephadm 2021-03-10T20:42:12.495306+0000 mgr.gibba044.wflcwh (mgr.34466) 1835 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:42:13.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:13 gibba044 bash[25485]: cephadm 2021-03-10T20:42:12.495434+0000 mgr.gibba044.wflcwh (mgr.34466) 1836 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:42:13.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:13 gibba044 bash[25485]: cluster 2021-03-10T20:42:12.683063+0000 mgr.gibba044.wflcwh (mgr.34466) 1837 : cluster [DBG] pgmap v1027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:13.924 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[30844]: cephadm 2021-03-10T20:42:12.257428+0000 mgr.gibba044.wflcwh (mgr.34466) 1821 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:42:13.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[30844]: cephadm 2021-03-10T20:42:12.259088+0000 mgr.gibba044.wflcwh (mgr.34466) 1822 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:42:13.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[30844]: audit 2021-03-10T20:42:12.480952+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:42:13.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[30844]: audit 2021-03-10T20:42:12.484847+0000 mon.a (mon.0) 1043 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:42:13.925 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[30844]: cephadm 2021-03-10T20:42:12.484980+0000 mgr.gibba044.wflcwh (mgr.34466) 1823 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:42:13.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[30844]: audit 2021-03-10T20:42:12.486435+0000 mon.a (mon.0) 1044 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:13.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[30844]: cephadm 2021-03-10T20:42:12.487150+0000 mgr.gibba044.wflcwh (mgr.34466) 1824 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:42:13.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[30844]: audit 2021-03-10T20:42:12.487834+0000 mon.a (mon.0) 1045 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:13.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[30844]: cephadm 2021-03-10T20:42:12.488643+0000 mgr.gibba044.wflcwh (mgr.34466) 1825 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:42:13.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[30844]: cephadm 2021-03-10T20:42:12.488682+0000 mgr.gibba044.wflcwh (mgr.34466) 1826 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:42:13.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[30844]: audit 2021-03-10T20:42:12.489041+0000 mon.a (mon.0) 1046 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:13.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[30844]: cephadm 2021-03-10T20:42:12.489824+0000 mgr.gibba044.wflcwh (mgr.34466) 1827 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:42:13.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[30844]: cephadm 2021-03-10T20:42:12.489862+0000 mgr.gibba044.wflcwh (mgr.34466) 1828 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:42:13.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[30844]: cephadm 2021-03-10T20:42:12.491213+0000 mgr.gibba044.wflcwh (mgr.34466) 1829 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:42:13.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[30844]: audit 2021-03-10T20:42:12.491685+0000 mon.a (mon.0) 1047 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:13.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[30844]: cephadm 2021-03-10T20:42:12.492404+0000 mgr.gibba044.wflcwh (mgr.34466) 1830 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:42:13.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[30844]: cephadm 2021-03-10T20:42:12.492438+0000 mgr.gibba044.wflcwh (mgr.34466) 1831 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:42:13.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[30844]: audit 2021-03-10T20:42:12.493339+0000 mon.a (mon.0) 1048 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:13.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[30844]: cephadm 2021-03-10T20:42:12.493821+0000 mgr.gibba044.wflcwh (mgr.34466) 1832 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:42:13.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[30844]: cephadm 2021-03-10T20:42:12.494136+0000 mgr.gibba044.wflcwh (mgr.34466) 1833 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:42:13.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[30844]: cephadm 2021-03-10T20:42:12.495267+0000 mgr.gibba044.wflcwh (mgr.34466) 1834 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:42:13.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[30844]: cephadm 2021-03-10T20:42:12.495306+0000 mgr.gibba044.wflcwh (mgr.34466) 1835 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:42:13.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[30844]: cephadm 2021-03-10T20:42:12.495434+0000 mgr.gibba044.wflcwh (mgr.34466) 1836 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:42:13.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[30844]: cluster 2021-03-10T20:42:12.683063+0000 mgr.gibba044.wflcwh (mgr.34466) 1837 : cluster [DBG] pgmap v1027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:13.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[31815]: cephadm 2021-03-10T20:42:12.257428+0000 mgr.gibba044.wflcwh (mgr.34466) 1821 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:42:13.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[31815]: cephadm 2021-03-10T20:42:12.259088+0000 mgr.gibba044.wflcwh (mgr.34466) 1822 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:42:13.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[31815]: audit 2021-03-10T20:42:12.480952+0000 mon.a (mon.0) 1042 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:42:13.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[31815]: audit 2021-03-10T20:42:12.484847+0000 mon.a (mon.0) 1043 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:42:13.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[31815]: cephadm 2021-03-10T20:42:12.484980+0000 mgr.gibba044.wflcwh (mgr.34466) 1823 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:42:13.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[31815]: audit 2021-03-10T20:42:12.486435+0000 mon.a (mon.0) 1044 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:13.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[31815]: cephadm 2021-03-10T20:42:12.487150+0000 mgr.gibba044.wflcwh (mgr.34466) 1824 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:42:13.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[31815]: audit 2021-03-10T20:42:12.487834+0000 mon.a (mon.0) 1045 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:13.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[31815]: cephadm 2021-03-10T20:42:12.488643+0000 mgr.gibba044.wflcwh (mgr.34466) 1825 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:42:13.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[31815]: cephadm 2021-03-10T20:42:12.488682+0000 mgr.gibba044.wflcwh (mgr.34466) 1826 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:42:13.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[31815]: audit 2021-03-10T20:42:12.489041+0000 mon.a (mon.0) 1046 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:13.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[31815]: cephadm 2021-03-10T20:42:12.489824+0000 mgr.gibba044.wflcwh (mgr.34466) 1827 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:42:13.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[31815]: cephadm 2021-03-10T20:42:12.489862+0000 mgr.gibba044.wflcwh (mgr.34466) 1828 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:42:13.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[31815]: cephadm 2021-03-10T20:42:12.491213+0000 mgr.gibba044.wflcwh (mgr.34466) 1829 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:42:13.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[31815]: audit 2021-03-10T20:42:12.491685+0000 mon.a (mon.0) 1047 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:13.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[31815]: cephadm 2021-03-10T20:42:12.492404+0000 mgr.gibba044.wflcwh (mgr.34466) 1830 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:42:13.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[31815]: cephadm 2021-03-10T20:42:12.492438+0000 mgr.gibba044.wflcwh (mgr.34466) 1831 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:42:13.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[31815]: audit 2021-03-10T20:42:12.493339+0000 mon.a (mon.0) 1048 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:13.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[31815]: cephadm 2021-03-10T20:42:12.493821+0000 mgr.gibba044.wflcwh (mgr.34466) 1832 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:42:13.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[31815]: cephadm 2021-03-10T20:42:12.494136+0000 mgr.gibba044.wflcwh (mgr.34466) 1833 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:42:13.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[31815]: cephadm 2021-03-10T20:42:12.495267+0000 mgr.gibba044.wflcwh (mgr.34466) 1834 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:42:13.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[31815]: cephadm 2021-03-10T20:42:12.495306+0000 mgr.gibba044.wflcwh (mgr.34466) 1835 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:42:13.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[31815]: cephadm 2021-03-10T20:42:12.495434+0000 mgr.gibba044.wflcwh (mgr.34466) 1836 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:42:13.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:13 gibba023 bash[31815]: cluster 2021-03-10T20:42:12.683063+0000 mgr.gibba044.wflcwh (mgr.34466) 1837 : cluster [DBG] pgmap v1027: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:16.000 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:15 gibba044 bash[25485]: cluster 2021-03-10T20:42:14.683604+0000 mgr.gibba044.wflcwh (mgr.34466) 1838 : cluster [DBG] pgmap v1028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:16.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:15 gibba023 bash[30844]: cluster 2021-03-10T20:42:14.683604+0000 mgr.gibba044.wflcwh (mgr.34466) 1838 : cluster [DBG] pgmap v1028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:16.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:15 gibba023 bash[31815]: cluster 2021-03-10T20:42:14.683604+0000 mgr.gibba044.wflcwh (mgr.34466) 1838 : cluster [DBG] pgmap v1028: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:18.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:17 gibba044 bash[25485]: cluster 2021-03-10T20:42:16.685153+0000 mgr.gibba044.wflcwh (mgr.34466) 1839 : cluster [DBG] pgmap v1029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:18.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:17 gibba023 bash[30844]: cluster 2021-03-10T20:42:16.685153+0000 mgr.gibba044.wflcwh (mgr.34466) 1839 : cluster [DBG] pgmap v1029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:18.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:17 gibba023 bash[31815]: cluster 2021-03-10T20:42:16.685153+0000 mgr.gibba044.wflcwh (mgr.34466) 1839 : cluster [DBG] pgmap v1029: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:20.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:19 gibba044 bash[25485]: cluster 2021-03-10T20:42:18.686900+0000 mgr.gibba044.wflcwh (mgr.34466) 1840 : cluster [DBG] pgmap v1030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:20.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:19 gibba023 bash[30844]: cluster 2021-03-10T20:42:18.686900+0000 mgr.gibba044.wflcwh (mgr.34466) 1840 : cluster [DBG] pgmap v1030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:20.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:19 gibba023 bash[31815]: cluster 2021-03-10T20:42:18.686900+0000 mgr.gibba044.wflcwh (mgr.34466) 1840 : cluster [DBG] pgmap v1030: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:22.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:21 gibba044 bash[25485]: cluster 2021-03-10T20:42:20.688472+0000 mgr.gibba044.wflcwh (mgr.34466) 1841 : cluster [DBG] pgmap v1031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:22.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:21 gibba023 bash[30844]: cluster 2021-03-10T20:42:20.688472+0000 mgr.gibba044.wflcwh (mgr.34466) 1841 : cluster [DBG] pgmap v1031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:22.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:21 gibba023 bash[31815]: cluster 2021-03-10T20:42:20.688472+0000 mgr.gibba044.wflcwh (mgr.34466) 1841 : cluster [DBG] pgmap v1031: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:24.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:23 gibba044 bash[25485]: cluster 2021-03-10T20:42:22.689881+0000 mgr.gibba044.wflcwh (mgr.34466) 1842 : cluster [DBG] pgmap v1032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:24.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:23 gibba023 bash[30844]: cluster 2021-03-10T20:42:22.689881+0000 mgr.gibba044.wflcwh (mgr.34466) 1842 : cluster [DBG] pgmap v1032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:24.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:23 gibba023 bash[31815]: cluster 2021-03-10T20:42:22.689881+0000 mgr.gibba044.wflcwh (mgr.34466) 1842 : cluster [DBG] pgmap v1032: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:26.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:25 gibba044 bash[25485]: cluster 2021-03-10T20:42:24.690468+0000 mgr.gibba044.wflcwh (mgr.34466) 1843 : cluster [DBG] pgmap v1033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:26.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:25 gibba023 bash[30844]: cluster 2021-03-10T20:42:24.690468+0000 mgr.gibba044.wflcwh (mgr.34466) 1843 : cluster [DBG] pgmap v1033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:26.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:25 gibba023 bash[31815]: cluster 2021-03-10T20:42:24.690468+0000 mgr.gibba044.wflcwh (mgr.34466) 1843 : cluster [DBG] pgmap v1033: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:28.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:27 gibba044 bash[25485]: cluster 2021-03-10T20:42:26.691894+0000 mgr.gibba044.wflcwh (mgr.34466) 1844 : cluster [DBG] pgmap v1034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:28.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:27 gibba044 bash[25485]: audit 2021-03-10T20:42:27.228341+0000 mon.a (mon.0) 1049 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:42:28.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:27 gibba044 bash[25485]: audit 2021-03-10T20:42:27.228982+0000 mon.a (mon.0) 1050 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:42:28.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:27 gibba044 bash[25485]: audit 2021-03-10T20:42:27.229567+0000 mon.a (mon.0) 1051 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:42:28.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:27 gibba044 bash[25485]: audit 2021-03-10T20:42:27.230300+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:42:28.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:27 gibba044 bash[25485]: audit 2021-03-10T20:42:27.231016+0000 mon.a (mon.0) 1053 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:42:28.258 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:27 gibba044 bash[25485]: audit 2021-03-10T20:42:27.231686+0000 mon.a (mon.0) 1054 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T20:42:28.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:27 gibba023 bash[30844]: cluster 2021-03-10T20:42:26.691894+0000 mgr.gibba044.wflcwh (mgr.34466) 1844 : cluster [DBG] pgmap v1034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:28.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:27 gibba023 bash[30844]: audit 2021-03-10T20:42:27.228341+0000 mon.a (mon.0) 1049 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:42:28.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:27 gibba023 bash[30844]: audit 2021-03-10T20:42:27.228982+0000 mon.a (mon.0) 1050 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:42:28.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:27 gibba023 bash[30844]: audit 2021-03-10T20:42:27.229567+0000 mon.a (mon.0) 1051 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:42:28.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:27 gibba023 bash[30844]: audit 2021-03-10T20:42:27.230300+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:42:28.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:27 gibba023 bash[30844]: audit 2021-03-10T20:42:27.231016+0000 mon.a (mon.0) 1053 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:42:28.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:27 gibba023 bash[30844]: audit 2021-03-10T20:42:27.231686+0000 mon.a (mon.0) 1054 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T20:42:28.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:27 gibba023 bash[31815]: cluster 2021-03-10T20:42:26.691894+0000 mgr.gibba044.wflcwh (mgr.34466) 1844 : cluster [DBG] pgmap v1034: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:27 gibba023 bash[31815]: audit 2021-03-10T20:42:27.228341+0000 mon.a (mon.0) 1049 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:42:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:27 gibba023 bash[31815]: audit 2021-03-10T20:42:27.228982+0000 mon.a (mon.0) 1050 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:42:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:27 gibba023 bash[31815]: audit 2021-03-10T20:42:27.229567+0000 mon.a (mon.0) 1051 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:42:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:27 gibba023 bash[31815]: audit 2021-03-10T20:42:27.230300+0000 mon.a (mon.0) 1052 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:42:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:27 gibba023 bash[31815]: audit 2021-03-10T20:42:27.231016+0000 mon.a (mon.0) 1053 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:42:28.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:27 gibba023 bash[31815]: audit 2021-03-10T20:42:27.231686+0000 mon.a (mon.0) 1054 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2021-03-10T20:42:29.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:28 gibba044 bash[25485]: cephadm 2021-03-10T20:42:27.500785+0000 mgr.gibba044.wflcwh (mgr.34466) 1845 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:42:29.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:28 gibba023 bash[30844]: cephadm 2021-03-10T20:42:27.500785+0000 mgr.gibba044.wflcwh (mgr.34466) 1845 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:42:29.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:28 gibba023 bash[31815]: cephadm 2021-03-10T20:42:27.500785+0000 mgr.gibba044.wflcwh (mgr.34466) 1845 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:42:30.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:29 gibba044 bash[25485]: cluster 2021-03-10T20:42:28.693526+0000 mgr.gibba044.wflcwh (mgr.34466) 1846 : cluster [DBG] pgmap v1035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:30.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:29 gibba023 bash[30844]: cluster 2021-03-10T20:42:28.693526+0000 mgr.gibba044.wflcwh (mgr.34466) 1846 : cluster [DBG] pgmap v1035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:30.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:29 gibba023 bash[31815]: cluster 2021-03-10T20:42:28.693526+0000 mgr.gibba044.wflcwh (mgr.34466) 1846 : cluster [DBG] pgmap v1035: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:32.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:31 gibba044 bash[25485]: cluster 2021-03-10T20:42:30.695283+0000 mgr.gibba044.wflcwh (mgr.34466) 1847 : cluster [DBG] pgmap v1036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:32.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:31 gibba023 bash[30844]: cluster 2021-03-10T20:42:30.695283+0000 mgr.gibba044.wflcwh (mgr.34466) 1847 : cluster [DBG] pgmap v1036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:32.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:31 gibba023 bash[31815]: cluster 2021-03-10T20:42:30.695283+0000 mgr.gibba044.wflcwh (mgr.34466) 1847 : cluster [DBG] pgmap v1036: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:33.106 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:42:33.362 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:42:33.362 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (33m) 9m ago 39m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:42:33.363 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (39m) 8m ago 39m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:42:33.363 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (34m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:42:33.363 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (34m) 8m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:42:33.363 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (33m) 9m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:42:33.364 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (33m) 9m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:42:33.364 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (32m) 8m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:42:33.364 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (32m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:42:33.364 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (39m) 9m ago 39m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:42:33.365 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (39m) 8m ago 39m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:42:33.365 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (31m) 9m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:42:33.365 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (31m) 9m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:42:33.365 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (31m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:42:33.366 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (30m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:42:33.366 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (30m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:42:33.366 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (29m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:42:33.366 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (29m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:42:33.366 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (28m) 8m ago 39m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:42:33.367 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (38m) 8m ago 39m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:42:33.367 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 9m ago 37m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:42:33.367 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 8m ago 37m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:42:33.621 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:42:33.621 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:42:33.622 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:42:33.622 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:42:33.622 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:42:33.623 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:42:33.623 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:42:33.623 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:42:33.623 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:42:33.624 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:42:33.624 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:42:33.624 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:42:33.624 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:42:33.625 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:42:33.625 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:42:34.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:34 gibba023 bash[30844]: cluster 2021-03-10T20:42:32.696667+0000 mgr.gibba044.wflcwh (mgr.34466) 1848 : cluster [DBG] pgmap v1037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:34.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:34 gibba023 bash[30844]: audit 2021-03-10T20:42:33.098546+0000 mgr.gibba044.wflcwh (mgr.34466) 1849 : audit [DBG] from='client.55279 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:42:34.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:34 gibba023 bash[30844]: audit 2021-03-10T20:42:33.621020+0000 mon.c (mon.1) 47 : audit [DBG] from='client.? 172.21.2.123:0/3324626335' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:34.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:34 gibba023 bash[31815]: cluster 2021-03-10T20:42:32.696667+0000 mgr.gibba044.wflcwh (mgr.34466) 1848 : cluster [DBG] pgmap v1037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:34.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:34 gibba023 bash[31815]: audit 2021-03-10T20:42:33.098546+0000 mgr.gibba044.wflcwh (mgr.34466) 1849 : audit [DBG] from='client.55279 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:42:34.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:34 gibba023 bash[31815]: audit 2021-03-10T20:42:33.621020+0000 mon.c (mon.1) 47 : audit [DBG] from='client.? 172.21.2.123:0/3324626335' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:34.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:34 gibba044 bash[25485]: cluster 2021-03-10T20:42:32.696667+0000 mgr.gibba044.wflcwh (mgr.34466) 1848 : cluster [DBG] pgmap v1037: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:34.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:34 gibba044 bash[25485]: audit 2021-03-10T20:42:33.098546+0000 mgr.gibba044.wflcwh (mgr.34466) 1849 : audit [DBG] from='client.55279 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:42:34.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:34 gibba044 bash[25485]: audit 2021-03-10T20:42:33.621020+0000 mon.c (mon.1) 47 : audit [DBG] from='client.? 172.21.2.123:0/3324626335' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:42:35.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:35 gibba023 bash[30844]: audit 2021-03-10T20:42:33.322615+0000 mgr.gibba044.wflcwh (mgr.34466) 1850 : audit [DBG] from='client.55285 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:42:35.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:35 gibba023 bash[31815]: audit 2021-03-10T20:42:33.322615+0000 mgr.gibba044.wflcwh (mgr.34466) 1850 : audit [DBG] from='client.55285 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:42:35.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:35 gibba044 bash[25485]: audit 2021-03-10T20:42:33.322615+0000 mgr.gibba044.wflcwh (mgr.34466) 1850 : audit [DBG] from='client.55285 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:42:36.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:36 gibba023 bash[30844]: cluster 2021-03-10T20:42:34.697848+0000 mgr.gibba044.wflcwh (mgr.34466) 1851 : cluster [DBG] pgmap v1038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:36.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:36 gibba023 bash[31815]: cluster 2021-03-10T20:42:34.697848+0000 mgr.gibba044.wflcwh (mgr.34466) 1851 : cluster [DBG] pgmap v1038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:36.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:36 gibba044 bash[25485]: cluster 2021-03-10T20:42:34.697848+0000 mgr.gibba044.wflcwh (mgr.34466) 1851 : cluster [DBG] pgmap v1038: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:38.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:38 gibba023 bash[30844]: cluster 2021-03-10T20:42:36.699527+0000 mgr.gibba044.wflcwh (mgr.34466) 1852 : cluster [DBG] pgmap v1039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:38.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:38 gibba023 bash[31815]: cluster 2021-03-10T20:42:36.699527+0000 mgr.gibba044.wflcwh (mgr.34466) 1852 : cluster [DBG] pgmap v1039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:38.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:38 gibba044 bash[25485]: cluster 2021-03-10T20:42:36.699527+0000 mgr.gibba044.wflcwh (mgr.34466) 1852 : cluster [DBG] pgmap v1039: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:40.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:40 gibba023 bash[30844]: cluster 2021-03-10T20:42:38.701372+0000 mgr.gibba044.wflcwh (mgr.34466) 1853 : cluster [DBG] pgmap v1040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:40.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:40 gibba023 bash[31815]: cluster 2021-03-10T20:42:38.701372+0000 mgr.gibba044.wflcwh (mgr.34466) 1853 : cluster [DBG] pgmap v1040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:40.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:40 gibba044 bash[25485]: cluster 2021-03-10T20:42:38.701372+0000 mgr.gibba044.wflcwh (mgr.34466) 1853 : cluster [DBG] pgmap v1040: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:42.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:42 gibba023 bash[30844]: cluster 2021-03-10T20:42:40.703067+0000 mgr.gibba044.wflcwh (mgr.34466) 1854 : cluster [DBG] pgmap v1041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:42.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:42 gibba023 bash[31815]: cluster 2021-03-10T20:42:40.703067+0000 mgr.gibba044.wflcwh (mgr.34466) 1854 : cluster [DBG] pgmap v1041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:42.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:42 gibba044 bash[25485]: cluster 2021-03-10T20:42:40.703067+0000 mgr.gibba044.wflcwh (mgr.34466) 1854 : cluster [DBG] pgmap v1041: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:44.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:44 gibba023 bash[30844]: cephadm 2021-03-10T20:42:42.516568+0000 mgr.gibba044.wflcwh (mgr.34466) 1855 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:42:44.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:44 gibba023 bash[30844]: cluster 2021-03-10T20:42:42.704736+0000 mgr.gibba044.wflcwh (mgr.34466) 1856 : cluster [DBG] pgmap v1042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:44.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:44 gibba023 bash[31815]: cephadm 2021-03-10T20:42:42.516568+0000 mgr.gibba044.wflcwh (mgr.34466) 1855 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:42:44.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:44 gibba023 bash[31815]: cluster 2021-03-10T20:42:42.704736+0000 mgr.gibba044.wflcwh (mgr.34466) 1856 : cluster [DBG] pgmap v1042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:44.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:44 gibba044 bash[25485]: cephadm 2021-03-10T20:42:42.516568+0000 mgr.gibba044.wflcwh (mgr.34466) 1855 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:42:44.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:44 gibba044 bash[25485]: cluster 2021-03-10T20:42:42.704736+0000 mgr.gibba044.wflcwh (mgr.34466) 1856 : cluster [DBG] pgmap v1042: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:46.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:46 gibba023 bash[30844]: cluster 2021-03-10T20:42:44.705899+0000 mgr.gibba044.wflcwh (mgr.34466) 1857 : cluster [DBG] pgmap v1043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:46.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:46 gibba023 bash[31815]: cluster 2021-03-10T20:42:44.705899+0000 mgr.gibba044.wflcwh (mgr.34466) 1857 : cluster [DBG] pgmap v1043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:46.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:46 gibba044 bash[25485]: cluster 2021-03-10T20:42:44.705899+0000 mgr.gibba044.wflcwh (mgr.34466) 1857 : cluster [DBG] pgmap v1043: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:48.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:48 gibba023 bash[30844]: cluster 2021-03-10T20:42:46.707552+0000 mgr.gibba044.wflcwh (mgr.34466) 1858 : cluster [DBG] pgmap v1044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:48.528 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:48 gibba023 bash[31815]: cluster 2021-03-10T20:42:46.707552+0000 mgr.gibba044.wflcwh (mgr.34466) 1858 : cluster [DBG] pgmap v1044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:48.529 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:48 gibba044 bash[25485]: cluster 2021-03-10T20:42:46.707552+0000 mgr.gibba044.wflcwh (mgr.34466) 1858 : cluster [DBG] pgmap v1044: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:50.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:50 gibba023 bash[30844]: cluster 2021-03-10T20:42:48.709247+0000 mgr.gibba044.wflcwh (mgr.34466) 1859 : cluster [DBG] pgmap v1045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:50.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:50 gibba023 bash[31815]: cluster 2021-03-10T20:42:48.709247+0000 mgr.gibba044.wflcwh (mgr.34466) 1859 : cluster [DBG] pgmap v1045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:50.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:50 gibba044 bash[25485]: cluster 2021-03-10T20:42:48.709247+0000 mgr.gibba044.wflcwh (mgr.34466) 1859 : cluster [DBG] pgmap v1045: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:52.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:52 gibba023 bash[30844]: cluster 2021-03-10T20:42:50.710952+0000 mgr.gibba044.wflcwh (mgr.34466) 1860 : cluster [DBG] pgmap v1046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:52.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:52 gibba023 bash[31815]: cluster 2021-03-10T20:42:50.710952+0000 mgr.gibba044.wflcwh (mgr.34466) 1860 : cluster [DBG] pgmap v1046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:52.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:52 gibba044 bash[25485]: cluster 2021-03-10T20:42:50.710952+0000 mgr.gibba044.wflcwh (mgr.34466) 1860 : cluster [DBG] pgmap v1046: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:54.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:54 gibba023 bash[30844]: cluster 2021-03-10T20:42:52.712412+0000 mgr.gibba044.wflcwh (mgr.34466) 1861 : cluster [DBG] pgmap v1047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:54.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:54 gibba023 bash[31815]: cluster 2021-03-10T20:42:52.712412+0000 mgr.gibba044.wflcwh (mgr.34466) 1861 : cluster [DBG] pgmap v1047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:54.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:54 gibba044 bash[25485]: cluster 2021-03-10T20:42:52.712412+0000 mgr.gibba044.wflcwh (mgr.34466) 1861 : cluster [DBG] pgmap v1047: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:56.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:56 gibba023 bash[30844]: cluster 2021-03-10T20:42:54.712971+0000 mgr.gibba044.wflcwh (mgr.34466) 1862 : cluster [DBG] pgmap v1048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:56.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:56 gibba023 bash[31815]: cluster 2021-03-10T20:42:54.712971+0000 mgr.gibba044.wflcwh (mgr.34466) 1862 : cluster [DBG] pgmap v1048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:56.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:56 gibba044 bash[25485]: cluster 2021-03-10T20:42:54.712971+0000 mgr.gibba044.wflcwh (mgr.34466) 1862 : cluster [DBG] pgmap v1048: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:58.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:58 gibba023 bash[30844]: cluster 2021-03-10T20:42:56.714340+0000 mgr.gibba044.wflcwh (mgr.34466) 1863 : cluster [DBG] pgmap v1049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:58.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:58 gibba023 bash[31815]: cluster 2021-03-10T20:42:56.714340+0000 mgr.gibba044.wflcwh (mgr.34466) 1863 : cluster [DBG] pgmap v1049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:58.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:58 gibba044 bash[25485]: cluster 2021-03-10T20:42:56.714340+0000 mgr.gibba044.wflcwh (mgr.34466) 1863 : cluster [DBG] pgmap v1049: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:42:59.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:42:59 gibba023 bash[30844]: cephadm 2021-03-10T20:42:57.528582+0000 mgr.gibba044.wflcwh (mgr.34466) 1864 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:42:59.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:42:59 gibba023 bash[31815]: cephadm 2021-03-10T20:42:57.528582+0000 mgr.gibba044.wflcwh (mgr.34466) 1864 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:42:59.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:42:59 gibba044 bash[25485]: cephadm 2021-03-10T20:42:57.528582+0000 mgr.gibba044.wflcwh (mgr.34466) 1864 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:43:00.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:00 gibba023 bash[30844]: cluster 2021-03-10T20:42:58.715948+0000 mgr.gibba044.wflcwh (mgr.34466) 1865 : cluster [DBG] pgmap v1050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:00.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:00 gibba023 bash[31815]: cluster 2021-03-10T20:42:58.715948+0000 mgr.gibba044.wflcwh (mgr.34466) 1865 : cluster [DBG] pgmap v1050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:00.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:00 gibba044 bash[25485]: cluster 2021-03-10T20:42:58.715948+0000 mgr.gibba044.wflcwh (mgr.34466) 1865 : cluster [DBG] pgmap v1050: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:02.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:02 gibba023 bash[30844]: cluster 2021-03-10T20:43:00.717636+0000 mgr.gibba044.wflcwh (mgr.34466) 1866 : cluster [DBG] pgmap v1051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:02.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:02 gibba023 bash[31815]: cluster 2021-03-10T20:43:00.717636+0000 mgr.gibba044.wflcwh (mgr.34466) 1866 : cluster [DBG] pgmap v1051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:02.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:02 gibba044 bash[25485]: cluster 2021-03-10T20:43:00.717636+0000 mgr.gibba044.wflcwh (mgr.34466) 1866 : cluster [DBG] pgmap v1051: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:03.861 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:43:04.093 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:43:04.094 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (34m) 9m ago 39m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:43:04.094 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (39m) 8m ago 39m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:43:04.094 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (34m) 8m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:43:04.094 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (34m) 8m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:43:04.095 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (33m) 9m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:43:04.095 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (33m) 9m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:43:04.095 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (33m) 8m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:43:04.095 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (33m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:43:04.096 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (39m) 9m ago 39m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:43:04.096 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (39m) 8m ago 39m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:43:04.096 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (32m) 9m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:43:04.097 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (31m) 9m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:43:04.097 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (31m) 9m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:43:04.097 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (31m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:43:04.097 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (30m) 8m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:43:04.098 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (30m) 8m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:43:04.099 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (29m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:43:04.099 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (29m) 8m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:43:04.099 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (39m) 8m ago 39m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:43:04.099 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 9m ago 37m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:43:04.100 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 8m ago 37m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:43:04.345 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:43:04.346 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:43:04.346 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:43:04.346 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:43:04.347 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:43:04.347 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:43:04.347 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:43:04.347 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:43:04.348 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:43:04.348 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:43:04.348 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:43:04.348 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:43:04.348 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:43:04.349 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:43:04.349 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:43:04.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:04 gibba023 bash[30844]: cluster 2021-03-10T20:43:02.719244+0000 mgr.gibba044.wflcwh (mgr.34466) 1867 : cluster [DBG] pgmap v1052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:04.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:04 gibba023 bash[31815]: cluster 2021-03-10T20:43:02.719244+0000 mgr.gibba044.wflcwh (mgr.34466) 1867 : cluster [DBG] pgmap v1052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:04.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:04 gibba044 bash[25485]: cluster 2021-03-10T20:43:02.719244+0000 mgr.gibba044.wflcwh (mgr.34466) 1867 : cluster [DBG] pgmap v1052: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:05.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:05 gibba023 bash[30844]: audit 2021-03-10T20:43:03.852772+0000 mgr.gibba044.wflcwh (mgr.34466) 1868 : audit [DBG] from='client.55297 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:43:05.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:05 gibba023 bash[30844]: audit 2021-03-10T20:43:04.082622+0000 mgr.gibba044.wflcwh (mgr.34466) 1869 : audit [DBG] from='client.45324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:43:05.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:05 gibba023 bash[30844]: audit 2021-03-10T20:43:04.345871+0000 mon.a (mon.0) 1055 : audit [DBG] from='client.? 172.21.2.123:0/1865817754' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:05.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:05 gibba023 bash[31815]: audit 2021-03-10T20:43:03.852772+0000 mgr.gibba044.wflcwh (mgr.34466) 1868 : audit [DBG] from='client.55297 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:43:05.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:05 gibba023 bash[31815]: audit 2021-03-10T20:43:04.082622+0000 mgr.gibba044.wflcwh (mgr.34466) 1869 : audit [DBG] from='client.45324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:43:05.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:05 gibba023 bash[31815]: audit 2021-03-10T20:43:04.345871+0000 mon.a (mon.0) 1055 : audit [DBG] from='client.? 172.21.2.123:0/1865817754' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:05.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:05 gibba044 bash[25485]: audit 2021-03-10T20:43:03.852772+0000 mgr.gibba044.wflcwh (mgr.34466) 1868 : audit [DBG] from='client.55297 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:43:05.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:05 gibba044 bash[25485]: audit 2021-03-10T20:43:04.082622+0000 mgr.gibba044.wflcwh (mgr.34466) 1869 : audit [DBG] from='client.45324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:43:05.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:05 gibba044 bash[25485]: audit 2021-03-10T20:43:04.345871+0000 mon.a (mon.0) 1055 : audit [DBG] from='client.? 172.21.2.123:0/1865817754' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:06.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:06 gibba023 bash[30844]: cluster 2021-03-10T20:43:04.720017+0000 mgr.gibba044.wflcwh (mgr.34466) 1870 : cluster [DBG] pgmap v1053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:06.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:06 gibba023 bash[31815]: cluster 2021-03-10T20:43:04.720017+0000 mgr.gibba044.wflcwh (mgr.34466) 1870 : cluster [DBG] pgmap v1053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:06.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:06 gibba044 bash[25485]: cluster 2021-03-10T20:43:04.720017+0000 mgr.gibba044.wflcwh (mgr.34466) 1870 : cluster [DBG] pgmap v1053: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:08.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:07 gibba044 bash[25485]: cluster 2021-03-10T20:43:06.721455+0000 mgr.gibba044.wflcwh (mgr.34466) 1871 : cluster [DBG] pgmap v1054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:08.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:07 gibba023 bash[30844]: cluster 2021-03-10T20:43:06.721455+0000 mgr.gibba044.wflcwh (mgr.34466) 1871 : cluster [DBG] pgmap v1054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:08.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:07 gibba023 bash[31815]: cluster 2021-03-10T20:43:06.721455+0000 mgr.gibba044.wflcwh (mgr.34466) 1871 : cluster [DBG] pgmap v1054: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:10.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:09 gibba044 bash[25485]: cluster 2021-03-10T20:43:08.723291+0000 mgr.gibba044.wflcwh (mgr.34466) 1872 : cluster [DBG] pgmap v1055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:10.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:09 gibba023 bash[30844]: cluster 2021-03-10T20:43:08.723291+0000 mgr.gibba044.wflcwh (mgr.34466) 1872 : cluster [DBG] pgmap v1055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:10.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:09 gibba023 bash[31815]: cluster 2021-03-10T20:43:08.723291+0000 mgr.gibba044.wflcwh (mgr.34466) 1872 : cluster [DBG] pgmap v1055: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:12.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:11 gibba044 bash[25485]: cluster 2021-03-10T20:43:10.724919+0000 mgr.gibba044.wflcwh (mgr.34466) 1873 : cluster [DBG] pgmap v1056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:12.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:11 gibba023 bash[30844]: cluster 2021-03-10T20:43:10.724919+0000 mgr.gibba044.wflcwh (mgr.34466) 1873 : cluster [DBG] pgmap v1056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:12.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:11 gibba023 bash[31815]: cluster 2021-03-10T20:43:10.724919+0000 mgr.gibba044.wflcwh (mgr.34466) 1873 : cluster [DBG] pgmap v1056: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:13.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:12 gibba044 bash[25485]: audit 2021-03-10T20:43:12.545971+0000 mon.a (mon.0) 1056 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:43:13.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:12 gibba023 bash[30844]: audit 2021-03-10T20:43:12.545971+0000 mon.a (mon.0) 1056 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:43:13.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:12 gibba023 bash[31815]: audit 2021-03-10T20:43:12.545971+0000 mon.a (mon.0) 1056 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:43:14.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:13 gibba044 bash[25485]: cephadm 2021-03-10T20:43:12.546219+0000 mgr.gibba044.wflcwh (mgr.34466) 1874 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:43:14.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:13 gibba044 bash[25485]: cluster 2021-03-10T20:43:12.726324+0000 mgr.gibba044.wflcwh (mgr.34466) 1875 : cluster [DBG] pgmap v1057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:14.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:13 gibba023 bash[30844]: cephadm 2021-03-10T20:43:12.546219+0000 mgr.gibba044.wflcwh (mgr.34466) 1874 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:43:14.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:13 gibba023 bash[30844]: cluster 2021-03-10T20:43:12.726324+0000 mgr.gibba044.wflcwh (mgr.34466) 1875 : cluster [DBG] pgmap v1057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:14.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:13 gibba023 bash[31815]: cephadm 2021-03-10T20:43:12.546219+0000 mgr.gibba044.wflcwh (mgr.34466) 1874 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:43:14.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:13 gibba023 bash[31815]: cluster 2021-03-10T20:43:12.726324+0000 mgr.gibba044.wflcwh (mgr.34466) 1875 : cluster [DBG] pgmap v1057: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:16.420 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:16 gibba044 bash[25485]: cluster 2021-03-10T20:43:14.727520+0000 mgr.gibba044.wflcwh (mgr.34466) 1876 : cluster [DBG] pgmap v1058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:16.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:16 gibba023 bash[31815]: cluster 2021-03-10T20:43:14.727520+0000 mgr.gibba044.wflcwh (mgr.34466) 1876 : cluster [DBG] pgmap v1058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:16.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:16 gibba023 bash[30844]: cluster 2021-03-10T20:43:14.727520+0000 mgr.gibba044.wflcwh (mgr.34466) 1876 : cluster [DBG] pgmap v1058: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:17.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[30844]: audit 2021-03-10T20:43:16.161536+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:43:17.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[30844]: cephadm 2021-03-10T20:43:16.163141+0000 mgr.gibba044.wflcwh (mgr.34466) 1877 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:43:17.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[30844]: audit 2021-03-10T20:43:16.401804+0000 mon.a (mon.0) 1058 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:43:17.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[30844]: audit 2021-03-10T20:43:16.409664+0000 mon.a (mon.0) 1059 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:43:17.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[30844]: cephadm 2021-03-10T20:43:16.409844+0000 mgr.gibba044.wflcwh (mgr.34466) 1878 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:43:17.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[30844]: audit 2021-03-10T20:43:16.411217+0000 mon.a (mon.0) 1060 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[30844]: cephadm 2021-03-10T20:43:16.411813+0000 mgr.gibba044.wflcwh (mgr.34466) 1879 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:43:17.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[30844]: audit 2021-03-10T20:43:16.412771+0000 mon.a (mon.0) 1061 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[30844]: cephadm 2021-03-10T20:43:16.412925+0000 mgr.gibba044.wflcwh (mgr.34466) 1880 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:43:17.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[30844]: cephadm 2021-03-10T20:43:16.412968+0000 mgr.gibba044.wflcwh (mgr.34466) 1881 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:43:17.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[30844]: audit 2021-03-10T20:43:16.414146+0000 mon.a (mon.0) 1062 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[30844]: cephadm 2021-03-10T20:43:16.414565+0000 mgr.gibba044.wflcwh (mgr.34466) 1882 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:43:17.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[30844]: cephadm 2021-03-10T20:43:16.414602+0000 mgr.gibba044.wflcwh (mgr.34466) 1883 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:43:17.432 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[30844]: cephadm 2021-03-10T20:43:16.415921+0000 mgr.gibba044.wflcwh (mgr.34466) 1884 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:43:17.432 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[30844]: audit 2021-03-10T20:43:16.416962+0000 mon.a (mon.0) 1063 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.433 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[30844]: cephadm 2021-03-10T20:43:16.417413+0000 mgr.gibba044.wflcwh (mgr.34466) 1885 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:43:17.433 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[30844]: cephadm 2021-03-10T20:43:16.417456+0000 mgr.gibba044.wflcwh (mgr.34466) 1886 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:43:17.433 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[30844]: audit 2021-03-10T20:43:16.418793+0000 mon.a (mon.0) 1064 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.434 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[30844]: cephadm 2021-03-10T20:43:16.418920+0000 mgr.gibba044.wflcwh (mgr.34466) 1887 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:43:17.434 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[30844]: cephadm 2021-03-10T20:43:16.419361+0000 mgr.gibba044.wflcwh (mgr.34466) 1888 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:43:17.435 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[30844]: cephadm 2021-03-10T20:43:16.421161+0000 mgr.gibba044.wflcwh (mgr.34466) 1889 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:43:17.435 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[30844]: cephadm 2021-03-10T20:43:16.421206+0000 mgr.gibba044.wflcwh (mgr.34466) 1890 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:43:17.436 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[30844]: cephadm 2021-03-10T20:43:16.421368+0000 mgr.gibba044.wflcwh (mgr.34466) 1891 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:43:17.436 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[30844]: cluster 2021-03-10T20:43:16.729151+0000 mgr.gibba044.wflcwh (mgr.34466) 1892 : cluster [DBG] pgmap v1059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:17.437 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[31815]: audit 2021-03-10T20:43:16.161536+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:43:17.437 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[31815]: cephadm 2021-03-10T20:43:16.163141+0000 mgr.gibba044.wflcwh (mgr.34466) 1877 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:43:17.438 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[31815]: audit 2021-03-10T20:43:16.401804+0000 mon.a (mon.0) 1058 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:43:17.438 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[31815]: audit 2021-03-10T20:43:16.409664+0000 mon.a (mon.0) 1059 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:43:17.438 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[31815]: cephadm 2021-03-10T20:43:16.409844+0000 mgr.gibba044.wflcwh (mgr.34466) 1878 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:43:17.439 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[31815]: audit 2021-03-10T20:43:16.411217+0000 mon.a (mon.0) 1060 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.439 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[31815]: cephadm 2021-03-10T20:43:16.411813+0000 mgr.gibba044.wflcwh (mgr.34466) 1879 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:43:17.440 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[31815]: audit 2021-03-10T20:43:16.412771+0000 mon.a (mon.0) 1061 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.440 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[31815]: cephadm 2021-03-10T20:43:16.412925+0000 mgr.gibba044.wflcwh (mgr.34466) 1880 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:43:17.440 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[31815]: cephadm 2021-03-10T20:43:16.412968+0000 mgr.gibba044.wflcwh (mgr.34466) 1881 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:43:17.441 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[31815]: audit 2021-03-10T20:43:16.414146+0000 mon.a (mon.0) 1062 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.441 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[31815]: cephadm 2021-03-10T20:43:16.414565+0000 mgr.gibba044.wflcwh (mgr.34466) 1882 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:43:17.442 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[31815]: cephadm 2021-03-10T20:43:16.414602+0000 mgr.gibba044.wflcwh (mgr.34466) 1883 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:43:17.442 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[31815]: cephadm 2021-03-10T20:43:16.415921+0000 mgr.gibba044.wflcwh (mgr.34466) 1884 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:43:17.443 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[31815]: audit 2021-03-10T20:43:16.416962+0000 mon.a (mon.0) 1063 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.443 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[31815]: cephadm 2021-03-10T20:43:16.417413+0000 mgr.gibba044.wflcwh (mgr.34466) 1885 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:43:17.443 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[31815]: cephadm 2021-03-10T20:43:16.417456+0000 mgr.gibba044.wflcwh (mgr.34466) 1886 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:43:17.444 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[31815]: audit 2021-03-10T20:43:16.418793+0000 mon.a (mon.0) 1064 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.444 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[31815]: cephadm 2021-03-10T20:43:16.418920+0000 mgr.gibba044.wflcwh (mgr.34466) 1887 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:43:17.445 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[31815]: cephadm 2021-03-10T20:43:16.419361+0000 mgr.gibba044.wflcwh (mgr.34466) 1888 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:43:17.446 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[31815]: cephadm 2021-03-10T20:43:16.421161+0000 mgr.gibba044.wflcwh (mgr.34466) 1889 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:43:17.447 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[31815]: cephadm 2021-03-10T20:43:16.421206+0000 mgr.gibba044.wflcwh (mgr.34466) 1890 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:43:17.447 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[31815]: cephadm 2021-03-10T20:43:16.421368+0000 mgr.gibba044.wflcwh (mgr.34466) 1891 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:43:17.447 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:17 gibba023 bash[31815]: cluster 2021-03-10T20:43:16.729151+0000 mgr.gibba044.wflcwh (mgr.34466) 1892 : cluster [DBG] pgmap v1059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:17.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:17 gibba044 bash[25485]: audit 2021-03-10T20:43:16.161536+0000 mon.a (mon.0) 1057 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:43:17.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:17 gibba044 bash[25485]: cephadm 2021-03-10T20:43:16.163141+0000 mgr.gibba044.wflcwh (mgr.34466) 1877 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:43:17.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:17 gibba044 bash[25485]: audit 2021-03-10T20:43:16.401804+0000 mon.a (mon.0) 1058 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:43:17.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:17 gibba044 bash[25485]: audit 2021-03-10T20:43:16.409664+0000 mon.a (mon.0) 1059 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:43:17.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:17 gibba044 bash[25485]: cephadm 2021-03-10T20:43:16.409844+0000 mgr.gibba044.wflcwh (mgr.34466) 1878 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:43:17.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:17 gibba044 bash[25485]: audit 2021-03-10T20:43:16.411217+0000 mon.a (mon.0) 1060 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:17 gibba044 bash[25485]: cephadm 2021-03-10T20:43:16.411813+0000 mgr.gibba044.wflcwh (mgr.34466) 1879 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:43:17.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:17 gibba044 bash[25485]: audit 2021-03-10T20:43:16.412771+0000 mon.a (mon.0) 1061 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:17 gibba044 bash[25485]: cephadm 2021-03-10T20:43:16.412925+0000 mgr.gibba044.wflcwh (mgr.34466) 1880 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:43:17.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:17 gibba044 bash[25485]: cephadm 2021-03-10T20:43:16.412968+0000 mgr.gibba044.wflcwh (mgr.34466) 1881 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:43:17.508 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:17 gibba044 bash[25485]: audit 2021-03-10T20:43:16.414146+0000 mon.a (mon.0) 1062 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.509 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:17 gibba044 bash[25485]: cephadm 2021-03-10T20:43:16.414565+0000 mgr.gibba044.wflcwh (mgr.34466) 1882 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:43:17.509 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:17 gibba044 bash[25485]: cephadm 2021-03-10T20:43:16.414602+0000 mgr.gibba044.wflcwh (mgr.34466) 1883 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:43:17.509 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:17 gibba044 bash[25485]: cephadm 2021-03-10T20:43:16.415921+0000 mgr.gibba044.wflcwh (mgr.34466) 1884 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:43:17.510 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:17 gibba044 bash[25485]: audit 2021-03-10T20:43:16.416962+0000 mon.a (mon.0) 1063 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.511 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:17 gibba044 bash[25485]: cephadm 2021-03-10T20:43:16.417413+0000 mgr.gibba044.wflcwh (mgr.34466) 1885 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:43:17.511 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:17 gibba044 bash[25485]: cephadm 2021-03-10T20:43:16.417456+0000 mgr.gibba044.wflcwh (mgr.34466) 1886 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:43:17.511 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:17 gibba044 bash[25485]: audit 2021-03-10T20:43:16.418793+0000 mon.a (mon.0) 1064 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:17.512 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:17 gibba044 bash[25485]: cephadm 2021-03-10T20:43:16.418920+0000 mgr.gibba044.wflcwh (mgr.34466) 1887 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:43:17.512 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:17 gibba044 bash[25485]: cephadm 2021-03-10T20:43:16.419361+0000 mgr.gibba044.wflcwh (mgr.34466) 1888 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:43:17.513 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:17 gibba044 bash[25485]: cephadm 2021-03-10T20:43:16.421161+0000 mgr.gibba044.wflcwh (mgr.34466) 1889 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:43:17.513 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:17 gibba044 bash[25485]: cephadm 2021-03-10T20:43:16.421206+0000 mgr.gibba044.wflcwh (mgr.34466) 1890 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:43:17.514 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:17 gibba044 bash[25485]: cephadm 2021-03-10T20:43:16.421368+0000 mgr.gibba044.wflcwh (mgr.34466) 1891 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:43:17.514 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:17 gibba044 bash[25485]: cluster 2021-03-10T20:43:16.729151+0000 mgr.gibba044.wflcwh (mgr.34466) 1892 : cluster [DBG] pgmap v1059: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:20.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:19 gibba023 bash[30844]: cluster 2021-03-10T20:43:18.730961+0000 mgr.gibba044.wflcwh (mgr.34466) 1893 : cluster [DBG] pgmap v1060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:20.176 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:19 gibba023 bash[31815]: cluster 2021-03-10T20:43:18.730961+0000 mgr.gibba044.wflcwh (mgr.34466) 1893 : cluster [DBG] pgmap v1060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:20.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:19 gibba044 bash[25485]: cluster 2021-03-10T20:43:18.730961+0000 mgr.gibba044.wflcwh (mgr.34466) 1893 : cluster [DBG] pgmap v1060: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:22.174 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:21 gibba023 bash[30844]: cluster 2021-03-10T20:43:20.732575+0000 mgr.gibba044.wflcwh (mgr.34466) 1894 : cluster [DBG] pgmap v1061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:22.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:21 gibba023 bash[31815]: cluster 2021-03-10T20:43:20.732575+0000 mgr.gibba044.wflcwh (mgr.34466) 1894 : cluster [DBG] pgmap v1061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:22.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:21 gibba044 bash[25485]: cluster 2021-03-10T20:43:20.732575+0000 mgr.gibba044.wflcwh (mgr.34466) 1894 : cluster [DBG] pgmap v1061: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:24.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:23 gibba044 bash[25485]: cluster 2021-03-10T20:43:22.734121+0000 mgr.gibba044.wflcwh (mgr.34466) 1895 : cluster [DBG] pgmap v1062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:24.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:23 gibba023 bash[30844]: cluster 2021-03-10T20:43:22.734121+0000 mgr.gibba044.wflcwh (mgr.34466) 1895 : cluster [DBG] pgmap v1062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:24.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:23 gibba023 bash[31815]: cluster 2021-03-10T20:43:22.734121+0000 mgr.gibba044.wflcwh (mgr.34466) 1895 : cluster [DBG] pgmap v1062: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:26.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:25 gibba044 bash[25485]: cluster 2021-03-10T20:43:24.735353+0000 mgr.gibba044.wflcwh (mgr.34466) 1896 : cluster [DBG] pgmap v1063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:26.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:25 gibba023 bash[30844]: cluster 2021-03-10T20:43:24.735353+0000 mgr.gibba044.wflcwh (mgr.34466) 1896 : cluster [DBG] pgmap v1063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:26.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:25 gibba023 bash[31815]: cluster 2021-03-10T20:43:24.735353+0000 mgr.gibba044.wflcwh (mgr.34466) 1896 : cluster [DBG] pgmap v1063: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:28.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:27 gibba044 bash[25485]: cluster 2021-03-10T20:43:26.736945+0000 mgr.gibba044.wflcwh (mgr.34466) 1897 : cluster [DBG] pgmap v1064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:28.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:27 gibba044 bash[25485]: audit 2021-03-10T20:43:27.233756+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:43:28.251 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:27 gibba044 bash[25485]: audit 2021-03-10T20:43:27.234435+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:43:28.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:27 gibba044 bash[25485]: audit 2021-03-10T20:43:27.235833+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T20:43:28.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:27 gibba044 bash[25485]: audit 2021-03-10T20:43:27.236597+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:43:28.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:27 gibba044 bash[25485]: audit 2021-03-10T20:43:27.237316+0000 mon.a (mon.0) 1069 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:43:28.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:27 gibba044 bash[25485]: audit 2021-03-10T20:43:27.238022+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:43:28.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:27 gibba023 bash[30844]: cluster 2021-03-10T20:43:26.736945+0000 mgr.gibba044.wflcwh (mgr.34466) 1897 : cluster [DBG] pgmap v1064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:28.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:27 gibba023 bash[30844]: audit 2021-03-10T20:43:27.233756+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:43:28.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:27 gibba023 bash[30844]: audit 2021-03-10T20:43:27.234435+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:43:28.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:27 gibba023 bash[30844]: audit 2021-03-10T20:43:27.235833+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T20:43:28.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:27 gibba023 bash[30844]: audit 2021-03-10T20:43:27.236597+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:43:28.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:27 gibba023 bash[30844]: audit 2021-03-10T20:43:27.237316+0000 mon.a (mon.0) 1069 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:43:28.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:27 gibba023 bash[30844]: audit 2021-03-10T20:43:27.238022+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:43:28.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:27 gibba023 bash[31815]: cluster 2021-03-10T20:43:26.736945+0000 mgr.gibba044.wflcwh (mgr.34466) 1897 : cluster [DBG] pgmap v1064: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:28.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:27 gibba023 bash[31815]: audit 2021-03-10T20:43:27.233756+0000 mon.a (mon.0) 1065 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:43:28.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:27 gibba023 bash[31815]: audit 2021-03-10T20:43:27.234435+0000 mon.a (mon.0) 1066 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:43:28.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:27 gibba023 bash[31815]: audit 2021-03-10T20:43:27.235833+0000 mon.a (mon.0) 1067 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T20:43:28.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:27 gibba023 bash[31815]: audit 2021-03-10T20:43:27.236597+0000 mon.a (mon.0) 1068 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:43:28.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:27 gibba023 bash[31815]: audit 2021-03-10T20:43:27.237316+0000 mon.a (mon.0) 1069 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:43:28.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:27 gibba023 bash[31815]: audit 2021-03-10T20:43:27.238022+0000 mon.a (mon.0) 1070 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:43:30.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:29 gibba044 bash[25485]: cluster 2021-03-10T20:43:28.738789+0000 mgr.gibba044.wflcwh (mgr.34466) 1898 : cluster [DBG] pgmap v1065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:30.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:29 gibba023 bash[30844]: cluster 2021-03-10T20:43:28.738789+0000 mgr.gibba044.wflcwh (mgr.34466) 1898 : cluster [DBG] pgmap v1065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:30.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:29 gibba023 bash[31815]: cluster 2021-03-10T20:43:28.738789+0000 mgr.gibba044.wflcwh (mgr.34466) 1898 : cluster [DBG] pgmap v1065: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:32.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:32 gibba023 bash[30844]: cluster 2021-03-10T20:43:30.740433+0000 mgr.gibba044.wflcwh (mgr.34466) 1899 : cluster [DBG] pgmap v1066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:32.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:32 gibba023 bash[31815]: cluster 2021-03-10T20:43:30.740433+0000 mgr.gibba044.wflcwh (mgr.34466) 1899 : cluster [DBG] pgmap v1066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:32.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:32 gibba044 bash[25485]: cluster 2021-03-10T20:43:30.740433+0000 mgr.gibba044.wflcwh (mgr.34466) 1899 : cluster [DBG] pgmap v1066: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:33.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:33 gibba023 bash[30844]: cephadm 2021-03-10T20:43:31.437161+0000 mgr.gibba044.wflcwh (mgr.34466) 1900 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:43:33.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:33 gibba023 bash[31815]: cephadm 2021-03-10T20:43:31.437161+0000 mgr.gibba044.wflcwh (mgr.34466) 1900 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:43:33.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:33 gibba044 bash[25485]: cephadm 2021-03-10T20:43:31.437161+0000 mgr.gibba044.wflcwh (mgr.34466) 1900 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:43:34.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:34 gibba023 bash[30844]: cluster 2021-03-10T20:43:32.742113+0000 mgr.gibba044.wflcwh (mgr.34466) 1901 : cluster [DBG] pgmap v1067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:34.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:34 gibba023 bash[31815]: cluster 2021-03-10T20:43:32.742113+0000 mgr.gibba044.wflcwh (mgr.34466) 1901 : cluster [DBG] pgmap v1067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:34.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:34 gibba044 bash[25485]: cluster 2021-03-10T20:43:32.742113+0000 mgr.gibba044.wflcwh (mgr.34466) 1901 : cluster [DBG] pgmap v1067: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:34.592 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:43:34.819 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:43:34.820 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (34m) 18s ago 40m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:43:34.820 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (40m) 9m ago 40m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:43:34.820 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (35m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:43:34.820 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (35m) 9m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:43:34.821 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (34m) 18s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:43:34.821 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (34m) 18s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:43:34.821 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (33m) 9m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:43:34.821 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (33m) 18s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:43:34.822 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (40m) 18s ago 40m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:43:34.822 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (40m) 9m ago 40m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:43:34.822 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (32m) 18s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:43:34.823 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (32m) 18s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:43:34.823 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (32m) 18s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:43:34.823 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (31m) 18s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:43:34.823 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (31m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:43:34.823 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (30m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:43:34.824 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (30m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:43:34.824 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (29m) 9m ago 40m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:43:34.824 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (39m) 9m ago 40m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:43:34.825 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 18s ago 38m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:43:34.825 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 9m ago 38m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:43:35.069 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:43:35.070 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:43:35.070 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:43:35.070 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:43:35.071 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:43:35.071 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:43:35.071 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:43:35.072 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:43:35.072 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:43:35.072 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:43:35.072 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:43:35.073 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:43:35.073 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:43:35.073 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:43:35.073 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:43:36.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:36 gibba023 bash[30844]: audit 2021-03-10T20:43:34.584468+0000 mgr.gibba044.wflcwh (mgr.34466) 1902 : audit [DBG] from='client.45336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:43:36.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:36 gibba023 bash[30844]: cluster 2021-03-10T20:43:34.743376+0000 mgr.gibba044.wflcwh (mgr.34466) 1903 : cluster [DBG] pgmap v1068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:36.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:36 gibba023 bash[30844]: audit 2021-03-10T20:43:34.807362+0000 mgr.gibba044.wflcwh (mgr.34466) 1904 : audit [DBG] from='client.45342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:43:36.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:36 gibba023 bash[30844]: audit 2021-03-10T20:43:35.069902+0000 mon.a (mon.0) 1071 : audit [DBG] from='client.? 172.21.2.123:0/447291375' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:36.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:36 gibba023 bash[31815]: audit 2021-03-10T20:43:34.584468+0000 mgr.gibba044.wflcwh (mgr.34466) 1902 : audit [DBG] from='client.45336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:43:36.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:36 gibba023 bash[31815]: cluster 2021-03-10T20:43:34.743376+0000 mgr.gibba044.wflcwh (mgr.34466) 1903 : cluster [DBG] pgmap v1068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:36.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:36 gibba023 bash[31815]: audit 2021-03-10T20:43:34.807362+0000 mgr.gibba044.wflcwh (mgr.34466) 1904 : audit [DBG] from='client.45342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:43:36.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:36 gibba023 bash[31815]: audit 2021-03-10T20:43:35.069902+0000 mon.a (mon.0) 1071 : audit [DBG] from='client.? 172.21.2.123:0/447291375' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:36.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:36 gibba044 bash[25485]: audit 2021-03-10T20:43:34.584468+0000 mgr.gibba044.wflcwh (mgr.34466) 1902 : audit [DBG] from='client.45336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:43:36.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:36 gibba044 bash[25485]: cluster 2021-03-10T20:43:34.743376+0000 mgr.gibba044.wflcwh (mgr.34466) 1903 : cluster [DBG] pgmap v1068: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:36.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:36 gibba044 bash[25485]: audit 2021-03-10T20:43:34.807362+0000 mgr.gibba044.wflcwh (mgr.34466) 1904 : audit [DBG] from='client.45342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:43:36.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:36 gibba044 bash[25485]: audit 2021-03-10T20:43:35.069902+0000 mon.a (mon.0) 1071 : audit [DBG] from='client.? 172.21.2.123:0/447291375' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:43:38.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:38 gibba023 bash[30844]: cluster 2021-03-10T20:43:36.744954+0000 mgr.gibba044.wflcwh (mgr.34466) 1905 : cluster [DBG] pgmap v1069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:38.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:38 gibba023 bash[31815]: cluster 2021-03-10T20:43:36.744954+0000 mgr.gibba044.wflcwh (mgr.34466) 1905 : cluster [DBG] pgmap v1069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:38.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:38 gibba044 bash[25485]: cluster 2021-03-10T20:43:36.744954+0000 mgr.gibba044.wflcwh (mgr.34466) 1905 : cluster [DBG] pgmap v1069: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:40.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:40 gibba023 bash[30844]: cluster 2021-03-10T20:43:38.746519+0000 mgr.gibba044.wflcwh (mgr.34466) 1906 : cluster [DBG] pgmap v1070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:40.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:40 gibba023 bash[31815]: cluster 2021-03-10T20:43:38.746519+0000 mgr.gibba044.wflcwh (mgr.34466) 1906 : cluster [DBG] pgmap v1070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:40.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:40 gibba044 bash[25485]: cluster 2021-03-10T20:43:38.746519+0000 mgr.gibba044.wflcwh (mgr.34466) 1906 : cluster [DBG] pgmap v1070: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:42.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:42 gibba023 bash[30844]: cluster 2021-03-10T20:43:40.748259+0000 mgr.gibba044.wflcwh (mgr.34466) 1907 : cluster [DBG] pgmap v1071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:42.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:42 gibba023 bash[31815]: cluster 2021-03-10T20:43:40.748259+0000 mgr.gibba044.wflcwh (mgr.34466) 1907 : cluster [DBG] pgmap v1071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:42.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:42 gibba044 bash[25485]: cluster 2021-03-10T20:43:40.748259+0000 mgr.gibba044.wflcwh (mgr.34466) 1907 : cluster [DBG] pgmap v1071: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:44.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:44 gibba023 bash[30844]: cluster 2021-03-10T20:43:42.749929+0000 mgr.gibba044.wflcwh (mgr.34466) 1908 : cluster [DBG] pgmap v1072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:44.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:44 gibba023 bash[31815]: cluster 2021-03-10T20:43:42.749929+0000 mgr.gibba044.wflcwh (mgr.34466) 1908 : cluster [DBG] pgmap v1072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:44.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:44 gibba044 bash[25485]: cluster 2021-03-10T20:43:42.749929+0000 mgr.gibba044.wflcwh (mgr.34466) 1908 : cluster [DBG] pgmap v1072: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:46.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:46 gibba023 bash[30844]: cluster 2021-03-10T20:43:44.751293+0000 mgr.gibba044.wflcwh (mgr.34466) 1909 : cluster [DBG] pgmap v1073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:46.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:46 gibba023 bash[31815]: cluster 2021-03-10T20:43:44.751293+0000 mgr.gibba044.wflcwh (mgr.34466) 1909 : cluster [DBG] pgmap v1073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:46.452 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:46 gibba044 bash[25485]: cluster 2021-03-10T20:43:44.751293+0000 mgr.gibba044.wflcwh (mgr.34466) 1909 : cluster [DBG] pgmap v1073: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:48.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:48 gibba023 bash[30844]: cephadm 2021-03-10T20:43:46.453262+0000 mgr.gibba044.wflcwh (mgr.34466) 1910 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:43:48.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:48 gibba023 bash[30844]: cluster 2021-03-10T20:43:46.752906+0000 mgr.gibba044.wflcwh (mgr.34466) 1911 : cluster [DBG] pgmap v1074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:48.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:48 gibba023 bash[31815]: cephadm 2021-03-10T20:43:46.453262+0000 mgr.gibba044.wflcwh (mgr.34466) 1910 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:43:48.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:48 gibba023 bash[31815]: cluster 2021-03-10T20:43:46.752906+0000 mgr.gibba044.wflcwh (mgr.34466) 1911 : cluster [DBG] pgmap v1074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:48.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:48 gibba044 bash[25485]: cephadm 2021-03-10T20:43:46.453262+0000 mgr.gibba044.wflcwh (mgr.34466) 1910 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:43:48.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:48 gibba044 bash[25485]: cluster 2021-03-10T20:43:46.752906+0000 mgr.gibba044.wflcwh (mgr.34466) 1911 : cluster [DBG] pgmap v1074: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:50.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:50 gibba023 bash[30844]: cluster 2021-03-10T20:43:48.754742+0000 mgr.gibba044.wflcwh (mgr.34466) 1912 : cluster [DBG] pgmap v1075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:50.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:50 gibba023 bash[31815]: cluster 2021-03-10T20:43:48.754742+0000 mgr.gibba044.wflcwh (mgr.34466) 1912 : cluster [DBG] pgmap v1075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:50.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:50 gibba044 bash[25485]: cluster 2021-03-10T20:43:48.754742+0000 mgr.gibba044.wflcwh (mgr.34466) 1912 : cluster [DBG] pgmap v1075: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:52.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:52 gibba023 bash[30844]: cluster 2021-03-10T20:43:50.756501+0000 mgr.gibba044.wflcwh (mgr.34466) 1913 : cluster [DBG] pgmap v1076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:52.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:52 gibba023 bash[31815]: cluster 2021-03-10T20:43:50.756501+0000 mgr.gibba044.wflcwh (mgr.34466) 1913 : cluster [DBG] pgmap v1076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:52.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:52 gibba044 bash[25485]: cluster 2021-03-10T20:43:50.756501+0000 mgr.gibba044.wflcwh (mgr.34466) 1913 : cluster [DBG] pgmap v1076: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:54.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:54 gibba023 bash[30844]: cluster 2021-03-10T20:43:52.758103+0000 mgr.gibba044.wflcwh (mgr.34466) 1914 : cluster [DBG] pgmap v1077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:54.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:54 gibba023 bash[31815]: cluster 2021-03-10T20:43:52.758103+0000 mgr.gibba044.wflcwh (mgr.34466) 1914 : cluster [DBG] pgmap v1077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:54.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:54 gibba044 bash[25485]: cluster 2021-03-10T20:43:52.758103+0000 mgr.gibba044.wflcwh (mgr.34466) 1914 : cluster [DBG] pgmap v1077: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:56.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:56 gibba023 bash[30844]: cluster 2021-03-10T20:43:54.759323+0000 mgr.gibba044.wflcwh (mgr.34466) 1915 : cluster [DBG] pgmap v1078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:56.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:56 gibba023 bash[31815]: cluster 2021-03-10T20:43:54.759323+0000 mgr.gibba044.wflcwh (mgr.34466) 1915 : cluster [DBG] pgmap v1078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:56.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:56 gibba044 bash[25485]: cluster 2021-03-10T20:43:54.759323+0000 mgr.gibba044.wflcwh (mgr.34466) 1915 : cluster [DBG] pgmap v1078: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:58.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:43:58 gibba023 bash[30844]: cluster 2021-03-10T20:43:56.760991+0000 mgr.gibba044.wflcwh (mgr.34466) 1916 : cluster [DBG] pgmap v1079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:58.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:43:58 gibba023 bash[31815]: cluster 2021-03-10T20:43:56.760991+0000 mgr.gibba044.wflcwh (mgr.34466) 1916 : cluster [DBG] pgmap v1079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:43:58.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:43:58 gibba044 bash[25485]: cluster 2021-03-10T20:43:56.760991+0000 mgr.gibba044.wflcwh (mgr.34466) 1916 : cluster [DBG] pgmap v1079: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:00.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:00 gibba023 bash[30844]: cluster 2021-03-10T20:43:58.762756+0000 mgr.gibba044.wflcwh (mgr.34466) 1917 : cluster [DBG] pgmap v1080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:00.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:00 gibba023 bash[31815]: cluster 2021-03-10T20:43:58.762756+0000 mgr.gibba044.wflcwh (mgr.34466) 1917 : cluster [DBG] pgmap v1080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:00.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:00 gibba044 bash[25485]: cluster 2021-03-10T20:43:58.762756+0000 mgr.gibba044.wflcwh (mgr.34466) 1917 : cluster [DBG] pgmap v1080: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:02.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:02 gibba023 bash[30844]: cluster 2021-03-10T20:44:00.764328+0000 mgr.gibba044.wflcwh (mgr.34466) 1918 : cluster [DBG] pgmap v1081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:02.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:02 gibba023 bash[31815]: cluster 2021-03-10T20:44:00.764328+0000 mgr.gibba044.wflcwh (mgr.34466) 1918 : cluster [DBG] pgmap v1081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:02.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:02 gibba044 bash[25485]: cluster 2021-03-10T20:44:00.764328+0000 mgr.gibba044.wflcwh (mgr.34466) 1918 : cluster [DBG] pgmap v1081: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:03.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:03 gibba023 bash[30844]: cephadm 2021-03-10T20:44:01.469305+0000 mgr.gibba044.wflcwh (mgr.34466) 1919 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:44:03.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:03 gibba023 bash[31815]: cephadm 2021-03-10T20:44:01.469305+0000 mgr.gibba044.wflcwh (mgr.34466) 1919 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:44:03.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:03 gibba044 bash[25485]: cephadm 2021-03-10T20:44:01.469305+0000 mgr.gibba044.wflcwh (mgr.34466) 1919 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:44:04.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:04 gibba023 bash[30844]: cluster 2021-03-10T20:44:02.765972+0000 mgr.gibba044.wflcwh (mgr.34466) 1920 : cluster [DBG] pgmap v1082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:04.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:04 gibba023 bash[31815]: cluster 2021-03-10T20:44:02.765972+0000 mgr.gibba044.wflcwh (mgr.34466) 1920 : cluster [DBG] pgmap v1082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:04.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:04 gibba044 bash[25485]: cluster 2021-03-10T20:44:02.765972+0000 mgr.gibba044.wflcwh (mgr.34466) 1920 : cluster [DBG] pgmap v1082: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:05.311 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:44:05.537 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:44:05.538 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (35m) 49s ago 40m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:44:05.538 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (40m) 9m ago 40m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:44:05.539 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (35m) 9m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:44:05.539 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (35m) 9m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:44:05.539 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (34m) 49s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:44:05.540 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (34m) 49s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:44:05.540 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (34m) 9m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:44:05.540 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (34m) 49s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:44:05.541 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (40m) 49s ago 40m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:44:05.541 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (40m) 9m ago 40m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:44:05.541 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (33m) 49s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:44:05.542 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (33m) 49s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:44:05.542 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (32m) 49s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:44:05.543 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (32m) 49s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:44:05.544 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (31m) 9m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:44:05.544 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (31m) 9m ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:44:05.544 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (30m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:44:05.545 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (30m) 9m ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:44:05.545 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (40m) 9m ago 40m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:44:05.546 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 49s ago 38m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:44:05.546 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 9m ago 38m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:44:05.786 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:44:05.786 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:44:05.787 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:44:05.787 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:44:05.787 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:44:05.787 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:44:05.787 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:44:05.788 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:44:05.788 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:44:05.788 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:44:05.788 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:44:05.789 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:44:05.789 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:44:05.789 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:44:05.789 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:44:06.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:06 gibba023 bash[30844]: cluster 2021-03-10T20:44:04.767440+0000 mgr.gibba044.wflcwh (mgr.34466) 1921 : cluster [DBG] pgmap v1083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:06.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:06 gibba023 bash[30844]: audit 2021-03-10T20:44:05.786309+0000 mon.a (mon.0) 1072 : audit [DBG] from='client.? 172.21.2.123:0/3436296464' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:06.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:06 gibba023 bash[31815]: cluster 2021-03-10T20:44:04.767440+0000 mgr.gibba044.wflcwh (mgr.34466) 1921 : cluster [DBG] pgmap v1083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:06.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:06 gibba023 bash[31815]: audit 2021-03-10T20:44:05.786309+0000 mon.a (mon.0) 1072 : audit [DBG] from='client.? 172.21.2.123:0/3436296464' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:06.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:06 gibba044 bash[25485]: cluster 2021-03-10T20:44:04.767440+0000 mgr.gibba044.wflcwh (mgr.34466) 1921 : cluster [DBG] pgmap v1083: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:06.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:06 gibba044 bash[25485]: audit 2021-03-10T20:44:05.786309+0000 mon.a (mon.0) 1072 : audit [DBG] from='client.? 172.21.2.123:0/3436296464' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:07.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:07 gibba023 bash[30844]: audit 2021-03-10T20:44:05.302630+0000 mgr.gibba044.wflcwh (mgr.34466) 1922 : audit [DBG] from='client.55333 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:44:07.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:07 gibba023 bash[30844]: audit 2021-03-10T20:44:05.525443+0000 mgr.gibba044.wflcwh (mgr.34466) 1923 : audit [DBG] from='client.45360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:44:07.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:07 gibba023 bash[31815]: audit 2021-03-10T20:44:05.302630+0000 mgr.gibba044.wflcwh (mgr.34466) 1922 : audit [DBG] from='client.55333 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:44:07.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:07 gibba023 bash[31815]: audit 2021-03-10T20:44:05.525443+0000 mgr.gibba044.wflcwh (mgr.34466) 1923 : audit [DBG] from='client.45360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:44:07.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:07 gibba044 bash[25485]: audit 2021-03-10T20:44:05.302630+0000 mgr.gibba044.wflcwh (mgr.34466) 1922 : audit [DBG] from='client.55333 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:44:07.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:07 gibba044 bash[25485]: audit 2021-03-10T20:44:05.525443+0000 mgr.gibba044.wflcwh (mgr.34466) 1923 : audit [DBG] from='client.45360 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:44:08.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:08 gibba023 bash[30844]: cluster 2021-03-10T20:44:06.769241+0000 mgr.gibba044.wflcwh (mgr.34466) 1924 : cluster [DBG] pgmap v1084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:08.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:08 gibba023 bash[31815]: cluster 2021-03-10T20:44:06.769241+0000 mgr.gibba044.wflcwh (mgr.34466) 1924 : cluster [DBG] pgmap v1084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:08.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:08 gibba044 bash[25485]: cluster 2021-03-10T20:44:06.769241+0000 mgr.gibba044.wflcwh (mgr.34466) 1924 : cluster [DBG] pgmap v1084: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:09.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:09 gibba044 bash[25485]: cluster 2021-03-10T20:44:08.771028+0000 mgr.gibba044.wflcwh (mgr.34466) 1925 : cluster [DBG] pgmap v1085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:09.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:09 gibba023 bash[30844]: cluster 2021-03-10T20:44:08.771028+0000 mgr.gibba044.wflcwh (mgr.34466) 1925 : cluster [DBG] pgmap v1085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:09.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:09 gibba023 bash[31815]: cluster 2021-03-10T20:44:08.771028+0000 mgr.gibba044.wflcwh (mgr.34466) 1925 : cluster [DBG] pgmap v1085: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:12.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:11 gibba023 bash[30844]: cluster 2021-03-10T20:44:10.772857+0000 mgr.gibba044.wflcwh (mgr.34466) 1926 : cluster [DBG] pgmap v1086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:12.175 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:11 gibba023 bash[31815]: cluster 2021-03-10T20:44:10.772857+0000 mgr.gibba044.wflcwh (mgr.34466) 1926 : cluster [DBG] pgmap v1086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:12.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:11 gibba044 bash[25485]: cluster 2021-03-10T20:44:10.772857+0000 mgr.gibba044.wflcwh (mgr.34466) 1926 : cluster [DBG] pgmap v1086: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:14.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:13 gibba044 bash[25485]: cluster 2021-03-10T20:44:12.774553+0000 mgr.gibba044.wflcwh (mgr.34466) 1927 : cluster [DBG] pgmap v1087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:14.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:13 gibba023 bash[30844]: cluster 2021-03-10T20:44:12.774553+0000 mgr.gibba044.wflcwh (mgr.34466) 1927 : cluster [DBG] pgmap v1087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:14.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:13 gibba023 bash[31815]: cluster 2021-03-10T20:44:12.774553+0000 mgr.gibba044.wflcwh (mgr.34466) 1927 : cluster [DBG] pgmap v1087: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:16.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:16 gibba023 bash[30844]: cluster 2021-03-10T20:44:14.775788+0000 mgr.gibba044.wflcwh (mgr.34466) 1928 : cluster [DBG] pgmap v1088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:16.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:16 gibba023 bash[31815]: cluster 2021-03-10T20:44:14.775788+0000 mgr.gibba044.wflcwh (mgr.34466) 1928 : cluster [DBG] pgmap v1088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:16.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:16 gibba044 bash[25485]: cluster 2021-03-10T20:44:14.775788+0000 mgr.gibba044.wflcwh (mgr.34466) 1928 : cluster [DBG] pgmap v1088: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:17.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:17 gibba023 bash[30844]: audit 2021-03-10T20:44:16.486720+0000 mon.a (mon.0) 1073 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:44:17.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:17 gibba023 bash[31815]: audit 2021-03-10T20:44:16.486720+0000 mon.a (mon.0) 1073 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:44:17.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:17 gibba044 bash[25485]: audit 2021-03-10T20:44:16.486720+0000 mon.a (mon.0) 1073 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:44:18.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:18 gibba023 bash[30844]: cephadm 2021-03-10T20:44:16.485366+0000 mgr.gibba044.wflcwh (mgr.34466) 1929 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:44:18.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:18 gibba023 bash[30844]: cluster 2021-03-10T20:44:16.777440+0000 mgr.gibba044.wflcwh (mgr.34466) 1930 : cluster [DBG] pgmap v1089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:18.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:18 gibba023 bash[31815]: cephadm 2021-03-10T20:44:16.485366+0000 mgr.gibba044.wflcwh (mgr.34466) 1929 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:44:18.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:18 gibba023 bash[31815]: cluster 2021-03-10T20:44:16.777440+0000 mgr.gibba044.wflcwh (mgr.34466) 1930 : cluster [DBG] pgmap v1089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:18.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:18 gibba044 bash[25485]: cephadm 2021-03-10T20:44:16.485366+0000 mgr.gibba044.wflcwh (mgr.34466) 1929 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:44:18.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:18 gibba044 bash[25485]: cluster 2021-03-10T20:44:16.777440+0000 mgr.gibba044.wflcwh (mgr.34466) 1930 : cluster [DBG] pgmap v1089: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:20.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:20 gibba023 bash[30844]: cluster 2021-03-10T20:44:18.778914+0000 mgr.gibba044.wflcwh (mgr.34466) 1931 : cluster [DBG] pgmap v1090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:20.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:20 gibba023 bash[31815]: cluster 2021-03-10T20:44:18.778914+0000 mgr.gibba044.wflcwh (mgr.34466) 1931 : cluster [DBG] pgmap v1090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:20.449 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:20 gibba044 bash[25485]: cluster 2021-03-10T20:44:18.778914+0000 mgr.gibba044.wflcwh (mgr.34466) 1931 : cluster [DBG] pgmap v1090: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:21.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:21 gibba044 bash[25485]: audit 2021-03-10T20:44:20.241942+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:44:21.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:21 gibba044 bash[25485]: cephadm 2021-03-10T20:44:20.243362+0000 mgr.gibba044.wflcwh (mgr.34466) 1932 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:44:21.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:21 gibba044 bash[25485]: audit 2021-03-10T20:44:20.438128+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:44:21.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:21 gibba044 bash[25485]: audit 2021-03-10T20:44:20.441711+0000 mon.a (mon.0) 1076 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:44:21.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:21 gibba044 bash[25485]: cephadm 2021-03-10T20:44:20.441764+0000 mgr.gibba044.wflcwh (mgr.34466) 1933 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:44:21.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:21 gibba044 bash[25485]: audit 2021-03-10T20:44:20.443235+0000 mon.a (mon.0) 1077 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:21.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:21 gibba044 bash[25485]: cephadm 2021-03-10T20:44:20.443476+0000 mgr.gibba044.wflcwh (mgr.34466) 1934 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:44:21.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:21 gibba044 bash[25485]: audit 2021-03-10T20:44:20.444460+0000 mon.a (mon.0) 1078 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:21.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:21 gibba044 bash[25485]: cephadm 2021-03-10T20:44:20.444754+0000 mgr.gibba044.wflcwh (mgr.34466) 1935 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:44:21.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:21 gibba044 bash[25485]: cephadm 2021-03-10T20:44:20.444792+0000 mgr.gibba044.wflcwh (mgr.34466) 1936 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:44:21.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:21 gibba044 bash[25485]: audit 2021-03-10T20:44:20.445211+0000 mon.a (mon.0) 1079 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:21.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:21 gibba044 bash[25485]: cephadm 2021-03-10T20:44:20.445683+0000 mgr.gibba044.wflcwh (mgr.34466) 1937 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:44:21.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:21 gibba044 bash[25485]: cephadm 2021-03-10T20:44:20.445718+0000 mgr.gibba044.wflcwh (mgr.34466) 1938 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:44:21.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:21 gibba044 bash[25485]: cephadm 2021-03-10T20:44:20.446624+0000 mgr.gibba044.wflcwh (mgr.34466) 1939 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:44:21.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:21 gibba044 bash[25485]: audit 2021-03-10T20:44:20.447351+0000 mon.a (mon.0) 1080 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:21.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:21 gibba044 bash[25485]: cephadm 2021-03-10T20:44:20.447540+0000 mgr.gibba044.wflcwh (mgr.34466) 1940 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:44:21.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:21 gibba044 bash[25485]: cephadm 2021-03-10T20:44:20.447586+0000 mgr.gibba044.wflcwh (mgr.34466) 1941 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:44:21.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:21 gibba044 bash[25485]: audit 2021-03-10T20:44:20.448782+0000 mon.a (mon.0) 1081 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:21.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:21 gibba044 bash[25485]: cephadm 2021-03-10T20:44:20.448886+0000 mgr.gibba044.wflcwh (mgr.34466) 1942 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:44:21.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:21 gibba044 bash[25485]: cephadm 2021-03-10T20:44:20.449205+0000 mgr.gibba044.wflcwh (mgr.34466) 1943 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:44:21.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:21 gibba044 bash[25485]: cephadm 2021-03-10T20:44:20.450280+0000 mgr.gibba044.wflcwh (mgr.34466) 1944 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:44:21.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:21 gibba044 bash[25485]: cephadm 2021-03-10T20:44:20.450343+0000 mgr.gibba044.wflcwh (mgr.34466) 1945 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:44:21.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:21 gibba044 bash[25485]: cephadm 2021-03-10T20:44:20.450470+0000 mgr.gibba044.wflcwh (mgr.34466) 1946 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:44:21.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:21 gibba044 bash[25485]: cluster 2021-03-10T20:44:20.780370+0000 mgr.gibba044.wflcwh (mgr.34466) 1947 : cluster [DBG] pgmap v1091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:21.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[30844]: audit 2021-03-10T20:44:20.241942+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:44:21.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[30844]: cephadm 2021-03-10T20:44:20.243362+0000 mgr.gibba044.wflcwh (mgr.34466) 1932 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:44:21.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[30844]: audit 2021-03-10T20:44:20.438128+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:44:21.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[30844]: audit 2021-03-10T20:44:20.441711+0000 mon.a (mon.0) 1076 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:44:21.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[30844]: cephadm 2021-03-10T20:44:20.441764+0000 mgr.gibba044.wflcwh (mgr.34466) 1933 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:44:21.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[30844]: audit 2021-03-10T20:44:20.443235+0000 mon.a (mon.0) 1077 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:21.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[30844]: cephadm 2021-03-10T20:44:20.443476+0000 mgr.gibba044.wflcwh (mgr.34466) 1934 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:44:21.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[30844]: audit 2021-03-10T20:44:20.444460+0000 mon.a (mon.0) 1078 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:21.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[30844]: cephadm 2021-03-10T20:44:20.444754+0000 mgr.gibba044.wflcwh (mgr.34466) 1935 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:44:21.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[30844]: cephadm 2021-03-10T20:44:20.444792+0000 mgr.gibba044.wflcwh (mgr.34466) 1936 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:44:21.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[30844]: audit 2021-03-10T20:44:20.445211+0000 mon.a (mon.0) 1079 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:21.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[30844]: cephadm 2021-03-10T20:44:20.445683+0000 mgr.gibba044.wflcwh (mgr.34466) 1937 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:44:21.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[30844]: cephadm 2021-03-10T20:44:20.445718+0000 mgr.gibba044.wflcwh (mgr.34466) 1938 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:44:21.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[30844]: cephadm 2021-03-10T20:44:20.446624+0000 mgr.gibba044.wflcwh (mgr.34466) 1939 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:44:21.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[30844]: audit 2021-03-10T20:44:20.447351+0000 mon.a (mon.0) 1080 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:21.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[30844]: cephadm 2021-03-10T20:44:20.447540+0000 mgr.gibba044.wflcwh (mgr.34466) 1940 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:44:21.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[30844]: cephadm 2021-03-10T20:44:20.447586+0000 mgr.gibba044.wflcwh (mgr.34466) 1941 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:44:21.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[30844]: audit 2021-03-10T20:44:20.448782+0000 mon.a (mon.0) 1081 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:21.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[30844]: cephadm 2021-03-10T20:44:20.448886+0000 mgr.gibba044.wflcwh (mgr.34466) 1942 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:44:21.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[30844]: cephadm 2021-03-10T20:44:20.449205+0000 mgr.gibba044.wflcwh (mgr.34466) 1943 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:44:21.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[30844]: cephadm 2021-03-10T20:44:20.450280+0000 mgr.gibba044.wflcwh (mgr.34466) 1944 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:44:21.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[31815]: audit 2021-03-10T20:44:20.241942+0000 mon.a (mon.0) 1074 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:44:21.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[31815]: cephadm 2021-03-10T20:44:20.243362+0000 mgr.gibba044.wflcwh (mgr.34466) 1932 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:44:21.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[31815]: audit 2021-03-10T20:44:20.438128+0000 mon.a (mon.0) 1075 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:44:21.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[31815]: audit 2021-03-10T20:44:20.441711+0000 mon.a (mon.0) 1076 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:44:21.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[31815]: cephadm 2021-03-10T20:44:20.441764+0000 mgr.gibba044.wflcwh (mgr.34466) 1933 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:44:21.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[31815]: audit 2021-03-10T20:44:20.443235+0000 mon.a (mon.0) 1077 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:21.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[31815]: cephadm 2021-03-10T20:44:20.443476+0000 mgr.gibba044.wflcwh (mgr.34466) 1934 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:44:21.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[31815]: audit 2021-03-10T20:44:20.444460+0000 mon.a (mon.0) 1078 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:21.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[31815]: cephadm 2021-03-10T20:44:20.444754+0000 mgr.gibba044.wflcwh (mgr.34466) 1935 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:44:21.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[31815]: cephadm 2021-03-10T20:44:20.444792+0000 mgr.gibba044.wflcwh (mgr.34466) 1936 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:44:21.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[31815]: audit 2021-03-10T20:44:20.445211+0000 mon.a (mon.0) 1079 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:21.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[31815]: cephadm 2021-03-10T20:44:20.445683+0000 mgr.gibba044.wflcwh (mgr.34466) 1937 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:44:21.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[31815]: cephadm 2021-03-10T20:44:20.445718+0000 mgr.gibba044.wflcwh (mgr.34466) 1938 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:44:21.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[31815]: cephadm 2021-03-10T20:44:20.446624+0000 mgr.gibba044.wflcwh (mgr.34466) 1939 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:44:21.686 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[31815]: audit 2021-03-10T20:44:20.447351+0000 mon.a (mon.0) 1080 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:21.686 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[31815]: cephadm 2021-03-10T20:44:20.447540+0000 mgr.gibba044.wflcwh (mgr.34466) 1940 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:44:21.686 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[31815]: cephadm 2021-03-10T20:44:20.447586+0000 mgr.gibba044.wflcwh (mgr.34466) 1941 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:44:21.687 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[31815]: audit 2021-03-10T20:44:20.448782+0000 mon.a (mon.0) 1081 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:21.687 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[31815]: cephadm 2021-03-10T20:44:20.448886+0000 mgr.gibba044.wflcwh (mgr.34466) 1942 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:44:21.687 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[31815]: cephadm 2021-03-10T20:44:20.449205+0000 mgr.gibba044.wflcwh (mgr.34466) 1943 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:44:21.688 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[31815]: cephadm 2021-03-10T20:44:20.450280+0000 mgr.gibba044.wflcwh (mgr.34466) 1944 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:44:21.688 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[30844]: cephadm 2021-03-10T20:44:20.450343+0000 mgr.gibba044.wflcwh (mgr.34466) 1945 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:44:21.689 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[30844]: cephadm 2021-03-10T20:44:20.450470+0000 mgr.gibba044.wflcwh (mgr.34466) 1946 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:44:21.689 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[30844]: cluster 2021-03-10T20:44:20.780370+0000 mgr.gibba044.wflcwh (mgr.34466) 1947 : cluster [DBG] pgmap v1091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:21.690 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[31815]: cephadm 2021-03-10T20:44:20.450343+0000 mgr.gibba044.wflcwh (mgr.34466) 1945 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:44:21.690 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[31815]: cephadm 2021-03-10T20:44:20.450470+0000 mgr.gibba044.wflcwh (mgr.34466) 1946 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:44:21.691 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:21 gibba023 bash[31815]: cluster 2021-03-10T20:44:20.780370+0000 mgr.gibba044.wflcwh (mgr.34466) 1947 : cluster [DBG] pgmap v1091: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:24.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:24 gibba023 bash[30844]: cluster 2021-03-10T20:44:22.781801+0000 mgr.gibba044.wflcwh (mgr.34466) 1948 : cluster [DBG] pgmap v1092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:24.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:24 gibba023 bash[31815]: cluster 2021-03-10T20:44:22.781801+0000 mgr.gibba044.wflcwh (mgr.34466) 1948 : cluster [DBG] pgmap v1092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:24.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:24 gibba044 bash[25485]: cluster 2021-03-10T20:44:22.781801+0000 mgr.gibba044.wflcwh (mgr.34466) 1948 : cluster [DBG] pgmap v1092: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:26.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:26 gibba023 bash[30844]: cluster 2021-03-10T20:44:24.782968+0000 mgr.gibba044.wflcwh (mgr.34466) 1949 : cluster [DBG] pgmap v1093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:26.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:26 gibba023 bash[31815]: cluster 2021-03-10T20:44:24.782968+0000 mgr.gibba044.wflcwh (mgr.34466) 1949 : cluster [DBG] pgmap v1093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:26.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:26 gibba044 bash[25485]: cluster 2021-03-10T20:44:24.782968+0000 mgr.gibba044.wflcwh (mgr.34466) 1949 : cluster [DBG] pgmap v1093: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:28.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:28 gibba023 bash[30844]: cluster 2021-03-10T20:44:26.784361+0000 mgr.gibba044.wflcwh (mgr.34466) 1950 : cluster [DBG] pgmap v1094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:28.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:28 gibba023 bash[30844]: audit 2021-03-10T20:44:27.240603+0000 mon.a (mon.0) 1082 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:44:28.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:28 gibba023 bash[30844]: audit 2021-03-10T20:44:27.241219+0000 mon.a (mon.0) 1083 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:44:28.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:28 gibba023 bash[30844]: audit 2021-03-10T20:44:27.241845+0000 mon.a (mon.0) 1084 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:44:28.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:28 gibba023 bash[30844]: audit 2021-03-10T20:44:27.242578+0000 mon.a (mon.0) 1085 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:44:28.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:28 gibba023 bash[30844]: audit 2021-03-10T20:44:27.243257+0000 mon.a (mon.0) 1086 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:44:28.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:28 gibba023 bash[30844]: audit 2021-03-10T20:44:27.243909+0000 mon.a (mon.0) 1087 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T20:44:28.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:28 gibba023 bash[31815]: cluster 2021-03-10T20:44:26.784361+0000 mgr.gibba044.wflcwh (mgr.34466) 1950 : cluster [DBG] pgmap v1094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:28 gibba023 bash[31815]: audit 2021-03-10T20:44:27.240603+0000 mon.a (mon.0) 1082 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:44:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:28 gibba023 bash[31815]: audit 2021-03-10T20:44:27.241219+0000 mon.a (mon.0) 1083 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:44:28.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:28 gibba023 bash[31815]: audit 2021-03-10T20:44:27.241845+0000 mon.a (mon.0) 1084 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:44:28.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:28 gibba023 bash[31815]: audit 2021-03-10T20:44:27.242578+0000 mon.a (mon.0) 1085 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:44:28.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:28 gibba023 bash[31815]: audit 2021-03-10T20:44:27.243257+0000 mon.a (mon.0) 1086 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:44:28.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:28 gibba023 bash[31815]: audit 2021-03-10T20:44:27.243909+0000 mon.a (mon.0) 1087 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T20:44:28.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:28 gibba044 bash[25485]: cluster 2021-03-10T20:44:26.784361+0000 mgr.gibba044.wflcwh (mgr.34466) 1950 : cluster [DBG] pgmap v1094: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:28.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:28 gibba044 bash[25485]: audit 2021-03-10T20:44:27.240603+0000 mon.a (mon.0) 1082 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:44:28.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:28 gibba044 bash[25485]: audit 2021-03-10T20:44:27.241219+0000 mon.a (mon.0) 1083 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:44:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:28 gibba044 bash[25485]: audit 2021-03-10T20:44:27.241845+0000 mon.a (mon.0) 1084 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:44:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:28 gibba044 bash[25485]: audit 2021-03-10T20:44:27.242578+0000 mon.a (mon.0) 1085 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:44:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:28 gibba044 bash[25485]: audit 2021-03-10T20:44:27.243257+0000 mon.a (mon.0) 1086 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:44:28.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:28 gibba044 bash[25485]: audit 2021-03-10T20:44:27.243909+0000 mon.a (mon.0) 1087 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T20:44:30.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:30 gibba023 bash[30844]: cluster 2021-03-10T20:44:28.785902+0000 mgr.gibba044.wflcwh (mgr.34466) 1951 : cluster [DBG] pgmap v1095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:30.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:30 gibba023 bash[31815]: cluster 2021-03-10T20:44:28.785902+0000 mgr.gibba044.wflcwh (mgr.34466) 1951 : cluster [DBG] pgmap v1095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:30.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:30 gibba044 bash[25485]: cluster 2021-03-10T20:44:28.785902+0000 mgr.gibba044.wflcwh (mgr.34466) 1951 : cluster [DBG] pgmap v1095: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:32.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:32 gibba023 bash[30844]: cluster 2021-03-10T20:44:30.787497+0000 mgr.gibba044.wflcwh (mgr.34466) 1952 : cluster [DBG] pgmap v1096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:32.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:32 gibba023 bash[31815]: cluster 2021-03-10T20:44:30.787497+0000 mgr.gibba044.wflcwh (mgr.34466) 1952 : cluster [DBG] pgmap v1096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:32.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:32 gibba044 bash[25485]: cluster 2021-03-10T20:44:30.787497+0000 mgr.gibba044.wflcwh (mgr.34466) 1952 : cluster [DBG] pgmap v1096: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:34.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:34 gibba023 bash[30844]: cluster 2021-03-10T20:44:32.789238+0000 mgr.gibba044.wflcwh (mgr.34466) 1953 : cluster [DBG] pgmap v1097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:34.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:34 gibba023 bash[31815]: cluster 2021-03-10T20:44:32.789238+0000 mgr.gibba044.wflcwh (mgr.34466) 1953 : cluster [DBG] pgmap v1097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:34.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:34 gibba044 bash[25485]: cluster 2021-03-10T20:44:32.789238+0000 mgr.gibba044.wflcwh (mgr.34466) 1953 : cluster [DBG] pgmap v1097: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:36.026 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:44:36.255 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:44:36.255 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (35m) 80s ago 41m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:44:36.256 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (41m) 16s ago 41m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:44:36.256 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (36m) 16s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:44:36.256 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (36m) 16s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:44:36.256 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (35m) 80s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:44:36.256 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (35m) 80s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:44:36.257 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (34m) 16s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:44:36.257 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (34m) 80s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:44:36.257 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (41m) 80s ago 41m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:44:36.257 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (41m) 16s ago 41m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:44:36.258 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (33m) 80s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:44:36.258 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (33m) 80s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:44:36.258 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (33m) 80s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:44:36.258 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (32m) 80s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:44:36.258 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (32m) 16s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:44:36.259 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (31m) 16s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:44:36.259 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (31m) 16s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:44:36.259 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (30m) 16s ago 41m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:44:36.259 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (40m) 16s ago 41m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:44:36.259 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 80s ago 39m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:44:36.260 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 16s ago 39m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:44:36.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:36 gibba023 bash[30844]: cluster 2021-03-10T20:44:34.790459+0000 mgr.gibba044.wflcwh (mgr.34466) 1954 : cluster [DBG] pgmap v1098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:36.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:36 gibba023 bash[31815]: cluster 2021-03-10T20:44:34.790459+0000 mgr.gibba044.wflcwh (mgr.34466) 1954 : cluster [DBG] pgmap v1098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:36.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:36 gibba044 bash[25485]: cluster 2021-03-10T20:44:34.790459+0000 mgr.gibba044.wflcwh (mgr.34466) 1954 : cluster [DBG] pgmap v1098: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:36.505 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:44:36.505 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:44:36.506 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:44:36.506 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:44:36.507 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:44:36.507 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:44:36.508 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:44:36.508 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:44:36.509 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:44:36.510 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:44:36.510 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:44:36.510 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:44:36.511 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:44:36.511 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:44:36.511 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:44:37.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:37 gibba023 bash[30844]: cephadm 2021-03-10T20:44:35.459013+0000 mgr.gibba044.wflcwh (mgr.34466) 1955 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:44:37.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:37 gibba023 bash[30844]: audit 2021-03-10T20:44:36.018723+0000 mgr.gibba044.wflcwh (mgr.34466) 1956 : audit [DBG] from='client.45372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:44:37.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:37 gibba023 bash[30844]: audit 2021-03-10T20:44:36.505041+0000 mon.c (mon.1) 48 : audit [DBG] from='client.? 172.21.2.123:0/1384628531' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:37.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:37 gibba023 bash[31815]: cephadm 2021-03-10T20:44:35.459013+0000 mgr.gibba044.wflcwh (mgr.34466) 1955 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:44:37.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:37 gibba023 bash[31815]: audit 2021-03-10T20:44:36.018723+0000 mgr.gibba044.wflcwh (mgr.34466) 1956 : audit [DBG] from='client.45372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:44:37.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:37 gibba023 bash[31815]: audit 2021-03-10T20:44:36.505041+0000 mon.c (mon.1) 48 : audit [DBG] from='client.? 172.21.2.123:0/1384628531' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:37.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:37 gibba044 bash[25485]: cephadm 2021-03-10T20:44:35.459013+0000 mgr.gibba044.wflcwh (mgr.34466) 1955 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:44:37.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:37 gibba044 bash[25485]: audit 2021-03-10T20:44:36.018723+0000 mgr.gibba044.wflcwh (mgr.34466) 1956 : audit [DBG] from='client.45372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:44:37.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:37 gibba044 bash[25485]: audit 2021-03-10T20:44:36.505041+0000 mon.c (mon.1) 48 : audit [DBG] from='client.? 172.21.2.123:0/1384628531' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:44:38.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:38 gibba023 bash[30844]: audit 2021-03-10T20:44:36.243536+0000 mgr.gibba044.wflcwh (mgr.34466) 1957 : audit [DBG] from='client.55357 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:44:38.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:38 gibba023 bash[30844]: cluster 2021-03-10T20:44:36.792124+0000 mgr.gibba044.wflcwh (mgr.34466) 1958 : cluster [DBG] pgmap v1099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:38.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:38 gibba023 bash[31815]: audit 2021-03-10T20:44:36.243536+0000 mgr.gibba044.wflcwh (mgr.34466) 1957 : audit [DBG] from='client.55357 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:44:38.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:38 gibba023 bash[31815]: cluster 2021-03-10T20:44:36.792124+0000 mgr.gibba044.wflcwh (mgr.34466) 1958 : cluster [DBG] pgmap v1099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:38.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:38 gibba044 bash[25485]: audit 2021-03-10T20:44:36.243536+0000 mgr.gibba044.wflcwh (mgr.34466) 1957 : audit [DBG] from='client.55357 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:44:38.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:38 gibba044 bash[25485]: cluster 2021-03-10T20:44:36.792124+0000 mgr.gibba044.wflcwh (mgr.34466) 1958 : cluster [DBG] pgmap v1099: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:40.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:40 gibba023 bash[30844]: cluster 2021-03-10T20:44:38.793937+0000 mgr.gibba044.wflcwh (mgr.34466) 1959 : cluster [DBG] pgmap v1100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:40.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:40 gibba023 bash[31815]: cluster 2021-03-10T20:44:38.793937+0000 mgr.gibba044.wflcwh (mgr.34466) 1959 : cluster [DBG] pgmap v1100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:40.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:40 gibba044 bash[25485]: cluster 2021-03-10T20:44:38.793937+0000 mgr.gibba044.wflcwh (mgr.34466) 1959 : cluster [DBG] pgmap v1100: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:42.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:42 gibba023 bash[30844]: cluster 2021-03-10T20:44:40.795720+0000 mgr.gibba044.wflcwh (mgr.34466) 1960 : cluster [DBG] pgmap v1101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:42.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:42 gibba023 bash[31815]: cluster 2021-03-10T20:44:40.795720+0000 mgr.gibba044.wflcwh (mgr.34466) 1960 : cluster [DBG] pgmap v1101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:42.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:42 gibba044 bash[25485]: cluster 2021-03-10T20:44:40.795720+0000 mgr.gibba044.wflcwh (mgr.34466) 1960 : cluster [DBG] pgmap v1101: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:44.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:44 gibba023 bash[30844]: cluster 2021-03-10T20:44:42.797089+0000 mgr.gibba044.wflcwh (mgr.34466) 1961 : cluster [DBG] pgmap v1102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:44.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:44 gibba023 bash[31815]: cluster 2021-03-10T20:44:42.797089+0000 mgr.gibba044.wflcwh (mgr.34466) 1961 : cluster [DBG] pgmap v1102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:44.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:44 gibba044 bash[25485]: cluster 2021-03-10T20:44:42.797089+0000 mgr.gibba044.wflcwh (mgr.34466) 1961 : cluster [DBG] pgmap v1102: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:46.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:46 gibba023 bash[30844]: cluster 2021-03-10T20:44:44.798294+0000 mgr.gibba044.wflcwh (mgr.34466) 1962 : cluster [DBG] pgmap v1103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:46.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:46 gibba023 bash[31815]: cluster 2021-03-10T20:44:44.798294+0000 mgr.gibba044.wflcwh (mgr.34466) 1962 : cluster [DBG] pgmap v1103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:46.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:46 gibba044 bash[25485]: cluster 2021-03-10T20:44:44.798294+0000 mgr.gibba044.wflcwh (mgr.34466) 1962 : cluster [DBG] pgmap v1103: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:48.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:48 gibba023 bash[30844]: cluster 2021-03-10T20:44:46.799989+0000 mgr.gibba044.wflcwh (mgr.34466) 1963 : cluster [DBG] pgmap v1104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:48.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:48 gibba023 bash[31815]: cluster 2021-03-10T20:44:46.799989+0000 mgr.gibba044.wflcwh (mgr.34466) 1963 : cluster [DBG] pgmap v1104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:48.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:48 gibba044 bash[25485]: cluster 2021-03-10T20:44:46.799989+0000 mgr.gibba044.wflcwh (mgr.34466) 1963 : cluster [DBG] pgmap v1104: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:50.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:50 gibba023 bash[30844]: cluster 2021-03-10T20:44:48.801794+0000 mgr.gibba044.wflcwh (mgr.34466) 1964 : cluster [DBG] pgmap v1105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:50.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:50 gibba023 bash[31815]: cluster 2021-03-10T20:44:48.801794+0000 mgr.gibba044.wflcwh (mgr.34466) 1964 : cluster [DBG] pgmap v1105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:50.472 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:50 gibba044 bash[25485]: cluster 2021-03-10T20:44:48.801794+0000 mgr.gibba044.wflcwh (mgr.34466) 1964 : cluster [DBG] pgmap v1105: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:52.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:52 gibba023 bash[30844]: cephadm 2021-03-10T20:44:50.472333+0000 mgr.gibba044.wflcwh (mgr.34466) 1965 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:44:52.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:52 gibba023 bash[30844]: cluster 2021-03-10T20:44:50.803312+0000 mgr.gibba044.wflcwh (mgr.34466) 1966 : cluster [DBG] pgmap v1106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:52.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:52 gibba023 bash[31815]: cephadm 2021-03-10T20:44:50.472333+0000 mgr.gibba044.wflcwh (mgr.34466) 1965 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:44:52.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:52 gibba023 bash[31815]: cluster 2021-03-10T20:44:50.803312+0000 mgr.gibba044.wflcwh (mgr.34466) 1966 : cluster [DBG] pgmap v1106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:52.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:52 gibba044 bash[25485]: cephadm 2021-03-10T20:44:50.472333+0000 mgr.gibba044.wflcwh (mgr.34466) 1965 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:44:52.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:52 gibba044 bash[25485]: cluster 2021-03-10T20:44:50.803312+0000 mgr.gibba044.wflcwh (mgr.34466) 1966 : cluster [DBG] pgmap v1106: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:54.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:54 gibba023 bash[30844]: cluster 2021-03-10T20:44:52.805028+0000 mgr.gibba044.wflcwh (mgr.34466) 1967 : cluster [DBG] pgmap v1107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:54.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:54 gibba023 bash[31815]: cluster 2021-03-10T20:44:52.805028+0000 mgr.gibba044.wflcwh (mgr.34466) 1967 : cluster [DBG] pgmap v1107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:54.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:54 gibba044 bash[25485]: cluster 2021-03-10T20:44:52.805028+0000 mgr.gibba044.wflcwh (mgr.34466) 1967 : cluster [DBG] pgmap v1107: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:56.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:56 gibba023 bash[30844]: cluster 2021-03-10T20:44:54.806355+0000 mgr.gibba044.wflcwh (mgr.34466) 1968 : cluster [DBG] pgmap v1108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:56.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:56 gibba023 bash[31815]: cluster 2021-03-10T20:44:54.806355+0000 mgr.gibba044.wflcwh (mgr.34466) 1968 : cluster [DBG] pgmap v1108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:56.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:56 gibba044 bash[25485]: cluster 2021-03-10T20:44:54.806355+0000 mgr.gibba044.wflcwh (mgr.34466) 1968 : cluster [DBG] pgmap v1108: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:58.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:44:58 gibba023 bash[30844]: cluster 2021-03-10T20:44:56.808081+0000 mgr.gibba044.wflcwh (mgr.34466) 1969 : cluster [DBG] pgmap v1109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:58.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:44:58 gibba023 bash[31815]: cluster 2021-03-10T20:44:56.808081+0000 mgr.gibba044.wflcwh (mgr.34466) 1969 : cluster [DBG] pgmap v1109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:44:58.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:44:58 gibba044 bash[25485]: cluster 2021-03-10T20:44:56.808081+0000 mgr.gibba044.wflcwh (mgr.34466) 1969 : cluster [DBG] pgmap v1109: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:00.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:00 gibba023 bash[30844]: cluster 2021-03-10T20:44:58.809760+0000 mgr.gibba044.wflcwh (mgr.34466) 1970 : cluster [DBG] pgmap v1110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:00.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:00 gibba023 bash[31815]: cluster 2021-03-10T20:44:58.809760+0000 mgr.gibba044.wflcwh (mgr.34466) 1970 : cluster [DBG] pgmap v1110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:00.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:00 gibba044 bash[25485]: cluster 2021-03-10T20:44:58.809760+0000 mgr.gibba044.wflcwh (mgr.34466) 1970 : cluster [DBG] pgmap v1110: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:02.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:02 gibba023 bash[30844]: cluster 2021-03-10T20:45:00.811392+0000 mgr.gibba044.wflcwh (mgr.34466) 1971 : cluster [DBG] pgmap v1111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:02.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:02 gibba023 bash[31815]: cluster 2021-03-10T20:45:00.811392+0000 mgr.gibba044.wflcwh (mgr.34466) 1971 : cluster [DBG] pgmap v1111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:02.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:02 gibba044 bash[25485]: cluster 2021-03-10T20:45:00.811392+0000 mgr.gibba044.wflcwh (mgr.34466) 1971 : cluster [DBG] pgmap v1111: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:04.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:04 gibba023 bash[30844]: cluster 2021-03-10T20:45:02.812818+0000 mgr.gibba044.wflcwh (mgr.34466) 1972 : cluster [DBG] pgmap v1112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:04.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:04 gibba023 bash[31815]: cluster 2021-03-10T20:45:02.812818+0000 mgr.gibba044.wflcwh (mgr.34466) 1972 : cluster [DBG] pgmap v1112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:04.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:04 gibba044 bash[25485]: cluster 2021-03-10T20:45:02.812818+0000 mgr.gibba044.wflcwh (mgr.34466) 1972 : cluster [DBG] pgmap v1112: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:06.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:06 gibba023 bash[30844]: cluster 2021-03-10T20:45:04.813993+0000 mgr.gibba044.wflcwh (mgr.34466) 1973 : cluster [DBG] pgmap v1113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:06.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:06 gibba023 bash[31815]: cluster 2021-03-10T20:45:04.813993+0000 mgr.gibba044.wflcwh (mgr.34466) 1973 : cluster [DBG] pgmap v1113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:06.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:06 gibba044 bash[25485]: cluster 2021-03-10T20:45:04.813993+0000 mgr.gibba044.wflcwh (mgr.34466) 1973 : cluster [DBG] pgmap v1113: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:06.748 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:45:06.973 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:45:06.974 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (36m) 110s ago 41m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:45:06.974 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (41m) 46s ago 41m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:45:06.974 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (36m) 46s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:45:06.974 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (36m) 46s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:45:06.975 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (35m) 110s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:45:06.975 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (35m) 110s ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:45:06.975 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (35m) 46s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:45:06.975 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (35m) 110s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:45:06.975 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (41m) 110s ago 41m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:45:06.976 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (41m) 46s ago 41m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:45:06.976 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (34m) 110s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:45:06.976 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (34m) 110s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:45:06.976 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (33m) 110s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:45:06.977 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (33m) 110s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:45:06.977 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (32m) 46s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:45:06.977 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (32m) 46s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:45:06.977 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (31m) 46s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:45:06.977 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (31m) 46s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:45:06.978 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (41m) 46s ago 41m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:45:06.978 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 110s ago 39m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:45:06.979 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 46s ago 39m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:45:07.224 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:45:07.225 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:45:07.225 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:45:07.225 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:45:07.225 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:45:07.226 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:45:07.226 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:45:07.226 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:45:07.226 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:45:07.227 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:45:07.227 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:45:07.227 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:45:07.227 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:45:07.227 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:45:07.228 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:45:07.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:07 gibba044 bash[25485]: cephadm 2021-03-10T20:45:05.475068+0000 mgr.gibba044.wflcwh (mgr.34466) 1974 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:45:07.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:07 gibba023 bash[30844]: cephadm 2021-03-10T20:45:05.475068+0000 mgr.gibba044.wflcwh (mgr.34466) 1974 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:45:07.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:07 gibba023 bash[31815]: cephadm 2021-03-10T20:45:05.475068+0000 mgr.gibba044.wflcwh (mgr.34466) 1974 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:45:08.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:08 gibba044 bash[25485]: audit 2021-03-10T20:45:06.738612+0000 mgr.gibba044.wflcwh (mgr.34466) 1975 : audit [DBG] from='client.55369 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:45:08.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:08 gibba044 bash[25485]: cluster 2021-03-10T20:45:06.815601+0000 mgr.gibba044.wflcwh (mgr.34466) 1976 : cluster [DBG] pgmap v1114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:08.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:08 gibba044 bash[25485]: audit 2021-03-10T20:45:06.961875+0000 mgr.gibba044.wflcwh (mgr.34466) 1977 : audit [DBG] from='client.45396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:45:08.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:08 gibba044 bash[25485]: audit 2021-03-10T20:45:07.224792+0000 mon.c (mon.1) 49 : audit [DBG] from='client.? 172.21.2.123:0/4152222775' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:08.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:08 gibba023 bash[30844]: audit 2021-03-10T20:45:06.738612+0000 mgr.gibba044.wflcwh (mgr.34466) 1975 : audit [DBG] from='client.55369 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:45:08.980 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:08 gibba023 bash[30844]: cluster 2021-03-10T20:45:06.815601+0000 mgr.gibba044.wflcwh (mgr.34466) 1976 : cluster [DBG] pgmap v1114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:08.981 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:08 gibba023 bash[30844]: audit 2021-03-10T20:45:06.961875+0000 mgr.gibba044.wflcwh (mgr.34466) 1977 : audit [DBG] from='client.45396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:45:08.981 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:08 gibba023 bash[30844]: audit 2021-03-10T20:45:07.224792+0000 mon.c (mon.1) 49 : audit [DBG] from='client.? 172.21.2.123:0/4152222775' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:08.981 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:08 gibba023 bash[31815]: audit 2021-03-10T20:45:06.738612+0000 mgr.gibba044.wflcwh (mgr.34466) 1975 : audit [DBG] from='client.55369 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:45:08.982 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:08 gibba023 bash[31815]: cluster 2021-03-10T20:45:06.815601+0000 mgr.gibba044.wflcwh (mgr.34466) 1976 : cluster [DBG] pgmap v1114: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:08.982 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:08 gibba023 bash[31815]: audit 2021-03-10T20:45:06.961875+0000 mgr.gibba044.wflcwh (mgr.34466) 1977 : audit [DBG] from='client.45396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:45:08.982 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:08 gibba023 bash[31815]: audit 2021-03-10T20:45:07.224792+0000 mon.c (mon.1) 49 : audit [DBG] from='client.? 172.21.2.123:0/4152222775' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:10.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:10 gibba044 bash[25485]: cluster 2021-03-10T20:45:08.817418+0000 mgr.gibba044.wflcwh (mgr.34466) 1978 : cluster [DBG] pgmap v1115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:10.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:10 gibba023 bash[30844]: cluster 2021-03-10T20:45:08.817418+0000 mgr.gibba044.wflcwh (mgr.34466) 1978 : cluster [DBG] pgmap v1115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:10.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:10 gibba023 bash[31815]: cluster 2021-03-10T20:45:08.817418+0000 mgr.gibba044.wflcwh (mgr.34466) 1978 : cluster [DBG] pgmap v1115: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:11.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:11 gibba044 bash[25485]: cluster 2021-03-10T20:45:10.818900+0000 mgr.gibba044.wflcwh (mgr.34466) 1979 : cluster [DBG] pgmap v1116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:11.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:11 gibba023 bash[30844]: cluster 2021-03-10T20:45:10.818900+0000 mgr.gibba044.wflcwh (mgr.34466) 1979 : cluster [DBG] pgmap v1116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:11.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:11 gibba023 bash[31815]: cluster 2021-03-10T20:45:10.818900+0000 mgr.gibba044.wflcwh (mgr.34466) 1979 : cluster [DBG] pgmap v1116: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:14.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:14 gibba023 bash[30844]: cluster 2021-03-10T20:45:12.820545+0000 mgr.gibba044.wflcwh (mgr.34466) 1980 : cluster [DBG] pgmap v1117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:14.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:14 gibba023 bash[31815]: cluster 2021-03-10T20:45:12.820545+0000 mgr.gibba044.wflcwh (mgr.34466) 1980 : cluster [DBG] pgmap v1117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:14.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:14 gibba044 bash[25485]: cluster 2021-03-10T20:45:12.820545+0000 mgr.gibba044.wflcwh (mgr.34466) 1980 : cluster [DBG] pgmap v1117: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:16.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:16 gibba023 bash[30844]: cluster 2021-03-10T20:45:14.821704+0000 mgr.gibba044.wflcwh (mgr.34466) 1981 : cluster [DBG] pgmap v1118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:16.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:16 gibba023 bash[31815]: cluster 2021-03-10T20:45:14.821704+0000 mgr.gibba044.wflcwh (mgr.34466) 1981 : cluster [DBG] pgmap v1118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:16.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:16 gibba044 bash[25485]: cluster 2021-03-10T20:45:14.821704+0000 mgr.gibba044.wflcwh (mgr.34466) 1981 : cluster [DBG] pgmap v1118: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:18.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:18 gibba023 bash[30844]: cluster 2021-03-10T20:45:16.823284+0000 mgr.gibba044.wflcwh (mgr.34466) 1982 : cluster [DBG] pgmap v1119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:18.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:18 gibba023 bash[31815]: cluster 2021-03-10T20:45:16.823284+0000 mgr.gibba044.wflcwh (mgr.34466) 1982 : cluster [DBG] pgmap v1119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:18.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:18 gibba044 bash[25485]: cluster 2021-03-10T20:45:16.823284+0000 mgr.gibba044.wflcwh (mgr.34466) 1982 : cluster [DBG] pgmap v1119: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:20.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:20 gibba023 bash[30844]: cluster 2021-03-10T20:45:18.824843+0000 mgr.gibba044.wflcwh (mgr.34466) 1983 : cluster [DBG] pgmap v1120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:20.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:20 gibba023 bash[31815]: cluster 2021-03-10T20:45:18.824843+0000 mgr.gibba044.wflcwh (mgr.34466) 1983 : cluster [DBG] pgmap v1120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:20.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:20 gibba044 bash[25485]: cluster 2021-03-10T20:45:18.824843+0000 mgr.gibba044.wflcwh (mgr.34466) 1983 : cluster [DBG] pgmap v1120: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:22.001 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:21 gibba044 bash[25485]: cephadm 2021-03-10T20:45:20.490900+0000 mgr.gibba044.wflcwh (mgr.34466) 1984 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:45:22.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:21 gibba044 bash[25485]: cephadm 2021-03-10T20:45:20.492521+0000 mgr.gibba044.wflcwh (mgr.34466) 1985 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:45:22.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:21 gibba044 bash[25485]: audit 2021-03-10T20:45:20.717557+0000 mon.a (mon.0) 1088 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:45:22.002 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:21 gibba044 bash[25485]: cephadm 2021-03-10T20:45:20.720868+0000 mgr.gibba044.wflcwh (mgr.34466) 1986 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:45:22.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:21 gibba044 bash[25485]: audit 2021-03-10T20:45:20.721162+0000 mon.a (mon.0) 1089 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:45:22.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:21 gibba044 bash[25485]: audit 2021-03-10T20:45:20.722686+0000 mon.a (mon.0) 1090 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:21 gibba044 bash[25485]: cephadm 2021-03-10T20:45:20.722861+0000 mgr.gibba044.wflcwh (mgr.34466) 1987 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:45:22.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:21 gibba044 bash[25485]: cephadm 2021-03-10T20:45:20.724293+0000 mgr.gibba044.wflcwh (mgr.34466) 1988 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:45:22.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:21 gibba044 bash[25485]: audit 2021-03-10T20:45:20.724297+0000 mon.a (mon.0) 1091 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:21 gibba044 bash[25485]: cephadm 2021-03-10T20:45:20.724336+0000 mgr.gibba044.wflcwh (mgr.34466) 1989 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:45:22.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:21 gibba044 bash[25485]: audit 2021-03-10T20:45:20.725798+0000 mon.a (mon.0) 1092 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:21 gibba044 bash[25485]: cephadm 2021-03-10T20:45:20.725834+0000 mgr.gibba044.wflcwh (mgr.34466) 1990 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:45:22.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:21 gibba044 bash[25485]: cephadm 2021-03-10T20:45:20.725872+0000 mgr.gibba044.wflcwh (mgr.34466) 1991 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:45:22.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:21 gibba044 bash[25485]: cephadm 2021-03-10T20:45:20.727307+0000 mgr.gibba044.wflcwh (mgr.34466) 1992 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:45:22.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:21 gibba044 bash[25485]: cephadm 2021-03-10T20:45:20.728750+0000 mgr.gibba044.wflcwh (mgr.34466) 1993 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:45:22.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:21 gibba044 bash[25485]: cephadm 2021-03-10T20:45:20.728789+0000 mgr.gibba044.wflcwh (mgr.34466) 1994 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:45:22.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:21 gibba044 bash[25485]: audit 2021-03-10T20:45:20.728818+0000 mon.a (mon.0) 1093 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:21 gibba044 bash[25485]: cephadm 2021-03-10T20:45:20.730330+0000 mgr.gibba044.wflcwh (mgr.34466) 1995 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:45:22.011 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:21 gibba044 bash[25485]: audit 2021-03-10T20:45:20.730568+0000 mon.a (mon.0) 1094 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.011 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:21 gibba044 bash[25485]: cephadm 2021-03-10T20:45:20.730689+0000 mgr.gibba044.wflcwh (mgr.34466) 1996 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:45:22.012 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:21 gibba044 bash[25485]: cephadm 2021-03-10T20:45:20.732329+0000 mgr.gibba044.wflcwh (mgr.34466) 1997 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:45:22.012 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:21 gibba044 bash[25485]: cephadm 2021-03-10T20:45:20.732376+0000 mgr.gibba044.wflcwh (mgr.34466) 1998 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:45:22.012 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:21 gibba044 bash[25485]: cephadm 2021-03-10T20:45:20.732527+0000 mgr.gibba044.wflcwh (mgr.34466) 1999 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:45:22.012 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:21 gibba044 bash[25485]: cluster 2021-03-10T20:45:20.826528+0000 mgr.gibba044.wflcwh (mgr.34466) 2000 : cluster [DBG] pgmap v1121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:22.175 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[30844]: cephadm 2021-03-10T20:45:20.490900+0000 mgr.gibba044.wflcwh (mgr.34466) 1984 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:45:22.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[30844]: cephadm 2021-03-10T20:45:20.492521+0000 mgr.gibba044.wflcwh (mgr.34466) 1985 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:45:22.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[30844]: audit 2021-03-10T20:45:20.717557+0000 mon.a (mon.0) 1088 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:45:22.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[30844]: cephadm 2021-03-10T20:45:20.720868+0000 mgr.gibba044.wflcwh (mgr.34466) 1986 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:45:22.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[30844]: audit 2021-03-10T20:45:20.721162+0000 mon.a (mon.0) 1089 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:45:22.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[30844]: audit 2021-03-10T20:45:20.722686+0000 mon.a (mon.0) 1090 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[30844]: cephadm 2021-03-10T20:45:20.722861+0000 mgr.gibba044.wflcwh (mgr.34466) 1987 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:45:22.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[30844]: cephadm 2021-03-10T20:45:20.724293+0000 mgr.gibba044.wflcwh (mgr.34466) 1988 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:45:22.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[30844]: audit 2021-03-10T20:45:20.724297+0000 mon.a (mon.0) 1091 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[30844]: cephadm 2021-03-10T20:45:20.724336+0000 mgr.gibba044.wflcwh (mgr.34466) 1989 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:45:22.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[30844]: audit 2021-03-10T20:45:20.725798+0000 mon.a (mon.0) 1092 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[30844]: cephadm 2021-03-10T20:45:20.725834+0000 mgr.gibba044.wflcwh (mgr.34466) 1990 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:45:22.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[30844]: cephadm 2021-03-10T20:45:20.725872+0000 mgr.gibba044.wflcwh (mgr.34466) 1991 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:45:22.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[30844]: cephadm 2021-03-10T20:45:20.727307+0000 mgr.gibba044.wflcwh (mgr.34466) 1992 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:45:22.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[30844]: cephadm 2021-03-10T20:45:20.728750+0000 mgr.gibba044.wflcwh (mgr.34466) 1993 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:45:22.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[30844]: cephadm 2021-03-10T20:45:20.728789+0000 mgr.gibba044.wflcwh (mgr.34466) 1994 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:45:22.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[30844]: audit 2021-03-10T20:45:20.728818+0000 mon.a (mon.0) 1093 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[30844]: cephadm 2021-03-10T20:45:20.730330+0000 mgr.gibba044.wflcwh (mgr.34466) 1995 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:45:22.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[30844]: audit 2021-03-10T20:45:20.730568+0000 mon.a (mon.0) 1094 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[30844]: cephadm 2021-03-10T20:45:20.730689+0000 mgr.gibba044.wflcwh (mgr.34466) 1996 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:45:22.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[30844]: cephadm 2021-03-10T20:45:20.732329+0000 mgr.gibba044.wflcwh (mgr.34466) 1997 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:45:22.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[31815]: cephadm 2021-03-10T20:45:20.490900+0000 mgr.gibba044.wflcwh (mgr.34466) 1984 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:45:22.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[31815]: cephadm 2021-03-10T20:45:20.492521+0000 mgr.gibba044.wflcwh (mgr.34466) 1985 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:45:22.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[31815]: audit 2021-03-10T20:45:20.717557+0000 mon.a (mon.0) 1088 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:45:22.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[31815]: cephadm 2021-03-10T20:45:20.720868+0000 mgr.gibba044.wflcwh (mgr.34466) 1986 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:45:22.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[31815]: audit 2021-03-10T20:45:20.721162+0000 mon.a (mon.0) 1089 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:45:22.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[31815]: audit 2021-03-10T20:45:20.722686+0000 mon.a (mon.0) 1090 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[31815]: cephadm 2021-03-10T20:45:20.722861+0000 mgr.gibba044.wflcwh (mgr.34466) 1987 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:45:22.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[31815]: cephadm 2021-03-10T20:45:20.724293+0000 mgr.gibba044.wflcwh (mgr.34466) 1988 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:45:22.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[31815]: audit 2021-03-10T20:45:20.724297+0000 mon.a (mon.0) 1091 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[31815]: cephadm 2021-03-10T20:45:20.724336+0000 mgr.gibba044.wflcwh (mgr.34466) 1989 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:45:22.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[31815]: audit 2021-03-10T20:45:20.725798+0000 mon.a (mon.0) 1092 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[31815]: cephadm 2021-03-10T20:45:20.725834+0000 mgr.gibba044.wflcwh (mgr.34466) 1990 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:45:22.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[31815]: cephadm 2021-03-10T20:45:20.725872+0000 mgr.gibba044.wflcwh (mgr.34466) 1991 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:45:22.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[31815]: cephadm 2021-03-10T20:45:20.727307+0000 mgr.gibba044.wflcwh (mgr.34466) 1992 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:45:22.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[31815]: cephadm 2021-03-10T20:45:20.728750+0000 mgr.gibba044.wflcwh (mgr.34466) 1993 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:45:22.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[31815]: cephadm 2021-03-10T20:45:20.728789+0000 mgr.gibba044.wflcwh (mgr.34466) 1994 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:45:22.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[31815]: audit 2021-03-10T20:45:20.728818+0000 mon.a (mon.0) 1093 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[31815]: cephadm 2021-03-10T20:45:20.730330+0000 mgr.gibba044.wflcwh (mgr.34466) 1995 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:45:22.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[31815]: audit 2021-03-10T20:45:20.730568+0000 mon.a (mon.0) 1094 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:22.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[31815]: cephadm 2021-03-10T20:45:20.730689+0000 mgr.gibba044.wflcwh (mgr.34466) 1996 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:45:22.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[31815]: cephadm 2021-03-10T20:45:20.732329+0000 mgr.gibba044.wflcwh (mgr.34466) 1997 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:45:22.188 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[30844]: cephadm 2021-03-10T20:45:20.732376+0000 mgr.gibba044.wflcwh (mgr.34466) 1998 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:45:22.188 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[30844]: cephadm 2021-03-10T20:45:20.732527+0000 mgr.gibba044.wflcwh (mgr.34466) 1999 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:45:22.188 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[30844]: cluster 2021-03-10T20:45:20.826528+0000 mgr.gibba044.wflcwh (mgr.34466) 2000 : cluster [DBG] pgmap v1121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:22.189 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[31815]: cephadm 2021-03-10T20:45:20.732376+0000 mgr.gibba044.wflcwh (mgr.34466) 1998 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:45:22.189 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[31815]: cephadm 2021-03-10T20:45:20.732527+0000 mgr.gibba044.wflcwh (mgr.34466) 1999 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:45:22.189 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:21 gibba023 bash[31815]: cluster 2021-03-10T20:45:20.826528+0000 mgr.gibba044.wflcwh (mgr.34466) 2000 : cluster [DBG] pgmap v1121: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:24.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:24 gibba023 bash[30844]: cluster 2021-03-10T20:45:22.827953+0000 mgr.gibba044.wflcwh (mgr.34466) 2001 : cluster [DBG] pgmap v1122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:24.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:24 gibba023 bash[31815]: cluster 2021-03-10T20:45:22.827953+0000 mgr.gibba044.wflcwh (mgr.34466) 2001 : cluster [DBG] pgmap v1122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:24.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:24 gibba044 bash[25485]: cluster 2021-03-10T20:45:22.827953+0000 mgr.gibba044.wflcwh (mgr.34466) 2001 : cluster [DBG] pgmap v1122: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:26.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:26 gibba023 bash[30844]: cluster 2021-03-10T20:45:24.829172+0000 mgr.gibba044.wflcwh (mgr.34466) 2002 : cluster [DBG] pgmap v1123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:26.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:26 gibba023 bash[31815]: cluster 2021-03-10T20:45:24.829172+0000 mgr.gibba044.wflcwh (mgr.34466) 2002 : cluster [DBG] pgmap v1123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:26.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:26 gibba044 bash[25485]: cluster 2021-03-10T20:45:24.829172+0000 mgr.gibba044.wflcwh (mgr.34466) 2002 : cluster [DBG] pgmap v1123: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:28.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:28 gibba023 bash[30844]: cluster 2021-03-10T20:45:26.830633+0000 mgr.gibba044.wflcwh (mgr.34466) 2003 : cluster [DBG] pgmap v1124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:28.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:28 gibba023 bash[30844]: audit 2021-03-10T20:45:27.249903+0000 mon.a (mon.0) 1095 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:45:28.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:28 gibba023 bash[30844]: audit 2021-03-10T20:45:27.250633+0000 mon.a (mon.0) 1096 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:45:28.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:28 gibba023 bash[30844]: audit 2021-03-10T20:45:27.251237+0000 mon.a (mon.0) 1097 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T20:45:28.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:28 gibba023 bash[30844]: audit 2021-03-10T20:45:27.251937+0000 mon.a (mon.0) 1098 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T20:45:28.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:28 gibba023 bash[30844]: audit 2021-03-10T20:45:27.252598+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:45:28.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:28 gibba023 bash[30844]: audit 2021-03-10T20:45:27.253269+0000 mon.a (mon.0) 1100 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:45:28.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:28 gibba023 bash[31815]: cluster 2021-03-10T20:45:26.830633+0000 mgr.gibba044.wflcwh (mgr.34466) 2003 : cluster [DBG] pgmap v1124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:28.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:28 gibba023 bash[31815]: audit 2021-03-10T20:45:27.249903+0000 mon.a (mon.0) 1095 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:45:28.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:28 gibba023 bash[31815]: audit 2021-03-10T20:45:27.250633+0000 mon.a (mon.0) 1096 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:45:28.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:28 gibba023 bash[31815]: audit 2021-03-10T20:45:27.251237+0000 mon.a (mon.0) 1097 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T20:45:28.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:28 gibba023 bash[31815]: audit 2021-03-10T20:45:27.251937+0000 mon.a (mon.0) 1098 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T20:45:28.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:28 gibba023 bash[31815]: audit 2021-03-10T20:45:27.252598+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:45:28.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:28 gibba023 bash[31815]: audit 2021-03-10T20:45:27.253269+0000 mon.a (mon.0) 1100 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:45:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:28 gibba044 bash[25485]: cluster 2021-03-10T20:45:26.830633+0000 mgr.gibba044.wflcwh (mgr.34466) 2003 : cluster [DBG] pgmap v1124: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:28 gibba044 bash[25485]: audit 2021-03-10T20:45:27.249903+0000 mon.a (mon.0) 1095 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:45:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:28 gibba044 bash[25485]: audit 2021-03-10T20:45:27.250633+0000 mon.a (mon.0) 1096 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:45:28.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:28 gibba044 bash[25485]: audit 2021-03-10T20:45:27.251237+0000 mon.a (mon.0) 1097 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T20:45:28.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:28 gibba044 bash[25485]: audit 2021-03-10T20:45:27.251937+0000 mon.a (mon.0) 1098 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T20:45:28.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:28 gibba044 bash[25485]: audit 2021-03-10T20:45:27.252598+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:45:28.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:28 gibba044 bash[25485]: audit 2021-03-10T20:45:27.253269+0000 mon.a (mon.0) 1100 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:45:30.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:30 gibba023 bash[30844]: cluster 2021-03-10T20:45:28.832175+0000 mgr.gibba044.wflcwh (mgr.34466) 2004 : cluster [DBG] pgmap v1125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:30.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:30 gibba023 bash[31815]: cluster 2021-03-10T20:45:28.832175+0000 mgr.gibba044.wflcwh (mgr.34466) 2004 : cluster [DBG] pgmap v1125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:30.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:30 gibba044 bash[25485]: cluster 2021-03-10T20:45:28.832175+0000 mgr.gibba044.wflcwh (mgr.34466) 2004 : cluster [DBG] pgmap v1125: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:32.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:32 gibba023 bash[30844]: cluster 2021-03-10T20:45:30.833923+0000 mgr.gibba044.wflcwh (mgr.34466) 2005 : cluster [DBG] pgmap v1126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:32.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:32 gibba023 bash[31815]: cluster 2021-03-10T20:45:30.833923+0000 mgr.gibba044.wflcwh (mgr.34466) 2005 : cluster [DBG] pgmap v1126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:32.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:32 gibba044 bash[25485]: cluster 2021-03-10T20:45:30.833923+0000 mgr.gibba044.wflcwh (mgr.34466) 2005 : cluster [DBG] pgmap v1126: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:34.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:34 gibba023 bash[30844]: cluster 2021-03-10T20:45:32.835440+0000 mgr.gibba044.wflcwh (mgr.34466) 2006 : cluster [DBG] pgmap v1127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:34.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:34 gibba023 bash[31815]: cluster 2021-03-10T20:45:32.835440+0000 mgr.gibba044.wflcwh (mgr.34466) 2006 : cluster [DBG] pgmap v1127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:34.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:34 gibba044 bash[25485]: cluster 2021-03-10T20:45:32.835440+0000 mgr.gibba044.wflcwh (mgr.34466) 2006 : cluster [DBG] pgmap v1127: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:36.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:36 gibba023 bash[30844]: cluster 2021-03-10T20:45:34.836649+0000 mgr.gibba044.wflcwh (mgr.34466) 2007 : cluster [DBG] pgmap v1128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:36.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:36 gibba023 bash[31815]: cluster 2021-03-10T20:45:34.836649+0000 mgr.gibba044.wflcwh (mgr.34466) 2007 : cluster [DBG] pgmap v1128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:36.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:36 gibba044 bash[25485]: cluster 2021-03-10T20:45:34.836649+0000 mgr.gibba044.wflcwh (mgr.34466) 2007 : cluster [DBG] pgmap v1128: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:37.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:37 gibba023 bash[30844]: cephadm 2021-03-10T20:45:35.748365+0000 mgr.gibba044.wflcwh (mgr.34466) 2008 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:45:37.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:37 gibba023 bash[31815]: cephadm 2021-03-10T20:45:35.748365+0000 mgr.gibba044.wflcwh (mgr.34466) 2008 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:45:37.469 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:45:37.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:37 gibba044 bash[25485]: cephadm 2021-03-10T20:45:35.748365+0000 mgr.gibba044.wflcwh (mgr.34466) 2008 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:45:37.725 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:45:37.726 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (36m) 2m ago 42m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:45:37.726 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (42m) 77s ago 42m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:45:37.726 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (37m) 77s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:45:37.727 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (37m) 77s ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:45:37.727 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (36m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:45:37.727 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (36m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:45:37.727 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (35m) 77s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:45:37.727 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (36m) 2m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:45:37.728 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (42m) 2m ago 42m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:45:37.728 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (42m) 77s ago 42m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:45:37.728 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (35m) 2m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:45:37.728 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (34m) 2m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:45:37.729 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (34m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:45:37.729 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (33m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:45:37.729 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (33m) 77s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:45:37.729 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (32m) 77s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:45:37.729 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (32m) 77s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:45:37.730 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (31m) 77s ago 42m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:45:37.730 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (41m) 77s ago 42m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:45:37.731 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 2m ago 40m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:45:37.731 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 77s ago 40m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:45:37.981 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:45:37.982 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:45:37.982 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:45:37.982 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:45:37.982 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:45:37.983 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:45:37.983 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:45:37.983 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:45:37.983 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:45:37.984 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:45:37.984 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:45:37.984 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:45:37.985 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:45:37.985 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:45:37.985 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:45:38.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:38 gibba023 bash[30844]: cluster 2021-03-10T20:45:36.838218+0000 mgr.gibba044.wflcwh (mgr.34466) 2009 : cluster [DBG] pgmap v1129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:38.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:38 gibba023 bash[30844]: audit 2021-03-10T20:45:37.981595+0000 mon.c (mon.1) 50 : audit [DBG] from='client.? 172.21.2.123:0/1587912008' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:38.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:38 gibba023 bash[31815]: cluster 2021-03-10T20:45:36.838218+0000 mgr.gibba044.wflcwh (mgr.34466) 2009 : cluster [DBG] pgmap v1129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:38.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:38 gibba023 bash[31815]: audit 2021-03-10T20:45:37.981595+0000 mon.c (mon.1) 50 : audit [DBG] from='client.? 172.21.2.123:0/1587912008' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:38.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:38 gibba044 bash[25485]: cluster 2021-03-10T20:45:36.838218+0000 mgr.gibba044.wflcwh (mgr.34466) 2009 : cluster [DBG] pgmap v1129: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:38.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:38 gibba044 bash[25485]: audit 2021-03-10T20:45:37.981595+0000 mon.c (mon.1) 50 : audit [DBG] from='client.? 172.21.2.123:0/1587912008' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:45:39.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:39 gibba023 bash[30844]: audit 2021-03-10T20:45:37.460400+0000 mgr.gibba044.wflcwh (mgr.34466) 2010 : audit [DBG] from='client.45408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:45:39.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:39 gibba023 bash[30844]: audit 2021-03-10T20:45:37.684779+0000 mgr.gibba044.wflcwh (mgr.34466) 2011 : audit [DBG] from='client.55393 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:45:39.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:39 gibba023 bash[31815]: audit 2021-03-10T20:45:37.460400+0000 mgr.gibba044.wflcwh (mgr.34466) 2010 : audit [DBG] from='client.45408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:45:39.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:39 gibba023 bash[31815]: audit 2021-03-10T20:45:37.684779+0000 mgr.gibba044.wflcwh (mgr.34466) 2011 : audit [DBG] from='client.55393 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:45:39.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:39 gibba044 bash[25485]: audit 2021-03-10T20:45:37.460400+0000 mgr.gibba044.wflcwh (mgr.34466) 2010 : audit [DBG] from='client.45408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:45:39.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:39 gibba044 bash[25485]: audit 2021-03-10T20:45:37.684779+0000 mgr.gibba044.wflcwh (mgr.34466) 2011 : audit [DBG] from='client.55393 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:45:40.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:40 gibba023 bash[30844]: cluster 2021-03-10T20:45:38.839902+0000 mgr.gibba044.wflcwh (mgr.34466) 2012 : cluster [DBG] pgmap v1130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:40.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:40 gibba023 bash[31815]: cluster 2021-03-10T20:45:38.839902+0000 mgr.gibba044.wflcwh (mgr.34466) 2012 : cluster [DBG] pgmap v1130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:40.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:40 gibba044 bash[25485]: cluster 2021-03-10T20:45:38.839902+0000 mgr.gibba044.wflcwh (mgr.34466) 2012 : cluster [DBG] pgmap v1130: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:42.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:42 gibba023 bash[30844]: cluster 2021-03-10T20:45:40.841284+0000 mgr.gibba044.wflcwh (mgr.34466) 2013 : cluster [DBG] pgmap v1131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:42.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:42 gibba023 bash[31815]: cluster 2021-03-10T20:45:40.841284+0000 mgr.gibba044.wflcwh (mgr.34466) 2013 : cluster [DBG] pgmap v1131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:42.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:42 gibba044 bash[25485]: cluster 2021-03-10T20:45:40.841284+0000 mgr.gibba044.wflcwh (mgr.34466) 2013 : cluster [DBG] pgmap v1131: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:44.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:44 gibba023 bash[30844]: cluster 2021-03-10T20:45:42.842840+0000 mgr.gibba044.wflcwh (mgr.34466) 2014 : cluster [DBG] pgmap v1132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:44.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:44 gibba023 bash[31815]: cluster 2021-03-10T20:45:42.842840+0000 mgr.gibba044.wflcwh (mgr.34466) 2014 : cluster [DBG] pgmap v1132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:44.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:44 gibba044 bash[25485]: cluster 2021-03-10T20:45:42.842840+0000 mgr.gibba044.wflcwh (mgr.34466) 2014 : cluster [DBG] pgmap v1132: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:46.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:46 gibba023 bash[30844]: cluster 2021-03-10T20:45:44.844378+0000 mgr.gibba044.wflcwh (mgr.34466) 2015 : cluster [DBG] pgmap v1133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:46.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:46 gibba023 bash[31815]: cluster 2021-03-10T20:45:44.844378+0000 mgr.gibba044.wflcwh (mgr.34466) 2015 : cluster [DBG] pgmap v1133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:46.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:46 gibba044 bash[25485]: cluster 2021-03-10T20:45:44.844378+0000 mgr.gibba044.wflcwh (mgr.34466) 2015 : cluster [DBG] pgmap v1133: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:48.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:48 gibba023 bash[30844]: cluster 2021-03-10T20:45:46.845976+0000 mgr.gibba044.wflcwh (mgr.34466) 2016 : cluster [DBG] pgmap v1134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:48.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:48 gibba023 bash[31815]: cluster 2021-03-10T20:45:46.845976+0000 mgr.gibba044.wflcwh (mgr.34466) 2016 : cluster [DBG] pgmap v1134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:48.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:48 gibba044 bash[25485]: cluster 2021-03-10T20:45:46.845976+0000 mgr.gibba044.wflcwh (mgr.34466) 2016 : cluster [DBG] pgmap v1134: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:50.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:50 gibba023 bash[30844]: cluster 2021-03-10T20:45:48.847784+0000 mgr.gibba044.wflcwh (mgr.34466) 2017 : cluster [DBG] pgmap v1135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:50.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:50 gibba023 bash[31815]: cluster 2021-03-10T20:45:48.847784+0000 mgr.gibba044.wflcwh (mgr.34466) 2017 : cluster [DBG] pgmap v1135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:50.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:50 gibba044 bash[25485]: cluster 2021-03-10T20:45:48.847784+0000 mgr.gibba044.wflcwh (mgr.34466) 2017 : cluster [DBG] pgmap v1135: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:52.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:52 gibba023 bash[30844]: cephadm 2021-03-10T20:45:50.764229+0000 mgr.gibba044.wflcwh (mgr.34466) 2018 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:45:52.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:52 gibba023 bash[30844]: cluster 2021-03-10T20:45:50.849313+0000 mgr.gibba044.wflcwh (mgr.34466) 2019 : cluster [DBG] pgmap v1136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:52.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:52 gibba023 bash[31815]: cephadm 2021-03-10T20:45:50.764229+0000 mgr.gibba044.wflcwh (mgr.34466) 2018 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:45:52.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:52 gibba023 bash[31815]: cluster 2021-03-10T20:45:50.849313+0000 mgr.gibba044.wflcwh (mgr.34466) 2019 : cluster [DBG] pgmap v1136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:52.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:52 gibba044 bash[25485]: cephadm 2021-03-10T20:45:50.764229+0000 mgr.gibba044.wflcwh (mgr.34466) 2018 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:45:52.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:52 gibba044 bash[25485]: cluster 2021-03-10T20:45:50.849313+0000 mgr.gibba044.wflcwh (mgr.34466) 2019 : cluster [DBG] pgmap v1136: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:54.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:54 gibba023 bash[30844]: cluster 2021-03-10T20:45:52.850859+0000 mgr.gibba044.wflcwh (mgr.34466) 2020 : cluster [DBG] pgmap v1137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:54.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:54 gibba023 bash[31815]: cluster 2021-03-10T20:45:52.850859+0000 mgr.gibba044.wflcwh (mgr.34466) 2020 : cluster [DBG] pgmap v1137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:54.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:54 gibba044 bash[25485]: cluster 2021-03-10T20:45:52.850859+0000 mgr.gibba044.wflcwh (mgr.34466) 2020 : cluster [DBG] pgmap v1137: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:56.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:56 gibba023 bash[30844]: cluster 2021-03-10T20:45:54.852115+0000 mgr.gibba044.wflcwh (mgr.34466) 2021 : cluster [DBG] pgmap v1138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:56.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:56 gibba023 bash[31815]: cluster 2021-03-10T20:45:54.852115+0000 mgr.gibba044.wflcwh (mgr.34466) 2021 : cluster [DBG] pgmap v1138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:56.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:56 gibba044 bash[25485]: cluster 2021-03-10T20:45:54.852115+0000 mgr.gibba044.wflcwh (mgr.34466) 2021 : cluster [DBG] pgmap v1138: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:58.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:45:58 gibba044 bash[25485]: cluster 2021-03-10T20:45:56.853778+0000 mgr.gibba044.wflcwh (mgr.34466) 2022 : cluster [DBG] pgmap v1139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:58.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:45:58 gibba023 bash[30844]: cluster 2021-03-10T20:45:56.853778+0000 mgr.gibba044.wflcwh (mgr.34466) 2022 : cluster [DBG] pgmap v1139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:45:58.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:45:58 gibba023 bash[31815]: cluster 2021-03-10T20:45:56.853778+0000 mgr.gibba044.wflcwh (mgr.34466) 2022 : cluster [DBG] pgmap v1139: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:00.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:00 gibba044 bash[25485]: cluster 2021-03-10T20:45:58.855547+0000 mgr.gibba044.wflcwh (mgr.34466) 2023 : cluster [DBG] pgmap v1140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:00.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:00 gibba023 bash[30844]: cluster 2021-03-10T20:45:58.855547+0000 mgr.gibba044.wflcwh (mgr.34466) 2023 : cluster [DBG] pgmap v1140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:00.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:00 gibba023 bash[31815]: cluster 2021-03-10T20:45:58.855547+0000 mgr.gibba044.wflcwh (mgr.34466) 2023 : cluster [DBG] pgmap v1140: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:02.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:02 gibba044 bash[25485]: cluster 2021-03-10T20:46:00.857265+0000 mgr.gibba044.wflcwh (mgr.34466) 2024 : cluster [DBG] pgmap v1141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:02.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:02 gibba023 bash[30844]: cluster 2021-03-10T20:46:00.857265+0000 mgr.gibba044.wflcwh (mgr.34466) 2024 : cluster [DBG] pgmap v1141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:02.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:02 gibba023 bash[31815]: cluster 2021-03-10T20:46:00.857265+0000 mgr.gibba044.wflcwh (mgr.34466) 2024 : cluster [DBG] pgmap v1141: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:04.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:04 gibba044 bash[25485]: cluster 2021-03-10T20:46:02.858911+0000 mgr.gibba044.wflcwh (mgr.34466) 2025 : cluster [DBG] pgmap v1142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:04.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:04 gibba023 bash[30844]: cluster 2021-03-10T20:46:02.858911+0000 mgr.gibba044.wflcwh (mgr.34466) 2025 : cluster [DBG] pgmap v1142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:04.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:04 gibba023 bash[31815]: cluster 2021-03-10T20:46:02.858911+0000 mgr.gibba044.wflcwh (mgr.34466) 2025 : cluster [DBG] pgmap v1142: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:06.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:06 gibba044 bash[25485]: cluster 2021-03-10T20:46:04.860153+0000 mgr.gibba044.wflcwh (mgr.34466) 2026 : cluster [DBG] pgmap v1143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:06.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:06 gibba023 bash[30844]: cluster 2021-03-10T20:46:04.860153+0000 mgr.gibba044.wflcwh (mgr.34466) 2026 : cluster [DBG] pgmap v1143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:06.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:06 gibba023 bash[31815]: cluster 2021-03-10T20:46:04.860153+0000 mgr.gibba044.wflcwh (mgr.34466) 2026 : cluster [DBG] pgmap v1143: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:07.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:07 gibba044 bash[25485]: cephadm 2021-03-10T20:46:05.768413+0000 mgr.gibba044.wflcwh (mgr.34466) 2027 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:46:07.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:07 gibba023 bash[30844]: cephadm 2021-03-10T20:46:05.768413+0000 mgr.gibba044.wflcwh (mgr.34466) 2027 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:46:07.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:07 gibba023 bash[31815]: cephadm 2021-03-10T20:46:05.768413+0000 mgr.gibba044.wflcwh (mgr.34466) 2027 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:46:08.226 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:46:08.457 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:46:08.457 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (37m) 2m ago 42m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:46:08.457 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (42m) 108s ago 42m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:46:08.457 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (37m) 108s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:46:08.458 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (37m) 108s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:46:08.458 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (36m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:46:08.458 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (36m) 2m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:46:08.458 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (36m) 108s ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:46:08.459 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (36m) 2m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:46:08.459 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (42m) 2m ago 42m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:46:08.459 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (42m) 108s ago 43m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:46:08.459 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (35m) 2m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:46:08.459 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (35m) 2m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:46:08.460 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (34m) 2m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:46:08.460 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (34m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:46:08.460 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (33m) 108s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:46:08.460 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (33m) 108s ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:46:08.461 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (32m) 108s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:46:08.461 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (32m) 108s ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:46:08.461 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (42m) 108s ago 43m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:46:08.461 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 2m ago 40m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:46:08.461 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 108s ago 40m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:46:08.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:08 gibba044 bash[25485]: cluster 2021-03-10T20:46:06.861737+0000 mgr.gibba044.wflcwh (mgr.34466) 2028 : cluster [DBG] pgmap v1144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:08.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:08 gibba023 bash[30844]: cluster 2021-03-10T20:46:06.861737+0000 mgr.gibba044.wflcwh (mgr.34466) 2028 : cluster [DBG] pgmap v1144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:08.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:08 gibba023 bash[31815]: cluster 2021-03-10T20:46:06.861737+0000 mgr.gibba044.wflcwh (mgr.34466) 2028 : cluster [DBG] pgmap v1144: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:08.712 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:46:08.712 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:46:08.712 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:46:08.712 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:46:08.713 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:46:08.713 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:46:08.713 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:46:08.713 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:46:08.713 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:46:08.714 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:46:08.714 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:46:08.714 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:46:08.714 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:46:08.715 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:46:08.715 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:46:09.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:09 gibba044 bash[25485]: audit 2021-03-10T20:46:08.712182+0000 mon.c (mon.1) 51 : audit [DBG] from='client.? 172.21.2.123:0/2073203572' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:09.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:09 gibba023 bash[30844]: audit 2021-03-10T20:46:08.712182+0000 mon.c (mon.1) 51 : audit [DBG] from='client.? 172.21.2.123:0/2073203572' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:09.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:09 gibba023 bash[31815]: audit 2021-03-10T20:46:08.712182+0000 mon.c (mon.1) 51 : audit [DBG] from='client.? 172.21.2.123:0/2073203572' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:10.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:10 gibba044 bash[25485]: audit 2021-03-10T20:46:08.218573+0000 mgr.gibba044.wflcwh (mgr.34466) 2029 : audit [DBG] from='client.45426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:46:10.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:10 gibba044 bash[25485]: audit 2021-03-10T20:46:08.445692+0000 mgr.gibba044.wflcwh (mgr.34466) 2030 : audit [DBG] from='client.45432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:46:10.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:10 gibba044 bash[25485]: cluster 2021-03-10T20:46:08.863528+0000 mgr.gibba044.wflcwh (mgr.34466) 2031 : cluster [DBG] pgmap v1145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:10.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:10 gibba023 bash[30844]: audit 2021-03-10T20:46:08.218573+0000 mgr.gibba044.wflcwh (mgr.34466) 2029 : audit [DBG] from='client.45426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:46:10.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:10 gibba023 bash[30844]: audit 2021-03-10T20:46:08.445692+0000 mgr.gibba044.wflcwh (mgr.34466) 2030 : audit [DBG] from='client.45432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:46:10.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:10 gibba023 bash[30844]: cluster 2021-03-10T20:46:08.863528+0000 mgr.gibba044.wflcwh (mgr.34466) 2031 : cluster [DBG] pgmap v1145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:10.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:10 gibba023 bash[31815]: audit 2021-03-10T20:46:08.218573+0000 mgr.gibba044.wflcwh (mgr.34466) 2029 : audit [DBG] from='client.45426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:46:10.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:10 gibba023 bash[31815]: audit 2021-03-10T20:46:08.445692+0000 mgr.gibba044.wflcwh (mgr.34466) 2030 : audit [DBG] from='client.45432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:46:10.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:10 gibba023 bash[31815]: cluster 2021-03-10T20:46:08.863528+0000 mgr.gibba044.wflcwh (mgr.34466) 2031 : cluster [DBG] pgmap v1145: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:11.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:11 gibba044 bash[25485]: cluster 2021-03-10T20:46:10.864963+0000 mgr.gibba044.wflcwh (mgr.34466) 2032 : cluster [DBG] pgmap v1146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:11.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:11 gibba023 bash[30844]: cluster 2021-03-10T20:46:10.864963+0000 mgr.gibba044.wflcwh (mgr.34466) 2032 : cluster [DBG] pgmap v1146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:11.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:11 gibba023 bash[31815]: cluster 2021-03-10T20:46:10.864963+0000 mgr.gibba044.wflcwh (mgr.34466) 2032 : cluster [DBG] pgmap v1146: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:14.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:14 gibba023 bash[30844]: cluster 2021-03-10T20:46:12.866394+0000 mgr.gibba044.wflcwh (mgr.34466) 2033 : cluster [DBG] pgmap v1147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:14.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:14 gibba023 bash[31815]: cluster 2021-03-10T20:46:12.866394+0000 mgr.gibba044.wflcwh (mgr.34466) 2033 : cluster [DBG] pgmap v1147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:14.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:14 gibba044 bash[25485]: cluster 2021-03-10T20:46:12.866394+0000 mgr.gibba044.wflcwh (mgr.34466) 2033 : cluster [DBG] pgmap v1147: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:16.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:16 gibba023 bash[30844]: cluster 2021-03-10T20:46:14.867646+0000 mgr.gibba044.wflcwh (mgr.34466) 2034 : cluster [DBG] pgmap v1148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:16.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:16 gibba023 bash[31815]: cluster 2021-03-10T20:46:14.867646+0000 mgr.gibba044.wflcwh (mgr.34466) 2034 : cluster [DBG] pgmap v1148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:16.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:16 gibba044 bash[25485]: cluster 2021-03-10T20:46:14.867646+0000 mgr.gibba044.wflcwh (mgr.34466) 2034 : cluster [DBG] pgmap v1148: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:18.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:18 gibba023 bash[30844]: cluster 2021-03-10T20:46:16.869284+0000 mgr.gibba044.wflcwh (mgr.34466) 2035 : cluster [DBG] pgmap v1149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:18.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:18 gibba023 bash[31815]: cluster 2021-03-10T20:46:16.869284+0000 mgr.gibba044.wflcwh (mgr.34466) 2035 : cluster [DBG] pgmap v1149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:18.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:18 gibba044 bash[25485]: cluster 2021-03-10T20:46:16.869284+0000 mgr.gibba044.wflcwh (mgr.34466) 2035 : cluster [DBG] pgmap v1149: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:20.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:20 gibba023 bash[30844]: cluster 2021-03-10T20:46:18.871082+0000 mgr.gibba044.wflcwh (mgr.34466) 2036 : cluster [DBG] pgmap v1150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:20.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:20 gibba023 bash[31815]: cluster 2021-03-10T20:46:18.871082+0000 mgr.gibba044.wflcwh (mgr.34466) 2036 : cluster [DBG] pgmap v1150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:20.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:20 gibba044 bash[25485]: cluster 2021-03-10T20:46:18.871082+0000 mgr.gibba044.wflcwh (mgr.34466) 2036 : cluster [DBG] pgmap v1150: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:22.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[30844]: cephadm 2021-03-10T20:46:20.785296+0000 mgr.gibba044.wflcwh (mgr.34466) 2037 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:46:22.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[30844]: cephadm 2021-03-10T20:46:20.786853+0000 mgr.gibba044.wflcwh (mgr.34466) 2038 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:46:22.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[30844]: cluster 2021-03-10T20:46:20.871656+0000 mgr.gibba044.wflcwh (mgr.34466) 2039 : cluster [DBG] pgmap v1151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:22.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[30844]: audit 2021-03-10T20:46:21.008859+0000 mon.a (mon.0) 1101 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:46:22.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[30844]: cephadm 2021-03-10T20:46:21.012152+0000 mgr.gibba044.wflcwh (mgr.34466) 2040 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:46:22.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[30844]: audit 2021-03-10T20:46:21.012337+0000 mon.a (mon.0) 1102 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:46:22.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[30844]: audit 2021-03-10T20:46:21.013739+0000 mon.a (mon.0) 1103 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:22.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[30844]: cephadm 2021-03-10T20:46:21.013937+0000 mgr.gibba044.wflcwh (mgr.34466) 2041 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:46:22.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[30844]: cephadm 2021-03-10T20:46:21.015110+0000 mgr.gibba044.wflcwh (mgr.34466) 2042 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:46:22.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[30844]: cephadm 2021-03-10T20:46:21.015147+0000 mgr.gibba044.wflcwh (mgr.34466) 2043 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:46:22.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[30844]: audit 2021-03-10T20:46:21.015177+0000 mon.a (mon.0) 1104 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:22.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[30844]: audit 2021-03-10T20:46:21.016509+0000 mon.a (mon.0) 1105 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:22.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[30844]: cephadm 2021-03-10T20:46:21.016566+0000 mgr.gibba044.wflcwh (mgr.34466) 2044 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:46:22.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[30844]: cephadm 2021-03-10T20:46:21.016602+0000 mgr.gibba044.wflcwh (mgr.34466) 2045 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:46:22.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[30844]: cephadm 2021-03-10T20:46:21.018191+0000 mgr.gibba044.wflcwh (mgr.34466) 2046 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:46:22.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[30844]: audit 2021-03-10T20:46:21.018986+0000 mon.a (mon.0) 1106 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:22.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[30844]: cephadm 2021-03-10T20:46:21.019093+0000 mgr.gibba044.wflcwh (mgr.34466) 2047 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:46:22.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[30844]: cephadm 2021-03-10T20:46:21.019132+0000 mgr.gibba044.wflcwh (mgr.34466) 2048 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:46:22.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[30844]: cephadm 2021-03-10T20:46:21.020569+0000 mgr.gibba044.wflcwh (mgr.34466) 2049 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:46:22.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[30844]: audit 2021-03-10T20:46:21.020736+0000 mon.a (mon.0) 1107 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:22.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[31815]: cephadm 2021-03-10T20:46:20.785296+0000 mgr.gibba044.wflcwh (mgr.34466) 2037 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:46:22.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[31815]: cephadm 2021-03-10T20:46:20.786853+0000 mgr.gibba044.wflcwh (mgr.34466) 2038 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:46:22.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[31815]: cluster 2021-03-10T20:46:20.871656+0000 mgr.gibba044.wflcwh (mgr.34466) 2039 : cluster [DBG] pgmap v1151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:22.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[31815]: audit 2021-03-10T20:46:21.008859+0000 mon.a (mon.0) 1101 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:46:22.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[31815]: cephadm 2021-03-10T20:46:21.012152+0000 mgr.gibba044.wflcwh (mgr.34466) 2040 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:46:22.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[31815]: audit 2021-03-10T20:46:21.012337+0000 mon.a (mon.0) 1102 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:46:22.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[31815]: audit 2021-03-10T20:46:21.013739+0000 mon.a (mon.0) 1103 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:22.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[31815]: cephadm 2021-03-10T20:46:21.013937+0000 mgr.gibba044.wflcwh (mgr.34466) 2041 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:46:22.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[31815]: cephadm 2021-03-10T20:46:21.015110+0000 mgr.gibba044.wflcwh (mgr.34466) 2042 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:46:22.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[31815]: cephadm 2021-03-10T20:46:21.015147+0000 mgr.gibba044.wflcwh (mgr.34466) 2043 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:46:22.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[31815]: audit 2021-03-10T20:46:21.015177+0000 mon.a (mon.0) 1104 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:22.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[31815]: audit 2021-03-10T20:46:21.016509+0000 mon.a (mon.0) 1105 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:22.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[31815]: cephadm 2021-03-10T20:46:21.016566+0000 mgr.gibba044.wflcwh (mgr.34466) 2044 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:46:22.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[31815]: cephadm 2021-03-10T20:46:21.016602+0000 mgr.gibba044.wflcwh (mgr.34466) 2045 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:46:22.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[31815]: cephadm 2021-03-10T20:46:21.018191+0000 mgr.gibba044.wflcwh (mgr.34466) 2046 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:46:22.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[31815]: audit 2021-03-10T20:46:21.018986+0000 mon.a (mon.0) 1106 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:22.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[31815]: cephadm 2021-03-10T20:46:21.019093+0000 mgr.gibba044.wflcwh (mgr.34466) 2047 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:46:22.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[31815]: cephadm 2021-03-10T20:46:21.019132+0000 mgr.gibba044.wflcwh (mgr.34466) 2048 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:46:22.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[31815]: cephadm 2021-03-10T20:46:21.020569+0000 mgr.gibba044.wflcwh (mgr.34466) 2049 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:46:22.436 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[31815]: audit 2021-03-10T20:46:21.020736+0000 mon.a (mon.0) 1107 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:22.436 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[30844]: cephadm 2021-03-10T20:46:21.020883+0000 mgr.gibba044.wflcwh (mgr.34466) 2050 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:46:22.437 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[30844]: cephadm 2021-03-10T20:46:21.022060+0000 mgr.gibba044.wflcwh (mgr.34466) 2051 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:46:22.437 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[30844]: cephadm 2021-03-10T20:46:21.022098+0000 mgr.gibba044.wflcwh (mgr.34466) 2052 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:46:22.437 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[30844]: cephadm 2021-03-10T20:46:21.022235+0000 mgr.gibba044.wflcwh (mgr.34466) 2053 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:46:22.437 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[31815]: cephadm 2021-03-10T20:46:21.020883+0000 mgr.gibba044.wflcwh (mgr.34466) 2050 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:46:22.438 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[31815]: cephadm 2021-03-10T20:46:21.022060+0000 mgr.gibba044.wflcwh (mgr.34466) 2051 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:46:22.438 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[31815]: cephadm 2021-03-10T20:46:21.022098+0000 mgr.gibba044.wflcwh (mgr.34466) 2052 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:46:22.438 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:22 gibba023 bash[31815]: cephadm 2021-03-10T20:46:21.022235+0000 mgr.gibba044.wflcwh (mgr.34466) 2053 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:46:22.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:22 gibba044 bash[25485]: cephadm 2021-03-10T20:46:20.785296+0000 mgr.gibba044.wflcwh (mgr.34466) 2037 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:46:22.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:22 gibba044 bash[25485]: cephadm 2021-03-10T20:46:20.786853+0000 mgr.gibba044.wflcwh (mgr.34466) 2038 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:46:22.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:22 gibba044 bash[25485]: cluster 2021-03-10T20:46:20.871656+0000 mgr.gibba044.wflcwh (mgr.34466) 2039 : cluster [DBG] pgmap v1151: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:22.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:22 gibba044 bash[25485]: audit 2021-03-10T20:46:21.008859+0000 mon.a (mon.0) 1101 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:46:22.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:22 gibba044 bash[25485]: cephadm 2021-03-10T20:46:21.012152+0000 mgr.gibba044.wflcwh (mgr.34466) 2040 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:46:22.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:22 gibba044 bash[25485]: audit 2021-03-10T20:46:21.012337+0000 mon.a (mon.0) 1102 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:46:22.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:22 gibba044 bash[25485]: audit 2021-03-10T20:46:21.013739+0000 mon.a (mon.0) 1103 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:22.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:22 gibba044 bash[25485]: cephadm 2021-03-10T20:46:21.013937+0000 mgr.gibba044.wflcwh (mgr.34466) 2041 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:46:22.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:22 gibba044 bash[25485]: cephadm 2021-03-10T20:46:21.015110+0000 mgr.gibba044.wflcwh (mgr.34466) 2042 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:46:22.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:22 gibba044 bash[25485]: cephadm 2021-03-10T20:46:21.015147+0000 mgr.gibba044.wflcwh (mgr.34466) 2043 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:46:22.508 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:22 gibba044 bash[25485]: audit 2021-03-10T20:46:21.015177+0000 mon.a (mon.0) 1104 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:22.509 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:22 gibba044 bash[25485]: audit 2021-03-10T20:46:21.016509+0000 mon.a (mon.0) 1105 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:22.509 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:22 gibba044 bash[25485]: cephadm 2021-03-10T20:46:21.016566+0000 mgr.gibba044.wflcwh (mgr.34466) 2044 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:46:22.510 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:22 gibba044 bash[25485]: cephadm 2021-03-10T20:46:21.016602+0000 mgr.gibba044.wflcwh (mgr.34466) 2045 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:46:22.510 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:22 gibba044 bash[25485]: cephadm 2021-03-10T20:46:21.018191+0000 mgr.gibba044.wflcwh (mgr.34466) 2046 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:46:22.511 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:22 gibba044 bash[25485]: audit 2021-03-10T20:46:21.018986+0000 mon.a (mon.0) 1106 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:22.511 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:22 gibba044 bash[25485]: cephadm 2021-03-10T20:46:21.019093+0000 mgr.gibba044.wflcwh (mgr.34466) 2047 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:46:22.511 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:22 gibba044 bash[25485]: cephadm 2021-03-10T20:46:21.019132+0000 mgr.gibba044.wflcwh (mgr.34466) 2048 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:46:22.512 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:22 gibba044 bash[25485]: cephadm 2021-03-10T20:46:21.020569+0000 mgr.gibba044.wflcwh (mgr.34466) 2049 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:46:22.512 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:22 gibba044 bash[25485]: audit 2021-03-10T20:46:21.020736+0000 mon.a (mon.0) 1107 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:22.513 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:22 gibba044 bash[25485]: cephadm 2021-03-10T20:46:21.020883+0000 mgr.gibba044.wflcwh (mgr.34466) 2050 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:46:22.513 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:22 gibba044 bash[25485]: cephadm 2021-03-10T20:46:21.022060+0000 mgr.gibba044.wflcwh (mgr.34466) 2051 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:46:22.514 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:22 gibba044 bash[25485]: cephadm 2021-03-10T20:46:21.022098+0000 mgr.gibba044.wflcwh (mgr.34466) 2052 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:46:22.514 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:22 gibba044 bash[25485]: cephadm 2021-03-10T20:46:21.022235+0000 mgr.gibba044.wflcwh (mgr.34466) 2053 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:46:24.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:24 gibba023 bash[30844]: cluster 2021-03-10T20:46:22.873245+0000 mgr.gibba044.wflcwh (mgr.34466) 2054 : cluster [DBG] pgmap v1152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:24.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:24 gibba023 bash[31815]: cluster 2021-03-10T20:46:22.873245+0000 mgr.gibba044.wflcwh (mgr.34466) 2054 : cluster [DBG] pgmap v1152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:24.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:24 gibba044 bash[25485]: cluster 2021-03-10T20:46:22.873245+0000 mgr.gibba044.wflcwh (mgr.34466) 2054 : cluster [DBG] pgmap v1152: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:26.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:26 gibba023 bash[30844]: cluster 2021-03-10T20:46:24.874474+0000 mgr.gibba044.wflcwh (mgr.34466) 2055 : cluster [DBG] pgmap v1153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:26.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:26 gibba023 bash[31815]: cluster 2021-03-10T20:46:24.874474+0000 mgr.gibba044.wflcwh (mgr.34466) 2055 : cluster [DBG] pgmap v1153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:26.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:26 gibba044 bash[25485]: cluster 2021-03-10T20:46:24.874474+0000 mgr.gibba044.wflcwh (mgr.34466) 2055 : cluster [DBG] pgmap v1153: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:28.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:28 gibba023 bash[30844]: cluster 2021-03-10T20:46:26.876099+0000 mgr.gibba044.wflcwh (mgr.34466) 2056 : cluster [DBG] pgmap v1154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:28.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:28 gibba023 bash[30844]: audit 2021-03-10T20:46:27.264008+0000 mon.a (mon.0) 1108 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:46:28.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:28 gibba023 bash[30844]: audit 2021-03-10T20:46:27.264659+0000 mon.a (mon.0) 1109 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:46:28.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:28 gibba023 bash[30844]: audit 2021-03-10T20:46:27.277368+0000 mon.a (mon.0) 1110 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T20:46:28.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:28 gibba023 bash[30844]: audit 2021-03-10T20:46:27.278164+0000 mon.a (mon.0) 1111 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:46:28.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:28 gibba023 bash[30844]: audit 2021-03-10T20:46:27.278943+0000 mon.a (mon.0) 1112 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:46:28.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:28 gibba023 bash[30844]: audit 2021-03-10T20:46:27.279656+0000 mon.a (mon.0) 1113 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:46:28.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:28 gibba023 bash[31815]: cluster 2021-03-10T20:46:26.876099+0000 mgr.gibba044.wflcwh (mgr.34466) 2056 : cluster [DBG] pgmap v1154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:28.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:28 gibba023 bash[31815]: audit 2021-03-10T20:46:27.264008+0000 mon.a (mon.0) 1108 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:46:28.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:28 gibba023 bash[31815]: audit 2021-03-10T20:46:27.264659+0000 mon.a (mon.0) 1109 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:46:28.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:28 gibba023 bash[31815]: audit 2021-03-10T20:46:27.277368+0000 mon.a (mon.0) 1110 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T20:46:28.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:28 gibba023 bash[31815]: audit 2021-03-10T20:46:27.278164+0000 mon.a (mon.0) 1111 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:46:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:28 gibba023 bash[31815]: audit 2021-03-10T20:46:27.278943+0000 mon.a (mon.0) 1112 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:46:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:28 gibba023 bash[31815]: audit 2021-03-10T20:46:27.279656+0000 mon.a (mon.0) 1113 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:46:28.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:28 gibba044 bash[25485]: cluster 2021-03-10T20:46:26.876099+0000 mgr.gibba044.wflcwh (mgr.34466) 2056 : cluster [DBG] pgmap v1154: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:28.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:28 gibba044 bash[25485]: audit 2021-03-10T20:46:27.264008+0000 mon.a (mon.0) 1108 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:46:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:28 gibba044 bash[25485]: audit 2021-03-10T20:46:27.264659+0000 mon.a (mon.0) 1109 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:46:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:28 gibba044 bash[25485]: audit 2021-03-10T20:46:27.277368+0000 mon.a (mon.0) 1110 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [7, 2]}]: dispatch 2021-03-10T20:46:28.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:28 gibba044 bash[25485]: audit 2021-03-10T20:46:27.278164+0000 mon.a (mon.0) 1111 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:46:28.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:28 gibba044 bash[25485]: audit 2021-03-10T20:46:27.278943+0000 mon.a (mon.0) 1112 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:46:28.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:28 gibba044 bash[25485]: audit 2021-03-10T20:46:27.279656+0000 mon.a (mon.0) 1113 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:46:30.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:30 gibba023 bash[30844]: cluster 2021-03-10T20:46:28.877933+0000 mgr.gibba044.wflcwh (mgr.34466) 2057 : cluster [DBG] pgmap v1155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:30.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:30 gibba023 bash[31815]: cluster 2021-03-10T20:46:28.877933+0000 mgr.gibba044.wflcwh (mgr.34466) 2057 : cluster [DBG] pgmap v1155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:30.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:30 gibba044 bash[25485]: cluster 2021-03-10T20:46:28.877933+0000 mgr.gibba044.wflcwh (mgr.34466) 2057 : cluster [DBG] pgmap v1155: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:32.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:32 gibba023 bash[30844]: cluster 2021-03-10T20:46:30.879550+0000 mgr.gibba044.wflcwh (mgr.34466) 2058 : cluster [DBG] pgmap v1156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:32.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:32 gibba023 bash[31815]: cluster 2021-03-10T20:46:30.879550+0000 mgr.gibba044.wflcwh (mgr.34466) 2058 : cluster [DBG] pgmap v1156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:32.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:32 gibba044 bash[25485]: cluster 2021-03-10T20:46:30.879550+0000 mgr.gibba044.wflcwh (mgr.34466) 2058 : cluster [DBG] pgmap v1156: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:34.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:34 gibba023 bash[30844]: cluster 2021-03-10T20:46:32.881361+0000 mgr.gibba044.wflcwh (mgr.34466) 2059 : cluster [DBG] pgmap v1157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:34.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:34 gibba023 bash[31815]: cluster 2021-03-10T20:46:32.881361+0000 mgr.gibba044.wflcwh (mgr.34466) 2059 : cluster [DBG] pgmap v1157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:34.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:34 gibba044 bash[25485]: cluster 2021-03-10T20:46:32.881361+0000 mgr.gibba044.wflcwh (mgr.34466) 2059 : cluster [DBG] pgmap v1157: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:36.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:36 gibba023 bash[30844]: cluster 2021-03-10T20:46:34.882585+0000 mgr.gibba044.wflcwh (mgr.34466) 2060 : cluster [DBG] pgmap v1158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:36.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:36 gibba023 bash[31815]: cluster 2021-03-10T20:46:34.882585+0000 mgr.gibba044.wflcwh (mgr.34466) 2060 : cluster [DBG] pgmap v1158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:36.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:36 gibba044 bash[25485]: cluster 2021-03-10T20:46:34.882585+0000 mgr.gibba044.wflcwh (mgr.34466) 2060 : cluster [DBG] pgmap v1158: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:37.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:37 gibba023 bash[30844]: cephadm 2021-03-10T20:46:36.038258+0000 mgr.gibba044.wflcwh (mgr.34466) 2061 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:46:37.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:37 gibba023 bash[31815]: cephadm 2021-03-10T20:46:36.038258+0000 mgr.gibba044.wflcwh (mgr.34466) 2061 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:46:37.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:37 gibba044 bash[25485]: cephadm 2021-03-10T20:46:36.038258+0000 mgr.gibba044.wflcwh (mgr.34466) 2061 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:46:38.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:38 gibba023 bash[30844]: cluster 2021-03-10T20:46:36.884251+0000 mgr.gibba044.wflcwh (mgr.34466) 2062 : cluster [DBG] pgmap v1159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:38.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:38 gibba023 bash[31815]: cluster 2021-03-10T20:46:36.884251+0000 mgr.gibba044.wflcwh (mgr.34466) 2062 : cluster [DBG] pgmap v1159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:38.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:38 gibba044 bash[25485]: cluster 2021-03-10T20:46:36.884251+0000 mgr.gibba044.wflcwh (mgr.34466) 2062 : cluster [DBG] pgmap v1159: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:38.959 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:46:39.185 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:46:39.186 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (37m) 3m ago 43m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:46:39.186 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (43m) 2m ago 43m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:46:39.187 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (38m) 2m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:46:39.187 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (38m) 2m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:46:39.188 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (37m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:46:39.188 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (37m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:46:39.189 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (36m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:46:39.189 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (37m) 3m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:46:39.189 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (43m) 3m ago 43m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:46:39.190 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (43m) 2m ago 43m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:46:39.191 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (36m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:46:39.192 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (35m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:46:39.192 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (35m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:46:39.192 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (34m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:46:39.193 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (34m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:46:39.193 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (33m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:46:39.195 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (33m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:46:39.195 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (32m) 2m ago 43m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:46:39.195 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (42m) 2m ago 43m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:46:39.196 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 3m ago 41m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:46:39.196 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 2m ago 41m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:46:39.435 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:46:39.436 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:46:39.436 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:46:39.436 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:46:39.436 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:46:39.437 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:46:39.437 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:46:39.437 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:46:39.437 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:46:39.438 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:46:39.438 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:46:39.438 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:46:39.438 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:46:39.438 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:46:39.439 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:46:40.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:40 gibba023 bash[30844]: cluster 2021-03-10T20:46:38.886015+0000 mgr.gibba044.wflcwh (mgr.34466) 2063 : cluster [DBG] pgmap v1160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:40.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:40 gibba023 bash[30844]: audit 2021-03-10T20:46:38.950795+0000 mgr.gibba044.wflcwh (mgr.34466) 2064 : audit [DBG] from='client.55423 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:46:40.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:40 gibba023 bash[30844]: audit 2021-03-10T20:46:39.177160+0000 mgr.gibba044.wflcwh (mgr.34466) 2065 : audit [DBG] from='client.55429 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:46:40.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:40 gibba023 bash[30844]: audit 2021-03-10T20:46:39.436003+0000 mon.c (mon.1) 52 : audit [DBG] from='client.? 172.21.2.123:0/2250742315' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:40.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:40 gibba023 bash[31815]: cluster 2021-03-10T20:46:38.886015+0000 mgr.gibba044.wflcwh (mgr.34466) 2063 : cluster [DBG] pgmap v1160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:40.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:40 gibba023 bash[31815]: audit 2021-03-10T20:46:38.950795+0000 mgr.gibba044.wflcwh (mgr.34466) 2064 : audit [DBG] from='client.55423 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:46:40.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:40 gibba023 bash[31815]: audit 2021-03-10T20:46:39.177160+0000 mgr.gibba044.wflcwh (mgr.34466) 2065 : audit [DBG] from='client.55429 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:46:40.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:40 gibba023 bash[31815]: audit 2021-03-10T20:46:39.436003+0000 mon.c (mon.1) 52 : audit [DBG] from='client.? 172.21.2.123:0/2250742315' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:40.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:40 gibba044 bash[25485]: cluster 2021-03-10T20:46:38.886015+0000 mgr.gibba044.wflcwh (mgr.34466) 2063 : cluster [DBG] pgmap v1160: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:40.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:40 gibba044 bash[25485]: audit 2021-03-10T20:46:38.950795+0000 mgr.gibba044.wflcwh (mgr.34466) 2064 : audit [DBG] from='client.55423 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:46:40.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:40 gibba044 bash[25485]: audit 2021-03-10T20:46:39.177160+0000 mgr.gibba044.wflcwh (mgr.34466) 2065 : audit [DBG] from='client.55429 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:46:40.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:40 gibba044 bash[25485]: audit 2021-03-10T20:46:39.436003+0000 mon.c (mon.1) 52 : audit [DBG] from='client.? 172.21.2.123:0/2250742315' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:46:42.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:42 gibba023 bash[30844]: cluster 2021-03-10T20:46:40.887590+0000 mgr.gibba044.wflcwh (mgr.34466) 2066 : cluster [DBG] pgmap v1161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:42.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:42 gibba023 bash[31815]: cluster 2021-03-10T20:46:40.887590+0000 mgr.gibba044.wflcwh (mgr.34466) 2066 : cluster [DBG] pgmap v1161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:42.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:42 gibba044 bash[25485]: cluster 2021-03-10T20:46:40.887590+0000 mgr.gibba044.wflcwh (mgr.34466) 2066 : cluster [DBG] pgmap v1161: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:44.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:44 gibba023 bash[30844]: cluster 2021-03-10T20:46:42.889122+0000 mgr.gibba044.wflcwh (mgr.34466) 2067 : cluster [DBG] pgmap v1162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:44.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:44 gibba023 bash[31815]: cluster 2021-03-10T20:46:42.889122+0000 mgr.gibba044.wflcwh (mgr.34466) 2067 : cluster [DBG] pgmap v1162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:44.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:44 gibba044 bash[25485]: cluster 2021-03-10T20:46:42.889122+0000 mgr.gibba044.wflcwh (mgr.34466) 2067 : cluster [DBG] pgmap v1162: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:46.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:46 gibba044 bash[25485]: cluster 2021-03-10T20:46:44.890352+0000 mgr.gibba044.wflcwh (mgr.34466) 2068 : cluster [DBG] pgmap v1163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:46.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:46 gibba023 bash[30844]: cluster 2021-03-10T20:46:44.890352+0000 mgr.gibba044.wflcwh (mgr.34466) 2068 : cluster [DBG] pgmap v1163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:46.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:46 gibba023 bash[31815]: cluster 2021-03-10T20:46:44.890352+0000 mgr.gibba044.wflcwh (mgr.34466) 2068 : cluster [DBG] pgmap v1163: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:48.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:48 gibba044 bash[25485]: cluster 2021-03-10T20:46:46.891941+0000 mgr.gibba044.wflcwh (mgr.34466) 2069 : cluster [DBG] pgmap v1164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:48.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:48 gibba023 bash[30844]: cluster 2021-03-10T20:46:46.891941+0000 mgr.gibba044.wflcwh (mgr.34466) 2069 : cluster [DBG] pgmap v1164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:48.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:48 gibba023 bash[31815]: cluster 2021-03-10T20:46:46.891941+0000 mgr.gibba044.wflcwh (mgr.34466) 2069 : cluster [DBG] pgmap v1164: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:50.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:50 gibba044 bash[25485]: cluster 2021-03-10T20:46:48.893467+0000 mgr.gibba044.wflcwh (mgr.34466) 2070 : cluster [DBG] pgmap v1165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:50.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:50 gibba023 bash[30844]: cluster 2021-03-10T20:46:48.893467+0000 mgr.gibba044.wflcwh (mgr.34466) 2070 : cluster [DBG] pgmap v1165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:50.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:50 gibba023 bash[31815]: cluster 2021-03-10T20:46:48.893467+0000 mgr.gibba044.wflcwh (mgr.34466) 2070 : cluster [DBG] pgmap v1165: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:52.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:52 gibba044 bash[25485]: cluster 2021-03-10T20:46:50.894907+0000 mgr.gibba044.wflcwh (mgr.34466) 2071 : cluster [DBG] pgmap v1166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:52.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:52 gibba044 bash[25485]: cephadm 2021-03-10T20:46:51.054304+0000 mgr.gibba044.wflcwh (mgr.34466) 2072 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:46:52.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:52 gibba023 bash[30844]: cluster 2021-03-10T20:46:50.894907+0000 mgr.gibba044.wflcwh (mgr.34466) 2071 : cluster [DBG] pgmap v1166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:52.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:52 gibba023 bash[30844]: cephadm 2021-03-10T20:46:51.054304+0000 mgr.gibba044.wflcwh (mgr.34466) 2072 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:46:52.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:52 gibba023 bash[31815]: cluster 2021-03-10T20:46:50.894907+0000 mgr.gibba044.wflcwh (mgr.34466) 2071 : cluster [DBG] pgmap v1166: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:52.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:52 gibba023 bash[31815]: cephadm 2021-03-10T20:46:51.054304+0000 mgr.gibba044.wflcwh (mgr.34466) 2072 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:46:54.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:54 gibba044 bash[25485]: cluster 2021-03-10T20:46:52.896650+0000 mgr.gibba044.wflcwh (mgr.34466) 2073 : cluster [DBG] pgmap v1167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:54.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:54 gibba023 bash[30844]: cluster 2021-03-10T20:46:52.896650+0000 mgr.gibba044.wflcwh (mgr.34466) 2073 : cluster [DBG] pgmap v1167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:54.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:54 gibba023 bash[31815]: cluster 2021-03-10T20:46:52.896650+0000 mgr.gibba044.wflcwh (mgr.34466) 2073 : cluster [DBG] pgmap v1167: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:56.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:56 gibba044 bash[25485]: cluster 2021-03-10T20:46:54.897852+0000 mgr.gibba044.wflcwh (mgr.34466) 2074 : cluster [DBG] pgmap v1168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:56.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:56 gibba023 bash[30844]: cluster 2021-03-10T20:46:54.897852+0000 mgr.gibba044.wflcwh (mgr.34466) 2074 : cluster [DBG] pgmap v1168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:56.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:56 gibba023 bash[31815]: cluster 2021-03-10T20:46:54.897852+0000 mgr.gibba044.wflcwh (mgr.34466) 2074 : cluster [DBG] pgmap v1168: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:58.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:46:58 gibba044 bash[25485]: cluster 2021-03-10T20:46:56.898792+0000 mgr.gibba044.wflcwh (mgr.34466) 2075 : cluster [DBG] pgmap v1169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:58.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:46:58 gibba023 bash[30844]: cluster 2021-03-10T20:46:56.898792+0000 mgr.gibba044.wflcwh (mgr.34466) 2075 : cluster [DBG] pgmap v1169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:46:58.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:46:58 gibba023 bash[31815]: cluster 2021-03-10T20:46:56.898792+0000 mgr.gibba044.wflcwh (mgr.34466) 2075 : cluster [DBG] pgmap v1169: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:00.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:00 gibba044 bash[25485]: cluster 2021-03-10T20:46:58.900224+0000 mgr.gibba044.wflcwh (mgr.34466) 2076 : cluster [DBG] pgmap v1170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:00.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:00 gibba023 bash[30844]: cluster 2021-03-10T20:46:58.900224+0000 mgr.gibba044.wflcwh (mgr.34466) 2076 : cluster [DBG] pgmap v1170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:00.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:00 gibba023 bash[31815]: cluster 2021-03-10T20:46:58.900224+0000 mgr.gibba044.wflcwh (mgr.34466) 2076 : cluster [DBG] pgmap v1170: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:01.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:01 gibba023 bash[30844]: cluster 2021-03-10T20:47:00.901683+0000 mgr.gibba044.wflcwh (mgr.34466) 2077 : cluster [DBG] pgmap v1171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:01.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:01 gibba023 bash[31815]: cluster 2021-03-10T20:47:00.901683+0000 mgr.gibba044.wflcwh (mgr.34466) 2077 : cluster [DBG] pgmap v1171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:01.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:01 gibba044 bash[25485]: cluster 2021-03-10T20:47:00.901683+0000 mgr.gibba044.wflcwh (mgr.34466) 2077 : cluster [DBG] pgmap v1171: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:04.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:04 gibba023 bash[30844]: cluster 2021-03-10T20:47:02.902239+0000 mgr.gibba044.wflcwh (mgr.34466) 2078 : cluster [DBG] pgmap v1172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:04.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:04 gibba023 bash[31815]: cluster 2021-03-10T20:47:02.902239+0000 mgr.gibba044.wflcwh (mgr.34466) 2078 : cluster [DBG] pgmap v1172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:04.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:04 gibba044 bash[25485]: cluster 2021-03-10T20:47:02.902239+0000 mgr.gibba044.wflcwh (mgr.34466) 2078 : cluster [DBG] pgmap v1172: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:06.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:06 gibba023 bash[30844]: cluster 2021-03-10T20:47:04.903308+0000 mgr.gibba044.wflcwh (mgr.34466) 2079 : cluster [DBG] pgmap v1173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:06.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:06 gibba023 bash[31815]: cluster 2021-03-10T20:47:04.903308+0000 mgr.gibba044.wflcwh (mgr.34466) 2079 : cluster [DBG] pgmap v1173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:06.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:06 gibba044 bash[25485]: cluster 2021-03-10T20:47:04.903308+0000 mgr.gibba044.wflcwh (mgr.34466) 2079 : cluster [DBG] pgmap v1173: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:07.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:07 gibba023 bash[30844]: cephadm 2021-03-10T20:47:06.070414+0000 mgr.gibba044.wflcwh (mgr.34466) 2080 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:47:07.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:07 gibba023 bash[31815]: cephadm 2021-03-10T20:47:06.070414+0000 mgr.gibba044.wflcwh (mgr.34466) 2080 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:47:07.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:07 gibba044 bash[25485]: cephadm 2021-03-10T20:47:06.070414+0000 mgr.gibba044.wflcwh (mgr.34466) 2080 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:47:08.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:08 gibba023 bash[30844]: cluster 2021-03-10T20:47:06.904996+0000 mgr.gibba044.wflcwh (mgr.34466) 2081 : cluster [DBG] pgmap v1174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:08.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:08 gibba023 bash[31815]: cluster 2021-03-10T20:47:06.904996+0000 mgr.gibba044.wflcwh (mgr.34466) 2081 : cluster [DBG] pgmap v1174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:08.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:08 gibba044 bash[25485]: cluster 2021-03-10T20:47:06.904996+0000 mgr.gibba044.wflcwh (mgr.34466) 2081 : cluster [DBG] pgmap v1174: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:09.679 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:47:09.935 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:47:09.935 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (38m) 3m ago 43m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:47:09.935 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (43m) 2m ago 43m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:47:09.936 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (38m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:47:09.936 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (38m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:47:09.936 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (37m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:47:09.937 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (37m) 3m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:47:09.937 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (37m) 2m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:47:09.938 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (37m) 3m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:47:09.938 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (43m) 3m ago 44m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:47:09.938 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (43m) 2m ago 44m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:47:09.939 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (36m) 3m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:47:09.939 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (36m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:47:09.939 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (35m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:47:09.940 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (35m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:47:09.940 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (34m) 2m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:47:09.941 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (34m) 2m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:47:09.941 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (33m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:47:09.941 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (33m) 2m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:47:09.942 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (43m) 2m ago 44m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:47:09.942 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 3m ago 41m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:47:09.943 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 2m ago 41m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:47:10.184 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:47:10.185 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:47:10.185 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:47:10.186 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:47:10.186 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:47:10.187 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:47:10.187 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:47:10.187 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:47:10.188 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:47:10.188 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:47:10.189 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:47:10.189 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:47:10.189 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:47:10.190 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:47:10.190 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:47:10.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:10 gibba023 bash[30844]: cluster 2021-03-10T20:47:08.905673+0000 mgr.gibba044.wflcwh (mgr.34466) 2082 : cluster [DBG] pgmap v1175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:10.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:10 gibba023 bash[31815]: cluster 2021-03-10T20:47:08.905673+0000 mgr.gibba044.wflcwh (mgr.34466) 2082 : cluster [DBG] pgmap v1175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:10.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:10 gibba044 bash[25485]: cluster 2021-03-10T20:47:08.905673+0000 mgr.gibba044.wflcwh (mgr.34466) 2082 : cluster [DBG] pgmap v1175: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:11.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:11 gibba023 bash[30844]: audit 2021-03-10T20:47:09.671979+0000 mgr.gibba044.wflcwh (mgr.34466) 2083 : audit [DBG] from='client.55441 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:47:11.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:11 gibba023 bash[30844]: audit 2021-03-10T20:47:09.895575+0000 mgr.gibba044.wflcwh (mgr.34466) 2084 : audit [DBG] from='client.55447 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:47:11.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:11 gibba023 bash[30844]: audit 2021-03-10T20:47:10.184900+0000 mon.c (mon.1) 53 : audit [DBG] from='client.? 172.21.2.123:0/3316806917' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:11.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:11 gibba023 bash[31815]: audit 2021-03-10T20:47:09.671979+0000 mgr.gibba044.wflcwh (mgr.34466) 2083 : audit [DBG] from='client.55441 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:47:11.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:11 gibba023 bash[31815]: audit 2021-03-10T20:47:09.895575+0000 mgr.gibba044.wflcwh (mgr.34466) 2084 : audit [DBG] from='client.55447 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:47:11.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:11 gibba023 bash[31815]: audit 2021-03-10T20:47:10.184900+0000 mon.c (mon.1) 53 : audit [DBG] from='client.? 172.21.2.123:0/3316806917' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:11.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:11 gibba044 bash[25485]: audit 2021-03-10T20:47:09.671979+0000 mgr.gibba044.wflcwh (mgr.34466) 2083 : audit [DBG] from='client.55441 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:47:11.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:11 gibba044 bash[25485]: audit 2021-03-10T20:47:09.895575+0000 mgr.gibba044.wflcwh (mgr.34466) 2084 : audit [DBG] from='client.55447 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:47:11.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:11 gibba044 bash[25485]: audit 2021-03-10T20:47:10.184900+0000 mon.c (mon.1) 53 : audit [DBG] from='client.? 172.21.2.123:0/3316806917' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:12.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:12 gibba023 bash[30844]: cluster 2021-03-10T20:47:10.907242+0000 mgr.gibba044.wflcwh (mgr.34466) 2085 : cluster [DBG] pgmap v1176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:12.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:12 gibba023 bash[31815]: cluster 2021-03-10T20:47:10.907242+0000 mgr.gibba044.wflcwh (mgr.34466) 2085 : cluster [DBG] pgmap v1176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:12.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:12 gibba044 bash[25485]: cluster 2021-03-10T20:47:10.907242+0000 mgr.gibba044.wflcwh (mgr.34466) 2085 : cluster [DBG] pgmap v1176: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:14.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:14 gibba023 bash[30844]: cluster 2021-03-10T20:47:12.908894+0000 mgr.gibba044.wflcwh (mgr.34466) 2086 : cluster [DBG] pgmap v1177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:14.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:14 gibba023 bash[31815]: cluster 2021-03-10T20:47:12.908894+0000 mgr.gibba044.wflcwh (mgr.34466) 2086 : cluster [DBG] pgmap v1177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:14.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:14 gibba044 bash[25485]: cluster 2021-03-10T20:47:12.908894+0000 mgr.gibba044.wflcwh (mgr.34466) 2086 : cluster [DBG] pgmap v1177: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:16.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:16 gibba023 bash[30844]: cluster 2021-03-10T20:47:14.909356+0000 mgr.gibba044.wflcwh (mgr.34466) 2087 : cluster [DBG] pgmap v1178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:16.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:16 gibba023 bash[31815]: cluster 2021-03-10T20:47:14.909356+0000 mgr.gibba044.wflcwh (mgr.34466) 2087 : cluster [DBG] pgmap v1178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:16.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:16 gibba044 bash[25485]: cluster 2021-03-10T20:47:14.909356+0000 mgr.gibba044.wflcwh (mgr.34466) 2087 : cluster [DBG] pgmap v1178: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:18.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:18 gibba023 bash[30844]: cluster 2021-03-10T20:47:16.910720+0000 mgr.gibba044.wflcwh (mgr.34466) 2088 : cluster [DBG] pgmap v1179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:18.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:18 gibba023 bash[31815]: cluster 2021-03-10T20:47:16.910720+0000 mgr.gibba044.wflcwh (mgr.34466) 2088 : cluster [DBG] pgmap v1179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:18.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:18 gibba044 bash[25485]: cluster 2021-03-10T20:47:16.910720+0000 mgr.gibba044.wflcwh (mgr.34466) 2088 : cluster [DBG] pgmap v1179: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:20.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:20 gibba023 bash[30844]: cluster 2021-03-10T20:47:18.912496+0000 mgr.gibba044.wflcwh (mgr.34466) 2089 : cluster [DBG] pgmap v1180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:20.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:20 gibba023 bash[31815]: cluster 2021-03-10T20:47:18.912496+0000 mgr.gibba044.wflcwh (mgr.34466) 2089 : cluster [DBG] pgmap v1180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:20.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:20 gibba044 bash[25485]: cluster 2021-03-10T20:47:18.912496+0000 mgr.gibba044.wflcwh (mgr.34466) 2089 : cluster [DBG] pgmap v1180: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:22.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:22 gibba023 bash[30844]: cluster 2021-03-10T20:47:20.913995+0000 mgr.gibba044.wflcwh (mgr.34466) 2090 : cluster [DBG] pgmap v1181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:22.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:22 gibba023 bash[30844]: cephadm 2021-03-10T20:47:21.086942+0000 mgr.gibba044.wflcwh (mgr.34466) 2091 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:47:22.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:22 gibba023 bash[30844]: cephadm 2021-03-10T20:47:21.088584+0000 mgr.gibba044.wflcwh (mgr.34466) 2092 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:47:22.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:22 gibba023 bash[30844]: audit 2021-03-10T20:47:21.313094+0000 mon.a (mon.0) 1114 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:47:22.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:22 gibba023 bash[30844]: audit 2021-03-10T20:47:21.316589+0000 mon.a (mon.0) 1115 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:47:22.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:22 gibba023 bash[30844]: audit 2021-03-10T20:47:21.318133+0000 mon.a (mon.0) 1116 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:22.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:22 gibba023 bash[30844]: audit 2021-03-10T20:47:21.319680+0000 mon.a (mon.0) 1117 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:22.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:22 gibba023 bash[30844]: audit 2021-03-10T20:47:21.321099+0000 mon.a (mon.0) 1118 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:22.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:22 gibba023 bash[30844]: audit 2021-03-10T20:47:21.323896+0000 mon.a (mon.0) 1119 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:22.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:22 gibba023 bash[30844]: audit 2021-03-10T20:47:21.325585+0000 mon.a (mon.0) 1120 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:22.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:22 gibba023 bash[31815]: cluster 2021-03-10T20:47:20.913995+0000 mgr.gibba044.wflcwh (mgr.34466) 2090 : cluster [DBG] pgmap v1181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:22.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:22 gibba023 bash[31815]: cephadm 2021-03-10T20:47:21.086942+0000 mgr.gibba044.wflcwh (mgr.34466) 2091 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:47:22.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:22 gibba023 bash[31815]: cephadm 2021-03-10T20:47:21.088584+0000 mgr.gibba044.wflcwh (mgr.34466) 2092 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:47:22.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:22 gibba023 bash[31815]: audit 2021-03-10T20:47:21.313094+0000 mon.a (mon.0) 1114 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:47:22.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:22 gibba023 bash[31815]: audit 2021-03-10T20:47:21.316589+0000 mon.a (mon.0) 1115 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:47:22.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:22 gibba023 bash[31815]: audit 2021-03-10T20:47:21.318133+0000 mon.a (mon.0) 1116 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:22.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:22 gibba023 bash[31815]: audit 2021-03-10T20:47:21.319680+0000 mon.a (mon.0) 1117 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:22.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:22 gibba023 bash[31815]: audit 2021-03-10T20:47:21.321099+0000 mon.a (mon.0) 1118 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:22.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:22 gibba023 bash[31815]: audit 2021-03-10T20:47:21.323896+0000 mon.a (mon.0) 1119 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:22.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:22 gibba023 bash[31815]: audit 2021-03-10T20:47:21.325585+0000 mon.a (mon.0) 1120 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:22.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:22 gibba044 bash[25485]: cluster 2021-03-10T20:47:20.913995+0000 mgr.gibba044.wflcwh (mgr.34466) 2090 : cluster [DBG] pgmap v1181: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:22.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:22 gibba044 bash[25485]: cephadm 2021-03-10T20:47:21.086942+0000 mgr.gibba044.wflcwh (mgr.34466) 2091 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:47:22.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:22 gibba044 bash[25485]: cephadm 2021-03-10T20:47:21.088584+0000 mgr.gibba044.wflcwh (mgr.34466) 2092 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:47:22.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:22 gibba044 bash[25485]: audit 2021-03-10T20:47:21.313094+0000 mon.a (mon.0) 1114 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:47:22.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:22 gibba044 bash[25485]: audit 2021-03-10T20:47:21.316589+0000 mon.a (mon.0) 1115 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:47:22.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:22 gibba044 bash[25485]: audit 2021-03-10T20:47:21.318133+0000 mon.a (mon.0) 1116 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:22.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:22 gibba044 bash[25485]: audit 2021-03-10T20:47:21.319680+0000 mon.a (mon.0) 1117 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:22.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:22 gibba044 bash[25485]: audit 2021-03-10T20:47:21.321099+0000 mon.a (mon.0) 1118 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:22.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:22 gibba044 bash[25485]: audit 2021-03-10T20:47:21.323896+0000 mon.a (mon.0) 1119 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:22.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:22 gibba044 bash[25485]: audit 2021-03-10T20:47:21.325585+0000 mon.a (mon.0) 1120 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:23.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:23 gibba044 bash[25485]: cephadm 2021-03-10T20:47:21.316197+0000 mgr.gibba044.wflcwh (mgr.34466) 2093 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:47:23.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:23 gibba044 bash[25485]: cephadm 2021-03-10T20:47:21.318102+0000 mgr.gibba044.wflcwh (mgr.34466) 2094 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:47:23.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:23 gibba044 bash[25485]: cephadm 2021-03-10T20:47:21.319556+0000 mgr.gibba044.wflcwh (mgr.34466) 2095 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:47:23.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:23 gibba044 bash[25485]: cephadm 2021-03-10T20:47:21.319597+0000 mgr.gibba044.wflcwh (mgr.34466) 2096 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:47:23.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:23 gibba044 bash[25485]: cephadm 2021-03-10T20:47:21.321058+0000 mgr.gibba044.wflcwh (mgr.34466) 2097 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:47:23.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:23 gibba044 bash[25485]: cephadm 2021-03-10T20:47:21.321098+0000 mgr.gibba044.wflcwh (mgr.34466) 2098 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:47:23.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:23 gibba044 bash[25485]: cephadm 2021-03-10T20:47:21.322461+0000 mgr.gibba044.wflcwh (mgr.34466) 2099 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:47:23.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:23 gibba044 bash[25485]: cephadm 2021-03-10T20:47:21.323673+0000 mgr.gibba044.wflcwh (mgr.34466) 2100 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:47:23.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:23 gibba044 bash[25485]: cephadm 2021-03-10T20:47:21.323713+0000 mgr.gibba044.wflcwh (mgr.34466) 2101 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:47:23.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:23 gibba044 bash[25485]: cephadm 2021-03-10T20:47:21.325250+0000 mgr.gibba044.wflcwh (mgr.34466) 2102 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:47:23.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:23 gibba044 bash[25485]: cephadm 2021-03-10T20:47:21.325609+0000 mgr.gibba044.wflcwh (mgr.34466) 2103 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:47:23.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:23 gibba044 bash[25485]: cephadm 2021-03-10T20:47:21.327044+0000 mgr.gibba044.wflcwh (mgr.34466) 2104 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:47:23.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:23 gibba044 bash[25485]: cephadm 2021-03-10T20:47:21.327086+0000 mgr.gibba044.wflcwh (mgr.34466) 2105 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:47:23.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:23 gibba044 bash[25485]: cephadm 2021-03-10T20:47:21.327228+0000 mgr.gibba044.wflcwh (mgr.34466) 2106 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:47:23.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:23 gibba023 bash[30844]: cephadm 2021-03-10T20:47:21.316197+0000 mgr.gibba044.wflcwh (mgr.34466) 2093 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:47:23.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:23 gibba023 bash[30844]: cephadm 2021-03-10T20:47:21.318102+0000 mgr.gibba044.wflcwh (mgr.34466) 2094 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:47:23.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:23 gibba023 bash[30844]: cephadm 2021-03-10T20:47:21.319556+0000 mgr.gibba044.wflcwh (mgr.34466) 2095 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:47:23.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:23 gibba023 bash[30844]: cephadm 2021-03-10T20:47:21.319597+0000 mgr.gibba044.wflcwh (mgr.34466) 2096 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:47:23.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:23 gibba023 bash[30844]: cephadm 2021-03-10T20:47:21.321058+0000 mgr.gibba044.wflcwh (mgr.34466) 2097 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:47:23.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:23 gibba023 bash[30844]: cephadm 2021-03-10T20:47:21.321098+0000 mgr.gibba044.wflcwh (mgr.34466) 2098 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:47:23.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:23 gibba023 bash[30844]: cephadm 2021-03-10T20:47:21.322461+0000 mgr.gibba044.wflcwh (mgr.34466) 2099 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:47:23.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:23 gibba023 bash[30844]: cephadm 2021-03-10T20:47:21.323673+0000 mgr.gibba044.wflcwh (mgr.34466) 2100 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:47:23.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:23 gibba023 bash[30844]: cephadm 2021-03-10T20:47:21.323713+0000 mgr.gibba044.wflcwh (mgr.34466) 2101 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:47:23.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:23 gibba023 bash[30844]: cephadm 2021-03-10T20:47:21.325250+0000 mgr.gibba044.wflcwh (mgr.34466) 2102 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:47:23.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:23 gibba023 bash[30844]: cephadm 2021-03-10T20:47:21.325609+0000 mgr.gibba044.wflcwh (mgr.34466) 2103 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:47:23.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:23 gibba023 bash[30844]: cephadm 2021-03-10T20:47:21.327044+0000 mgr.gibba044.wflcwh (mgr.34466) 2104 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:47:23.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:23 gibba023 bash[30844]: cephadm 2021-03-10T20:47:21.327086+0000 mgr.gibba044.wflcwh (mgr.34466) 2105 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:47:23.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:23 gibba023 bash[30844]: cephadm 2021-03-10T20:47:21.327228+0000 mgr.gibba044.wflcwh (mgr.34466) 2106 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:47:23.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:23 gibba023 bash[31815]: cephadm 2021-03-10T20:47:21.316197+0000 mgr.gibba044.wflcwh (mgr.34466) 2093 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:47:23.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:23 gibba023 bash[31815]: cephadm 2021-03-10T20:47:21.318102+0000 mgr.gibba044.wflcwh (mgr.34466) 2094 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:47:23.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:23 gibba023 bash[31815]: cephadm 2021-03-10T20:47:21.319556+0000 mgr.gibba044.wflcwh (mgr.34466) 2095 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:47:23.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:23 gibba023 bash[31815]: cephadm 2021-03-10T20:47:21.319597+0000 mgr.gibba044.wflcwh (mgr.34466) 2096 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:47:23.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:23 gibba023 bash[31815]: cephadm 2021-03-10T20:47:21.321058+0000 mgr.gibba044.wflcwh (mgr.34466) 2097 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:47:23.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:23 gibba023 bash[31815]: cephadm 2021-03-10T20:47:21.321098+0000 mgr.gibba044.wflcwh (mgr.34466) 2098 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:47:23.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:23 gibba023 bash[31815]: cephadm 2021-03-10T20:47:21.322461+0000 mgr.gibba044.wflcwh (mgr.34466) 2099 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:47:23.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:23 gibba023 bash[31815]: cephadm 2021-03-10T20:47:21.323673+0000 mgr.gibba044.wflcwh (mgr.34466) 2100 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:47:23.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:23 gibba023 bash[31815]: cephadm 2021-03-10T20:47:21.323713+0000 mgr.gibba044.wflcwh (mgr.34466) 2101 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:47:23.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:23 gibba023 bash[31815]: cephadm 2021-03-10T20:47:21.325250+0000 mgr.gibba044.wflcwh (mgr.34466) 2102 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:47:23.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:23 gibba023 bash[31815]: cephadm 2021-03-10T20:47:21.325609+0000 mgr.gibba044.wflcwh (mgr.34466) 2103 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:47:23.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:23 gibba023 bash[31815]: cephadm 2021-03-10T20:47:21.327044+0000 mgr.gibba044.wflcwh (mgr.34466) 2104 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:47:23.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:23 gibba023 bash[31815]: cephadm 2021-03-10T20:47:21.327086+0000 mgr.gibba044.wflcwh (mgr.34466) 2105 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:47:23.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:23 gibba023 bash[31815]: cephadm 2021-03-10T20:47:21.327228+0000 mgr.gibba044.wflcwh (mgr.34466) 2106 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:47:24.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:24 gibba044 bash[25485]: cluster 2021-03-10T20:47:22.915715+0000 mgr.gibba044.wflcwh (mgr.34466) 2107 : cluster [DBG] pgmap v1182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:24.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:24 gibba023 bash[30844]: cluster 2021-03-10T20:47:22.915715+0000 mgr.gibba044.wflcwh (mgr.34466) 2107 : cluster [DBG] pgmap v1182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:24.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:24 gibba023 bash[31815]: cluster 2021-03-10T20:47:22.915715+0000 mgr.gibba044.wflcwh (mgr.34466) 2107 : cluster [DBG] pgmap v1182: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:26.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:26 gibba044 bash[25485]: cluster 2021-03-10T20:47:24.916974+0000 mgr.gibba044.wflcwh (mgr.34466) 2108 : cluster [DBG] pgmap v1183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:26.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:26 gibba023 bash[30844]: cluster 2021-03-10T20:47:24.916974+0000 mgr.gibba044.wflcwh (mgr.34466) 2108 : cluster [DBG] pgmap v1183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:26.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:26 gibba023 bash[31815]: cluster 2021-03-10T20:47:24.916974+0000 mgr.gibba044.wflcwh (mgr.34466) 2108 : cluster [DBG] pgmap v1183: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:28.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:28 gibba044 bash[25485]: cluster 2021-03-10T20:47:26.917728+0000 mgr.gibba044.wflcwh (mgr.34466) 2109 : cluster [DBG] pgmap v1184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:28.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:28 gibba044 bash[25485]: audit 2021-03-10T20:47:27.272087+0000 mon.a (mon.0) 1121 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:47:28.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:28 gibba044 bash[25485]: audit 2021-03-10T20:47:27.280335+0000 mon.a (mon.0) 1122 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:47:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:28 gibba044 bash[25485]: audit 2021-03-10T20:47:27.283189+0000 mon.a (mon.0) 1123 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T20:47:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:28 gibba044 bash[25485]: audit 2021-03-10T20:47:27.283977+0000 mon.a (mon.0) 1124 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:47:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:28 gibba044 bash[25485]: audit 2021-03-10T20:47:27.284658+0000 mon.a (mon.0) 1125 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T20:47:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:28 gibba044 bash[25485]: audit 2021-03-10T20:47:27.285314+0000 mon.a (mon.0) 1126 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:47:28.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:28 gibba023 bash[30844]: cluster 2021-03-10T20:47:26.917728+0000 mgr.gibba044.wflcwh (mgr.34466) 2109 : cluster [DBG] pgmap v1184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:28.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:28 gibba023 bash[30844]: audit 2021-03-10T20:47:27.272087+0000 mon.a (mon.0) 1121 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:47:28.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:28 gibba023 bash[30844]: audit 2021-03-10T20:47:27.280335+0000 mon.a (mon.0) 1122 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:47:28.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:28 gibba023 bash[30844]: audit 2021-03-10T20:47:27.283189+0000 mon.a (mon.0) 1123 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T20:47:28.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:28 gibba023 bash[30844]: audit 2021-03-10T20:47:27.283977+0000 mon.a (mon.0) 1124 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:47:28.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:28 gibba023 bash[30844]: audit 2021-03-10T20:47:27.284658+0000 mon.a (mon.0) 1125 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T20:47:28.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:28 gibba023 bash[30844]: audit 2021-03-10T20:47:27.285314+0000 mon.a (mon.0) 1126 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:47:28.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:28 gibba023 bash[31815]: cluster 2021-03-10T20:47:26.917728+0000 mgr.gibba044.wflcwh (mgr.34466) 2109 : cluster [DBG] pgmap v1184: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:28.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:28 gibba023 bash[31815]: audit 2021-03-10T20:47:27.272087+0000 mon.a (mon.0) 1121 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:47:28.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:28 gibba023 bash[31815]: audit 2021-03-10T20:47:27.280335+0000 mon.a (mon.0) 1122 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:47:28.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:28 gibba023 bash[31815]: audit 2021-03-10T20:47:27.283189+0000 mon.a (mon.0) 1123 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2021-03-10T20:47:28.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:28 gibba023 bash[31815]: audit 2021-03-10T20:47:27.283977+0000 mon.a (mon.0) 1124 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2021-03-10T20:47:28.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:28 gibba023 bash[31815]: audit 2021-03-10T20:47:27.284658+0000 mon.a (mon.0) 1125 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 5]}]: dispatch 2021-03-10T20:47:28.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:28 gibba023 bash[31815]: audit 2021-03-10T20:47:27.285314+0000 mon.a (mon.0) 1126 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T20:47:30.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:30 gibba044 bash[25485]: cluster 2021-03-10T20:47:28.919136+0000 mgr.gibba044.wflcwh (mgr.34466) 2110 : cluster [DBG] pgmap v1185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:30.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:30 gibba023 bash[30844]: cluster 2021-03-10T20:47:28.919136+0000 mgr.gibba044.wflcwh (mgr.34466) 2110 : cluster [DBG] pgmap v1185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:30.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:30 gibba023 bash[31815]: cluster 2021-03-10T20:47:28.919136+0000 mgr.gibba044.wflcwh (mgr.34466) 2110 : cluster [DBG] pgmap v1185: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:32.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:32 gibba044 bash[25485]: cluster 2021-03-10T20:47:30.921031+0000 mgr.gibba044.wflcwh (mgr.34466) 2111 : cluster [DBG] pgmap v1186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:32.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:32 gibba023 bash[30844]: cluster 2021-03-10T20:47:30.921031+0000 mgr.gibba044.wflcwh (mgr.34466) 2111 : cluster [DBG] pgmap v1186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:32.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:32 gibba023 bash[31815]: cluster 2021-03-10T20:47:30.921031+0000 mgr.gibba044.wflcwh (mgr.34466) 2111 : cluster [DBG] pgmap v1186: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:34.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:34 gibba044 bash[25485]: cluster 2021-03-10T20:47:32.921757+0000 mgr.gibba044.wflcwh (mgr.34466) 2112 : cluster [DBG] pgmap v1187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:34.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:34 gibba023 bash[30844]: cluster 2021-03-10T20:47:32.921757+0000 mgr.gibba044.wflcwh (mgr.34466) 2112 : cluster [DBG] pgmap v1187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:34.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:34 gibba023 bash[31815]: cluster 2021-03-10T20:47:32.921757+0000 mgr.gibba044.wflcwh (mgr.34466) 2112 : cluster [DBG] pgmap v1187: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:36.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:36 gibba044 bash[25485]: cluster 2021-03-10T20:47:34.923012+0000 mgr.gibba044.wflcwh (mgr.34466) 2113 : cluster [DBG] pgmap v1188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:36.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:36 gibba023 bash[30844]: cluster 2021-03-10T20:47:34.923012+0000 mgr.gibba044.wflcwh (mgr.34466) 2113 : cluster [DBG] pgmap v1188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:36.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:36 gibba023 bash[31815]: cluster 2021-03-10T20:47:34.923012+0000 mgr.gibba044.wflcwh (mgr.34466) 2113 : cluster [DBG] pgmap v1188: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:38.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:38 gibba044 bash[25485]: cephadm 2021-03-10T20:47:36.335184+0000 mgr.gibba044.wflcwh (mgr.34466) 2114 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:47:38.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:38 gibba044 bash[25485]: cluster 2021-03-10T20:47:36.924793+0000 mgr.gibba044.wflcwh (mgr.34466) 2115 : cluster [DBG] pgmap v1189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:38.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:38 gibba023 bash[30844]: cephadm 2021-03-10T20:47:36.335184+0000 mgr.gibba044.wflcwh (mgr.34466) 2114 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:47:38.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:38 gibba023 bash[30844]: cluster 2021-03-10T20:47:36.924793+0000 mgr.gibba044.wflcwh (mgr.34466) 2115 : cluster [DBG] pgmap v1189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:38.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:38 gibba023 bash[31815]: cephadm 2021-03-10T20:47:36.335184+0000 mgr.gibba044.wflcwh (mgr.34466) 2114 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:47:38.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:38 gibba023 bash[31815]: cluster 2021-03-10T20:47:36.924793+0000 mgr.gibba044.wflcwh (mgr.34466) 2115 : cluster [DBG] pgmap v1189: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:40.431 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:47:40.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:40 gibba044 bash[25485]: cluster 2021-03-10T20:47:38.925671+0000 mgr.gibba044.wflcwh (mgr.34466) 2116 : cluster [DBG] pgmap v1190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:40.660 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:47:40.661 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (38m) 4m ago 44m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:47:40.661 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (44m) 3m ago 44m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:47:40.661 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (39m) 3m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:47:40.662 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (39m) 3m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:47:40.662 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (38m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:47:40.663 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (38m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:47:40.663 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (37m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:47:40.663 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (38m) 4m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:47:40.664 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (44m) 4m ago 44m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:47:40.664 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (44m) 3m ago 44m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:47:40.665 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (37m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:47:40.665 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (36m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:47:40.666 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (36m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:47:40.666 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (35m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:47:40.666 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (35m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:47:40.667 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (34m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:47:40.667 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (34m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:47:40.668 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (34m) 3m ago 44m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:47:40.668 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (43m) 3m ago 44m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:47:40.669 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 4m ago 42m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:47:40.669 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 3m ago 42m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:47:40.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:40 gibba023 bash[30844]: cluster 2021-03-10T20:47:38.925671+0000 mgr.gibba044.wflcwh (mgr.34466) 2116 : cluster [DBG] pgmap v1190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:40.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:40 gibba023 bash[31815]: cluster 2021-03-10T20:47:38.925671+0000 mgr.gibba044.wflcwh (mgr.34466) 2116 : cluster [DBG] pgmap v1190: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:40.908 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:47:40.908 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:47:40.909 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:47:40.909 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:47:40.910 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:47:40.910 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:47:40.911 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:47:40.911 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:47:40.911 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:47:40.912 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:47:40.912 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:47:40.913 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:47:40.913 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:47:40.913 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:47:40.914 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:47:41.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:41 gibba023 bash[30844]: audit 2021-03-10T20:47:40.908435+0000 mon.c (mon.1) 54 : audit [DBG] from='client.? 172.21.2.123:0/1668727853' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:41.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:41 gibba023 bash[31815]: audit 2021-03-10T20:47:40.908435+0000 mon.c (mon.1) 54 : audit [DBG] from='client.? 172.21.2.123:0/1668727853' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:41.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:41 gibba044 bash[25485]: audit 2021-03-10T20:47:40.908435+0000 mon.c (mon.1) 54 : audit [DBG] from='client.? 172.21.2.123:0/1668727853' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:47:42.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:42 gibba023 bash[30844]: audit 2021-03-10T20:47:40.423331+0000 mgr.gibba044.wflcwh (mgr.34466) 2117 : audit [DBG] from='client.45480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:47:42.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:42 gibba023 bash[30844]: audit 2021-03-10T20:47:40.650387+0000 mgr.gibba044.wflcwh (mgr.34466) 2118 : audit [DBG] from='client.45486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:47:42.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:42 gibba023 bash[30844]: cluster 2021-03-10T20:47:40.927270+0000 mgr.gibba044.wflcwh (mgr.34466) 2119 : cluster [DBG] pgmap v1191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:42.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:42 gibba023 bash[31815]: audit 2021-03-10T20:47:40.423331+0000 mgr.gibba044.wflcwh (mgr.34466) 2117 : audit [DBG] from='client.45480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:47:42.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:42 gibba023 bash[31815]: audit 2021-03-10T20:47:40.650387+0000 mgr.gibba044.wflcwh (mgr.34466) 2118 : audit [DBG] from='client.45486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:47:42.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:42 gibba023 bash[31815]: cluster 2021-03-10T20:47:40.927270+0000 mgr.gibba044.wflcwh (mgr.34466) 2119 : cluster [DBG] pgmap v1191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:42.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:42 gibba044 bash[25485]: audit 2021-03-10T20:47:40.423331+0000 mgr.gibba044.wflcwh (mgr.34466) 2117 : audit [DBG] from='client.45480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:47:42.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:42 gibba044 bash[25485]: audit 2021-03-10T20:47:40.650387+0000 mgr.gibba044.wflcwh (mgr.34466) 2118 : audit [DBG] from='client.45486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:47:42.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:42 gibba044 bash[25485]: cluster 2021-03-10T20:47:40.927270+0000 mgr.gibba044.wflcwh (mgr.34466) 2119 : cluster [DBG] pgmap v1191: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:43.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:43 gibba023 bash[30844]: cluster 2021-03-10T20:47:42.929128+0000 mgr.gibba044.wflcwh (mgr.34466) 2120 : cluster [DBG] pgmap v1192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:43.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:43 gibba023 bash[31815]: cluster 2021-03-10T20:47:42.929128+0000 mgr.gibba044.wflcwh (mgr.34466) 2120 : cluster [DBG] pgmap v1192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:43.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:43 gibba044 bash[25485]: cluster 2021-03-10T20:47:42.929128+0000 mgr.gibba044.wflcwh (mgr.34466) 2120 : cluster [DBG] pgmap v1192: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:46.250 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:45 gibba044 bash[25485]: cluster 2021-03-10T20:47:44.929742+0000 mgr.gibba044.wflcwh (mgr.34466) 2121 : cluster [DBG] pgmap v1193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:46.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:45 gibba023 bash[30844]: cluster 2021-03-10T20:47:44.929742+0000 mgr.gibba044.wflcwh (mgr.34466) 2121 : cluster [DBG] pgmap v1193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:46.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:45 gibba023 bash[31815]: cluster 2021-03-10T20:47:44.929742+0000 mgr.gibba044.wflcwh (mgr.34466) 2121 : cluster [DBG] pgmap v1193: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:48.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:48 gibba023 bash[30844]: cluster 2021-03-10T20:47:46.931236+0000 mgr.gibba044.wflcwh (mgr.34466) 2122 : cluster [DBG] pgmap v1194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:48.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:48 gibba023 bash[31815]: cluster 2021-03-10T20:47:46.931236+0000 mgr.gibba044.wflcwh (mgr.34466) 2122 : cluster [DBG] pgmap v1194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:48.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:48 gibba044 bash[25485]: cluster 2021-03-10T20:47:46.931236+0000 mgr.gibba044.wflcwh (mgr.34466) 2122 : cluster [DBG] pgmap v1194: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:50.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:50 gibba023 bash[30844]: cluster 2021-03-10T20:47:48.932786+0000 mgr.gibba044.wflcwh (mgr.34466) 2123 : cluster [DBG] pgmap v1195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:50.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:50 gibba023 bash[31815]: cluster 2021-03-10T20:47:48.932786+0000 mgr.gibba044.wflcwh (mgr.34466) 2123 : cluster [DBG] pgmap v1195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:50.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:50 gibba044 bash[25485]: cluster 2021-03-10T20:47:48.932786+0000 mgr.gibba044.wflcwh (mgr.34466) 2123 : cluster [DBG] pgmap v1195: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:52.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:52 gibba023 bash[30844]: cluster 2021-03-10T20:47:50.933611+0000 mgr.gibba044.wflcwh (mgr.34466) 2124 : cluster [DBG] pgmap v1196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:52.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:52 gibba023 bash[31815]: cluster 2021-03-10T20:47:50.933611+0000 mgr.gibba044.wflcwh (mgr.34466) 2124 : cluster [DBG] pgmap v1196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:52.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:52 gibba044 bash[25485]: cluster 2021-03-10T20:47:50.933611+0000 mgr.gibba044.wflcwh (mgr.34466) 2124 : cluster [DBG] pgmap v1196: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:53.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:53 gibba023 bash[30844]: cephadm 2021-03-10T20:47:51.351285+0000 mgr.gibba044.wflcwh (mgr.34466) 2125 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:47:53.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:53 gibba023 bash[31815]: cephadm 2021-03-10T20:47:51.351285+0000 mgr.gibba044.wflcwh (mgr.34466) 2125 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:47:53.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:53 gibba044 bash[25485]: cephadm 2021-03-10T20:47:51.351285+0000 mgr.gibba044.wflcwh (mgr.34466) 2125 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:47:54.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:54 gibba023 bash[30844]: cluster 2021-03-10T20:47:52.934868+0000 mgr.gibba044.wflcwh (mgr.34466) 2126 : cluster [DBG] pgmap v1197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:54.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:54 gibba023 bash[31815]: cluster 2021-03-10T20:47:52.934868+0000 mgr.gibba044.wflcwh (mgr.34466) 2126 : cluster [DBG] pgmap v1197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:54.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:54 gibba044 bash[25485]: cluster 2021-03-10T20:47:52.934868+0000 mgr.gibba044.wflcwh (mgr.34466) 2126 : cluster [DBG] pgmap v1197: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:56.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:56 gibba023 bash[30844]: cluster 2021-03-10T20:47:54.936064+0000 mgr.gibba044.wflcwh (mgr.34466) 2127 : cluster [DBG] pgmap v1198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:56.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:56 gibba023 bash[31815]: cluster 2021-03-10T20:47:54.936064+0000 mgr.gibba044.wflcwh (mgr.34466) 2127 : cluster [DBG] pgmap v1198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:56.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:56 gibba044 bash[25485]: cluster 2021-03-10T20:47:54.936064+0000 mgr.gibba044.wflcwh (mgr.34466) 2127 : cluster [DBG] pgmap v1198: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:58.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:47:58 gibba023 bash[30844]: cluster 2021-03-10T20:47:56.936637+0000 mgr.gibba044.wflcwh (mgr.34466) 2128 : cluster [DBG] pgmap v1199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:58.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:47:58 gibba023 bash[31815]: cluster 2021-03-10T20:47:56.936637+0000 mgr.gibba044.wflcwh (mgr.34466) 2128 : cluster [DBG] pgmap v1199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:47:58.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:47:58 gibba044 bash[25485]: cluster 2021-03-10T20:47:56.936637+0000 mgr.gibba044.wflcwh (mgr.34466) 2128 : cluster [DBG] pgmap v1199: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:00.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:00 gibba023 bash[30844]: cluster 2021-03-10T20:47:58.937167+0000 mgr.gibba044.wflcwh (mgr.34466) 2129 : cluster [DBG] pgmap v1200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:00.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:00 gibba023 bash[31815]: cluster 2021-03-10T20:47:58.937167+0000 mgr.gibba044.wflcwh (mgr.34466) 2129 : cluster [DBG] pgmap v1200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:00.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:00 gibba044 bash[25485]: cluster 2021-03-10T20:47:58.937167+0000 mgr.gibba044.wflcwh (mgr.34466) 2129 : cluster [DBG] pgmap v1200: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:02.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:02 gibba023 bash[30844]: cluster 2021-03-10T20:48:00.938493+0000 mgr.gibba044.wflcwh (mgr.34466) 2130 : cluster [DBG] pgmap v1201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:02.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:02 gibba023 bash[31815]: cluster 2021-03-10T20:48:00.938493+0000 mgr.gibba044.wflcwh (mgr.34466) 2130 : cluster [DBG] pgmap v1201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:02.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:02 gibba044 bash[25485]: cluster 2021-03-10T20:48:00.938493+0000 mgr.gibba044.wflcwh (mgr.34466) 2130 : cluster [DBG] pgmap v1201: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:04.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:04 gibba023 bash[30844]: cluster 2021-03-10T20:48:02.939342+0000 mgr.gibba044.wflcwh (mgr.34466) 2131 : cluster [DBG] pgmap v1202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:04.461 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:04 gibba023 bash[31815]: cluster 2021-03-10T20:48:02.939342+0000 mgr.gibba044.wflcwh (mgr.34466) 2131 : cluster [DBG] pgmap v1202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:04.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:04 gibba044 bash[25485]: cluster 2021-03-10T20:48:02.939342+0000 mgr.gibba044.wflcwh (mgr.34466) 2131 : cluster [DBG] pgmap v1202: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:06.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:06 gibba044 bash[25485]: cluster 2021-03-10T20:48:04.940414+0000 mgr.gibba044.wflcwh (mgr.34466) 2132 : cluster [DBG] pgmap v1203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:06.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:06 gibba023 bash[30844]: cluster 2021-03-10T20:48:04.940414+0000 mgr.gibba044.wflcwh (mgr.34466) 2132 : cluster [DBG] pgmap v1203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:06.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:06 gibba023 bash[31815]: cluster 2021-03-10T20:48:04.940414+0000 mgr.gibba044.wflcwh (mgr.34466) 2132 : cluster [DBG] pgmap v1203: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:08.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:08 gibba044 bash[25485]: cephadm 2021-03-10T20:48:06.366845+0000 mgr.gibba044.wflcwh (mgr.34466) 2133 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:48:08.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:08 gibba044 bash[25485]: cluster 2021-03-10T20:48:06.941779+0000 mgr.gibba044.wflcwh (mgr.34466) 2134 : cluster [DBG] pgmap v1204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:08.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:08 gibba023 bash[30844]: cephadm 2021-03-10T20:48:06.366845+0000 mgr.gibba044.wflcwh (mgr.34466) 2133 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:48:08.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:08 gibba023 bash[30844]: cluster 2021-03-10T20:48:06.941779+0000 mgr.gibba044.wflcwh (mgr.34466) 2134 : cluster [DBG] pgmap v1204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:08.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:08 gibba023 bash[31815]: cephadm 2021-03-10T20:48:06.366845+0000 mgr.gibba044.wflcwh (mgr.34466) 2133 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:48:08.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:08 gibba023 bash[31815]: cluster 2021-03-10T20:48:06.941779+0000 mgr.gibba044.wflcwh (mgr.34466) 2134 : cluster [DBG] pgmap v1204: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:10.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:10 gibba044 bash[25485]: cluster 2021-03-10T20:48:08.942600+0000 mgr.gibba044.wflcwh (mgr.34466) 2135 : cluster [DBG] pgmap v1205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:10.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:10 gibba023 bash[30844]: cluster 2021-03-10T20:48:08.942600+0000 mgr.gibba044.wflcwh (mgr.34466) 2135 : cluster [DBG] pgmap v1205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:10.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:10 gibba023 bash[31815]: cluster 2021-03-10T20:48:08.942600+0000 mgr.gibba044.wflcwh (mgr.34466) 2135 : cluster [DBG] pgmap v1205: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:11.151 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:48:11.381 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:48:11.382 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (39m) 4m ago 44m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:48:11.382 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (44m) 3m ago 44m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:48:11.382 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (39m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:48:11.382 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (39m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:48:11.383 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (39m) 4m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:48:11.383 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (38m) 4m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:48:11.383 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (38m) 3m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:48:11.383 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (38m) 4m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:48:11.384 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (45m) 4m ago 45m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:48:11.384 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (45m) 3m ago 45m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:48:11.384 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (37m) 4m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:48:11.384 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (37m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:48:11.384 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (36m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:48:11.385 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (36m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:48:11.385 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (35m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:48:11.385 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (35m) 3m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:48:11.385 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (34m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:48:11.385 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (34m) 3m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:48:11.386 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (44m) 3m ago 45m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:48:11.386 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 4m ago 42m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:48:11.386 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 3m ago 42m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:48:11.630 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:48:11.631 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:48:11.631 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:48:11.631 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:48:11.632 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:48:11.632 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:48:11.632 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:48:11.632 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:48:11.632 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:48:11.633 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:48:11.633 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:48:11.633 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:48:11.633 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:48:11.633 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:48:11.634 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:48:12.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:12 gibba044 bash[25485]: cluster 2021-03-10T20:48:10.944125+0000 mgr.gibba044.wflcwh (mgr.34466) 2136 : cluster [DBG] pgmap v1206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:12.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:12 gibba044 bash[25485]: audit 2021-03-10T20:48:11.142955+0000 mgr.gibba044.wflcwh (mgr.34466) 2137 : audit [DBG] from='client.45498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:48:12.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:12 gibba044 bash[25485]: audit 2021-03-10T20:48:11.631287+0000 mon.c (mon.1) 55 : audit [DBG] from='client.? 172.21.2.123:0/1745419520' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:12.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:12 gibba023 bash[30844]: cluster 2021-03-10T20:48:10.944125+0000 mgr.gibba044.wflcwh (mgr.34466) 2136 : cluster [DBG] pgmap v1206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:12.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:12 gibba023 bash[30844]: audit 2021-03-10T20:48:11.142955+0000 mgr.gibba044.wflcwh (mgr.34466) 2137 : audit [DBG] from='client.45498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:48:12.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:12 gibba023 bash[30844]: audit 2021-03-10T20:48:11.631287+0000 mon.c (mon.1) 55 : audit [DBG] from='client.? 172.21.2.123:0/1745419520' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:12.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:12 gibba023 bash[31815]: cluster 2021-03-10T20:48:10.944125+0000 mgr.gibba044.wflcwh (mgr.34466) 2136 : cluster [DBG] pgmap v1206: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:12.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:12 gibba023 bash[31815]: audit 2021-03-10T20:48:11.142955+0000 mgr.gibba044.wflcwh (mgr.34466) 2137 : audit [DBG] from='client.45498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:48:12.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:12 gibba023 bash[31815]: audit 2021-03-10T20:48:11.631287+0000 mon.c (mon.1) 55 : audit [DBG] from='client.? 172.21.2.123:0/1745419520' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:13.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:13 gibba044 bash[25485]: audit 2021-03-10T20:48:11.369841+0000 mgr.gibba044.wflcwh (mgr.34466) 2138 : audit [DBG] from='client.45504 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:48:13.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:13 gibba023 bash[30844]: audit 2021-03-10T20:48:11.369841+0000 mgr.gibba044.wflcwh (mgr.34466) 2138 : audit [DBG] from='client.45504 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:48:13.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:13 gibba023 bash[31815]: audit 2021-03-10T20:48:11.369841+0000 mgr.gibba044.wflcwh (mgr.34466) 2138 : audit [DBG] from='client.45504 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:48:14.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:14 gibba044 bash[25485]: cluster 2021-03-10T20:48:12.945554+0000 mgr.gibba044.wflcwh (mgr.34466) 2139 : cluster [DBG] pgmap v1207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:14.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:14 gibba023 bash[30844]: cluster 2021-03-10T20:48:12.945554+0000 mgr.gibba044.wflcwh (mgr.34466) 2139 : cluster [DBG] pgmap v1207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:14.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:14 gibba023 bash[31815]: cluster 2021-03-10T20:48:12.945554+0000 mgr.gibba044.wflcwh (mgr.34466) 2139 : cluster [DBG] pgmap v1207: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:16.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:16 gibba044 bash[25485]: cluster 2021-03-10T20:48:14.946797+0000 mgr.gibba044.wflcwh (mgr.34466) 2140 : cluster [DBG] pgmap v1208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:16.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:16 gibba023 bash[30844]: cluster 2021-03-10T20:48:14.946797+0000 mgr.gibba044.wflcwh (mgr.34466) 2140 : cluster [DBG] pgmap v1208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:16.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:16 gibba023 bash[31815]: cluster 2021-03-10T20:48:14.946797+0000 mgr.gibba044.wflcwh (mgr.34466) 2140 : cluster [DBG] pgmap v1208: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:18.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:18 gibba044 bash[25485]: cluster 2021-03-10T20:48:16.948488+0000 mgr.gibba044.wflcwh (mgr.34466) 2141 : cluster [DBG] pgmap v1209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:18.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:18 gibba023 bash[30844]: cluster 2021-03-10T20:48:16.948488+0000 mgr.gibba044.wflcwh (mgr.34466) 2141 : cluster [DBG] pgmap v1209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:18.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:18 gibba023 bash[31815]: cluster 2021-03-10T20:48:16.948488+0000 mgr.gibba044.wflcwh (mgr.34466) 2141 : cluster [DBG] pgmap v1209: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:20.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:20 gibba023 bash[30844]: cluster 2021-03-10T20:48:18.949267+0000 mgr.gibba044.wflcwh (mgr.34466) 2142 : cluster [DBG] pgmap v1210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:20.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:20 gibba023 bash[31815]: cluster 2021-03-10T20:48:18.949267+0000 mgr.gibba044.wflcwh (mgr.34466) 2142 : cluster [DBG] pgmap v1210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:20.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:20 gibba044 bash[25485]: cluster 2021-03-10T20:48:18.949267+0000 mgr.gibba044.wflcwh (mgr.34466) 2142 : cluster [DBG] pgmap v1210: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:22.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:22 gibba023 bash[30844]: cluster 2021-03-10T20:48:20.950028+0000 mgr.gibba044.wflcwh (mgr.34466) 2143 : cluster [DBG] pgmap v1211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:22.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:22 gibba023 bash[30844]: audit 2021-03-10T20:48:21.593084+0000 mon.a (mon.0) 1127 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:48:22.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:22 gibba023 bash[30844]: audit 2021-03-10T20:48:21.596940+0000 mon.a (mon.0) 1128 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:48:22.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:22 gibba023 bash[30844]: audit 2021-03-10T20:48:21.598808+0000 mon.a (mon.0) 1129 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:22.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:22 gibba023 bash[30844]: audit 2021-03-10T20:48:21.600232+0000 mon.a (mon.0) 1130 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:22.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:22 gibba023 bash[30844]: audit 2021-03-10T20:48:21.601438+0000 mon.a (mon.0) 1131 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:22.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:22 gibba023 bash[30844]: audit 2021-03-10T20:48:21.603920+0000 mon.a (mon.0) 1132 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:22.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:22 gibba023 bash[30844]: audit 2021-03-10T20:48:21.605617+0000 mon.a (mon.0) 1133 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:22.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:22 gibba023 bash[31815]: cluster 2021-03-10T20:48:20.950028+0000 mgr.gibba044.wflcwh (mgr.34466) 2143 : cluster [DBG] pgmap v1211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:22.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:22 gibba023 bash[31815]: audit 2021-03-10T20:48:21.593084+0000 mon.a (mon.0) 1127 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:48:22.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:22 gibba023 bash[31815]: audit 2021-03-10T20:48:21.596940+0000 mon.a (mon.0) 1128 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:48:22.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:22 gibba023 bash[31815]: audit 2021-03-10T20:48:21.598808+0000 mon.a (mon.0) 1129 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:22.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:22 gibba023 bash[31815]: audit 2021-03-10T20:48:21.600232+0000 mon.a (mon.0) 1130 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:22.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:22 gibba023 bash[31815]: audit 2021-03-10T20:48:21.601438+0000 mon.a (mon.0) 1131 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:22.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:22 gibba023 bash[31815]: audit 2021-03-10T20:48:21.603920+0000 mon.a (mon.0) 1132 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:22.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:22 gibba023 bash[31815]: audit 2021-03-10T20:48:21.605617+0000 mon.a (mon.0) 1133 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:22.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:22 gibba044 bash[25485]: cluster 2021-03-10T20:48:20.950028+0000 mgr.gibba044.wflcwh (mgr.34466) 2143 : cluster [DBG] pgmap v1211: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:22.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:22 gibba044 bash[25485]: audit 2021-03-10T20:48:21.593084+0000 mon.a (mon.0) 1127 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:48:22.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:22 gibba044 bash[25485]: audit 2021-03-10T20:48:21.596940+0000 mon.a (mon.0) 1128 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:48:22.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:22 gibba044 bash[25485]: audit 2021-03-10T20:48:21.598808+0000 mon.a (mon.0) 1129 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:22.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:22 gibba044 bash[25485]: audit 2021-03-10T20:48:21.600232+0000 mon.a (mon.0) 1130 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:22.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:22 gibba044 bash[25485]: audit 2021-03-10T20:48:21.601438+0000 mon.a (mon.0) 1131 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:22.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:22 gibba044 bash[25485]: audit 2021-03-10T20:48:21.603920+0000 mon.a (mon.0) 1132 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:22.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:22 gibba044 bash[25485]: audit 2021-03-10T20:48:21.605617+0000 mon.a (mon.0) 1133 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:23.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[30844]: cephadm 2021-03-10T20:48:21.374513+0000 mgr.gibba044.wflcwh (mgr.34466) 2144 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:48:23.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[30844]: cephadm 2021-03-10T20:48:21.376146+0000 mgr.gibba044.wflcwh (mgr.34466) 2145 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:48:23.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[30844]: cephadm 2021-03-10T20:48:21.596494+0000 mgr.gibba044.wflcwh (mgr.34466) 2146 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:48:23.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[30844]: cephadm 2021-03-10T20:48:21.598702+0000 mgr.gibba044.wflcwh (mgr.34466) 2147 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:48:23.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[30844]: cephadm 2021-03-10T20:48:21.600222+0000 mgr.gibba044.wflcwh (mgr.34466) 2148 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:48:23.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[30844]: cephadm 2021-03-10T20:48:21.600261+0000 mgr.gibba044.wflcwh (mgr.34466) 2149 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:48:23.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[30844]: cephadm 2021-03-10T20:48:21.601483+0000 mgr.gibba044.wflcwh (mgr.34466) 2150 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:48:23.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[30844]: cephadm 2021-03-10T20:48:21.601525+0000 mgr.gibba044.wflcwh (mgr.34466) 2151 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:48:23.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[30844]: cephadm 2021-03-10T20:48:21.602648+0000 mgr.gibba044.wflcwh (mgr.34466) 2152 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:48:23.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[30844]: cephadm 2021-03-10T20:48:21.603762+0000 mgr.gibba044.wflcwh (mgr.34466) 2153 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:48:23.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[30844]: cephadm 2021-03-10T20:48:21.603804+0000 mgr.gibba044.wflcwh (mgr.34466) 2154 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:48:23.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[30844]: cephadm 2021-03-10T20:48:21.605305+0000 mgr.gibba044.wflcwh (mgr.34466) 2155 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:48:23.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[30844]: cephadm 2021-03-10T20:48:21.605656+0000 mgr.gibba044.wflcwh (mgr.34466) 2156 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:48:23.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[30844]: cephadm 2021-03-10T20:48:21.607226+0000 mgr.gibba044.wflcwh (mgr.34466) 2157 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:48:23.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[30844]: cephadm 2021-03-10T20:48:21.607272+0000 mgr.gibba044.wflcwh (mgr.34466) 2158 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:48:23.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[30844]: cephadm 2021-03-10T20:48:21.607424+0000 mgr.gibba044.wflcwh (mgr.34466) 2159 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:48:23.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[31815]: cephadm 2021-03-10T20:48:21.374513+0000 mgr.gibba044.wflcwh (mgr.34466) 2144 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:48:23.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[31815]: cephadm 2021-03-10T20:48:21.376146+0000 mgr.gibba044.wflcwh (mgr.34466) 2145 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:48:23.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[31815]: cephadm 2021-03-10T20:48:21.596494+0000 mgr.gibba044.wflcwh (mgr.34466) 2146 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:48:23.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[31815]: cephadm 2021-03-10T20:48:21.598702+0000 mgr.gibba044.wflcwh (mgr.34466) 2147 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:48:23.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[31815]: cephadm 2021-03-10T20:48:21.600222+0000 mgr.gibba044.wflcwh (mgr.34466) 2148 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:48:23.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[31815]: cephadm 2021-03-10T20:48:21.600261+0000 mgr.gibba044.wflcwh (mgr.34466) 2149 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:48:23.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[31815]: cephadm 2021-03-10T20:48:21.601483+0000 mgr.gibba044.wflcwh (mgr.34466) 2150 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:48:23.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[31815]: cephadm 2021-03-10T20:48:21.601525+0000 mgr.gibba044.wflcwh (mgr.34466) 2151 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:48:23.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[31815]: cephadm 2021-03-10T20:48:21.602648+0000 mgr.gibba044.wflcwh (mgr.34466) 2152 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:48:23.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[31815]: cephadm 2021-03-10T20:48:21.603762+0000 mgr.gibba044.wflcwh (mgr.34466) 2153 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:48:23.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[31815]: cephadm 2021-03-10T20:48:21.603804+0000 mgr.gibba044.wflcwh (mgr.34466) 2154 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:48:23.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[31815]: cephadm 2021-03-10T20:48:21.605305+0000 mgr.gibba044.wflcwh (mgr.34466) 2155 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:48:23.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[31815]: cephadm 2021-03-10T20:48:21.605656+0000 mgr.gibba044.wflcwh (mgr.34466) 2156 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:48:23.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[31815]: cephadm 2021-03-10T20:48:21.607226+0000 mgr.gibba044.wflcwh (mgr.34466) 2157 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:48:23.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[31815]: cephadm 2021-03-10T20:48:21.607272+0000 mgr.gibba044.wflcwh (mgr.34466) 2158 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:48:23.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:23 gibba023 bash[31815]: cephadm 2021-03-10T20:48:21.607424+0000 mgr.gibba044.wflcwh (mgr.34466) 2159 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:48:23.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:23 gibba044 bash[25485]: cephadm 2021-03-10T20:48:21.374513+0000 mgr.gibba044.wflcwh (mgr.34466) 2144 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:48:23.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:23 gibba044 bash[25485]: cephadm 2021-03-10T20:48:21.376146+0000 mgr.gibba044.wflcwh (mgr.34466) 2145 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:48:23.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:23 gibba044 bash[25485]: cephadm 2021-03-10T20:48:21.596494+0000 mgr.gibba044.wflcwh (mgr.34466) 2146 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:48:23.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:23 gibba044 bash[25485]: cephadm 2021-03-10T20:48:21.598702+0000 mgr.gibba044.wflcwh (mgr.34466) 2147 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:48:23.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:23 gibba044 bash[25485]: cephadm 2021-03-10T20:48:21.600222+0000 mgr.gibba044.wflcwh (mgr.34466) 2148 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:48:23.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:23 gibba044 bash[25485]: cephadm 2021-03-10T20:48:21.600261+0000 mgr.gibba044.wflcwh (mgr.34466) 2149 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:48:23.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:23 gibba044 bash[25485]: cephadm 2021-03-10T20:48:21.601483+0000 mgr.gibba044.wflcwh (mgr.34466) 2150 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:48:23.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:23 gibba044 bash[25485]: cephadm 2021-03-10T20:48:21.601525+0000 mgr.gibba044.wflcwh (mgr.34466) 2151 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:48:23.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:23 gibba044 bash[25485]: cephadm 2021-03-10T20:48:21.602648+0000 mgr.gibba044.wflcwh (mgr.34466) 2152 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:48:23.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:23 gibba044 bash[25485]: cephadm 2021-03-10T20:48:21.603762+0000 mgr.gibba044.wflcwh (mgr.34466) 2153 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:48:23.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:23 gibba044 bash[25485]: cephadm 2021-03-10T20:48:21.603804+0000 mgr.gibba044.wflcwh (mgr.34466) 2154 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:48:23.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:23 gibba044 bash[25485]: cephadm 2021-03-10T20:48:21.605305+0000 mgr.gibba044.wflcwh (mgr.34466) 2155 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:48:23.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:23 gibba044 bash[25485]: cephadm 2021-03-10T20:48:21.605656+0000 mgr.gibba044.wflcwh (mgr.34466) 2156 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:48:23.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:23 gibba044 bash[25485]: cephadm 2021-03-10T20:48:21.607226+0000 mgr.gibba044.wflcwh (mgr.34466) 2157 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:48:23.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:23 gibba044 bash[25485]: cephadm 2021-03-10T20:48:21.607272+0000 mgr.gibba044.wflcwh (mgr.34466) 2158 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:48:23.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:23 gibba044 bash[25485]: cephadm 2021-03-10T20:48:21.607424+0000 mgr.gibba044.wflcwh (mgr.34466) 2159 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:48:24.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:24 gibba023 bash[30844]: cluster 2021-03-10T20:48:22.951868+0000 mgr.gibba044.wflcwh (mgr.34466) 2160 : cluster [DBG] pgmap v1212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:24.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:24 gibba023 bash[31815]: cluster 2021-03-10T20:48:22.951868+0000 mgr.gibba044.wflcwh (mgr.34466) 2160 : cluster [DBG] pgmap v1212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:24.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:24 gibba044 bash[25485]: cluster 2021-03-10T20:48:22.951868+0000 mgr.gibba044.wflcwh (mgr.34466) 2160 : cluster [DBG] pgmap v1212: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:25.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:25 gibba023 bash[30844]: cluster 2021-03-10T20:48:24.953264+0000 mgr.gibba044.wflcwh (mgr.34466) 2161 : cluster [DBG] pgmap v1213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:25.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:25 gibba023 bash[31815]: cluster 2021-03-10T20:48:24.953264+0000 mgr.gibba044.wflcwh (mgr.34466) 2161 : cluster [DBG] pgmap v1213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:25.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:25 gibba044 bash[25485]: cluster 2021-03-10T20:48:24.953264+0000 mgr.gibba044.wflcwh (mgr.34466) 2161 : cluster [DBG] pgmap v1213: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:28.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:28 gibba023 bash[30844]: cluster 2021-03-10T20:48:26.954178+0000 mgr.gibba044.wflcwh (mgr.34466) 2162 : cluster [DBG] pgmap v1214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:28.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:28 gibba023 bash[30844]: audit 2021-03-10T20:48:27.285864+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:48:28.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:28 gibba023 bash[30844]: audit 2021-03-10T20:48:27.286679+0000 mon.a (mon.0) 1135 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:48:28.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:28 gibba023 bash[30844]: audit 2021-03-10T20:48:27.289517+0000 mon.a (mon.0) 1136 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T20:48:28.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:28 gibba023 bash[30844]: audit 2021-03-10T20:48:27.290251+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:48:28.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:28 gibba023 bash[30844]: audit 2021-03-10T20:48:27.291359+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:48:28.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:28 gibba023 bash[30844]: audit 2021-03-10T20:48:27.292032+0000 mon.a (mon.0) 1139 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:48:28.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:28 gibba023 bash[31815]: cluster 2021-03-10T20:48:26.954178+0000 mgr.gibba044.wflcwh (mgr.34466) 2162 : cluster [DBG] pgmap v1214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:28.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:28 gibba023 bash[31815]: audit 2021-03-10T20:48:27.285864+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:48:28.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:28 gibba023 bash[31815]: audit 2021-03-10T20:48:27.286679+0000 mon.a (mon.0) 1135 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:48:28.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:28 gibba023 bash[31815]: audit 2021-03-10T20:48:27.289517+0000 mon.a (mon.0) 1136 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T20:48:28.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:28 gibba023 bash[31815]: audit 2021-03-10T20:48:27.290251+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:48:28.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:28 gibba023 bash[31815]: audit 2021-03-10T20:48:27.291359+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:48:28.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:28 gibba023 bash[31815]: audit 2021-03-10T20:48:27.292032+0000 mon.a (mon.0) 1139 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:48:28.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:28 gibba044 bash[25485]: cluster 2021-03-10T20:48:26.954178+0000 mgr.gibba044.wflcwh (mgr.34466) 2162 : cluster [DBG] pgmap v1214: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:28.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:28 gibba044 bash[25485]: audit 2021-03-10T20:48:27.285864+0000 mon.a (mon.0) 1134 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:48:28.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:28 gibba044 bash[25485]: audit 2021-03-10T20:48:27.286679+0000 mon.a (mon.0) 1135 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:48:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:28 gibba044 bash[25485]: audit 2021-03-10T20:48:27.289517+0000 mon.a (mon.0) 1136 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T20:48:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:28 gibba044 bash[25485]: audit 2021-03-10T20:48:27.290251+0000 mon.a (mon.0) 1137 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:48:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:28 gibba044 bash[25485]: audit 2021-03-10T20:48:27.291359+0000 mon.a (mon.0) 1138 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:48:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:28 gibba044 bash[25485]: audit 2021-03-10T20:48:27.292032+0000 mon.a (mon.0) 1139 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:48:30.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:30 gibba023 bash[30844]: cluster 2021-03-10T20:48:28.955007+0000 mgr.gibba044.wflcwh (mgr.34466) 2163 : cluster [DBG] pgmap v1215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:30.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:30 gibba023 bash[31815]: cluster 2021-03-10T20:48:28.955007+0000 mgr.gibba044.wflcwh (mgr.34466) 2163 : cluster [DBG] pgmap v1215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:30.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:30 gibba044 bash[25485]: cluster 2021-03-10T20:48:28.955007+0000 mgr.gibba044.wflcwh (mgr.34466) 2163 : cluster [DBG] pgmap v1215: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:32.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:32 gibba023 bash[30844]: cluster 2021-03-10T20:48:30.956386+0000 mgr.gibba044.wflcwh (mgr.34466) 2164 : cluster [DBG] pgmap v1216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:32.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:32 gibba023 bash[31815]: cluster 2021-03-10T20:48:30.956386+0000 mgr.gibba044.wflcwh (mgr.34466) 2164 : cluster [DBG] pgmap v1216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:32.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:32 gibba044 bash[25485]: cluster 2021-03-10T20:48:30.956386+0000 mgr.gibba044.wflcwh (mgr.34466) 2164 : cluster [DBG] pgmap v1216: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:34.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:34 gibba023 bash[30844]: cluster 2021-03-10T20:48:32.957375+0000 mgr.gibba044.wflcwh (mgr.34466) 2165 : cluster [DBG] pgmap v1217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:34.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:34 gibba023 bash[31815]: cluster 2021-03-10T20:48:32.957375+0000 mgr.gibba044.wflcwh (mgr.34466) 2165 : cluster [DBG] pgmap v1217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:34.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:34 gibba044 bash[25485]: cluster 2021-03-10T20:48:32.957375+0000 mgr.gibba044.wflcwh (mgr.34466) 2165 : cluster [DBG] pgmap v1217: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:36.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:36 gibba023 bash[30844]: cluster 2021-03-10T20:48:34.958474+0000 mgr.gibba044.wflcwh (mgr.34466) 2166 : cluster [DBG] pgmap v1218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:36.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:36 gibba023 bash[31815]: cluster 2021-03-10T20:48:34.958474+0000 mgr.gibba044.wflcwh (mgr.34466) 2166 : cluster [DBG] pgmap v1218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:36.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:36 gibba044 bash[25485]: cluster 2021-03-10T20:48:34.958474+0000 mgr.gibba044.wflcwh (mgr.34466) 2166 : cluster [DBG] pgmap v1218: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:38.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:38 gibba023 bash[30844]: cephadm 2021-03-10T20:48:36.623429+0000 mgr.gibba044.wflcwh (mgr.34466) 2167 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:48:38.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:38 gibba023 bash[30844]: cluster 2021-03-10T20:48:36.960131+0000 mgr.gibba044.wflcwh (mgr.34466) 2168 : cluster [DBG] pgmap v1219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:38.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:38 gibba023 bash[31815]: cephadm 2021-03-10T20:48:36.623429+0000 mgr.gibba044.wflcwh (mgr.34466) 2167 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:48:38.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:38 gibba023 bash[31815]: cluster 2021-03-10T20:48:36.960131+0000 mgr.gibba044.wflcwh (mgr.34466) 2168 : cluster [DBG] pgmap v1219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:38.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:38 gibba044 bash[25485]: cephadm 2021-03-10T20:48:36.623429+0000 mgr.gibba044.wflcwh (mgr.34466) 2167 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:48:38.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:38 gibba044 bash[25485]: cluster 2021-03-10T20:48:36.960131+0000 mgr.gibba044.wflcwh (mgr.34466) 2168 : cluster [DBG] pgmap v1219: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:40.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:40 gibba023 bash[30844]: cluster 2021-03-10T20:48:38.961887+0000 mgr.gibba044.wflcwh (mgr.34466) 2169 : cluster [DBG] pgmap v1220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:40.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:40 gibba023 bash[31815]: cluster 2021-03-10T20:48:38.961887+0000 mgr.gibba044.wflcwh (mgr.34466) 2169 : cluster [DBG] pgmap v1220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:40.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:40 gibba044 bash[25485]: cluster 2021-03-10T20:48:38.961887+0000 mgr.gibba044.wflcwh (mgr.34466) 2169 : cluster [DBG] pgmap v1220: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:41.875 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:48:42.101 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:48:42.101 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (39m) 5m ago 45m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:48:42.102 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (45m) 4m ago 45m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:48:42.102 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (40m) 4m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:48:42.102 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (40m) 4m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:48:42.102 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (39m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:48:42.103 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (39m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:48:42.103 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (38m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:48:42.103 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (39m) 5m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:48:42.103 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (45m) 5m ago 45m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:48:42.103 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (45m) 4m ago 45m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:48:42.104 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (38m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:48:42.104 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (37m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:48:42.104 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (37m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:48:42.104 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (36m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:48:42.105 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (36m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:48:42.105 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (35m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:48:42.106 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (35m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:48:42.106 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (35m) 4m ago 45m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:48:42.106 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (44m) 4m ago 45m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:48:42.106 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 5m ago 43m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:48:42.107 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 4m ago 43m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:48:42.353 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:48:42.353 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:48:42.353 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:48:42.353 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:48:42.354 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:48:42.354 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:48:42.354 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:48:42.354 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:48:42.354 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:48:42.355 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:48:42.355 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:48:42.355 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:48:42.355 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:48:42.356 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:48:42.356 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:48:42.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:42 gibba044 bash[25485]: cluster 2021-03-10T20:48:40.963711+0000 mgr.gibba044.wflcwh (mgr.34466) 2170 : cluster [DBG] pgmap v1221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:42.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:42 gibba023 bash[30844]: cluster 2021-03-10T20:48:40.963711+0000 mgr.gibba044.wflcwh (mgr.34466) 2170 : cluster [DBG] pgmap v1221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:42.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:42 gibba023 bash[31815]: cluster 2021-03-10T20:48:40.963711+0000 mgr.gibba044.wflcwh (mgr.34466) 2170 : cluster [DBG] pgmap v1221: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:43.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:43 gibba044 bash[25485]: audit 2021-03-10T20:48:41.866202+0000 mgr.gibba044.wflcwh (mgr.34466) 2171 : audit [DBG] from='client.55495 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:48:43.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:43 gibba044 bash[25485]: audit 2021-03-10T20:48:42.089362+0000 mgr.gibba044.wflcwh (mgr.34466) 2172 : audit [DBG] from='client.55501 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:48:43.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:43 gibba044 bash[25485]: audit 2021-03-10T20:48:42.353182+0000 mon.a (mon.0) 1140 : audit [DBG] from='client.? 172.21.2.123:0/2209339695' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:43.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:43 gibba023 bash[30844]: audit 2021-03-10T20:48:41.866202+0000 mgr.gibba044.wflcwh (mgr.34466) 2171 : audit [DBG] from='client.55495 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:48:43.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:43 gibba023 bash[30844]: audit 2021-03-10T20:48:42.089362+0000 mgr.gibba044.wflcwh (mgr.34466) 2172 : audit [DBG] from='client.55501 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:48:43.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:43 gibba023 bash[30844]: audit 2021-03-10T20:48:42.353182+0000 mon.a (mon.0) 1140 : audit [DBG] from='client.? 172.21.2.123:0/2209339695' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:43.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:43 gibba023 bash[31815]: audit 2021-03-10T20:48:41.866202+0000 mgr.gibba044.wflcwh (mgr.34466) 2171 : audit [DBG] from='client.55495 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:48:43.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:43 gibba023 bash[31815]: audit 2021-03-10T20:48:42.089362+0000 mgr.gibba044.wflcwh (mgr.34466) 2172 : audit [DBG] from='client.55501 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:48:43.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:43 gibba023 bash[31815]: audit 2021-03-10T20:48:42.353182+0000 mon.a (mon.0) 1140 : audit [DBG] from='client.? 172.21.2.123:0/2209339695' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:48:44.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:44 gibba044 bash[25485]: cluster 2021-03-10T20:48:42.965165+0000 mgr.gibba044.wflcwh (mgr.34466) 2173 : cluster [DBG] pgmap v1222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:44.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:44 gibba023 bash[30844]: cluster 2021-03-10T20:48:42.965165+0000 mgr.gibba044.wflcwh (mgr.34466) 2173 : cluster [DBG] pgmap v1222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:44.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:44 gibba023 bash[31815]: cluster 2021-03-10T20:48:42.965165+0000 mgr.gibba044.wflcwh (mgr.34466) 2173 : cluster [DBG] pgmap v1222: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:46.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:46 gibba044 bash[25485]: cluster 2021-03-10T20:48:44.966202+0000 mgr.gibba044.wflcwh (mgr.34466) 2174 : cluster [DBG] pgmap v1223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:46.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:46 gibba023 bash[30844]: cluster 2021-03-10T20:48:44.966202+0000 mgr.gibba044.wflcwh (mgr.34466) 2174 : cluster [DBG] pgmap v1223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:46.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:46 gibba023 bash[31815]: cluster 2021-03-10T20:48:44.966202+0000 mgr.gibba044.wflcwh (mgr.34466) 2174 : cluster [DBG] pgmap v1223: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:48.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:48 gibba044 bash[25485]: cluster 2021-03-10T20:48:46.967707+0000 mgr.gibba044.wflcwh (mgr.34466) 2175 : cluster [DBG] pgmap v1224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:48.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:48 gibba023 bash[30844]: cluster 2021-03-10T20:48:46.967707+0000 mgr.gibba044.wflcwh (mgr.34466) 2175 : cluster [DBG] pgmap v1224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:48.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:48 gibba023 bash[31815]: cluster 2021-03-10T20:48:46.967707+0000 mgr.gibba044.wflcwh (mgr.34466) 2175 : cluster [DBG] pgmap v1224: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:50.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:50 gibba044 bash[25485]: cluster 2021-03-10T20:48:48.968834+0000 mgr.gibba044.wflcwh (mgr.34466) 2176 : cluster [DBG] pgmap v1225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:50.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:50 gibba023 bash[30844]: cluster 2021-03-10T20:48:48.968834+0000 mgr.gibba044.wflcwh (mgr.34466) 2176 : cluster [DBG] pgmap v1225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:50.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:50 gibba023 bash[31815]: cluster 2021-03-10T20:48:48.968834+0000 mgr.gibba044.wflcwh (mgr.34466) 2176 : cluster [DBG] pgmap v1225: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:52.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:52 gibba044 bash[25485]: cluster 2021-03-10T20:48:50.970456+0000 mgr.gibba044.wflcwh (mgr.34466) 2177 : cluster [DBG] pgmap v1226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:52.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:52 gibba023 bash[30844]: cluster 2021-03-10T20:48:50.970456+0000 mgr.gibba044.wflcwh (mgr.34466) 2177 : cluster [DBG] pgmap v1226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:52.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:52 gibba023 bash[31815]: cluster 2021-03-10T20:48:50.970456+0000 mgr.gibba044.wflcwh (mgr.34466) 2177 : cluster [DBG] pgmap v1226: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:53.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:53 gibba044 bash[25485]: cephadm 2021-03-10T20:48:51.639370+0000 mgr.gibba044.wflcwh (mgr.34466) 2178 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:48:53.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:53 gibba023 bash[30844]: cephadm 2021-03-10T20:48:51.639370+0000 mgr.gibba044.wflcwh (mgr.34466) 2178 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:48:53.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:53 gibba023 bash[31815]: cephadm 2021-03-10T20:48:51.639370+0000 mgr.gibba044.wflcwh (mgr.34466) 2178 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:48:54.500 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:54 gibba044 bash[25485]: cluster 2021-03-10T20:48:52.972125+0000 mgr.gibba044.wflcwh (mgr.34466) 2179 : cluster [DBG] pgmap v1227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:54.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:54 gibba023 bash[30844]: cluster 2021-03-10T20:48:52.972125+0000 mgr.gibba044.wflcwh (mgr.34466) 2179 : cluster [DBG] pgmap v1227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:54.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:54 gibba023 bash[31815]: cluster 2021-03-10T20:48:52.972125+0000 mgr.gibba044.wflcwh (mgr.34466) 2179 : cluster [DBG] pgmap v1227: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:56.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:56 gibba023 bash[30844]: cluster 2021-03-10T20:48:54.973320+0000 mgr.gibba044.wflcwh (mgr.34466) 2180 : cluster [DBG] pgmap v1228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:56.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:56 gibba023 bash[31815]: cluster 2021-03-10T20:48:54.973320+0000 mgr.gibba044.wflcwh (mgr.34466) 2180 : cluster [DBG] pgmap v1228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:56.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:56 gibba044 bash[25485]: cluster 2021-03-10T20:48:54.973320+0000 mgr.gibba044.wflcwh (mgr.34466) 2180 : cluster [DBG] pgmap v1228: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:58.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:48:58 gibba023 bash[30844]: cluster 2021-03-10T20:48:56.974522+0000 mgr.gibba044.wflcwh (mgr.34466) 2181 : cluster [DBG] pgmap v1229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:58.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:48:58 gibba023 bash[31815]: cluster 2021-03-10T20:48:56.974522+0000 mgr.gibba044.wflcwh (mgr.34466) 2181 : cluster [DBG] pgmap v1229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:48:58.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:48:58 gibba044 bash[25485]: cluster 2021-03-10T20:48:56.974522+0000 mgr.gibba044.wflcwh (mgr.34466) 2181 : cluster [DBG] pgmap v1229: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:00.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:00 gibba023 bash[30844]: cluster 2021-03-10T20:48:58.975886+0000 mgr.gibba044.wflcwh (mgr.34466) 2182 : cluster [DBG] pgmap v1230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:00.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:00 gibba023 bash[31815]: cluster 2021-03-10T20:48:58.975886+0000 mgr.gibba044.wflcwh (mgr.34466) 2182 : cluster [DBG] pgmap v1230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:00.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:00 gibba044 bash[25485]: cluster 2021-03-10T20:48:58.975886+0000 mgr.gibba044.wflcwh (mgr.34466) 2182 : cluster [DBG] pgmap v1230: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:02.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:02 gibba023 bash[30844]: cluster 2021-03-10T20:49:00.977533+0000 mgr.gibba044.wflcwh (mgr.34466) 2183 : cluster [DBG] pgmap v1231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:02.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:02 gibba023 bash[31815]: cluster 2021-03-10T20:49:00.977533+0000 mgr.gibba044.wflcwh (mgr.34466) 2183 : cluster [DBG] pgmap v1231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:02.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:02 gibba044 bash[25485]: cluster 2021-03-10T20:49:00.977533+0000 mgr.gibba044.wflcwh (mgr.34466) 2183 : cluster [DBG] pgmap v1231: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:04.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:04 gibba023 bash[30844]: cluster 2021-03-10T20:49:02.979216+0000 mgr.gibba044.wflcwh (mgr.34466) 2184 : cluster [DBG] pgmap v1232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:04.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:04 gibba023 bash[31815]: cluster 2021-03-10T20:49:02.979216+0000 mgr.gibba044.wflcwh (mgr.34466) 2184 : cluster [DBG] pgmap v1232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:04.750 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:04 gibba044 bash[25485]: cluster 2021-03-10T20:49:02.979216+0000 mgr.gibba044.wflcwh (mgr.34466) 2184 : cluster [DBG] pgmap v1232: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:05.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:05 gibba023 bash[30844]: cluster 2021-03-10T20:49:04.980482+0000 mgr.gibba044.wflcwh (mgr.34466) 2185 : cluster [DBG] pgmap v1233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:05.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:05 gibba023 bash[31815]: cluster 2021-03-10T20:49:04.980482+0000 mgr.gibba044.wflcwh (mgr.34466) 2185 : cluster [DBG] pgmap v1233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:05.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:05 gibba044 bash[25485]: cluster 2021-03-10T20:49:04.980482+0000 mgr.gibba044.wflcwh (mgr.34466) 2185 : cluster [DBG] pgmap v1233: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:08.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:08 gibba023 bash[30844]: cephadm 2021-03-10T20:49:06.646521+0000 mgr.gibba044.wflcwh (mgr.34466) 2186 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:49:08.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:08 gibba023 bash[30844]: cluster 2021-03-10T20:49:06.982037+0000 mgr.gibba044.wflcwh (mgr.34466) 2187 : cluster [DBG] pgmap v1234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:08.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:08 gibba023 bash[31815]: cephadm 2021-03-10T20:49:06.646521+0000 mgr.gibba044.wflcwh (mgr.34466) 2186 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:49:08.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:08 gibba023 bash[31815]: cluster 2021-03-10T20:49:06.982037+0000 mgr.gibba044.wflcwh (mgr.34466) 2187 : cluster [DBG] pgmap v1234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:08.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:08 gibba044 bash[25485]: cephadm 2021-03-10T20:49:06.646521+0000 mgr.gibba044.wflcwh (mgr.34466) 2186 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:49:08.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:08 gibba044 bash[25485]: cluster 2021-03-10T20:49:06.982037+0000 mgr.gibba044.wflcwh (mgr.34466) 2187 : cluster [DBG] pgmap v1234: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:10.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:10 gibba023 bash[30844]: cluster 2021-03-10T20:49:08.983566+0000 mgr.gibba044.wflcwh (mgr.34466) 2188 : cluster [DBG] pgmap v1235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:10.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:10 gibba023 bash[31815]: cluster 2021-03-10T20:49:08.983566+0000 mgr.gibba044.wflcwh (mgr.34466) 2188 : cluster [DBG] pgmap v1235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:10.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:10 gibba044 bash[25485]: cluster 2021-03-10T20:49:08.983566+0000 mgr.gibba044.wflcwh (mgr.34466) 2188 : cluster [DBG] pgmap v1235: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:12.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:12 gibba023 bash[30844]: cluster 2021-03-10T20:49:10.985223+0000 mgr.gibba044.wflcwh (mgr.34466) 2189 : cluster [DBG] pgmap v1236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:12.424 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:12 gibba023 bash[31815]: cluster 2021-03-10T20:49:10.985223+0000 mgr.gibba044.wflcwh (mgr.34466) 2189 : cluster [DBG] pgmap v1236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:12.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:12 gibba044 bash[25485]: cluster 2021-03-10T20:49:10.985223+0000 mgr.gibba044.wflcwh (mgr.34466) 2189 : cluster [DBG] pgmap v1236: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:12.593 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:49:12.818 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:49:12.819 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (40m) 5m ago 45m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:49:12.819 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (45m) 4m ago 45m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:49:12.819 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (40m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:49:12.819 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (41m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:49:12.820 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (40m) 5m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:49:12.820 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (39m) 5m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:49:12.820 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (39m) 4m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:49:12.820 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (39m) 5m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:49:12.821 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (46m) 5m ago 46m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:49:12.821 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (46m) 4m ago 46m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:49:12.821 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (38m) 5m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:49:12.821 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (38m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:49:12.821 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (37m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:49:12.822 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (37m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:49:12.822 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (36m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:49:12.822 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (36m) 4m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:49:12.822 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (35m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:49:12.823 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (35m) 4m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:49:12.823 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (45m) 4m ago 46m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:49:12.823 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 5m ago 43m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:49:12.823 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 4m ago 43m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:49:13.070 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:49:13.070 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:49:13.070 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:49:13.070 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:49:13.071 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:49:13.071 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:49:13.071 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:49:13.071 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:49:13.072 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:49:13.072 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:49:13.072 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:49:13.072 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:49:13.072 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:49:13.073 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:49:13.073 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:49:13.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:13 gibba023 bash[30844]: audit 2021-03-10T20:49:13.070104+0000 mon.c (mon.1) 56 : audit [DBG] from='client.? 172.21.2.123:0/2405740048' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:13.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:13 gibba023 bash[31815]: audit 2021-03-10T20:49:13.070104+0000 mon.c (mon.1) 56 : audit [DBG] from='client.? 172.21.2.123:0/2405740048' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:13.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:13 gibba044 bash[25485]: audit 2021-03-10T20:49:13.070104+0000 mon.c (mon.1) 56 : audit [DBG] from='client.? 172.21.2.123:0/2405740048' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:14.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:14 gibba023 bash[30844]: audit 2021-03-10T20:49:12.585311+0000 mgr.gibba044.wflcwh (mgr.34466) 2190 : audit [DBG] from='client.55513 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:49:14.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:14 gibba023 bash[30844]: audit 2021-03-10T20:49:12.808606+0000 mgr.gibba044.wflcwh (mgr.34466) 2191 : audit [DBG] from='client.55519 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:49:14.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:14 gibba023 bash[30844]: cluster 2021-03-10T20:49:12.986793+0000 mgr.gibba044.wflcwh (mgr.34466) 2192 : cluster [DBG] pgmap v1237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:14.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:14 gibba023 bash[31815]: audit 2021-03-10T20:49:12.585311+0000 mgr.gibba044.wflcwh (mgr.34466) 2190 : audit [DBG] from='client.55513 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:49:14.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:14 gibba023 bash[31815]: audit 2021-03-10T20:49:12.808606+0000 mgr.gibba044.wflcwh (mgr.34466) 2191 : audit [DBG] from='client.55519 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:49:14.427 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:14 gibba023 bash[31815]: cluster 2021-03-10T20:49:12.986793+0000 mgr.gibba044.wflcwh (mgr.34466) 2192 : cluster [DBG] pgmap v1237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:14.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:14 gibba044 bash[25485]: audit 2021-03-10T20:49:12.585311+0000 mgr.gibba044.wflcwh (mgr.34466) 2190 : audit [DBG] from='client.55513 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:49:14.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:14 gibba044 bash[25485]: audit 2021-03-10T20:49:12.808606+0000 mgr.gibba044.wflcwh (mgr.34466) 2191 : audit [DBG] from='client.55519 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:49:14.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:14 gibba044 bash[25485]: cluster 2021-03-10T20:49:12.986793+0000 mgr.gibba044.wflcwh (mgr.34466) 2192 : cluster [DBG] pgmap v1237: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:16.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:16 gibba044 bash[25485]: cluster 2021-03-10T20:49:14.988056+0000 mgr.gibba044.wflcwh (mgr.34466) 2193 : cluster [DBG] pgmap v1238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:16.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:16 gibba023 bash[30844]: cluster 2021-03-10T20:49:14.988056+0000 mgr.gibba044.wflcwh (mgr.34466) 2193 : cluster [DBG] pgmap v1238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:16.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:16 gibba023 bash[31815]: cluster 2021-03-10T20:49:14.988056+0000 mgr.gibba044.wflcwh (mgr.34466) 2193 : cluster [DBG] pgmap v1238: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:18.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:18 gibba044 bash[25485]: cluster 2021-03-10T20:49:16.989393+0000 mgr.gibba044.wflcwh (mgr.34466) 2194 : cluster [DBG] pgmap v1239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:18.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:18 gibba023 bash[30844]: cluster 2021-03-10T20:49:16.989393+0000 mgr.gibba044.wflcwh (mgr.34466) 2194 : cluster [DBG] pgmap v1239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:18.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:18 gibba023 bash[31815]: cluster 2021-03-10T20:49:16.989393+0000 mgr.gibba044.wflcwh (mgr.34466) 2194 : cluster [DBG] pgmap v1239: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:20.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:20 gibba044 bash[25485]: cluster 2021-03-10T20:49:18.990716+0000 mgr.gibba044.wflcwh (mgr.34466) 2195 : cluster [DBG] pgmap v1240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:20.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:20 gibba023 bash[30844]: cluster 2021-03-10T20:49:18.990716+0000 mgr.gibba044.wflcwh (mgr.34466) 2195 : cluster [DBG] pgmap v1240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:20.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:20 gibba023 bash[31815]: cluster 2021-03-10T20:49:18.990716+0000 mgr.gibba044.wflcwh (mgr.34466) 2195 : cluster [DBG] pgmap v1240: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:22.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:22 gibba044 bash[25485]: cluster 2021-03-10T20:49:20.992429+0000 mgr.gibba044.wflcwh (mgr.34466) 2196 : cluster [DBG] pgmap v1241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:22.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:22 gibba044 bash[25485]: audit 2021-03-10T20:49:21.861437+0000 mon.a (mon.0) 1141 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:49:22.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:22 gibba044 bash[25485]: audit 2021-03-10T20:49:22.070027+0000 mon.a (mon.0) 1142 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:49:22.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:22 gibba044 bash[25485]: audit 2021-03-10T20:49:22.087485+0000 mon.a (mon.0) 1143 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:49:22.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:22 gibba044 bash[25485]: audit 2021-03-10T20:49:22.092328+0000 mon.a (mon.0) 1144 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:22.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:22 gibba044 bash[25485]: audit 2021-03-10T20:49:22.096746+0000 mon.a (mon.0) 1145 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:22.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:22 gibba044 bash[25485]: audit 2021-03-10T20:49:22.100397+0000 mon.a (mon.0) 1146 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:22.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:22 gibba044 bash[25485]: audit 2021-03-10T20:49:22.107720+0000 mon.a (mon.0) 1147 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:22.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:22 gibba044 bash[25485]: audit 2021-03-10T20:49:22.112948+0000 mon.a (mon.0) 1148 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:22.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:22 gibba023 bash[30844]: cluster 2021-03-10T20:49:20.992429+0000 mgr.gibba044.wflcwh (mgr.34466) 2196 : cluster [DBG] pgmap v1241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:22.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:22 gibba023 bash[30844]: audit 2021-03-10T20:49:21.861437+0000 mon.a (mon.0) 1141 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:49:22.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:22 gibba023 bash[30844]: audit 2021-03-10T20:49:22.070027+0000 mon.a (mon.0) 1142 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:49:22.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:22 gibba023 bash[30844]: audit 2021-03-10T20:49:22.087485+0000 mon.a (mon.0) 1143 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:49:22.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:22 gibba023 bash[30844]: audit 2021-03-10T20:49:22.092328+0000 mon.a (mon.0) 1144 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:22.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:22 gibba023 bash[30844]: audit 2021-03-10T20:49:22.096746+0000 mon.a (mon.0) 1145 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:22.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:22 gibba023 bash[30844]: audit 2021-03-10T20:49:22.100397+0000 mon.a (mon.0) 1146 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:22.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:22 gibba023 bash[30844]: audit 2021-03-10T20:49:22.107720+0000 mon.a (mon.0) 1147 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:22.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:22 gibba023 bash[30844]: audit 2021-03-10T20:49:22.112948+0000 mon.a (mon.0) 1148 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:22.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:22 gibba023 bash[31815]: cluster 2021-03-10T20:49:20.992429+0000 mgr.gibba044.wflcwh (mgr.34466) 2196 : cluster [DBG] pgmap v1241: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:22.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:22 gibba023 bash[31815]: audit 2021-03-10T20:49:21.861437+0000 mon.a (mon.0) 1141 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:49:22.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:22 gibba023 bash[31815]: audit 2021-03-10T20:49:22.070027+0000 mon.a (mon.0) 1142 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:49:22.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:22 gibba023 bash[31815]: audit 2021-03-10T20:49:22.087485+0000 mon.a (mon.0) 1143 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:49:22.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:22 gibba023 bash[31815]: audit 2021-03-10T20:49:22.092328+0000 mon.a (mon.0) 1144 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:22.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:22 gibba023 bash[31815]: audit 2021-03-10T20:49:22.096746+0000 mon.a (mon.0) 1145 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:22.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:22 gibba023 bash[31815]: audit 2021-03-10T20:49:22.100397+0000 mon.a (mon.0) 1146 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:22.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:22 gibba023 bash[31815]: audit 2021-03-10T20:49:22.107720+0000 mon.a (mon.0) 1147 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:22.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:22 gibba023 bash[31815]: audit 2021-03-10T20:49:22.112948+0000 mon.a (mon.0) 1148 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:23.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:23 gibba044 bash[25485]: cephadm 2021-03-10T20:49:21.664225+0000 mgr.gibba044.wflcwh (mgr.34466) 2197 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:49:23.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:23 gibba044 bash[25485]: cephadm 2021-03-10T20:49:21.862426+0000 mgr.gibba044.wflcwh (mgr.34466) 2198 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:49:23.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:23 gibba044 bash[25485]: cephadm 2021-03-10T20:49:22.085100+0000 mgr.gibba044.wflcwh (mgr.34466) 2199 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:49:23.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:23 gibba044 bash[25485]: cephadm 2021-03-10T20:49:22.091104+0000 mgr.gibba044.wflcwh (mgr.34466) 2200 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:49:23.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:23 gibba044 bash[25485]: cephadm 2021-03-10T20:49:22.095324+0000 mgr.gibba044.wflcwh (mgr.34466) 2201 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:49:23.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:23 gibba044 bash[25485]: cephadm 2021-03-10T20:49:22.095942+0000 mgr.gibba044.wflcwh (mgr.34466) 2202 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:49:23.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:23 gibba044 bash[25485]: cephadm 2021-03-10T20:49:22.099494+0000 mgr.gibba044.wflcwh (mgr.34466) 2203 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:49:23.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:23 gibba044 bash[25485]: cephadm 2021-03-10T20:49:22.100050+0000 mgr.gibba044.wflcwh (mgr.34466) 2204 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:49:23.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:23 gibba044 bash[25485]: cephadm 2021-03-10T20:49:22.103139+0000 mgr.gibba044.wflcwh (mgr.34466) 2205 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:49:23.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:23 gibba044 bash[25485]: cephadm 2021-03-10T20:49:22.106101+0000 mgr.gibba044.wflcwh (mgr.34466) 2206 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:49:23.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:23 gibba044 bash[25485]: cephadm 2021-03-10T20:49:22.106386+0000 mgr.gibba044.wflcwh (mgr.34466) 2207 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:49:23.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:23 gibba044 bash[25485]: cephadm 2021-03-10T20:49:22.110412+0000 mgr.gibba044.wflcwh (mgr.34466) 2208 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:49:23.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:23 gibba044 bash[25485]: cephadm 2021-03-10T20:49:22.112522+0000 mgr.gibba044.wflcwh (mgr.34466) 2209 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:49:23.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:23 gibba044 bash[25485]: cephadm 2021-03-10T20:49:22.115551+0000 mgr.gibba044.wflcwh (mgr.34466) 2210 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:49:23.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:23 gibba044 bash[25485]: cephadm 2021-03-10T20:49:22.115970+0000 mgr.gibba044.wflcwh (mgr.34466) 2211 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:49:23.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:23 gibba044 bash[25485]: cephadm 2021-03-10T20:49:22.116817+0000 mgr.gibba044.wflcwh (mgr.34466) 2212 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:49:23.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[30844]: cephadm 2021-03-10T20:49:21.664225+0000 mgr.gibba044.wflcwh (mgr.34466) 2197 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:49:23.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[30844]: cephadm 2021-03-10T20:49:21.862426+0000 mgr.gibba044.wflcwh (mgr.34466) 2198 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:49:23.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[30844]: cephadm 2021-03-10T20:49:22.085100+0000 mgr.gibba044.wflcwh (mgr.34466) 2199 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:49:23.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[30844]: cephadm 2021-03-10T20:49:22.091104+0000 mgr.gibba044.wflcwh (mgr.34466) 2200 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:49:23.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[30844]: cephadm 2021-03-10T20:49:22.095324+0000 mgr.gibba044.wflcwh (mgr.34466) 2201 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:49:23.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[30844]: cephadm 2021-03-10T20:49:22.095942+0000 mgr.gibba044.wflcwh (mgr.34466) 2202 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:49:23.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[30844]: cephadm 2021-03-10T20:49:22.099494+0000 mgr.gibba044.wflcwh (mgr.34466) 2203 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:49:23.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[30844]: cephadm 2021-03-10T20:49:22.100050+0000 mgr.gibba044.wflcwh (mgr.34466) 2204 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:49:23.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[30844]: cephadm 2021-03-10T20:49:22.103139+0000 mgr.gibba044.wflcwh (mgr.34466) 2205 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:49:23.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[30844]: cephadm 2021-03-10T20:49:22.106101+0000 mgr.gibba044.wflcwh (mgr.34466) 2206 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:49:23.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[30844]: cephadm 2021-03-10T20:49:22.106386+0000 mgr.gibba044.wflcwh (mgr.34466) 2207 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:49:23.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[30844]: cephadm 2021-03-10T20:49:22.110412+0000 mgr.gibba044.wflcwh (mgr.34466) 2208 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:49:23.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[30844]: cephadm 2021-03-10T20:49:22.112522+0000 mgr.gibba044.wflcwh (mgr.34466) 2209 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:49:23.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[30844]: cephadm 2021-03-10T20:49:22.115551+0000 mgr.gibba044.wflcwh (mgr.34466) 2210 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:49:23.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[30844]: cephadm 2021-03-10T20:49:22.115970+0000 mgr.gibba044.wflcwh (mgr.34466) 2211 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:49:23.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[30844]: cephadm 2021-03-10T20:49:22.116817+0000 mgr.gibba044.wflcwh (mgr.34466) 2212 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:49:23.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[31815]: cephadm 2021-03-10T20:49:21.664225+0000 mgr.gibba044.wflcwh (mgr.34466) 2197 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:49:23.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[31815]: cephadm 2021-03-10T20:49:21.862426+0000 mgr.gibba044.wflcwh (mgr.34466) 2198 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:49:23.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[31815]: cephadm 2021-03-10T20:49:22.085100+0000 mgr.gibba044.wflcwh (mgr.34466) 2199 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:49:23.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[31815]: cephadm 2021-03-10T20:49:22.091104+0000 mgr.gibba044.wflcwh (mgr.34466) 2200 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:49:23.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[31815]: cephadm 2021-03-10T20:49:22.095324+0000 mgr.gibba044.wflcwh (mgr.34466) 2201 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:49:23.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[31815]: cephadm 2021-03-10T20:49:22.095942+0000 mgr.gibba044.wflcwh (mgr.34466) 2202 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:49:23.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[31815]: cephadm 2021-03-10T20:49:22.099494+0000 mgr.gibba044.wflcwh (mgr.34466) 2203 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:49:23.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[31815]: cephadm 2021-03-10T20:49:22.100050+0000 mgr.gibba044.wflcwh (mgr.34466) 2204 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:49:23.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[31815]: cephadm 2021-03-10T20:49:22.103139+0000 mgr.gibba044.wflcwh (mgr.34466) 2205 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:49:23.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[31815]: cephadm 2021-03-10T20:49:22.106101+0000 mgr.gibba044.wflcwh (mgr.34466) 2206 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:49:23.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[31815]: cephadm 2021-03-10T20:49:22.106386+0000 mgr.gibba044.wflcwh (mgr.34466) 2207 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:49:23.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[31815]: cephadm 2021-03-10T20:49:22.110412+0000 mgr.gibba044.wflcwh (mgr.34466) 2208 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:49:23.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[31815]: cephadm 2021-03-10T20:49:22.112522+0000 mgr.gibba044.wflcwh (mgr.34466) 2209 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:49:23.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[31815]: cephadm 2021-03-10T20:49:22.115551+0000 mgr.gibba044.wflcwh (mgr.34466) 2210 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:49:23.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[31815]: cephadm 2021-03-10T20:49:22.115970+0000 mgr.gibba044.wflcwh (mgr.34466) 2211 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:49:23.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:23 gibba023 bash[31815]: cephadm 2021-03-10T20:49:22.116817+0000 mgr.gibba044.wflcwh (mgr.34466) 2212 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:49:24.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:24 gibba044 bash[25485]: cluster 2021-03-10T20:49:22.993963+0000 mgr.gibba044.wflcwh (mgr.34466) 2213 : cluster [DBG] pgmap v1242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:24.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:24 gibba023 bash[30844]: cluster 2021-03-10T20:49:22.993963+0000 mgr.gibba044.wflcwh (mgr.34466) 2213 : cluster [DBG] pgmap v1242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:24.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:24 gibba023 bash[31815]: cluster 2021-03-10T20:49:22.993963+0000 mgr.gibba044.wflcwh (mgr.34466) 2213 : cluster [DBG] pgmap v1242: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:26.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:26 gibba044 bash[25485]: cluster 2021-03-10T20:49:24.995145+0000 mgr.gibba044.wflcwh (mgr.34466) 2214 : cluster [DBG] pgmap v1243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:26.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:26 gibba023 bash[30844]: cluster 2021-03-10T20:49:24.995145+0000 mgr.gibba044.wflcwh (mgr.34466) 2214 : cluster [DBG] pgmap v1243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:26.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:26 gibba023 bash[31815]: cluster 2021-03-10T20:49:24.995145+0000 mgr.gibba044.wflcwh (mgr.34466) 2214 : cluster [DBG] pgmap v1243: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:28.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:28 gibba044 bash[25485]: cluster 2021-03-10T20:49:26.996431+0000 mgr.gibba044.wflcwh (mgr.34466) 2215 : cluster [DBG] pgmap v1244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:28 gibba044 bash[25485]: audit 2021-03-10T20:49:27.293128+0000 mon.a (mon.0) 1149 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:49:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:28 gibba044 bash[25485]: audit 2021-03-10T20:49:27.293791+0000 mon.a (mon.0) 1150 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:49:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:28 gibba044 bash[25485]: audit 2021-03-10T20:49:27.295931+0000 mon.a (mon.0) 1151 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:49:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:28 gibba044 bash[25485]: audit 2021-03-10T20:49:27.296713+0000 mon.a (mon.0) 1152 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:49:28.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:28 gibba044 bash[25485]: audit 2021-03-10T20:49:27.297428+0000 mon.a (mon.0) 1153 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:49:28.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:28 gibba044 bash[25485]: audit 2021-03-10T20:49:27.298127+0000 mon.a (mon.0) 1154 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:49:28.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:28 gibba023 bash[30844]: cluster 2021-03-10T20:49:26.996431+0000 mgr.gibba044.wflcwh (mgr.34466) 2215 : cluster [DBG] pgmap v1244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:28.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:28 gibba023 bash[30844]: audit 2021-03-10T20:49:27.293128+0000 mon.a (mon.0) 1149 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:49:28.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:28 gibba023 bash[30844]: audit 2021-03-10T20:49:27.293791+0000 mon.a (mon.0) 1150 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:49:28.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:28 gibba023 bash[30844]: audit 2021-03-10T20:49:27.295931+0000 mon.a (mon.0) 1151 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:49:28.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:28 gibba023 bash[30844]: audit 2021-03-10T20:49:27.296713+0000 mon.a (mon.0) 1152 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:49:28.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:28 gibba023 bash[30844]: audit 2021-03-10T20:49:27.297428+0000 mon.a (mon.0) 1153 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:49:28.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:28 gibba023 bash[30844]: audit 2021-03-10T20:49:27.298127+0000 mon.a (mon.0) 1154 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:49:28.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:28 gibba023 bash[31815]: cluster 2021-03-10T20:49:26.996431+0000 mgr.gibba044.wflcwh (mgr.34466) 2215 : cluster [DBG] pgmap v1244: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:28.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:28 gibba023 bash[31815]: audit 2021-03-10T20:49:27.293128+0000 mon.a (mon.0) 1149 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:49:28.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:28 gibba023 bash[31815]: audit 2021-03-10T20:49:27.293791+0000 mon.a (mon.0) 1150 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:49:28.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:28 gibba023 bash[31815]: audit 2021-03-10T20:49:27.295931+0000 mon.a (mon.0) 1151 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-03-10T20:49:28.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:28 gibba023 bash[31815]: audit 2021-03-10T20:49:27.296713+0000 mon.a (mon.0) 1152 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:49:28.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:28 gibba023 bash[31815]: audit 2021-03-10T20:49:27.297428+0000 mon.a (mon.0) 1153 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:49:28.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:28 gibba023 bash[31815]: audit 2021-03-10T20:49:27.298127+0000 mon.a (mon.0) 1154 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:49:30.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:30 gibba044 bash[25485]: cluster 2021-03-10T20:49:28.997910+0000 mgr.gibba044.wflcwh (mgr.34466) 2216 : cluster [DBG] pgmap v1245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:30.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:30 gibba023 bash[30844]: cluster 2021-03-10T20:49:28.997910+0000 mgr.gibba044.wflcwh (mgr.34466) 2216 : cluster [DBG] pgmap v1245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:30.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:30 gibba023 bash[31815]: cluster 2021-03-10T20:49:28.997910+0000 mgr.gibba044.wflcwh (mgr.34466) 2216 : cluster [DBG] pgmap v1245: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:32.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:32 gibba023 bash[30844]: cluster 2021-03-10T20:49:30.999483+0000 mgr.gibba044.wflcwh (mgr.34466) 2217 : cluster [DBG] pgmap v1246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:32.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:32 gibba023 bash[31815]: cluster 2021-03-10T20:49:30.999483+0000 mgr.gibba044.wflcwh (mgr.34466) 2217 : cluster [DBG] pgmap v1246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:32.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:32 gibba044 bash[25485]: cluster 2021-03-10T20:49:30.999483+0000 mgr.gibba044.wflcwh (mgr.34466) 2217 : cluster [DBG] pgmap v1246: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:34.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:34 gibba023 bash[30844]: cluster 2021-03-10T20:49:33.001020+0000 mgr.gibba044.wflcwh (mgr.34466) 2218 : cluster [DBG] pgmap v1247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:34.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:34 gibba023 bash[31815]: cluster 2021-03-10T20:49:33.001020+0000 mgr.gibba044.wflcwh (mgr.34466) 2218 : cluster [DBG] pgmap v1247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:34.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:34 gibba044 bash[25485]: cluster 2021-03-10T20:49:33.001020+0000 mgr.gibba044.wflcwh (mgr.34466) 2218 : cluster [DBG] pgmap v1247: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:36.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:36 gibba023 bash[30844]: cluster 2021-03-10T20:49:35.002220+0000 mgr.gibba044.wflcwh (mgr.34466) 2219 : cluster [DBG] pgmap v1248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:36.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:36 gibba023 bash[31815]: cluster 2021-03-10T20:49:35.002220+0000 mgr.gibba044.wflcwh (mgr.34466) 2219 : cluster [DBG] pgmap v1248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:36.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:36 gibba044 bash[25485]: cluster 2021-03-10T20:49:35.002220+0000 mgr.gibba044.wflcwh (mgr.34466) 2219 : cluster [DBG] pgmap v1248: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:38.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:38 gibba023 bash[30844]: cluster 2021-03-10T20:49:37.003701+0000 mgr.gibba044.wflcwh (mgr.34466) 2220 : cluster [DBG] pgmap v1249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:38.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:38 gibba023 bash[30844]: cephadm 2021-03-10T20:49:37.133023+0000 mgr.gibba044.wflcwh (mgr.34466) 2221 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:49:38.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:38 gibba023 bash[31815]: cluster 2021-03-10T20:49:37.003701+0000 mgr.gibba044.wflcwh (mgr.34466) 2220 : cluster [DBG] pgmap v1249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:38.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:38 gibba023 bash[31815]: cephadm 2021-03-10T20:49:37.133023+0000 mgr.gibba044.wflcwh (mgr.34466) 2221 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:49:38.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:38 gibba044 bash[25485]: cluster 2021-03-10T20:49:37.003701+0000 mgr.gibba044.wflcwh (mgr.34466) 2220 : cluster [DBG] pgmap v1249: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:38.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:38 gibba044 bash[25485]: cephadm 2021-03-10T20:49:37.133023+0000 mgr.gibba044.wflcwh (mgr.34466) 2221 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:49:40.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:40 gibba023 bash[30844]: cluster 2021-03-10T20:49:39.005190+0000 mgr.gibba044.wflcwh (mgr.34466) 2222 : cluster [DBG] pgmap v1250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:40.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:40 gibba023 bash[31815]: cluster 2021-03-10T20:49:39.005190+0000 mgr.gibba044.wflcwh (mgr.34466) 2222 : cluster [DBG] pgmap v1250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:40.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:40 gibba044 bash[25485]: cluster 2021-03-10T20:49:39.005190+0000 mgr.gibba044.wflcwh (mgr.34466) 2222 : cluster [DBG] pgmap v1250: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:42.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:42 gibba023 bash[30844]: cluster 2021-03-10T20:49:41.006773+0000 mgr.gibba044.wflcwh (mgr.34466) 2223 : cluster [DBG] pgmap v1251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:42.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:42 gibba023 bash[31815]: cluster 2021-03-10T20:49:41.006773+0000 mgr.gibba044.wflcwh (mgr.34466) 2223 : cluster [DBG] pgmap v1251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:42.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:42 gibba044 bash[25485]: cluster 2021-03-10T20:49:41.006773+0000 mgr.gibba044.wflcwh (mgr.34466) 2223 : cluster [DBG] pgmap v1251: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:43.313 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:49:43.571 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:49:43.572 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (40m) 6m ago 46m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:49:43.572 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (46m) 5m ago 46m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:49:43.573 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (41m) 5m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:49:43.573 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (41m) 5m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:49:43.573 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (40m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:49:43.573 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (40m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:49:43.574 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (39m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:49:43.574 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (40m) 6m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:49:43.574 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (46m) 6m ago 46m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:49:43.574 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (46m) 5m ago 46m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:49:43.575 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (39m) 6m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:49:43.575 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (38m) 6m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:49:43.575 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (38m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:49:43.575 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (37m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:49:43.575 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (37m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:49:43.576 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (36m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:49:43.576 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (36m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:49:43.576 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (36m) 5m ago 46m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:49:43.576 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (45m) 5m ago 46m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:49:43.576 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 6m ago 44m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:49:43.577 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 5m ago 44m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:49:43.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:43 gibba023 bash[30844]: cluster 2021-03-10T20:49:43.008329+0000 mgr.gibba044.wflcwh (mgr.34466) 2224 : cluster [DBG] pgmap v1252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:43.674 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:43 gibba023 bash[31815]: cluster 2021-03-10T20:49:43.008329+0000 mgr.gibba044.wflcwh (mgr.34466) 2224 : cluster [DBG] pgmap v1252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:43.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:43 gibba044 bash[25485]: cluster 2021-03-10T20:49:43.008329+0000 mgr.gibba044.wflcwh (mgr.34466) 2224 : cluster [DBG] pgmap v1252: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:43.844 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:49:43.844 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:49:43.845 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:49:43.845 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:49:43.846 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:49:43.846 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:49:43.846 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:49:43.847 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:49:43.847 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:49:43.848 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:49:43.848 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:49:43.848 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:49:43.849 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:49:43.849 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:49:43.849 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:49:44.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:44 gibba023 bash[30844]: audit 2021-03-10T20:49:43.305917+0000 mgr.gibba044.wflcwh (mgr.34466) 2225 : audit [DBG] from='client.55531 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:49:44.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:44 gibba023 bash[30844]: audit 2021-03-10T20:49:43.531061+0000 mgr.gibba044.wflcwh (mgr.34466) 2226 : audit [DBG] from='client.55537 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:49:44.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:44 gibba023 bash[30844]: audit 2021-03-10T20:49:43.843777+0000 mon.c (mon.1) 57 : audit [DBG] from='client.? 172.21.2.123:0/3513527224' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:44.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:44 gibba023 bash[31815]: audit 2021-03-10T20:49:43.305917+0000 mgr.gibba044.wflcwh (mgr.34466) 2225 : audit [DBG] from='client.55531 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:49:44.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:44 gibba023 bash[31815]: audit 2021-03-10T20:49:43.531061+0000 mgr.gibba044.wflcwh (mgr.34466) 2226 : audit [DBG] from='client.55537 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:49:44.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:44 gibba023 bash[31815]: audit 2021-03-10T20:49:43.843777+0000 mon.c (mon.1) 57 : audit [DBG] from='client.? 172.21.2.123:0/3513527224' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:44.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:44 gibba044 bash[25485]: audit 2021-03-10T20:49:43.305917+0000 mgr.gibba044.wflcwh (mgr.34466) 2225 : audit [DBG] from='client.55531 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:49:44.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:44 gibba044 bash[25485]: audit 2021-03-10T20:49:43.531061+0000 mgr.gibba044.wflcwh (mgr.34466) 2226 : audit [DBG] from='client.55537 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:49:44.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:44 gibba044 bash[25485]: audit 2021-03-10T20:49:43.843777+0000 mon.c (mon.1) 57 : audit [DBG] from='client.? 172.21.2.123:0/3513527224' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:49:45.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:45 gibba023 bash[30844]: cluster 2021-03-10T20:49:45.009683+0000 mgr.gibba044.wflcwh (mgr.34466) 2227 : cluster [DBG] pgmap v1253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:45.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:45 gibba023 bash[31815]: cluster 2021-03-10T20:49:45.009683+0000 mgr.gibba044.wflcwh (mgr.34466) 2227 : cluster [DBG] pgmap v1253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:45.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:45 gibba044 bash[25485]: cluster 2021-03-10T20:49:45.009683+0000 mgr.gibba044.wflcwh (mgr.34466) 2227 : cluster [DBG] pgmap v1253: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:48.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:48 gibba023 bash[30844]: cluster 2021-03-10T20:49:47.011351+0000 mgr.gibba044.wflcwh (mgr.34466) 2228 : cluster [DBG] pgmap v1254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:48.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:48 gibba023 bash[31815]: cluster 2021-03-10T20:49:47.011351+0000 mgr.gibba044.wflcwh (mgr.34466) 2228 : cluster [DBG] pgmap v1254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:48.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:48 gibba044 bash[25485]: cluster 2021-03-10T20:49:47.011351+0000 mgr.gibba044.wflcwh (mgr.34466) 2228 : cluster [DBG] pgmap v1254: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:50.424 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:50 gibba023 bash[30844]: cluster 2021-03-10T20:49:49.013095+0000 mgr.gibba044.wflcwh (mgr.34466) 2229 : cluster [DBG] pgmap v1255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:50.425 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:50 gibba023 bash[31815]: cluster 2021-03-10T20:49:49.013095+0000 mgr.gibba044.wflcwh (mgr.34466) 2229 : cluster [DBG] pgmap v1255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:50.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:50 gibba044 bash[25485]: cluster 2021-03-10T20:49:49.013095+0000 mgr.gibba044.wflcwh (mgr.34466) 2229 : cluster [DBG] pgmap v1255: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:52.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:52 gibba044 bash[25485]: cluster 2021-03-10T20:49:51.014656+0000 mgr.gibba044.wflcwh (mgr.34466) 2230 : cluster [DBG] pgmap v1256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:52.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:52 gibba023 bash[30844]: cluster 2021-03-10T20:49:51.014656+0000 mgr.gibba044.wflcwh (mgr.34466) 2230 : cluster [DBG] pgmap v1256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:52.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:52 gibba023 bash[31815]: cluster 2021-03-10T20:49:51.014656+0000 mgr.gibba044.wflcwh (mgr.34466) 2230 : cluster [DBG] pgmap v1256: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:53.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:53 gibba044 bash[25485]: cephadm 2021-03-10T20:49:52.140705+0000 mgr.gibba044.wflcwh (mgr.34466) 2231 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:49:53.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:53 gibba023 bash[30844]: cephadm 2021-03-10T20:49:52.140705+0000 mgr.gibba044.wflcwh (mgr.34466) 2231 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:49:53.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:53 gibba023 bash[31815]: cephadm 2021-03-10T20:49:52.140705+0000 mgr.gibba044.wflcwh (mgr.34466) 2231 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:49:54.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:54 gibba044 bash[25485]: cluster 2021-03-10T20:49:53.016316+0000 mgr.gibba044.wflcwh (mgr.34466) 2232 : cluster [DBG] pgmap v1257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:54.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:54 gibba023 bash[30844]: cluster 2021-03-10T20:49:53.016316+0000 mgr.gibba044.wflcwh (mgr.34466) 2232 : cluster [DBG] pgmap v1257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:54.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:54 gibba023 bash[31815]: cluster 2021-03-10T20:49:53.016316+0000 mgr.gibba044.wflcwh (mgr.34466) 2232 : cluster [DBG] pgmap v1257: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:56.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:56 gibba044 bash[25485]: cluster 2021-03-10T20:49:55.017561+0000 mgr.gibba044.wflcwh (mgr.34466) 2233 : cluster [DBG] pgmap v1258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:56.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:56 gibba023 bash[30844]: cluster 2021-03-10T20:49:55.017561+0000 mgr.gibba044.wflcwh (mgr.34466) 2233 : cluster [DBG] pgmap v1258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:56.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:56 gibba023 bash[31815]: cluster 2021-03-10T20:49:55.017561+0000 mgr.gibba044.wflcwh (mgr.34466) 2233 : cluster [DBG] pgmap v1258: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:58.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:49:58 gibba044 bash[25485]: cluster 2021-03-10T20:49:57.019142+0000 mgr.gibba044.wflcwh (mgr.34466) 2234 : cluster [DBG] pgmap v1259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:58.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:49:58 gibba023 bash[30844]: cluster 2021-03-10T20:49:57.019142+0000 mgr.gibba044.wflcwh (mgr.34466) 2234 : cluster [DBG] pgmap v1259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:49:58.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:49:58 gibba023 bash[31815]: cluster 2021-03-10T20:49:57.019142+0000 mgr.gibba044.wflcwh (mgr.34466) 2234 : cluster [DBG] pgmap v1259: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:00.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:00 gibba023 bash[30844]: debug 2021-03-10T20:49:59.999+0000 7fa7fde59700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:50:00.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:00 gibba023 bash[30844]: cluster 2021-03-10T20:49:59.020764+0000 mgr.gibba044.wflcwh (mgr.34466) 2235 : cluster [DBG] pgmap v1260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:00.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:00 gibba023 bash[30844]: cluster 2021-03-10T20:50:00.000361+0000 mon.a (mon.0) 1155 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:50:00.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:00 gibba023 bash[31815]: cluster 2021-03-10T20:49:59.020764+0000 mgr.gibba044.wflcwh (mgr.34466) 2235 : cluster [DBG] pgmap v1260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:00.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:00 gibba023 bash[31815]: cluster 2021-03-10T20:50:00.000361+0000 mon.a (mon.0) 1155 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:50:00.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:00 gibba044 bash[25485]: cluster 2021-03-10T20:49:59.020764+0000 mgr.gibba044.wflcwh (mgr.34466) 2235 : cluster [DBG] pgmap v1260: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:00.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:00 gibba044 bash[25485]: cluster 2021-03-10T20:50:00.000361+0000 mon.a (mon.0) 1155 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T20:50:02.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:02 gibba044 bash[25485]: cluster 2021-03-10T20:50:01.022416+0000 mgr.gibba044.wflcwh (mgr.34466) 2236 : cluster [DBG] pgmap v1261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:02.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:02 gibba023 bash[30844]: cluster 2021-03-10T20:50:01.022416+0000 mgr.gibba044.wflcwh (mgr.34466) 2236 : cluster [DBG] pgmap v1261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:02.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:02 gibba023 bash[31815]: cluster 2021-03-10T20:50:01.022416+0000 mgr.gibba044.wflcwh (mgr.34466) 2236 : cluster [DBG] pgmap v1261: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:04.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:04 gibba044 bash[25485]: cluster 2021-03-10T20:50:03.024008+0000 mgr.gibba044.wflcwh (mgr.34466) 2237 : cluster [DBG] pgmap v1262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:04.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:04 gibba023 bash[30844]: cluster 2021-03-10T20:50:03.024008+0000 mgr.gibba044.wflcwh (mgr.34466) 2237 : cluster [DBG] pgmap v1262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:04.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:04 gibba023 bash[31815]: cluster 2021-03-10T20:50:03.024008+0000 mgr.gibba044.wflcwh (mgr.34466) 2237 : cluster [DBG] pgmap v1262: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:06.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:06 gibba044 bash[25485]: cluster 2021-03-10T20:50:05.025245+0000 mgr.gibba044.wflcwh (mgr.34466) 2238 : cluster [DBG] pgmap v1263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:06.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:06 gibba023 bash[30844]: cluster 2021-03-10T20:50:05.025245+0000 mgr.gibba044.wflcwh (mgr.34466) 2238 : cluster [DBG] pgmap v1263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:06.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:06 gibba023 bash[31815]: cluster 2021-03-10T20:50:05.025245+0000 mgr.gibba044.wflcwh (mgr.34466) 2238 : cluster [DBG] pgmap v1263: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:08.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:08 gibba023 bash[30844]: cluster 2021-03-10T20:50:07.026577+0000 mgr.gibba044.wflcwh (mgr.34466) 2239 : cluster [DBG] pgmap v1264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:08.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:08 gibba023 bash[30844]: cephadm 2021-03-10T20:50:07.156501+0000 mgr.gibba044.wflcwh (mgr.34466) 2240 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:50:08.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:08 gibba023 bash[31815]: cluster 2021-03-10T20:50:07.026577+0000 mgr.gibba044.wflcwh (mgr.34466) 2239 : cluster [DBG] pgmap v1264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:08.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:08 gibba023 bash[31815]: cephadm 2021-03-10T20:50:07.156501+0000 mgr.gibba044.wflcwh (mgr.34466) 2240 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:50:08.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:08 gibba044 bash[25485]: cluster 2021-03-10T20:50:07.026577+0000 mgr.gibba044.wflcwh (mgr.34466) 2239 : cluster [DBG] pgmap v1264: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:08.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:08 gibba044 bash[25485]: cephadm 2021-03-10T20:50:07.156501+0000 mgr.gibba044.wflcwh (mgr.34466) 2240 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:50:10.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:10 gibba023 bash[30844]: cluster 2021-03-10T20:50:09.028467+0000 mgr.gibba044.wflcwh (mgr.34466) 2241 : cluster [DBG] pgmap v1265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:10.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:10 gibba023 bash[31815]: cluster 2021-03-10T20:50:09.028467+0000 mgr.gibba044.wflcwh (mgr.34466) 2241 : cluster [DBG] pgmap v1265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:10.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:10 gibba044 bash[25485]: cluster 2021-03-10T20:50:09.028467+0000 mgr.gibba044.wflcwh (mgr.34466) 2241 : cluster [DBG] pgmap v1265: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:12.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:12 gibba023 bash[30844]: cluster 2021-03-10T20:50:11.030204+0000 mgr.gibba044.wflcwh (mgr.34466) 2242 : cluster [DBG] pgmap v1266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:12.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:12 gibba023 bash[31815]: cluster 2021-03-10T20:50:11.030204+0000 mgr.gibba044.wflcwh (mgr.34466) 2242 : cluster [DBG] pgmap v1266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:12.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:12 gibba044 bash[25485]: cluster 2021-03-10T20:50:11.030204+0000 mgr.gibba044.wflcwh (mgr.34466) 2242 : cluster [DBG] pgmap v1266: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:14.095 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:50:14.319 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:50:14.319 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (41m) 6m ago 46m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:50:14.319 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (46m) 5m ago 46m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:50:14.320 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (41m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:50:14.320 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (42m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:50:14.320 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (41m) 6m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:50:14.320 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (40m) 6m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:50:14.320 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (40m) 5m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:50:14.321 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (40m) 6m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:50:14.321 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (47m) 6m ago 47m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:50:14.321 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (47m) 5m ago 47m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:50:14.321 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (39m) 6m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:50:14.322 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (39m) 6m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:50:14.322 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (38m) 6m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:50:14.322 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (38m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:50:14.322 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (37m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:50:14.323 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (37m) 5m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:50:14.323 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (37m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:50:14.323 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (36m) 5m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:50:14.323 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (46m) 5m ago 47m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:50:14.323 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 6m ago 44m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:50:14.324 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 5m ago 44m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:50:14.569 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:50:14.569 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:50:14.569 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:50:14.570 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:50:14.570 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:50:14.570 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:50:14.570 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:50:14.570 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:50:14.571 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:50:14.571 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:50:14.571 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:50:14.571 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:50:14.572 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:50:14.572 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:50:14.572 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:50:14.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:14 gibba023 bash[30844]: cluster 2021-03-10T20:50:13.031931+0000 mgr.gibba044.wflcwh (mgr.34466) 2243 : cluster [DBG] pgmap v1267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:14.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:14 gibba023 bash[31815]: cluster 2021-03-10T20:50:13.031931+0000 mgr.gibba044.wflcwh (mgr.34466) 2243 : cluster [DBG] pgmap v1267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:14.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:14 gibba044 bash[25485]: cluster 2021-03-10T20:50:13.031931+0000 mgr.gibba044.wflcwh (mgr.34466) 2243 : cluster [DBG] pgmap v1267: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:15.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:15 gibba023 bash[30844]: audit 2021-03-10T20:50:14.086813+0000 mgr.gibba044.wflcwh (mgr.34466) 2244 : audit [DBG] from='client.55549 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:50:15.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:15 gibba023 bash[30844]: audit 2021-03-10T20:50:14.309937+0000 mgr.gibba044.wflcwh (mgr.34466) 2245 : audit [DBG] from='client.45576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:50:15.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:15 gibba023 bash[30844]: audit 2021-03-10T20:50:14.568766+0000 mon.a (mon.0) 1156 : audit [DBG] from='client.? 172.21.2.123:0/466122327' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:15.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:15 gibba023 bash[31815]: audit 2021-03-10T20:50:14.086813+0000 mgr.gibba044.wflcwh (mgr.34466) 2244 : audit [DBG] from='client.55549 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:50:15.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:15 gibba023 bash[31815]: audit 2021-03-10T20:50:14.309937+0000 mgr.gibba044.wflcwh (mgr.34466) 2245 : audit [DBG] from='client.45576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:50:15.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:15 gibba023 bash[31815]: audit 2021-03-10T20:50:14.568766+0000 mon.a (mon.0) 1156 : audit [DBG] from='client.? 172.21.2.123:0/466122327' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:15.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:15 gibba044 bash[25485]: audit 2021-03-10T20:50:14.086813+0000 mgr.gibba044.wflcwh (mgr.34466) 2244 : audit [DBG] from='client.55549 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:50:15.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:15 gibba044 bash[25485]: audit 2021-03-10T20:50:14.309937+0000 mgr.gibba044.wflcwh (mgr.34466) 2245 : audit [DBG] from='client.45576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:50:15.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:15 gibba044 bash[25485]: audit 2021-03-10T20:50:14.568766+0000 mon.a (mon.0) 1156 : audit [DBG] from='client.? 172.21.2.123:0/466122327' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:16.674 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:16 gibba023 bash[30844]: cluster 2021-03-10T20:50:15.033142+0000 mgr.gibba044.wflcwh (mgr.34466) 2246 : cluster [DBG] pgmap v1268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:16.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:16 gibba023 bash[31815]: cluster 2021-03-10T20:50:15.033142+0000 mgr.gibba044.wflcwh (mgr.34466) 2246 : cluster [DBG] pgmap v1268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:16.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:16 gibba044 bash[25485]: cluster 2021-03-10T20:50:15.033142+0000 mgr.gibba044.wflcwh (mgr.34466) 2246 : cluster [DBG] pgmap v1268: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:18.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:18 gibba023 bash[30844]: cluster 2021-03-10T20:50:17.034678+0000 mgr.gibba044.wflcwh (mgr.34466) 2247 : cluster [DBG] pgmap v1269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:18.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:18 gibba023 bash[31815]: cluster 2021-03-10T20:50:17.034678+0000 mgr.gibba044.wflcwh (mgr.34466) 2247 : cluster [DBG] pgmap v1269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:18.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:18 gibba044 bash[25485]: cluster 2021-03-10T20:50:17.034678+0000 mgr.gibba044.wflcwh (mgr.34466) 2247 : cluster [DBG] pgmap v1269: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:20.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:20 gibba023 bash[30844]: cluster 2021-03-10T20:50:19.036535+0000 mgr.gibba044.wflcwh (mgr.34466) 2248 : cluster [DBG] pgmap v1270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:20.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:20 gibba023 bash[31815]: cluster 2021-03-10T20:50:19.036535+0000 mgr.gibba044.wflcwh (mgr.34466) 2248 : cluster [DBG] pgmap v1270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:20.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:20 gibba044 bash[25485]: cluster 2021-03-10T20:50:19.036535+0000 mgr.gibba044.wflcwh (mgr.34466) 2248 : cluster [DBG] pgmap v1270: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:22.592 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:22 gibba044 bash[25485]: cluster 2021-03-10T20:50:21.038268+0000 mgr.gibba044.wflcwh (mgr.34466) 2249 : cluster [DBG] pgmap v1271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:22.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:22 gibba023 bash[30844]: cluster 2021-03-10T20:50:21.038268+0000 mgr.gibba044.wflcwh (mgr.34466) 2249 : cluster [DBG] pgmap v1271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:22.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:22 gibba023 bash[31815]: cluster 2021-03-10T20:50:21.038268+0000 mgr.gibba044.wflcwh (mgr.34466) 2249 : cluster [DBG] pgmap v1271: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:23.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:23 gibba023 bash[30844]: cephadm 2021-03-10T20:50:22.169171+0000 mgr.gibba044.wflcwh (mgr.34466) 2250 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:50:23.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:23 gibba023 bash[30844]: audit 2021-03-10T20:50:22.360136+0000 mon.a (mon.0) 1157 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:50:23.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:23 gibba023 bash[30844]: audit 2021-03-10T20:50:22.554528+0000 mon.a (mon.0) 1158 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:50:23.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:23 gibba023 bash[30844]: audit 2021-03-10T20:50:22.558352+0000 mon.a (mon.0) 1159 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:50:23.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:23 gibba023 bash[30844]: audit 2021-03-10T20:50:22.561488+0000 mon.a (mon.0) 1160 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:23.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:23 gibba023 bash[30844]: audit 2021-03-10T20:50:22.566657+0000 mon.a (mon.0) 1161 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:23.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:23 gibba023 bash[30844]: audit 2021-03-10T20:50:22.571267+0000 mon.a (mon.0) 1162 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:23.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:23 gibba023 bash[30844]: audit 2021-03-10T20:50:22.580816+0000 mon.a (mon.0) 1163 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:23.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:23 gibba023 bash[30844]: audit 2021-03-10T20:50:22.587081+0000 mon.a (mon.0) 1164 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:23.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:23 gibba023 bash[31815]: cephadm 2021-03-10T20:50:22.169171+0000 mgr.gibba044.wflcwh (mgr.34466) 2250 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:50:23.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:23 gibba023 bash[31815]: audit 2021-03-10T20:50:22.360136+0000 mon.a (mon.0) 1157 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:50:23.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:23 gibba023 bash[31815]: audit 2021-03-10T20:50:22.554528+0000 mon.a (mon.0) 1158 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:50:23.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:23 gibba023 bash[31815]: audit 2021-03-10T20:50:22.558352+0000 mon.a (mon.0) 1159 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:50:23.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:23 gibba023 bash[31815]: audit 2021-03-10T20:50:22.561488+0000 mon.a (mon.0) 1160 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:23.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:23 gibba023 bash[31815]: audit 2021-03-10T20:50:22.566657+0000 mon.a (mon.0) 1161 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:23.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:23 gibba023 bash[31815]: audit 2021-03-10T20:50:22.571267+0000 mon.a (mon.0) 1162 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:23.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:23 gibba023 bash[31815]: audit 2021-03-10T20:50:22.580816+0000 mon.a (mon.0) 1163 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:23.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:23 gibba023 bash[31815]: audit 2021-03-10T20:50:22.587081+0000 mon.a (mon.0) 1164 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:23.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:23 gibba044 bash[25485]: cephadm 2021-03-10T20:50:22.169171+0000 mgr.gibba044.wflcwh (mgr.34466) 2250 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:50:23.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:23 gibba044 bash[25485]: audit 2021-03-10T20:50:22.360136+0000 mon.a (mon.0) 1157 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:50:23.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:23 gibba044 bash[25485]: audit 2021-03-10T20:50:22.554528+0000 mon.a (mon.0) 1158 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:50:23.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:23 gibba044 bash[25485]: audit 2021-03-10T20:50:22.558352+0000 mon.a (mon.0) 1159 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:50:23.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:23 gibba044 bash[25485]: audit 2021-03-10T20:50:22.561488+0000 mon.a (mon.0) 1160 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:23.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:23 gibba044 bash[25485]: audit 2021-03-10T20:50:22.566657+0000 mon.a (mon.0) 1161 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:23.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:23 gibba044 bash[25485]: audit 2021-03-10T20:50:22.571267+0000 mon.a (mon.0) 1162 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:23.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:23 gibba044 bash[25485]: audit 2021-03-10T20:50:22.580816+0000 mon.a (mon.0) 1163 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:23.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:23 gibba044 bash[25485]: audit 2021-03-10T20:50:22.587081+0000 mon.a (mon.0) 1164 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:24.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[30844]: cephadm 2021-03-10T20:50:22.362595+0000 mgr.gibba044.wflcwh (mgr.34466) 2251 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:50:24.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[30844]: cephadm 2021-03-10T20:50:22.557762+0000 mgr.gibba044.wflcwh (mgr.34466) 2252 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:50:24.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[30844]: cephadm 2021-03-10T20:50:22.560980+0000 mgr.gibba044.wflcwh (mgr.34466) 2253 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:50:24.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[30844]: cephadm 2021-03-10T20:50:22.565114+0000 mgr.gibba044.wflcwh (mgr.34466) 2254 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:50:24.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[30844]: cephadm 2021-03-10T20:50:22.565723+0000 mgr.gibba044.wflcwh (mgr.34466) 2255 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:50:24.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[30844]: cephadm 2021-03-10T20:50:22.570137+0000 mgr.gibba044.wflcwh (mgr.34466) 2256 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:50:24.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[30844]: cephadm 2021-03-10T20:50:22.570395+0000 mgr.gibba044.wflcwh (mgr.34466) 2257 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:50:24.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[30844]: cephadm 2021-03-10T20:50:22.574747+0000 mgr.gibba044.wflcwh (mgr.34466) 2258 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:50:24.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[30844]: cephadm 2021-03-10T20:50:22.578756+0000 mgr.gibba044.wflcwh (mgr.34466) 2259 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:50:24.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[30844]: cephadm 2021-03-10T20:50:22.579235+0000 mgr.gibba044.wflcwh (mgr.34466) 2260 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:50:24.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[30844]: cephadm 2021-03-10T20:50:22.584330+0000 mgr.gibba044.wflcwh (mgr.34466) 2261 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:50:24.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[30844]: cephadm 2021-03-10T20:50:22.586452+0000 mgr.gibba044.wflcwh (mgr.34466) 2262 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:50:24.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[30844]: cephadm 2021-03-10T20:50:22.590796+0000 mgr.gibba044.wflcwh (mgr.34466) 2263 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:50:24.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[30844]: cephadm 2021-03-10T20:50:22.591022+0000 mgr.gibba044.wflcwh (mgr.34466) 2264 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:50:24.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[30844]: cephadm 2021-03-10T20:50:22.592120+0000 mgr.gibba044.wflcwh (mgr.34466) 2265 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:50:24.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[30844]: cluster 2021-03-10T20:50:23.039999+0000 mgr.gibba044.wflcwh (mgr.34466) 2266 : cluster [DBG] pgmap v1272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:24.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[31815]: cephadm 2021-03-10T20:50:22.362595+0000 mgr.gibba044.wflcwh (mgr.34466) 2251 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:50:24.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[31815]: cephadm 2021-03-10T20:50:22.557762+0000 mgr.gibba044.wflcwh (mgr.34466) 2252 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:50:24.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[31815]: cephadm 2021-03-10T20:50:22.560980+0000 mgr.gibba044.wflcwh (mgr.34466) 2253 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:50:24.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[31815]: cephadm 2021-03-10T20:50:22.565114+0000 mgr.gibba044.wflcwh (mgr.34466) 2254 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:50:24.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[31815]: cephadm 2021-03-10T20:50:22.565723+0000 mgr.gibba044.wflcwh (mgr.34466) 2255 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:50:24.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[31815]: cephadm 2021-03-10T20:50:22.570137+0000 mgr.gibba044.wflcwh (mgr.34466) 2256 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:50:24.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[31815]: cephadm 2021-03-10T20:50:22.570395+0000 mgr.gibba044.wflcwh (mgr.34466) 2257 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:50:24.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[31815]: cephadm 2021-03-10T20:50:22.574747+0000 mgr.gibba044.wflcwh (mgr.34466) 2258 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:50:24.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[31815]: cephadm 2021-03-10T20:50:22.578756+0000 mgr.gibba044.wflcwh (mgr.34466) 2259 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:50:24.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[31815]: cephadm 2021-03-10T20:50:22.579235+0000 mgr.gibba044.wflcwh (mgr.34466) 2260 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:50:24.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[31815]: cephadm 2021-03-10T20:50:22.584330+0000 mgr.gibba044.wflcwh (mgr.34466) 2261 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:50:24.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[31815]: cephadm 2021-03-10T20:50:22.586452+0000 mgr.gibba044.wflcwh (mgr.34466) 2262 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:50:24.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[31815]: cephadm 2021-03-10T20:50:22.590796+0000 mgr.gibba044.wflcwh (mgr.34466) 2263 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:50:24.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[31815]: cephadm 2021-03-10T20:50:22.591022+0000 mgr.gibba044.wflcwh (mgr.34466) 2264 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:50:24.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[31815]: cephadm 2021-03-10T20:50:22.592120+0000 mgr.gibba044.wflcwh (mgr.34466) 2265 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:50:24.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:24 gibba023 bash[31815]: cluster 2021-03-10T20:50:23.039999+0000 mgr.gibba044.wflcwh (mgr.34466) 2266 : cluster [DBG] pgmap v1272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:24.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:24 gibba044 bash[25485]: cephadm 2021-03-10T20:50:22.362595+0000 mgr.gibba044.wflcwh (mgr.34466) 2251 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:50:24.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:24 gibba044 bash[25485]: cephadm 2021-03-10T20:50:22.557762+0000 mgr.gibba044.wflcwh (mgr.34466) 2252 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:50:24.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:24 gibba044 bash[25485]: cephadm 2021-03-10T20:50:22.560980+0000 mgr.gibba044.wflcwh (mgr.34466) 2253 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:50:24.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:24 gibba044 bash[25485]: cephadm 2021-03-10T20:50:22.565114+0000 mgr.gibba044.wflcwh (mgr.34466) 2254 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:50:24.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:24 gibba044 bash[25485]: cephadm 2021-03-10T20:50:22.565723+0000 mgr.gibba044.wflcwh (mgr.34466) 2255 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:50:24.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:24 gibba044 bash[25485]: cephadm 2021-03-10T20:50:22.570137+0000 mgr.gibba044.wflcwh (mgr.34466) 2256 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:50:24.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:24 gibba044 bash[25485]: cephadm 2021-03-10T20:50:22.570395+0000 mgr.gibba044.wflcwh (mgr.34466) 2257 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:50:24.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:24 gibba044 bash[25485]: cephadm 2021-03-10T20:50:22.574747+0000 mgr.gibba044.wflcwh (mgr.34466) 2258 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:50:24.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:24 gibba044 bash[25485]: cephadm 2021-03-10T20:50:22.578756+0000 mgr.gibba044.wflcwh (mgr.34466) 2259 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:50:24.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:24 gibba044 bash[25485]: cephadm 2021-03-10T20:50:22.579235+0000 mgr.gibba044.wflcwh (mgr.34466) 2260 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:50:24.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:24 gibba044 bash[25485]: cephadm 2021-03-10T20:50:22.584330+0000 mgr.gibba044.wflcwh (mgr.34466) 2261 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:50:24.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:24 gibba044 bash[25485]: cephadm 2021-03-10T20:50:22.586452+0000 mgr.gibba044.wflcwh (mgr.34466) 2262 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:50:24.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:24 gibba044 bash[25485]: cephadm 2021-03-10T20:50:22.590796+0000 mgr.gibba044.wflcwh (mgr.34466) 2263 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:50:24.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:24 gibba044 bash[25485]: cephadm 2021-03-10T20:50:22.591022+0000 mgr.gibba044.wflcwh (mgr.34466) 2264 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:50:24.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:24 gibba044 bash[25485]: cephadm 2021-03-10T20:50:22.592120+0000 mgr.gibba044.wflcwh (mgr.34466) 2265 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:50:24.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:24 gibba044 bash[25485]: cluster 2021-03-10T20:50:23.039999+0000 mgr.gibba044.wflcwh (mgr.34466) 2266 : cluster [DBG] pgmap v1272: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:25.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:25 gibba023 bash[30844]: cluster 2021-03-10T20:50:25.041153+0000 mgr.gibba044.wflcwh (mgr.34466) 2267 : cluster [DBG] pgmap v1273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:25.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:25 gibba023 bash[31815]: cluster 2021-03-10T20:50:25.041153+0000 mgr.gibba044.wflcwh (mgr.34466) 2267 : cluster [DBG] pgmap v1273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:25.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:25 gibba044 bash[25485]: cluster 2021-03-10T20:50:25.041153+0000 mgr.gibba044.wflcwh (mgr.34466) 2267 : cluster [DBG] pgmap v1273: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:28.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:28 gibba044 bash[25485]: cluster 2021-03-10T20:50:27.042799+0000 mgr.gibba044.wflcwh (mgr.34466) 2268 : cluster [DBG] pgmap v1274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:28 gibba044 bash[25485]: audit 2021-03-10T20:50:27.308124+0000 mon.a (mon.0) 1165 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:50:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:28 gibba044 bash[25485]: audit 2021-03-10T20:50:27.308819+0000 mon.a (mon.0) 1166 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:50:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:28 gibba044 bash[25485]: audit 2021-03-10T20:50:27.321999+0000 mon.a (mon.0) 1167 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T20:50:28.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:28 gibba044 bash[25485]: audit 2021-03-10T20:50:27.322838+0000 mon.a (mon.0) 1168 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:50:28.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:28 gibba044 bash[25485]: audit 2021-03-10T20:50:27.323551+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:50:28.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:28 gibba044 bash[25485]: audit 2021-03-10T20:50:27.324247+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:50:28.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:28 gibba023 bash[30844]: cluster 2021-03-10T20:50:27.042799+0000 mgr.gibba044.wflcwh (mgr.34466) 2268 : cluster [DBG] pgmap v1274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:28.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:28 gibba023 bash[30844]: audit 2021-03-10T20:50:27.308124+0000 mon.a (mon.0) 1165 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:50:28.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:28 gibba023 bash[30844]: audit 2021-03-10T20:50:27.308819+0000 mon.a (mon.0) 1166 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:50:28.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:28 gibba023 bash[30844]: audit 2021-03-10T20:50:27.321999+0000 mon.a (mon.0) 1167 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T20:50:28.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:28 gibba023 bash[30844]: audit 2021-03-10T20:50:27.322838+0000 mon.a (mon.0) 1168 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:50:28.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:28 gibba023 bash[30844]: audit 2021-03-10T20:50:27.323551+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:50:28.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:28 gibba023 bash[30844]: audit 2021-03-10T20:50:27.324247+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:50:28.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:28 gibba023 bash[31815]: cluster 2021-03-10T20:50:27.042799+0000 mgr.gibba044.wflcwh (mgr.34466) 2268 : cluster [DBG] pgmap v1274: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:28.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:28 gibba023 bash[31815]: audit 2021-03-10T20:50:27.308124+0000 mon.a (mon.0) 1165 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:50:28.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:28 gibba023 bash[31815]: audit 2021-03-10T20:50:27.308819+0000 mon.a (mon.0) 1166 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:50:28.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:28 gibba023 bash[31815]: audit 2021-03-10T20:50:27.321999+0000 mon.a (mon.0) 1167 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T20:50:28.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:28 gibba023 bash[31815]: audit 2021-03-10T20:50:27.322838+0000 mon.a (mon.0) 1168 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:50:28.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:28 gibba023 bash[31815]: audit 2021-03-10T20:50:27.323551+0000 mon.a (mon.0) 1169 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:50:28.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:28 gibba023 bash[31815]: audit 2021-03-10T20:50:27.324247+0000 mon.a (mon.0) 1170 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T20:50:30.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:30 gibba044 bash[25485]: cluster 2021-03-10T20:50:29.044593+0000 mgr.gibba044.wflcwh (mgr.34466) 2269 : cluster [DBG] pgmap v1275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:30.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:30 gibba023 bash[30844]: cluster 2021-03-10T20:50:29.044593+0000 mgr.gibba044.wflcwh (mgr.34466) 2269 : cluster [DBG] pgmap v1275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:30.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:30 gibba023 bash[31815]: cluster 2021-03-10T20:50:29.044593+0000 mgr.gibba044.wflcwh (mgr.34466) 2269 : cluster [DBG] pgmap v1275: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:32.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:32 gibba044 bash[25485]: cluster 2021-03-10T20:50:31.046311+0000 mgr.gibba044.wflcwh (mgr.34466) 2270 : cluster [DBG] pgmap v1276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:32.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:32 gibba023 bash[30844]: cluster 2021-03-10T20:50:31.046311+0000 mgr.gibba044.wflcwh (mgr.34466) 2270 : cluster [DBG] pgmap v1276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:32.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:32 gibba023 bash[31815]: cluster 2021-03-10T20:50:31.046311+0000 mgr.gibba044.wflcwh (mgr.34466) 2270 : cluster [DBG] pgmap v1276: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:34.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:34 gibba044 bash[25485]: cluster 2021-03-10T20:50:33.047930+0000 mgr.gibba044.wflcwh (mgr.34466) 2271 : cluster [DBG] pgmap v1277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:34.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:34 gibba023 bash[30844]: cluster 2021-03-10T20:50:33.047930+0000 mgr.gibba044.wflcwh (mgr.34466) 2271 : cluster [DBG] pgmap v1277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:34.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:34 gibba023 bash[31815]: cluster 2021-03-10T20:50:33.047930+0000 mgr.gibba044.wflcwh (mgr.34466) 2271 : cluster [DBG] pgmap v1277: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:36.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:36 gibba044 bash[25485]: cluster 2021-03-10T20:50:35.049123+0000 mgr.gibba044.wflcwh (mgr.34466) 2272 : cluster [DBG] pgmap v1278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:36.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:36 gibba023 bash[30844]: cluster 2021-03-10T20:50:35.049123+0000 mgr.gibba044.wflcwh (mgr.34466) 2272 : cluster [DBG] pgmap v1278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:36.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:36 gibba023 bash[31815]: cluster 2021-03-10T20:50:35.049123+0000 mgr.gibba044.wflcwh (mgr.34466) 2272 : cluster [DBG] pgmap v1278: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:38.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:38 gibba044 bash[25485]: cluster 2021-03-10T20:50:37.050682+0000 mgr.gibba044.wflcwh (mgr.34466) 2273 : cluster [DBG] pgmap v1279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:38.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:38 gibba023 bash[30844]: cluster 2021-03-10T20:50:37.050682+0000 mgr.gibba044.wflcwh (mgr.34466) 2273 : cluster [DBG] pgmap v1279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:38.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:38 gibba023 bash[31815]: cluster 2021-03-10T20:50:37.050682+0000 mgr.gibba044.wflcwh (mgr.34466) 2273 : cluster [DBG] pgmap v1279: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:39.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:39 gibba044 bash[25485]: cephadm 2021-03-10T20:50:37.608232+0000 mgr.gibba044.wflcwh (mgr.34466) 2274 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:50:39.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:39 gibba023 bash[30844]: cephadm 2021-03-10T20:50:37.608232+0000 mgr.gibba044.wflcwh (mgr.34466) 2274 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:50:39.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:39 gibba023 bash[31815]: cephadm 2021-03-10T20:50:37.608232+0000 mgr.gibba044.wflcwh (mgr.34466) 2274 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:50:40.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:40 gibba044 bash[25485]: cluster 2021-03-10T20:50:39.052493+0000 mgr.gibba044.wflcwh (mgr.34466) 2275 : cluster [DBG] pgmap v1280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:40.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:40 gibba023 bash[30844]: cluster 2021-03-10T20:50:39.052493+0000 mgr.gibba044.wflcwh (mgr.34466) 2275 : cluster [DBG] pgmap v1280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:40.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:40 gibba023 bash[31815]: cluster 2021-03-10T20:50:39.052493+0000 mgr.gibba044.wflcwh (mgr.34466) 2275 : cluster [DBG] pgmap v1280: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:42.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:42 gibba044 bash[25485]: cluster 2021-03-10T20:50:41.054164+0000 mgr.gibba044.wflcwh (mgr.34466) 2276 : cluster [DBG] pgmap v1281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:42.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:42 gibba023 bash[30844]: cluster 2021-03-10T20:50:41.054164+0000 mgr.gibba044.wflcwh (mgr.34466) 2276 : cluster [DBG] pgmap v1281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:42.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:42 gibba023 bash[31815]: cluster 2021-03-10T20:50:41.054164+0000 mgr.gibba044.wflcwh (mgr.34466) 2276 : cluster [DBG] pgmap v1281: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:44.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:44 gibba023 bash[30844]: cluster 2021-03-10T20:50:43.055844+0000 mgr.gibba044.wflcwh (mgr.34466) 2277 : cluster [DBG] pgmap v1282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:44.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:44 gibba023 bash[31815]: cluster 2021-03-10T20:50:43.055844+0000 mgr.gibba044.wflcwh (mgr.34466) 2277 : cluster [DBG] pgmap v1282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:44.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:44 gibba044 bash[25485]: cluster 2021-03-10T20:50:43.055844+0000 mgr.gibba044.wflcwh (mgr.34466) 2277 : cluster [DBG] pgmap v1282: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:44.814 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:50:45.040 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:50:45.041 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (41m) 7m ago 47m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:50:45.041 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (47m) 6m ago 47m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:50:45.041 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (42m) 6m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:50:45.041 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (42m) 6m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:50:45.042 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (41m) 7m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:50:45.042 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (41m) 7m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:50:45.042 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (40m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:50:45.042 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (41m) 7m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:50:45.043 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (47m) 7m ago 47m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:50:45.043 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (47m) 6m ago 47m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:50:45.043 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (40m) 7m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:50:45.043 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (39m) 7m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:50:45.043 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (39m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:50:45.044 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (38m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:50:45.044 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (38m) 6m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:50:45.044 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (37m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:50:45.045 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (37m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:50:45.045 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (37m) 6m ago 47m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:50:45.045 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (46m) 6m ago 47m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:50:45.045 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 7m ago 45m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:50:45.046 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 6m ago 45m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:50:45.289 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:50:45.289 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:50:45.290 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:50:45.290 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:50:45.290 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:50:45.290 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:50:45.291 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:50:45.291 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:50:45.291 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:50:45.292 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:50:45.292 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:50:45.292 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:50:45.292 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:50:45.292 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:50:45.293 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:50:46.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:46 gibba023 bash[30844]: audit 2021-03-10T20:50:44.805564+0000 mgr.gibba044.wflcwh (mgr.34466) 2278 : audit [DBG] from='client.55567 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:50:46.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:46 gibba023 bash[30844]: audit 2021-03-10T20:50:45.027654+0000 mgr.gibba044.wflcwh (mgr.34466) 2279 : audit [DBG] from='client.45594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:50:46.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:46 gibba023 bash[30844]: cluster 2021-03-10T20:50:45.056274+0000 mgr.gibba044.wflcwh (mgr.34466) 2280 : cluster [DBG] pgmap v1283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:46.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:46 gibba023 bash[30844]: audit 2021-03-10T20:50:45.288840+0000 mon.a (mon.0) 1171 : audit [DBG] from='client.? 172.21.2.123:0/1231724081' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:46.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:46 gibba023 bash[31815]: audit 2021-03-10T20:50:44.805564+0000 mgr.gibba044.wflcwh (mgr.34466) 2278 : audit [DBG] from='client.55567 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:50:46.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:46 gibba023 bash[31815]: audit 2021-03-10T20:50:45.027654+0000 mgr.gibba044.wflcwh (mgr.34466) 2279 : audit [DBG] from='client.45594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:50:46.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:46 gibba023 bash[31815]: cluster 2021-03-10T20:50:45.056274+0000 mgr.gibba044.wflcwh (mgr.34466) 2280 : cluster [DBG] pgmap v1283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:46.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:46 gibba023 bash[31815]: audit 2021-03-10T20:50:45.288840+0000 mon.a (mon.0) 1171 : audit [DBG] from='client.? 172.21.2.123:0/1231724081' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:46.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:46 gibba044 bash[25485]: audit 2021-03-10T20:50:44.805564+0000 mgr.gibba044.wflcwh (mgr.34466) 2278 : audit [DBG] from='client.55567 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:50:46.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:46 gibba044 bash[25485]: audit 2021-03-10T20:50:45.027654+0000 mgr.gibba044.wflcwh (mgr.34466) 2279 : audit [DBG] from='client.45594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:50:46.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:46 gibba044 bash[25485]: cluster 2021-03-10T20:50:45.056274+0000 mgr.gibba044.wflcwh (mgr.34466) 2280 : cluster [DBG] pgmap v1283: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:46.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:46 gibba044 bash[25485]: audit 2021-03-10T20:50:45.288840+0000 mon.a (mon.0) 1171 : audit [DBG] from='client.? 172.21.2.123:0/1231724081' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:50:48.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:48 gibba023 bash[30844]: cluster 2021-03-10T20:50:47.057581+0000 mgr.gibba044.wflcwh (mgr.34466) 2281 : cluster [DBG] pgmap v1284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:48.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:48 gibba023 bash[31815]: cluster 2021-03-10T20:50:47.057581+0000 mgr.gibba044.wflcwh (mgr.34466) 2281 : cluster [DBG] pgmap v1284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:48.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:48 gibba044 bash[25485]: cluster 2021-03-10T20:50:47.057581+0000 mgr.gibba044.wflcwh (mgr.34466) 2281 : cluster [DBG] pgmap v1284: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:50.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:50 gibba023 bash[30844]: cluster 2021-03-10T20:50:49.059431+0000 mgr.gibba044.wflcwh (mgr.34466) 2282 : cluster [DBG] pgmap v1285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:50.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:50 gibba023 bash[31815]: cluster 2021-03-10T20:50:49.059431+0000 mgr.gibba044.wflcwh (mgr.34466) 2282 : cluster [DBG] pgmap v1285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:50.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:50 gibba044 bash[25485]: cluster 2021-03-10T20:50:49.059431+0000 mgr.gibba044.wflcwh (mgr.34466) 2282 : cluster [DBG] pgmap v1285: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:52.624 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:52 gibba044 bash[25485]: cluster 2021-03-10T20:50:51.060869+0000 mgr.gibba044.wflcwh (mgr.34466) 2283 : cluster [DBG] pgmap v1286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:52.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:52 gibba023 bash[30844]: cluster 2021-03-10T20:50:51.060869+0000 mgr.gibba044.wflcwh (mgr.34466) 2283 : cluster [DBG] pgmap v1286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:52.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:52 gibba023 bash[31815]: cluster 2021-03-10T20:50:51.060869+0000 mgr.gibba044.wflcwh (mgr.34466) 2283 : cluster [DBG] pgmap v1286: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:54.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:54 gibba023 bash[30844]: cephadm 2021-03-10T20:50:52.624273+0000 mgr.gibba044.wflcwh (mgr.34466) 2284 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:50:54.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:54 gibba023 bash[30844]: cluster 2021-03-10T20:50:53.062551+0000 mgr.gibba044.wflcwh (mgr.34466) 2285 : cluster [DBG] pgmap v1287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:54.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:54 gibba023 bash[31815]: cephadm 2021-03-10T20:50:52.624273+0000 mgr.gibba044.wflcwh (mgr.34466) 2284 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:50:54.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:54 gibba023 bash[31815]: cluster 2021-03-10T20:50:53.062551+0000 mgr.gibba044.wflcwh (mgr.34466) 2285 : cluster [DBG] pgmap v1287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:54.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:54 gibba044 bash[25485]: cephadm 2021-03-10T20:50:52.624273+0000 mgr.gibba044.wflcwh (mgr.34466) 2284 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:50:54.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:54 gibba044 bash[25485]: cluster 2021-03-10T20:50:53.062551+0000 mgr.gibba044.wflcwh (mgr.34466) 2285 : cluster [DBG] pgmap v1287: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:56.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:56 gibba023 bash[30844]: cluster 2021-03-10T20:50:55.063845+0000 mgr.gibba044.wflcwh (mgr.34466) 2286 : cluster [DBG] pgmap v1288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:56.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:56 gibba023 bash[31815]: cluster 2021-03-10T20:50:55.063845+0000 mgr.gibba044.wflcwh (mgr.34466) 2286 : cluster [DBG] pgmap v1288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:56.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:56 gibba044 bash[25485]: cluster 2021-03-10T20:50:55.063845+0000 mgr.gibba044.wflcwh (mgr.34466) 2286 : cluster [DBG] pgmap v1288: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:58.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:50:58 gibba023 bash[30844]: cluster 2021-03-10T20:50:57.065268+0000 mgr.gibba044.wflcwh (mgr.34466) 2287 : cluster [DBG] pgmap v1289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:58.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:50:58 gibba023 bash[31815]: cluster 2021-03-10T20:50:57.065268+0000 mgr.gibba044.wflcwh (mgr.34466) 2287 : cluster [DBG] pgmap v1289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:50:58.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:50:58 gibba044 bash[25485]: cluster 2021-03-10T20:50:57.065268+0000 mgr.gibba044.wflcwh (mgr.34466) 2287 : cluster [DBG] pgmap v1289: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:00.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:00 gibba023 bash[30844]: cluster 2021-03-10T20:50:59.066770+0000 mgr.gibba044.wflcwh (mgr.34466) 2288 : cluster [DBG] pgmap v1290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:00.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:00 gibba023 bash[31815]: cluster 2021-03-10T20:50:59.066770+0000 mgr.gibba044.wflcwh (mgr.34466) 2288 : cluster [DBG] pgmap v1290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:00.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:00 gibba044 bash[25485]: cluster 2021-03-10T20:50:59.066770+0000 mgr.gibba044.wflcwh (mgr.34466) 2288 : cluster [DBG] pgmap v1290: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:02.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:02 gibba023 bash[30844]: cluster 2021-03-10T20:51:01.068419+0000 mgr.gibba044.wflcwh (mgr.34466) 2289 : cluster [DBG] pgmap v1291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:02.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:02 gibba023 bash[31815]: cluster 2021-03-10T20:51:01.068419+0000 mgr.gibba044.wflcwh (mgr.34466) 2289 : cluster [DBG] pgmap v1291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:02.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:02 gibba044 bash[25485]: cluster 2021-03-10T20:51:01.068419+0000 mgr.gibba044.wflcwh (mgr.34466) 2289 : cluster [DBG] pgmap v1291: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:03.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:03 gibba023 bash[30844]: cluster 2021-03-10T20:51:03.070119+0000 mgr.gibba044.wflcwh (mgr.34466) 2290 : cluster [DBG] pgmap v1292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:03.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:03 gibba023 bash[31815]: cluster 2021-03-10T20:51:03.070119+0000 mgr.gibba044.wflcwh (mgr.34466) 2290 : cluster [DBG] pgmap v1292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:03.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:03 gibba044 bash[25485]: cluster 2021-03-10T20:51:03.070119+0000 mgr.gibba044.wflcwh (mgr.34466) 2290 : cluster [DBG] pgmap v1292: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:06.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:06 gibba023 bash[30844]: cluster 2021-03-10T20:51:05.071308+0000 mgr.gibba044.wflcwh (mgr.34466) 2291 : cluster [DBG] pgmap v1293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:06.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:06 gibba023 bash[31815]: cluster 2021-03-10T20:51:05.071308+0000 mgr.gibba044.wflcwh (mgr.34466) 2291 : cluster [DBG] pgmap v1293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:06.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:06 gibba044 bash[25485]: cluster 2021-03-10T20:51:05.071308+0000 mgr.gibba044.wflcwh (mgr.34466) 2291 : cluster [DBG] pgmap v1293: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:08.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:08 gibba044 bash[25485]: cluster 2021-03-10T20:51:07.072937+0000 mgr.gibba044.wflcwh (mgr.34466) 2292 : cluster [DBG] pgmap v1294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:08.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:08 gibba023 bash[30844]: cluster 2021-03-10T20:51:07.072937+0000 mgr.gibba044.wflcwh (mgr.34466) 2292 : cluster [DBG] pgmap v1294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:08.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:08 gibba023 bash[31815]: cluster 2021-03-10T20:51:07.072937+0000 mgr.gibba044.wflcwh (mgr.34466) 2292 : cluster [DBG] pgmap v1294: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:09.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:09 gibba044 bash[25485]: cephadm 2021-03-10T20:51:07.628322+0000 mgr.gibba044.wflcwh (mgr.34466) 2293 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:51:09.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:09 gibba023 bash[30844]: cephadm 2021-03-10T20:51:07.628322+0000 mgr.gibba044.wflcwh (mgr.34466) 2293 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:51:09.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:09 gibba023 bash[31815]: cephadm 2021-03-10T20:51:07.628322+0000 mgr.gibba044.wflcwh (mgr.34466) 2293 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:51:10.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:10 gibba044 bash[25485]: cluster 2021-03-10T20:51:09.074651+0000 mgr.gibba044.wflcwh (mgr.34466) 2294 : cluster [DBG] pgmap v1295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:10.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:10 gibba023 bash[30844]: cluster 2021-03-10T20:51:09.074651+0000 mgr.gibba044.wflcwh (mgr.34466) 2294 : cluster [DBG] pgmap v1295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:10.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:10 gibba023 bash[31815]: cluster 2021-03-10T20:51:09.074651+0000 mgr.gibba044.wflcwh (mgr.34466) 2294 : cluster [DBG] pgmap v1295: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:12.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:12 gibba044 bash[25485]: cluster 2021-03-10T20:51:11.076317+0000 mgr.gibba044.wflcwh (mgr.34466) 2295 : cluster [DBG] pgmap v1296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:12.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:12 gibba023 bash[30844]: cluster 2021-03-10T20:51:11.076317+0000 mgr.gibba044.wflcwh (mgr.34466) 2295 : cluster [DBG] pgmap v1296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:12.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:12 gibba023 bash[31815]: cluster 2021-03-10T20:51:11.076317+0000 mgr.gibba044.wflcwh (mgr.34466) 2295 : cluster [DBG] pgmap v1296: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:14.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:14 gibba044 bash[25485]: cluster 2021-03-10T20:51:13.077944+0000 mgr.gibba044.wflcwh (mgr.34466) 2296 : cluster [DBG] pgmap v1297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:14.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:14 gibba023 bash[30844]: cluster 2021-03-10T20:51:13.077944+0000 mgr.gibba044.wflcwh (mgr.34466) 2296 : cluster [DBG] pgmap v1297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:14.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:14 gibba023 bash[31815]: cluster 2021-03-10T20:51:13.077944+0000 mgr.gibba044.wflcwh (mgr.34466) 2296 : cluster [DBG] pgmap v1297: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:15.531 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:51:15.791 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:51:15.791 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (42m) 7m ago 47m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:51:15.792 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (47m) 6m ago 47m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:51:15.792 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (42m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:51:15.793 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (43m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:51:15.793 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (42m) 7m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:51:15.794 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (41m) 7m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:51:15.794 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (41m) 6m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:51:15.794 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (41m) 7m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:51:15.795 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (48m) 7m ago 48m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:51:15.795 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (48m) 6m ago 48m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:51:15.796 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (40m) 7m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:51:15.796 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (40m) 7m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:51:15.797 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (39m) 7m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:51:15.797 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (39m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:51:15.798 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (38m) 6m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:51:15.798 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (38m) 6m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:51:15.799 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (38m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:51:15.799 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (37m) 6m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:51:15.800 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (47m) 6m ago 48m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:51:15.800 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 7m ago 45m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:51:15.801 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 6m ago 45m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:51:16.038 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:51:16.039 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:51:16.039 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:51:16.039 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:51:16.039 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:51:16.040 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:51:16.040 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:51:16.040 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:51:16.040 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:51:16.040 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:51:16.041 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:51:16.041 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:51:16.041 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:51:16.041 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:51:16.042 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:51:16.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:16 gibba044 bash[25485]: cluster 2021-03-10T20:51:15.079155+0000 mgr.gibba044.wflcwh (mgr.34466) 2297 : cluster [DBG] pgmap v1298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:16.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:16 gibba044 bash[25485]: audit 2021-03-10T20:51:16.037885+0000 mon.a (mon.0) 1172 : audit [DBG] from='client.? 172.21.2.123:0/568618771' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:16.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:16 gibba023 bash[30844]: cluster 2021-03-10T20:51:15.079155+0000 mgr.gibba044.wflcwh (mgr.34466) 2297 : cluster [DBG] pgmap v1298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:16.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:16 gibba023 bash[30844]: audit 2021-03-10T20:51:16.037885+0000 mon.a (mon.0) 1172 : audit [DBG] from='client.? 172.21.2.123:0/568618771' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:16.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:16 gibba023 bash[31815]: cluster 2021-03-10T20:51:15.079155+0000 mgr.gibba044.wflcwh (mgr.34466) 2297 : cluster [DBG] pgmap v1298: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:16.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:16 gibba023 bash[31815]: audit 2021-03-10T20:51:16.037885+0000 mon.a (mon.0) 1172 : audit [DBG] from='client.? 172.21.2.123:0/568618771' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:17.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:17 gibba023 bash[30844]: audit 2021-03-10T20:51:15.521838+0000 mgr.gibba044.wflcwh (mgr.34466) 2298 : audit [DBG] from='client.45606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:51:17.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:17 gibba023 bash[30844]: audit 2021-03-10T20:51:15.749760+0000 mgr.gibba044.wflcwh (mgr.34466) 2299 : audit [DBG] from='client.55591 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:51:17.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:17 gibba023 bash[31815]: audit 2021-03-10T20:51:15.521838+0000 mgr.gibba044.wflcwh (mgr.34466) 2298 : audit [DBG] from='client.45606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:51:17.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:17 gibba023 bash[31815]: audit 2021-03-10T20:51:15.749760+0000 mgr.gibba044.wflcwh (mgr.34466) 2299 : audit [DBG] from='client.55591 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:51:17.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:17 gibba044 bash[25485]: audit 2021-03-10T20:51:15.521838+0000 mgr.gibba044.wflcwh (mgr.34466) 2298 : audit [DBG] from='client.45606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:51:17.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:17 gibba044 bash[25485]: audit 2021-03-10T20:51:15.749760+0000 mgr.gibba044.wflcwh (mgr.34466) 2299 : audit [DBG] from='client.55591 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:51:18.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:18 gibba023 bash[30844]: cluster 2021-03-10T20:51:17.080779+0000 mgr.gibba044.wflcwh (mgr.34466) 2300 : cluster [DBG] pgmap v1299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:18.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:18 gibba023 bash[31815]: cluster 2021-03-10T20:51:17.080779+0000 mgr.gibba044.wflcwh (mgr.34466) 2300 : cluster [DBG] pgmap v1299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:18.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:18 gibba044 bash[25485]: cluster 2021-03-10T20:51:17.080779+0000 mgr.gibba044.wflcwh (mgr.34466) 2300 : cluster [DBG] pgmap v1299: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:20.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:20 gibba023 bash[30844]: cluster 2021-03-10T20:51:19.082401+0000 mgr.gibba044.wflcwh (mgr.34466) 2301 : cluster [DBG] pgmap v1300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:20.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:20 gibba023 bash[31815]: cluster 2021-03-10T20:51:19.082401+0000 mgr.gibba044.wflcwh (mgr.34466) 2301 : cluster [DBG] pgmap v1300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:20.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:20 gibba044 bash[25485]: cluster 2021-03-10T20:51:19.082401+0000 mgr.gibba044.wflcwh (mgr.34466) 2301 : cluster [DBG] pgmap v1300: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:22.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:22 gibba023 bash[30844]: cluster 2021-03-10T20:51:21.084051+0000 mgr.gibba044.wflcwh (mgr.34466) 2302 : cluster [DBG] pgmap v1301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:22.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:22 gibba023 bash[31815]: cluster 2021-03-10T20:51:21.084051+0000 mgr.gibba044.wflcwh (mgr.34466) 2302 : cluster [DBG] pgmap v1301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:22.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:22 gibba044 bash[25485]: cluster 2021-03-10T20:51:21.084051+0000 mgr.gibba044.wflcwh (mgr.34466) 2302 : cluster [DBG] pgmap v1301: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:24.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[30844]: cephadm 2021-03-10T20:51:22.645129+0000 mgr.gibba044.wflcwh (mgr.34466) 2303 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:51:24.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[30844]: cephadm 2021-03-10T20:51:22.646715+0000 mgr.gibba044.wflcwh (mgr.34466) 2304 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:51:24.176 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[30844]: audit 2021-03-10T20:51:22.873067+0000 mon.a (mon.0) 1173 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:51:24.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[30844]: cephadm 2021-03-10T20:51:22.876267+0000 mgr.gibba044.wflcwh (mgr.34466) 2305 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:51:24.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[30844]: audit 2021-03-10T20:51:22.876586+0000 mon.a (mon.0) 1174 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:51:24.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[30844]: cephadm 2021-03-10T20:51:22.877887+0000 mgr.gibba044.wflcwh (mgr.34466) 2306 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:51:24.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[30844]: audit 2021-03-10T20:51:22.878073+0000 mon.a (mon.0) 1175 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:24.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[30844]: cephadm 2021-03-10T20:51:22.880336+0000 mgr.gibba044.wflcwh (mgr.34466) 2307 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:51:24.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[30844]: cephadm 2021-03-10T20:51:22.880378+0000 mgr.gibba044.wflcwh (mgr.34466) 2308 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:51:24.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[30844]: audit 2021-03-10T20:51:22.880822+0000 mon.a (mon.0) 1176 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:24.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[30844]: cephadm 2021-03-10T20:51:22.882966+0000 mgr.gibba044.wflcwh (mgr.34466) 2309 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:51:24.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[30844]: cephadm 2021-03-10T20:51:22.883010+0000 mgr.gibba044.wflcwh (mgr.34466) 2310 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:51:24.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[30844]: audit 2021-03-10T20:51:22.883333+0000 mon.a (mon.0) 1177 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:24.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[30844]: cephadm 2021-03-10T20:51:22.885899+0000 mgr.gibba044.wflcwh (mgr.34466) 2311 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:51:24.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[30844]: cephadm 2021-03-10T20:51:22.888495+0000 mgr.gibba044.wflcwh (mgr.34466) 2312 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:51:24.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[30844]: cephadm 2021-03-10T20:51:22.888542+0000 mgr.gibba044.wflcwh (mgr.34466) 2313 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:51:24.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[30844]: audit 2021-03-10T20:51:22.889284+0000 mon.a (mon.0) 1178 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:24.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[30844]: cephadm 2021-03-10T20:51:22.891465+0000 mgr.gibba044.wflcwh (mgr.34466) 2314 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:51:24.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[30844]: cephadm 2021-03-10T20:51:22.891943+0000 mgr.gibba044.wflcwh (mgr.34466) 2315 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:51:24.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[30844]: audit 2021-03-10T20:51:22.892390+0000 mon.a (mon.0) 1179 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:24.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[30844]: cephadm 2021-03-10T20:51:22.894585+0000 mgr.gibba044.wflcwh (mgr.34466) 2316 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:51:24.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[31815]: cephadm 2021-03-10T20:51:22.645129+0000 mgr.gibba044.wflcwh (mgr.34466) 2303 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:51:24.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[31815]: cephadm 2021-03-10T20:51:22.646715+0000 mgr.gibba044.wflcwh (mgr.34466) 2304 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:51:24.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[31815]: audit 2021-03-10T20:51:22.873067+0000 mon.a (mon.0) 1173 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:51:24.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[31815]: cephadm 2021-03-10T20:51:22.876267+0000 mgr.gibba044.wflcwh (mgr.34466) 2305 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:51:24.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[31815]: audit 2021-03-10T20:51:22.876586+0000 mon.a (mon.0) 1174 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:51:24.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[31815]: cephadm 2021-03-10T20:51:22.877887+0000 mgr.gibba044.wflcwh (mgr.34466) 2306 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:51:24.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[31815]: audit 2021-03-10T20:51:22.878073+0000 mon.a (mon.0) 1175 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:24.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[31815]: cephadm 2021-03-10T20:51:22.880336+0000 mgr.gibba044.wflcwh (mgr.34466) 2307 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:51:24.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[31815]: cephadm 2021-03-10T20:51:22.880378+0000 mgr.gibba044.wflcwh (mgr.34466) 2308 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:51:24.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[31815]: audit 2021-03-10T20:51:22.880822+0000 mon.a (mon.0) 1176 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:24.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[31815]: cephadm 2021-03-10T20:51:22.882966+0000 mgr.gibba044.wflcwh (mgr.34466) 2309 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:51:24.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[31815]: cephadm 2021-03-10T20:51:22.883010+0000 mgr.gibba044.wflcwh (mgr.34466) 2310 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:51:24.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[31815]: audit 2021-03-10T20:51:22.883333+0000 mon.a (mon.0) 1177 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:24.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[31815]: cephadm 2021-03-10T20:51:22.885899+0000 mgr.gibba044.wflcwh (mgr.34466) 2311 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:51:24.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[31815]: cephadm 2021-03-10T20:51:22.888495+0000 mgr.gibba044.wflcwh (mgr.34466) 2312 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:51:24.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[31815]: cephadm 2021-03-10T20:51:22.888542+0000 mgr.gibba044.wflcwh (mgr.34466) 2313 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:51:24.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[31815]: audit 2021-03-10T20:51:22.889284+0000 mon.a (mon.0) 1178 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:24.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[31815]: cephadm 2021-03-10T20:51:22.891465+0000 mgr.gibba044.wflcwh (mgr.34466) 2314 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:51:24.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[31815]: cephadm 2021-03-10T20:51:22.891943+0000 mgr.gibba044.wflcwh (mgr.34466) 2315 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:51:24.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[31815]: audit 2021-03-10T20:51:22.892390+0000 mon.a (mon.0) 1179 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:24.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[31815]: cephadm 2021-03-10T20:51:22.894585+0000 mgr.gibba044.wflcwh (mgr.34466) 2316 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:51:24.186 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[30844]: cephadm 2021-03-10T20:51:22.894630+0000 mgr.gibba044.wflcwh (mgr.34466) 2317 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:51:24.187 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[30844]: cephadm 2021-03-10T20:51:22.894794+0000 mgr.gibba044.wflcwh (mgr.34466) 2318 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:51:24.187 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[30844]: cluster 2021-03-10T20:51:23.085559+0000 mgr.gibba044.wflcwh (mgr.34466) 2319 : cluster [DBG] pgmap v1302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:24.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[31815]: cephadm 2021-03-10T20:51:22.894630+0000 mgr.gibba044.wflcwh (mgr.34466) 2317 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:51:24.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[31815]: cephadm 2021-03-10T20:51:22.894794+0000 mgr.gibba044.wflcwh (mgr.34466) 2318 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:51:24.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:23 gibba023 bash[31815]: cluster 2021-03-10T20:51:23.085559+0000 mgr.gibba044.wflcwh (mgr.34466) 2319 : cluster [DBG] pgmap v1302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:24.252 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:23 gibba044 bash[25485]: cephadm 2021-03-10T20:51:22.645129+0000 mgr.gibba044.wflcwh (mgr.34466) 2303 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:51:24.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:23 gibba044 bash[25485]: cephadm 2021-03-10T20:51:22.646715+0000 mgr.gibba044.wflcwh (mgr.34466) 2304 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:51:24.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:23 gibba044 bash[25485]: audit 2021-03-10T20:51:22.873067+0000 mon.a (mon.0) 1173 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:51:24.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:23 gibba044 bash[25485]: cephadm 2021-03-10T20:51:22.876267+0000 mgr.gibba044.wflcwh (mgr.34466) 2305 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:51:24.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:23 gibba044 bash[25485]: audit 2021-03-10T20:51:22.876586+0000 mon.a (mon.0) 1174 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:51:24.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:23 gibba044 bash[25485]: cephadm 2021-03-10T20:51:22.877887+0000 mgr.gibba044.wflcwh (mgr.34466) 2306 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:51:24.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:23 gibba044 bash[25485]: audit 2021-03-10T20:51:22.878073+0000 mon.a (mon.0) 1175 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:24.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:23 gibba044 bash[25485]: cephadm 2021-03-10T20:51:22.880336+0000 mgr.gibba044.wflcwh (mgr.34466) 2307 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:51:24.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:23 gibba044 bash[25485]: cephadm 2021-03-10T20:51:22.880378+0000 mgr.gibba044.wflcwh (mgr.34466) 2308 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:51:24.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:23 gibba044 bash[25485]: audit 2021-03-10T20:51:22.880822+0000 mon.a (mon.0) 1176 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:24.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:23 gibba044 bash[25485]: cephadm 2021-03-10T20:51:22.882966+0000 mgr.gibba044.wflcwh (mgr.34466) 2309 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:51:24.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:23 gibba044 bash[25485]: cephadm 2021-03-10T20:51:22.883010+0000 mgr.gibba044.wflcwh (mgr.34466) 2310 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:51:24.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:23 gibba044 bash[25485]: audit 2021-03-10T20:51:22.883333+0000 mon.a (mon.0) 1177 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:24.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:23 gibba044 bash[25485]: cephadm 2021-03-10T20:51:22.885899+0000 mgr.gibba044.wflcwh (mgr.34466) 2311 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:51:24.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:23 gibba044 bash[25485]: cephadm 2021-03-10T20:51:22.888495+0000 mgr.gibba044.wflcwh (mgr.34466) 2312 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:51:24.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:23 gibba044 bash[25485]: cephadm 2021-03-10T20:51:22.888542+0000 mgr.gibba044.wflcwh (mgr.34466) 2313 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:51:24.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:23 gibba044 bash[25485]: audit 2021-03-10T20:51:22.889284+0000 mon.a (mon.0) 1178 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:24.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:23 gibba044 bash[25485]: cephadm 2021-03-10T20:51:22.891465+0000 mgr.gibba044.wflcwh (mgr.34466) 2314 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:51:24.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:23 gibba044 bash[25485]: cephadm 2021-03-10T20:51:22.891943+0000 mgr.gibba044.wflcwh (mgr.34466) 2315 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:51:24.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:23 gibba044 bash[25485]: audit 2021-03-10T20:51:22.892390+0000 mon.a (mon.0) 1179 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:24.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:23 gibba044 bash[25485]: cephadm 2021-03-10T20:51:22.894585+0000 mgr.gibba044.wflcwh (mgr.34466) 2316 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:51:24.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:23 gibba044 bash[25485]: cephadm 2021-03-10T20:51:22.894630+0000 mgr.gibba044.wflcwh (mgr.34466) 2317 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:51:24.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:23 gibba044 bash[25485]: cephadm 2021-03-10T20:51:22.894794+0000 mgr.gibba044.wflcwh (mgr.34466) 2318 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:51:24.258 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:23 gibba044 bash[25485]: cluster 2021-03-10T20:51:23.085559+0000 mgr.gibba044.wflcwh (mgr.34466) 2319 : cluster [DBG] pgmap v1302: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:26.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:26 gibba023 bash[31815]: cluster 2021-03-10T20:51:25.086821+0000 mgr.gibba044.wflcwh (mgr.34466) 2320 : cluster [DBG] pgmap v1303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:26.426 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:26 gibba023 bash[30844]: cluster 2021-03-10T20:51:25.086821+0000 mgr.gibba044.wflcwh (mgr.34466) 2320 : cluster [DBG] pgmap v1303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:26.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:26 gibba044 bash[25485]: cluster 2021-03-10T20:51:25.086821+0000 mgr.gibba044.wflcwh (mgr.34466) 2320 : cluster [DBG] pgmap v1303: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:28 gibba044 bash[25485]: cluster 2021-03-10T20:51:27.088361+0000 mgr.gibba044.wflcwh (mgr.34466) 2321 : cluster [DBG] pgmap v1304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:28 gibba044 bash[25485]: audit 2021-03-10T20:51:27.316135+0000 mon.a (mon.0) 1180 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:51:28.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:28 gibba044 bash[25485]: audit 2021-03-10T20:51:27.316788+0000 mon.a (mon.0) 1181 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:51:28.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:28 gibba044 bash[25485]: audit 2021-03-10T20:51:27.328498+0000 mon.a (mon.0) 1182 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:51:28.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:28 gibba044 bash[25485]: audit 2021-03-10T20:51:27.329235+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:51:28.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:28 gibba044 bash[25485]: audit 2021-03-10T20:51:27.329947+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:51:28.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:28 gibba044 bash[25485]: audit 2021-03-10T20:51:27.330681+0000 mon.a (mon.0) 1185 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:51:28.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:28 gibba023 bash[30844]: cluster 2021-03-10T20:51:27.088361+0000 mgr.gibba044.wflcwh (mgr.34466) 2321 : cluster [DBG] pgmap v1304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:28.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:28 gibba023 bash[30844]: audit 2021-03-10T20:51:27.316135+0000 mon.a (mon.0) 1180 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:51:28.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:28 gibba023 bash[30844]: audit 2021-03-10T20:51:27.316788+0000 mon.a (mon.0) 1181 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:51:28.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:28 gibba023 bash[30844]: audit 2021-03-10T20:51:27.328498+0000 mon.a (mon.0) 1182 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:51:28.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:28 gibba023 bash[30844]: audit 2021-03-10T20:51:27.329235+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:51:28.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:28 gibba023 bash[30844]: audit 2021-03-10T20:51:27.329947+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:51:28.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:28 gibba023 bash[30844]: audit 2021-03-10T20:51:27.330681+0000 mon.a (mon.0) 1185 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:51:28.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:28 gibba023 bash[31815]: cluster 2021-03-10T20:51:27.088361+0000 mgr.gibba044.wflcwh (mgr.34466) 2321 : cluster [DBG] pgmap v1304: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:28.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:28 gibba023 bash[31815]: audit 2021-03-10T20:51:27.316135+0000 mon.a (mon.0) 1180 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:51:28.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:28 gibba023 bash[31815]: audit 2021-03-10T20:51:27.316788+0000 mon.a (mon.0) 1181 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:51:28.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:28 gibba023 bash[31815]: audit 2021-03-10T20:51:27.328498+0000 mon.a (mon.0) 1182 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [7, 2]}]: dispatch 2021-03-10T20:51:28.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:28 gibba023 bash[31815]: audit 2021-03-10T20:51:27.329235+0000 mon.a (mon.0) 1183 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T20:51:28.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:28 gibba023 bash[31815]: audit 2021-03-10T20:51:27.329947+0000 mon.a (mon.0) 1184 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:51:28.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:28 gibba023 bash[31815]: audit 2021-03-10T20:51:27.330681+0000 mon.a (mon.0) 1185 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T20:51:30.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:30 gibba044 bash[25485]: cluster 2021-03-10T20:51:29.090162+0000 mgr.gibba044.wflcwh (mgr.34466) 2322 : cluster [DBG] pgmap v1305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:30.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:30 gibba023 bash[30844]: cluster 2021-03-10T20:51:29.090162+0000 mgr.gibba044.wflcwh (mgr.34466) 2322 : cluster [DBG] pgmap v1305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:30.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:30 gibba023 bash[31815]: cluster 2021-03-10T20:51:29.090162+0000 mgr.gibba044.wflcwh (mgr.34466) 2322 : cluster [DBG] pgmap v1305: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:32.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:32 gibba044 bash[25485]: cluster 2021-03-10T20:51:31.091961+0000 mgr.gibba044.wflcwh (mgr.34466) 2323 : cluster [DBG] pgmap v1306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:32.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:32 gibba023 bash[30844]: cluster 2021-03-10T20:51:31.091961+0000 mgr.gibba044.wflcwh (mgr.34466) 2323 : cluster [DBG] pgmap v1306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:32.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:32 gibba023 bash[31815]: cluster 2021-03-10T20:51:31.091961+0000 mgr.gibba044.wflcwh (mgr.34466) 2323 : cluster [DBG] pgmap v1306: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:34.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:34 gibba044 bash[25485]: cluster 2021-03-10T20:51:33.093384+0000 mgr.gibba044.wflcwh (mgr.34466) 2324 : cluster [DBG] pgmap v1307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:34.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:34 gibba023 bash[30844]: cluster 2021-03-10T20:51:33.093384+0000 mgr.gibba044.wflcwh (mgr.34466) 2324 : cluster [DBG] pgmap v1307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:34.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:34 gibba023 bash[31815]: cluster 2021-03-10T20:51:33.093384+0000 mgr.gibba044.wflcwh (mgr.34466) 2324 : cluster [DBG] pgmap v1307: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:36.501 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:36 gibba044 bash[25485]: cluster 2021-03-10T20:51:35.094567+0000 mgr.gibba044.wflcwh (mgr.34466) 2325 : cluster [DBG] pgmap v1308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:36.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:36 gibba023 bash[30844]: cluster 2021-03-10T20:51:35.094567+0000 mgr.gibba044.wflcwh (mgr.34466) 2325 : cluster [DBG] pgmap v1308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:36.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:36 gibba023 bash[31815]: cluster 2021-03-10T20:51:35.094567+0000 mgr.gibba044.wflcwh (mgr.34466) 2325 : cluster [DBG] pgmap v1308: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:38.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:38 gibba023 bash[30844]: cluster 2021-03-10T20:51:37.096218+0000 mgr.gibba044.wflcwh (mgr.34466) 2326 : cluster [DBG] pgmap v1309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:38.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:38 gibba023 bash[31815]: cluster 2021-03-10T20:51:37.096218+0000 mgr.gibba044.wflcwh (mgr.34466) 2326 : cluster [DBG] pgmap v1309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:38.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:38 gibba044 bash[25485]: cluster 2021-03-10T20:51:37.096218+0000 mgr.gibba044.wflcwh (mgr.34466) 2326 : cluster [DBG] pgmap v1309: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:39.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:39 gibba023 bash[30844]: cephadm 2021-03-10T20:51:37.896105+0000 mgr.gibba044.wflcwh (mgr.34466) 2327 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:51:39.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:39 gibba023 bash[31815]: cephadm 2021-03-10T20:51:37.896105+0000 mgr.gibba044.wflcwh (mgr.34466) 2327 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:51:39.751 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:39 gibba044 bash[25485]: cephadm 2021-03-10T20:51:37.896105+0000 mgr.gibba044.wflcwh (mgr.34466) 2327 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:51:40.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:40 gibba023 bash[30844]: cluster 2021-03-10T20:51:39.097913+0000 mgr.gibba044.wflcwh (mgr.34466) 2328 : cluster [DBG] pgmap v1310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:40.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:40 gibba023 bash[31815]: cluster 2021-03-10T20:51:39.097913+0000 mgr.gibba044.wflcwh (mgr.34466) 2328 : cluster [DBG] pgmap v1310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:40.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:40 gibba044 bash[25485]: cluster 2021-03-10T20:51:39.097913+0000 mgr.gibba044.wflcwh (mgr.34466) 2328 : cluster [DBG] pgmap v1310: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:42.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:42 gibba023 bash[30844]: cluster 2021-03-10T20:51:41.099547+0000 mgr.gibba044.wflcwh (mgr.34466) 2329 : cluster [DBG] pgmap v1311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:42.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:42 gibba023 bash[31815]: cluster 2021-03-10T20:51:41.099547+0000 mgr.gibba044.wflcwh (mgr.34466) 2329 : cluster [DBG] pgmap v1311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:42.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:42 gibba044 bash[25485]: cluster 2021-03-10T20:51:41.099547+0000 mgr.gibba044.wflcwh (mgr.34466) 2329 : cluster [DBG] pgmap v1311: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:44.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:44 gibba023 bash[30844]: cluster 2021-03-10T20:51:43.101209+0000 mgr.gibba044.wflcwh (mgr.34466) 2330 : cluster [DBG] pgmap v1312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:44.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:44 gibba023 bash[31815]: cluster 2021-03-10T20:51:43.101209+0000 mgr.gibba044.wflcwh (mgr.34466) 2330 : cluster [DBG] pgmap v1312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:44.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:44 gibba044 bash[25485]: cluster 2021-03-10T20:51:43.101209+0000 mgr.gibba044.wflcwh (mgr.34466) 2330 : cluster [DBG] pgmap v1312: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:46.280 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:51:46.508 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:51:46.508 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (42m) 8m ago 48m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:51:46.509 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (48m) 7m ago 48m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:51:46.509 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (43m) 7m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:51:46.509 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (43m) 7m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:51:46.509 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (42m) 8m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:51:46.510 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (42m) 8m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:51:46.510 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (41m) 7m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:51:46.510 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (42m) 8m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:51:46.510 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (48m) 8m ago 48m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:51:46.510 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (48m) 7m ago 48m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:51:46.511 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (41m) 8m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:51:46.511 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (40m) 8m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:51:46.511 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (40m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:51:46.511 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (39m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:51:46.512 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (39m) 7m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:51:46.512 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (38m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:51:46.512 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (38m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:51:46.512 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (38m) 7m ago 48m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:51:46.513 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (47m) 7m ago 48m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:51:46.513 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 8m ago 46m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:51:46.513 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 7m ago 46m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:51:46.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:46 gibba023 bash[30844]: cluster 2021-03-10T20:51:45.102434+0000 mgr.gibba044.wflcwh (mgr.34466) 2331 : cluster [DBG] pgmap v1313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:46.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:46 gibba023 bash[31815]: cluster 2021-03-10T20:51:45.102434+0000 mgr.gibba044.wflcwh (mgr.34466) 2331 : cluster [DBG] pgmap v1313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:46.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:46 gibba044 bash[25485]: cluster 2021-03-10T20:51:45.102434+0000 mgr.gibba044.wflcwh (mgr.34466) 2331 : cluster [DBG] pgmap v1313: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:46.755 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:51:46.756 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:51:46.756 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:51:46.756 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:51:46.756 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:51:46.757 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:51:46.757 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:51:46.757 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:51:46.757 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:51:46.758 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:51:46.758 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:51:46.758 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:51:46.758 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:51:46.758 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:51:46.759 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:51:47.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:47 gibba023 bash[30844]: audit 2021-03-10T20:51:46.271045+0000 mgr.gibba044.wflcwh (mgr.34466) 2332 : audit [DBG] from='client.55603 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:51:47.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:47 gibba023 bash[30844]: audit 2021-03-10T20:51:46.755175+0000 mon.a (mon.0) 1186 : audit [DBG] from='client.? 172.21.2.123:0/4103944856' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:47.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:47 gibba023 bash[31815]: audit 2021-03-10T20:51:46.271045+0000 mgr.gibba044.wflcwh (mgr.34466) 2332 : audit [DBG] from='client.55603 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:51:47.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:47 gibba023 bash[31815]: audit 2021-03-10T20:51:46.755175+0000 mon.a (mon.0) 1186 : audit [DBG] from='client.? 172.21.2.123:0/4103944856' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:47.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:47 gibba044 bash[25485]: audit 2021-03-10T20:51:46.271045+0000 mgr.gibba044.wflcwh (mgr.34466) 2332 : audit [DBG] from='client.55603 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:51:47.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:47 gibba044 bash[25485]: audit 2021-03-10T20:51:46.755175+0000 mon.a (mon.0) 1186 : audit [DBG] from='client.? 172.21.2.123:0/4103944856' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:51:48.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:48 gibba023 bash[30844]: audit 2021-03-10T20:51:46.495645+0000 mgr.gibba044.wflcwh (mgr.34466) 2333 : audit [DBG] from='client.45630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:51:48.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:48 gibba023 bash[30844]: cluster 2021-03-10T20:51:47.104204+0000 mgr.gibba044.wflcwh (mgr.34466) 2334 : cluster [DBG] pgmap v1314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:48.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:48 gibba023 bash[31815]: audit 2021-03-10T20:51:46.495645+0000 mgr.gibba044.wflcwh (mgr.34466) 2333 : audit [DBG] from='client.45630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:51:48.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:48 gibba023 bash[31815]: cluster 2021-03-10T20:51:47.104204+0000 mgr.gibba044.wflcwh (mgr.34466) 2334 : cluster [DBG] pgmap v1314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:48.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:48 gibba044 bash[25485]: audit 2021-03-10T20:51:46.495645+0000 mgr.gibba044.wflcwh (mgr.34466) 2333 : audit [DBG] from='client.45630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:51:48.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:48 gibba044 bash[25485]: cluster 2021-03-10T20:51:47.104204+0000 mgr.gibba044.wflcwh (mgr.34466) 2334 : cluster [DBG] pgmap v1314: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:50.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:50 gibba023 bash[30844]: cluster 2021-03-10T20:51:49.105916+0000 mgr.gibba044.wflcwh (mgr.34466) 2335 : cluster [DBG] pgmap v1315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:50.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:50 gibba023 bash[31815]: cluster 2021-03-10T20:51:49.105916+0000 mgr.gibba044.wflcwh (mgr.34466) 2335 : cluster [DBG] pgmap v1315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:50.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:50 gibba044 bash[25485]: cluster 2021-03-10T20:51:49.105916+0000 mgr.gibba044.wflcwh (mgr.34466) 2335 : cluster [DBG] pgmap v1315: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:52.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:52 gibba023 bash[30844]: cluster 2021-03-10T20:51:51.107513+0000 mgr.gibba044.wflcwh (mgr.34466) 2336 : cluster [DBG] pgmap v1316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:52.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:52 gibba023 bash[31815]: cluster 2021-03-10T20:51:51.107513+0000 mgr.gibba044.wflcwh (mgr.34466) 2336 : cluster [DBG] pgmap v1316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:52.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:52 gibba044 bash[25485]: cluster 2021-03-10T20:51:51.107513+0000 mgr.gibba044.wflcwh (mgr.34466) 2336 : cluster [DBG] pgmap v1316: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:54.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:54 gibba023 bash[30844]: cephadm 2021-03-10T20:51:52.912127+0000 mgr.gibba044.wflcwh (mgr.34466) 2337 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:51:54.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:54 gibba023 bash[30844]: cluster 2021-03-10T20:51:53.109372+0000 mgr.gibba044.wflcwh (mgr.34466) 2338 : cluster [DBG] pgmap v1317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:54.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:54 gibba023 bash[31815]: cephadm 2021-03-10T20:51:52.912127+0000 mgr.gibba044.wflcwh (mgr.34466) 2337 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:51:54.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:54 gibba023 bash[31815]: cluster 2021-03-10T20:51:53.109372+0000 mgr.gibba044.wflcwh (mgr.34466) 2338 : cluster [DBG] pgmap v1317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:54.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:54 gibba044 bash[25485]: cephadm 2021-03-10T20:51:52.912127+0000 mgr.gibba044.wflcwh (mgr.34466) 2337 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:51:54.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:54 gibba044 bash[25485]: cluster 2021-03-10T20:51:53.109372+0000 mgr.gibba044.wflcwh (mgr.34466) 2338 : cluster [DBG] pgmap v1317: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:56.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:56 gibba023 bash[30844]: cluster 2021-03-10T20:51:55.110613+0000 mgr.gibba044.wflcwh (mgr.34466) 2339 : cluster [DBG] pgmap v1318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:56.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:56 gibba023 bash[31815]: cluster 2021-03-10T20:51:55.110613+0000 mgr.gibba044.wflcwh (mgr.34466) 2339 : cluster [DBG] pgmap v1318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:56.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:56 gibba044 bash[25485]: cluster 2021-03-10T20:51:55.110613+0000 mgr.gibba044.wflcwh (mgr.34466) 2339 : cluster [DBG] pgmap v1318: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:58.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:51:58 gibba023 bash[30844]: cluster 2021-03-10T20:51:57.112098+0000 mgr.gibba044.wflcwh (mgr.34466) 2340 : cluster [DBG] pgmap v1319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:58.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:51:58 gibba023 bash[31815]: cluster 2021-03-10T20:51:57.112098+0000 mgr.gibba044.wflcwh (mgr.34466) 2340 : cluster [DBG] pgmap v1319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:51:58.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:51:58 gibba044 bash[25485]: cluster 2021-03-10T20:51:57.112098+0000 mgr.gibba044.wflcwh (mgr.34466) 2340 : cluster [DBG] pgmap v1319: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:00.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:00 gibba023 bash[30844]: cluster 2021-03-10T20:51:59.113597+0000 mgr.gibba044.wflcwh (mgr.34466) 2341 : cluster [DBG] pgmap v1320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:00.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:00 gibba023 bash[31815]: cluster 2021-03-10T20:51:59.113597+0000 mgr.gibba044.wflcwh (mgr.34466) 2341 : cluster [DBG] pgmap v1320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:00.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:00 gibba044 bash[25485]: cluster 2021-03-10T20:51:59.113597+0000 mgr.gibba044.wflcwh (mgr.34466) 2341 : cluster [DBG] pgmap v1320: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:01.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:01 gibba023 bash[30844]: cluster 2021-03-10T20:52:01.115063+0000 mgr.gibba044.wflcwh (mgr.34466) 2342 : cluster [DBG] pgmap v1321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:01.708 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:01 gibba023 bash[31815]: cluster 2021-03-10T20:52:01.115063+0000 mgr.gibba044.wflcwh (mgr.34466) 2342 : cluster [DBG] pgmap v1321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:01.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:01 gibba044 bash[25485]: cluster 2021-03-10T20:52:01.115063+0000 mgr.gibba044.wflcwh (mgr.34466) 2342 : cluster [DBG] pgmap v1321: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:04.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:04 gibba044 bash[25485]: cluster 2021-03-10T20:52:03.116772+0000 mgr.gibba044.wflcwh (mgr.34466) 2343 : cluster [DBG] pgmap v1322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:04.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:04 gibba023 bash[30844]: cluster 2021-03-10T20:52:03.116772+0000 mgr.gibba044.wflcwh (mgr.34466) 2343 : cluster [DBG] pgmap v1322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:04.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:04 gibba023 bash[31815]: cluster 2021-03-10T20:52:03.116772+0000 mgr.gibba044.wflcwh (mgr.34466) 2343 : cluster [DBG] pgmap v1322: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:06.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:06 gibba044 bash[25485]: cluster 2021-03-10T20:52:05.117962+0000 mgr.gibba044.wflcwh (mgr.34466) 2344 : cluster [DBG] pgmap v1323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:06.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:06 gibba023 bash[30844]: cluster 2021-03-10T20:52:05.117962+0000 mgr.gibba044.wflcwh (mgr.34466) 2344 : cluster [DBG] pgmap v1323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:06.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:06 gibba023 bash[31815]: cluster 2021-03-10T20:52:05.117962+0000 mgr.gibba044.wflcwh (mgr.34466) 2344 : cluster [DBG] pgmap v1323: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:08.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:08 gibba044 bash[25485]: cluster 2021-03-10T20:52:07.119867+0000 mgr.gibba044.wflcwh (mgr.34466) 2345 : cluster [DBG] pgmap v1324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:08.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:08 gibba023 bash[30844]: cluster 2021-03-10T20:52:07.119867+0000 mgr.gibba044.wflcwh (mgr.34466) 2345 : cluster [DBG] pgmap v1324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:08.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:08 gibba023 bash[31815]: cluster 2021-03-10T20:52:07.119867+0000 mgr.gibba044.wflcwh (mgr.34466) 2345 : cluster [DBG] pgmap v1324: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:09.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:09 gibba023 bash[30844]: cephadm 2021-03-10T20:52:07.928179+0000 mgr.gibba044.wflcwh (mgr.34466) 2346 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:52:09.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:09 gibba023 bash[31815]: cephadm 2021-03-10T20:52:07.928179+0000 mgr.gibba044.wflcwh (mgr.34466) 2346 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:52:09.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:09 gibba044 bash[25485]: cephadm 2021-03-10T20:52:07.928179+0000 mgr.gibba044.wflcwh (mgr.34466) 2346 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:52:10.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:10 gibba023 bash[30844]: cluster 2021-03-10T20:52:09.121651+0000 mgr.gibba044.wflcwh (mgr.34466) 2347 : cluster [DBG] pgmap v1325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:10.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:10 gibba023 bash[31815]: cluster 2021-03-10T20:52:09.121651+0000 mgr.gibba044.wflcwh (mgr.34466) 2347 : cluster [DBG] pgmap v1325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:10.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:10 gibba044 bash[25485]: cluster 2021-03-10T20:52:09.121651+0000 mgr.gibba044.wflcwh (mgr.34466) 2347 : cluster [DBG] pgmap v1325: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:12.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:12 gibba023 bash[30844]: cluster 2021-03-10T20:52:11.123020+0000 mgr.gibba044.wflcwh (mgr.34466) 2348 : cluster [DBG] pgmap v1326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:12.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:12 gibba023 bash[31815]: cluster 2021-03-10T20:52:11.123020+0000 mgr.gibba044.wflcwh (mgr.34466) 2348 : cluster [DBG] pgmap v1326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:12.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:12 gibba044 bash[25485]: cluster 2021-03-10T20:52:11.123020+0000 mgr.gibba044.wflcwh (mgr.34466) 2348 : cluster [DBG] pgmap v1326: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:14.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:14 gibba023 bash[30844]: cluster 2021-03-10T20:52:13.124692+0000 mgr.gibba044.wflcwh (mgr.34466) 2349 : cluster [DBG] pgmap v1327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:14.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:14 gibba023 bash[31815]: cluster 2021-03-10T20:52:13.124692+0000 mgr.gibba044.wflcwh (mgr.34466) 2349 : cluster [DBG] pgmap v1327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:14.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:14 gibba044 bash[25485]: cluster 2021-03-10T20:52:13.124692+0000 mgr.gibba044.wflcwh (mgr.34466) 2349 : cluster [DBG] pgmap v1327: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:16.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:16 gibba023 bash[30844]: cluster 2021-03-10T20:52:15.125904+0000 mgr.gibba044.wflcwh (mgr.34466) 2350 : cluster [DBG] pgmap v1328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:16.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:16 gibba023 bash[31815]: cluster 2021-03-10T20:52:15.125904+0000 mgr.gibba044.wflcwh (mgr.34466) 2350 : cluster [DBG] pgmap v1328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:16.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:16 gibba044 bash[25485]: cluster 2021-03-10T20:52:15.125904+0000 mgr.gibba044.wflcwh (mgr.34466) 2350 : cluster [DBG] pgmap v1328: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:17.002 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:52:17.225 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:52:17.225 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (43m) 9m ago 48m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:52:17.225 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (48m) 7m ago 48m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:52:17.225 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (43m) 7m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:52:17.226 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (44m) 7m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:52:17.226 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (43m) 9m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:52:17.226 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (42m) 9m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:52:17.226 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (42m) 7m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:52:17.227 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (42m) 9m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:52:17.227 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (49m) 9m ago 49m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:52:17.227 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (49m) 7m ago 49m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:52:17.227 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (41m) 9m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:52:17.228 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (41m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:52:17.228 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (40m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:52:17.228 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (40m) 9m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:52:17.228 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (39m) 7m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:52:17.228 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (39m) 7m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:52:17.229 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (39m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:52:17.229 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (38m) 7m ago 49m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:52:17.229 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (48m) 7m ago 49m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:52:17.229 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 9m ago 46m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:52:17.230 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 7m ago 46m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:52:17.476 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:52:17.477 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:52:17.477 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:52:17.477 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:52:17.477 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:52:17.478 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:52:17.478 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:52:17.478 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:52:17.478 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:52:17.478 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:52:17.479 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:52:17.479 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:52:17.479 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:52:17.479 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:52:17.480 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:52:18.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:18 gibba023 bash[30844]: audit 2021-03-10T20:52:16.992539+0000 mgr.gibba044.wflcwh (mgr.34466) 2351 : audit [DBG] from='client.55621 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:52:18.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:18 gibba023 bash[30844]: cluster 2021-03-10T20:52:17.127658+0000 mgr.gibba044.wflcwh (mgr.34466) 2352 : cluster [DBG] pgmap v1329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:18.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:18 gibba023 bash[30844]: audit 2021-03-10T20:52:17.216044+0000 mgr.gibba044.wflcwh (mgr.34466) 2353 : audit [DBG] from='client.45648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:52:18.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:18 gibba023 bash[30844]: audit 2021-03-10T20:52:17.475791+0000 mon.a (mon.0) 1187 : audit [DBG] from='client.? 172.21.2.123:0/3825371374' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:18.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:18 gibba023 bash[31815]: audit 2021-03-10T20:52:16.992539+0000 mgr.gibba044.wflcwh (mgr.34466) 2351 : audit [DBG] from='client.55621 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:52:18.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:18 gibba023 bash[31815]: cluster 2021-03-10T20:52:17.127658+0000 mgr.gibba044.wflcwh (mgr.34466) 2352 : cluster [DBG] pgmap v1329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:18.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:18 gibba023 bash[31815]: audit 2021-03-10T20:52:17.216044+0000 mgr.gibba044.wflcwh (mgr.34466) 2353 : audit [DBG] from='client.45648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:52:18.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:18 gibba023 bash[31815]: audit 2021-03-10T20:52:17.475791+0000 mon.a (mon.0) 1187 : audit [DBG] from='client.? 172.21.2.123:0/3825371374' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:18.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:18 gibba044 bash[25485]: audit 2021-03-10T20:52:16.992539+0000 mgr.gibba044.wflcwh (mgr.34466) 2351 : audit [DBG] from='client.55621 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:52:18.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:18 gibba044 bash[25485]: cluster 2021-03-10T20:52:17.127658+0000 mgr.gibba044.wflcwh (mgr.34466) 2352 : cluster [DBG] pgmap v1329: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:18.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:18 gibba044 bash[25485]: audit 2021-03-10T20:52:17.216044+0000 mgr.gibba044.wflcwh (mgr.34466) 2353 : audit [DBG] from='client.45648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:52:18.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:18 gibba044 bash[25485]: audit 2021-03-10T20:52:17.475791+0000 mon.a (mon.0) 1187 : audit [DBG] from='client.? 172.21.2.123:0/3825371374' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:20.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:20 gibba023 bash[30844]: cluster 2021-03-10T20:52:19.129195+0000 mgr.gibba044.wflcwh (mgr.34466) 2354 : cluster [DBG] pgmap v1330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:20.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:20 gibba023 bash[31815]: cluster 2021-03-10T20:52:19.129195+0000 mgr.gibba044.wflcwh (mgr.34466) 2354 : cluster [DBG] pgmap v1330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:20.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:20 gibba044 bash[25485]: cluster 2021-03-10T20:52:19.129195+0000 mgr.gibba044.wflcwh (mgr.34466) 2354 : cluster [DBG] pgmap v1330: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:22.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:22 gibba023 bash[30844]: cluster 2021-03-10T20:52:21.130719+0000 mgr.gibba044.wflcwh (mgr.34466) 2355 : cluster [DBG] pgmap v1331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:22.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:22 gibba023 bash[31815]: cluster 2021-03-10T20:52:21.130719+0000 mgr.gibba044.wflcwh (mgr.34466) 2355 : cluster [DBG] pgmap v1331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:22.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:22 gibba044 bash[25485]: cluster 2021-03-10T20:52:21.130719+0000 mgr.gibba044.wflcwh (mgr.34466) 2355 : cluster [DBG] pgmap v1331: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:24.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[30844]: cephadm 2021-03-10T20:52:22.932678+0000 mgr.gibba044.wflcwh (mgr.34466) 2356 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:52:24.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[30844]: cephadm 2021-03-10T20:52:22.934340+0000 mgr.gibba044.wflcwh (mgr.34466) 2357 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:52:24.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[30844]: audit 2021-03-10T20:52:23.125409+0000 mon.a (mon.0) 1188 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:52:24.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[30844]: cephadm 2021-03-10T20:52:23.128415+0000 mgr.gibba044.wflcwh (mgr.34466) 2358 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:52:24.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[30844]: audit 2021-03-10T20:52:23.129102+0000 mon.a (mon.0) 1189 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:52:24.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[30844]: cephadm 2021-03-10T20:52:23.130561+0000 mgr.gibba044.wflcwh (mgr.34466) 2359 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:52:24.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[30844]: audit 2021-03-10T20:52:23.130693+0000 mon.a (mon.0) 1190 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:24.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[30844]: cluster 2021-03-10T20:52:23.131161+0000 mgr.gibba044.wflcwh (mgr.34466) 2360 : cluster [DBG] pgmap v1332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:24.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[30844]: cephadm 2021-03-10T20:52:23.132400+0000 mgr.gibba044.wflcwh (mgr.34466) 2361 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:52:24.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[30844]: cephadm 2021-03-10T20:52:23.132440+0000 mgr.gibba044.wflcwh (mgr.34466) 2362 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:52:24.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[30844]: audit 2021-03-10T20:52:23.132594+0000 mon.a (mon.0) 1191 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:24.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[30844]: cephadm 2021-03-10T20:52:23.133893+0000 mgr.gibba044.wflcwh (mgr.34466) 2363 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:52:24.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[30844]: cephadm 2021-03-10T20:52:23.133930+0000 mgr.gibba044.wflcwh (mgr.34466) 2364 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:52:24.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[30844]: audit 2021-03-10T20:52:23.134017+0000 mon.a (mon.0) 1192 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:24.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[30844]: cephadm 2021-03-10T20:52:23.135282+0000 mgr.gibba044.wflcwh (mgr.34466) 2365 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:52:24.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[30844]: cephadm 2021-03-10T20:52:23.136994+0000 mgr.gibba044.wflcwh (mgr.34466) 2366 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:52:24.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[30844]: cephadm 2021-03-10T20:52:23.137029+0000 mgr.gibba044.wflcwh (mgr.34466) 2367 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:52:24.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[30844]: audit 2021-03-10T20:52:23.137267+0000 mon.a (mon.0) 1193 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:24.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[30844]: cephadm 2021-03-10T20:52:23.138503+0000 mgr.gibba044.wflcwh (mgr.34466) 2368 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:52:24.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[30844]: cephadm 2021-03-10T20:52:23.138824+0000 mgr.gibba044.wflcwh (mgr.34466) 2369 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:52:24.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[31815]: cephadm 2021-03-10T20:52:22.932678+0000 mgr.gibba044.wflcwh (mgr.34466) 2356 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:52:24.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[31815]: cephadm 2021-03-10T20:52:22.934340+0000 mgr.gibba044.wflcwh (mgr.34466) 2357 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:52:24.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[31815]: audit 2021-03-10T20:52:23.125409+0000 mon.a (mon.0) 1188 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:52:24.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[31815]: cephadm 2021-03-10T20:52:23.128415+0000 mgr.gibba044.wflcwh (mgr.34466) 2358 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:52:24.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[31815]: audit 2021-03-10T20:52:23.129102+0000 mon.a (mon.0) 1189 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:52:24.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[31815]: cephadm 2021-03-10T20:52:23.130561+0000 mgr.gibba044.wflcwh (mgr.34466) 2359 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:52:24.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[31815]: audit 2021-03-10T20:52:23.130693+0000 mon.a (mon.0) 1190 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:24.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[31815]: cluster 2021-03-10T20:52:23.131161+0000 mgr.gibba044.wflcwh (mgr.34466) 2360 : cluster [DBG] pgmap v1332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:24.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[31815]: cephadm 2021-03-10T20:52:23.132400+0000 mgr.gibba044.wflcwh (mgr.34466) 2361 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:52:24.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[31815]: cephadm 2021-03-10T20:52:23.132440+0000 mgr.gibba044.wflcwh (mgr.34466) 2362 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:52:24.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[31815]: audit 2021-03-10T20:52:23.132594+0000 mon.a (mon.0) 1191 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:24.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[31815]: cephadm 2021-03-10T20:52:23.133893+0000 mgr.gibba044.wflcwh (mgr.34466) 2363 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:52:24.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[31815]: cephadm 2021-03-10T20:52:23.133930+0000 mgr.gibba044.wflcwh (mgr.34466) 2364 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:52:24.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[31815]: audit 2021-03-10T20:52:23.134017+0000 mon.a (mon.0) 1192 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:24.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[31815]: cephadm 2021-03-10T20:52:23.135282+0000 mgr.gibba044.wflcwh (mgr.34466) 2365 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:52:24.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[31815]: cephadm 2021-03-10T20:52:23.136994+0000 mgr.gibba044.wflcwh (mgr.34466) 2366 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:52:24.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[31815]: cephadm 2021-03-10T20:52:23.137029+0000 mgr.gibba044.wflcwh (mgr.34466) 2367 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:52:24.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[31815]: audit 2021-03-10T20:52:23.137267+0000 mon.a (mon.0) 1193 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:24.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[31815]: cephadm 2021-03-10T20:52:23.138503+0000 mgr.gibba044.wflcwh (mgr.34466) 2368 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:52:24.436 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[31815]: cephadm 2021-03-10T20:52:23.138824+0000 mgr.gibba044.wflcwh (mgr.34466) 2369 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:52:24.436 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[30844]: audit 2021-03-10T20:52:23.138914+0000 mon.a (mon.0) 1194 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:24.436 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[30844]: cephadm 2021-03-10T20:52:23.140330+0000 mgr.gibba044.wflcwh (mgr.34466) 2370 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:52:24.437 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[30844]: cephadm 2021-03-10T20:52:23.140367+0000 mgr.gibba044.wflcwh (mgr.34466) 2371 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:52:24.437 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[30844]: cephadm 2021-03-10T20:52:23.140493+0000 mgr.gibba044.wflcwh (mgr.34466) 2372 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:52:24.437 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[31815]: audit 2021-03-10T20:52:23.138914+0000 mon.a (mon.0) 1194 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:24.438 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[31815]: cephadm 2021-03-10T20:52:23.140330+0000 mgr.gibba044.wflcwh (mgr.34466) 2370 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:52:24.438 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[31815]: cephadm 2021-03-10T20:52:23.140367+0000 mgr.gibba044.wflcwh (mgr.34466) 2371 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:52:24.438 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:24 gibba023 bash[31815]: cephadm 2021-03-10T20:52:23.140493+0000 mgr.gibba044.wflcwh (mgr.34466) 2372 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:52:24.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:24 gibba044 bash[25485]: cephadm 2021-03-10T20:52:22.932678+0000 mgr.gibba044.wflcwh (mgr.34466) 2356 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:52:24.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:24 gibba044 bash[25485]: cephadm 2021-03-10T20:52:22.934340+0000 mgr.gibba044.wflcwh (mgr.34466) 2357 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:52:24.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:24 gibba044 bash[25485]: audit 2021-03-10T20:52:23.125409+0000 mon.a (mon.0) 1188 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:52:24.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:24 gibba044 bash[25485]: cephadm 2021-03-10T20:52:23.128415+0000 mgr.gibba044.wflcwh (mgr.34466) 2358 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:52:24.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:24 gibba044 bash[25485]: audit 2021-03-10T20:52:23.129102+0000 mon.a (mon.0) 1189 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:52:24.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:24 gibba044 bash[25485]: cephadm 2021-03-10T20:52:23.130561+0000 mgr.gibba044.wflcwh (mgr.34466) 2359 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:52:24.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:24 gibba044 bash[25485]: audit 2021-03-10T20:52:23.130693+0000 mon.a (mon.0) 1190 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:24.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:24 gibba044 bash[25485]: cluster 2021-03-10T20:52:23.131161+0000 mgr.gibba044.wflcwh (mgr.34466) 2360 : cluster [DBG] pgmap v1332: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:24.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:24 gibba044 bash[25485]: cephadm 2021-03-10T20:52:23.132400+0000 mgr.gibba044.wflcwh (mgr.34466) 2361 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:52:24.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:24 gibba044 bash[25485]: cephadm 2021-03-10T20:52:23.132440+0000 mgr.gibba044.wflcwh (mgr.34466) 2362 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:52:24.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:24 gibba044 bash[25485]: audit 2021-03-10T20:52:23.132594+0000 mon.a (mon.0) 1191 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:24.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:24 gibba044 bash[25485]: cephadm 2021-03-10T20:52:23.133893+0000 mgr.gibba044.wflcwh (mgr.34466) 2363 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:52:24.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:24 gibba044 bash[25485]: cephadm 2021-03-10T20:52:23.133930+0000 mgr.gibba044.wflcwh (mgr.34466) 2364 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:52:24.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:24 gibba044 bash[25485]: audit 2021-03-10T20:52:23.134017+0000 mon.a (mon.0) 1192 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:24.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:24 gibba044 bash[25485]: cephadm 2021-03-10T20:52:23.135282+0000 mgr.gibba044.wflcwh (mgr.34466) 2365 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:52:24.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:24 gibba044 bash[25485]: cephadm 2021-03-10T20:52:23.136994+0000 mgr.gibba044.wflcwh (mgr.34466) 2366 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:52:24.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:24 gibba044 bash[25485]: cephadm 2021-03-10T20:52:23.137029+0000 mgr.gibba044.wflcwh (mgr.34466) 2367 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:52:24.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:24 gibba044 bash[25485]: audit 2021-03-10T20:52:23.137267+0000 mon.a (mon.0) 1193 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:24.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:24 gibba044 bash[25485]: cephadm 2021-03-10T20:52:23.138503+0000 mgr.gibba044.wflcwh (mgr.34466) 2368 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:52:24.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:24 gibba044 bash[25485]: cephadm 2021-03-10T20:52:23.138824+0000 mgr.gibba044.wflcwh (mgr.34466) 2369 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:52:24.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:24 gibba044 bash[25485]: audit 2021-03-10T20:52:23.138914+0000 mon.a (mon.0) 1194 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:24.508 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:24 gibba044 bash[25485]: cephadm 2021-03-10T20:52:23.140330+0000 mgr.gibba044.wflcwh (mgr.34466) 2370 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:52:24.508 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:24 gibba044 bash[25485]: cephadm 2021-03-10T20:52:23.140367+0000 mgr.gibba044.wflcwh (mgr.34466) 2371 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:52:24.508 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:24 gibba044 bash[25485]: cephadm 2021-03-10T20:52:23.140493+0000 mgr.gibba044.wflcwh (mgr.34466) 2372 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:52:26.425 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:26 gibba023 bash[30844]: cluster 2021-03-10T20:52:25.132295+0000 mgr.gibba044.wflcwh (mgr.34466) 2373 : cluster [DBG] pgmap v1333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:26.426 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:26 gibba023 bash[31815]: cluster 2021-03-10T20:52:25.132295+0000 mgr.gibba044.wflcwh (mgr.34466) 2373 : cluster [DBG] pgmap v1333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:26.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:26 gibba044 bash[25485]: cluster 2021-03-10T20:52:25.132295+0000 mgr.gibba044.wflcwh (mgr.34466) 2373 : cluster [DBG] pgmap v1333: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:28.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:28 gibba044 bash[25485]: cluster 2021-03-10T20:52:27.133786+0000 mgr.gibba044.wflcwh (mgr.34466) 2374 : cluster [DBG] pgmap v1334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:28.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:28 gibba044 bash[25485]: audit 2021-03-10T20:52:27.323149+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:52:28.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:28 gibba044 bash[25485]: audit 2021-03-10T20:52:27.323777+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:52:28.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:28 gibba044 bash[25485]: audit 2021-03-10T20:52:27.333978+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T20:52:28.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:28 gibba044 bash[25485]: audit 2021-03-10T20:52:27.334712+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:52:28.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:28 gibba044 bash[25485]: audit 2021-03-10T20:52:27.335458+0000 mon.a (mon.0) 1199 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:52:28.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:28 gibba044 bash[25485]: audit 2021-03-10T20:52:27.336190+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:52:28.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:28 gibba023 bash[30844]: cluster 2021-03-10T20:52:27.133786+0000 mgr.gibba044.wflcwh (mgr.34466) 2374 : cluster [DBG] pgmap v1334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:28.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:28 gibba023 bash[30844]: audit 2021-03-10T20:52:27.323149+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:52:28.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:28 gibba023 bash[30844]: audit 2021-03-10T20:52:27.323777+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:52:28.683 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:28 gibba023 bash[30844]: audit 2021-03-10T20:52:27.333978+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T20:52:28.683 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:28 gibba023 bash[30844]: audit 2021-03-10T20:52:27.334712+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:52:28.683 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:28 gibba023 bash[30844]: audit 2021-03-10T20:52:27.335458+0000 mon.a (mon.0) 1199 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:52:28.683 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:28 gibba023 bash[30844]: audit 2021-03-10T20:52:27.336190+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:52:28.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:28 gibba023 bash[31815]: cluster 2021-03-10T20:52:27.133786+0000 mgr.gibba044.wflcwh (mgr.34466) 2374 : cluster [DBG] pgmap v1334: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:28.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:28 gibba023 bash[31815]: audit 2021-03-10T20:52:27.323149+0000 mon.a (mon.0) 1195 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:52:28.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:28 gibba023 bash[31815]: audit 2021-03-10T20:52:27.323777+0000 mon.a (mon.0) 1196 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:52:28.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:28 gibba023 bash[31815]: audit 2021-03-10T20:52:27.333978+0000 mon.a (mon.0) 1197 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [7, 2]}]: dispatch 2021-03-10T20:52:28.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:28 gibba023 bash[31815]: audit 2021-03-10T20:52:27.334712+0000 mon.a (mon.0) 1198 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:52:28.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:28 gibba023 bash[31815]: audit 2021-03-10T20:52:27.335458+0000 mon.a (mon.0) 1199 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T20:52:28.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:28 gibba023 bash[31815]: audit 2021-03-10T20:52:27.336190+0000 mon.a (mon.0) 1200 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T20:52:30.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:30 gibba044 bash[25485]: cluster 2021-03-10T20:52:29.135566+0000 mgr.gibba044.wflcwh (mgr.34466) 2375 : cluster [DBG] pgmap v1335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:30.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:30 gibba023 bash[30844]: cluster 2021-03-10T20:52:29.135566+0000 mgr.gibba044.wflcwh (mgr.34466) 2375 : cluster [DBG] pgmap v1335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:30.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:30 gibba023 bash[31815]: cluster 2021-03-10T20:52:29.135566+0000 mgr.gibba044.wflcwh (mgr.34466) 2375 : cluster [DBG] pgmap v1335: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:32.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:32 gibba023 bash[30844]: cluster 2021-03-10T20:52:31.137250+0000 mgr.gibba044.wflcwh (mgr.34466) 2376 : cluster [DBG] pgmap v1336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:32.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:32 gibba023 bash[31815]: cluster 2021-03-10T20:52:31.137250+0000 mgr.gibba044.wflcwh (mgr.34466) 2376 : cluster [DBG] pgmap v1336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:32.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:32 gibba044 bash[25485]: cluster 2021-03-10T20:52:31.137250+0000 mgr.gibba044.wflcwh (mgr.34466) 2376 : cluster [DBG] pgmap v1336: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:34.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:34 gibba023 bash[30844]: cluster 2021-03-10T20:52:33.138877+0000 mgr.gibba044.wflcwh (mgr.34466) 2377 : cluster [DBG] pgmap v1337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:34.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:34 gibba023 bash[31815]: cluster 2021-03-10T20:52:33.138877+0000 mgr.gibba044.wflcwh (mgr.34466) 2377 : cluster [DBG] pgmap v1337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:34.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:34 gibba044 bash[25485]: cluster 2021-03-10T20:52:33.138877+0000 mgr.gibba044.wflcwh (mgr.34466) 2377 : cluster [DBG] pgmap v1337: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:36.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:36 gibba023 bash[30844]: cluster 2021-03-10T20:52:35.140097+0000 mgr.gibba044.wflcwh (mgr.34466) 2378 : cluster [DBG] pgmap v1338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:36.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:36 gibba023 bash[31815]: cluster 2021-03-10T20:52:35.140097+0000 mgr.gibba044.wflcwh (mgr.34466) 2378 : cluster [DBG] pgmap v1338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:36.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:36 gibba044 bash[25485]: cluster 2021-03-10T20:52:35.140097+0000 mgr.gibba044.wflcwh (mgr.34466) 2378 : cluster [DBG] pgmap v1338: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:38.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:38 gibba044 bash[25485]: cluster 2021-03-10T20:52:37.141854+0000 mgr.gibba044.wflcwh (mgr.34466) 2379 : cluster [DBG] pgmap v1339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:38.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:38 gibba023 bash[30844]: cluster 2021-03-10T20:52:37.141854+0000 mgr.gibba044.wflcwh (mgr.34466) 2379 : cluster [DBG] pgmap v1339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:38.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:38 gibba023 bash[31815]: cluster 2021-03-10T20:52:37.141854+0000 mgr.gibba044.wflcwh (mgr.34466) 2379 : cluster [DBG] pgmap v1339: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:39.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:39 gibba023 bash[30844]: cephadm 2021-03-10T20:52:38.156530+0000 mgr.gibba044.wflcwh (mgr.34466) 2380 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:52:39.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:39 gibba023 bash[31815]: cephadm 2021-03-10T20:52:38.156530+0000 mgr.gibba044.wflcwh (mgr.34466) 2380 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:52:39.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:39 gibba044 bash[25485]: cephadm 2021-03-10T20:52:38.156530+0000 mgr.gibba044.wflcwh (mgr.34466) 2380 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:52:40.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:40 gibba023 bash[30844]: cluster 2021-03-10T20:52:39.143560+0000 mgr.gibba044.wflcwh (mgr.34466) 2381 : cluster [DBG] pgmap v1340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:40.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:40 gibba023 bash[31815]: cluster 2021-03-10T20:52:39.143560+0000 mgr.gibba044.wflcwh (mgr.34466) 2381 : cluster [DBG] pgmap v1340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:40.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:40 gibba044 bash[25485]: cluster 2021-03-10T20:52:39.143560+0000 mgr.gibba044.wflcwh (mgr.34466) 2381 : cluster [DBG] pgmap v1340: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:42.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:42 gibba023 bash[30844]: cluster 2021-03-10T20:52:41.144944+0000 mgr.gibba044.wflcwh (mgr.34466) 2382 : cluster [DBG] pgmap v1341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:42.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:42 gibba023 bash[31815]: cluster 2021-03-10T20:52:41.144944+0000 mgr.gibba044.wflcwh (mgr.34466) 2382 : cluster [DBG] pgmap v1341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:42.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:42 gibba044 bash[25485]: cluster 2021-03-10T20:52:41.144944+0000 mgr.gibba044.wflcwh (mgr.34466) 2382 : cluster [DBG] pgmap v1341: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:44.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:44 gibba023 bash[30844]: cluster 2021-03-10T20:52:43.146647+0000 mgr.gibba044.wflcwh (mgr.34466) 2383 : cluster [DBG] pgmap v1342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:44.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:44 gibba023 bash[31815]: cluster 2021-03-10T20:52:43.146647+0000 mgr.gibba044.wflcwh (mgr.34466) 2383 : cluster [DBG] pgmap v1342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:44.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:44 gibba044 bash[25485]: cluster 2021-03-10T20:52:43.146647+0000 mgr.gibba044.wflcwh (mgr.34466) 2383 : cluster [DBG] pgmap v1342: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:46.682 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:46 gibba023 bash[30844]: cluster 2021-03-10T20:52:45.147948+0000 mgr.gibba044.wflcwh (mgr.34466) 2384 : cluster [DBG] pgmap v1343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:46.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:46 gibba023 bash[31815]: cluster 2021-03-10T20:52:45.147948+0000 mgr.gibba044.wflcwh (mgr.34466) 2384 : cluster [DBG] pgmap v1343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:46.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:46 gibba044 bash[25485]: cluster 2021-03-10T20:52:45.147948+0000 mgr.gibba044.wflcwh (mgr.34466) 2384 : cluster [DBG] pgmap v1343: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:47.722 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:52:47.946 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:52:47.946 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (43m) 9m ago 49m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:52:47.947 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (49m) 8m ago 49m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:52:47.947 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (44m) 8m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:52:47.947 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (44m) 8m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:52:47.947 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (43m) 9m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:52:47.948 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (43m) 9m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:52:47.948 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (43m) 8m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:52:47.948 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (43m) 9m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:52:47.948 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (49m) 9m ago 49m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:52:47.948 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (49m) 8m ago 49m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:52:47.949 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (42m) 9m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:52:47.949 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (41m) 9m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:52:47.949 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (41m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:52:47.949 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (40m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:52:47.950 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (40m) 8m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:52:47.950 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (40m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:52:47.950 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (39m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:52:47.950 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (39m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:52:47.950 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (49m) 8m ago 49m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:52:47.951 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 9m ago 47m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:52:47.951 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 8m ago 47m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:52:48.193 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:52:48.193 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:52:48.194 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:52:48.194 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:52:48.194 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:52:48.194 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:52:48.195 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:52:48.195 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:52:48.195 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:52:48.195 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:52:48.195 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:52:48.196 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:52:48.196 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:52:48.196 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:52:48.196 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:52:48.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:48 gibba023 bash[30844]: cluster 2021-03-10T20:52:47.149667+0000 mgr.gibba044.wflcwh (mgr.34466) 2385 : cluster [DBG] pgmap v1344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:48.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:48 gibba023 bash[30844]: audit 2021-03-10T20:52:48.192222+0000 mon.a (mon.0) 1201 : audit [DBG] from='client.? 172.21.2.123:0/3611825532' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:48.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:48 gibba023 bash[31815]: cluster 2021-03-10T20:52:47.149667+0000 mgr.gibba044.wflcwh (mgr.34466) 2385 : cluster [DBG] pgmap v1344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:48.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:48 gibba023 bash[31815]: audit 2021-03-10T20:52:48.192222+0000 mon.a (mon.0) 1201 : audit [DBG] from='client.? 172.21.2.123:0/3611825532' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:48.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:48 gibba044 bash[25485]: cluster 2021-03-10T20:52:47.149667+0000 mgr.gibba044.wflcwh (mgr.34466) 2385 : cluster [DBG] pgmap v1344: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:48.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:48 gibba044 bash[25485]: audit 2021-03-10T20:52:48.192222+0000 mon.a (mon.0) 1201 : audit [DBG] from='client.? 172.21.2.123:0/3611825532' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:52:49.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:49 gibba023 bash[30844]: audit 2021-03-10T20:52:47.712483+0000 mgr.gibba044.wflcwh (mgr.34466) 2386 : audit [DBG] from='client.55639 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:52:49.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:49 gibba023 bash[30844]: audit 2021-03-10T20:52:47.935009+0000 mgr.gibba044.wflcwh (mgr.34466) 2387 : audit [DBG] from='client.45666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:52:49.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:49 gibba023 bash[31815]: audit 2021-03-10T20:52:47.712483+0000 mgr.gibba044.wflcwh (mgr.34466) 2386 : audit [DBG] from='client.55639 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:52:49.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:49 gibba023 bash[31815]: audit 2021-03-10T20:52:47.935009+0000 mgr.gibba044.wflcwh (mgr.34466) 2387 : audit [DBG] from='client.45666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:52:49.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:49 gibba044 bash[25485]: audit 2021-03-10T20:52:47.712483+0000 mgr.gibba044.wflcwh (mgr.34466) 2386 : audit [DBG] from='client.55639 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:52:49.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:49 gibba044 bash[25485]: audit 2021-03-10T20:52:47.935009+0000 mgr.gibba044.wflcwh (mgr.34466) 2387 : audit [DBG] from='client.45666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:52:50.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:50 gibba023 bash[30844]: cluster 2021-03-10T20:52:49.151441+0000 mgr.gibba044.wflcwh (mgr.34466) 2388 : cluster [DBG] pgmap v1345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:50.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:50 gibba023 bash[31815]: cluster 2021-03-10T20:52:49.151441+0000 mgr.gibba044.wflcwh (mgr.34466) 2388 : cluster [DBG] pgmap v1345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:50.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:50 gibba044 bash[25485]: cluster 2021-03-10T20:52:49.151441+0000 mgr.gibba044.wflcwh (mgr.34466) 2388 : cluster [DBG] pgmap v1345: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:52.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:52 gibba023 bash[30844]: cluster 2021-03-10T20:52:51.152902+0000 mgr.gibba044.wflcwh (mgr.34466) 2389 : cluster [DBG] pgmap v1346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:52.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:52 gibba023 bash[31815]: cluster 2021-03-10T20:52:51.152902+0000 mgr.gibba044.wflcwh (mgr.34466) 2389 : cluster [DBG] pgmap v1346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:52.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:52 gibba044 bash[25485]: cluster 2021-03-10T20:52:51.152902+0000 mgr.gibba044.wflcwh (mgr.34466) 2389 : cluster [DBG] pgmap v1346: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:54.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:54 gibba023 bash[30844]: cluster 2021-03-10T20:52:53.154556+0000 mgr.gibba044.wflcwh (mgr.34466) 2390 : cluster [DBG] pgmap v1347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:54.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:54 gibba023 bash[30844]: cephadm 2021-03-10T20:52:53.172371+0000 mgr.gibba044.wflcwh (mgr.34466) 2391 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:52:54.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:54 gibba023 bash[31815]: cluster 2021-03-10T20:52:53.154556+0000 mgr.gibba044.wflcwh (mgr.34466) 2390 : cluster [DBG] pgmap v1347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:54.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:54 gibba023 bash[31815]: cephadm 2021-03-10T20:52:53.172371+0000 mgr.gibba044.wflcwh (mgr.34466) 2391 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:52:54.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:54 gibba044 bash[25485]: cluster 2021-03-10T20:52:53.154556+0000 mgr.gibba044.wflcwh (mgr.34466) 2390 : cluster [DBG] pgmap v1347: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:54.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:54 gibba044 bash[25485]: cephadm 2021-03-10T20:52:53.172371+0000 mgr.gibba044.wflcwh (mgr.34466) 2391 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:52:56.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:56 gibba023 bash[30844]: cluster 2021-03-10T20:52:55.155846+0000 mgr.gibba044.wflcwh (mgr.34466) 2392 : cluster [DBG] pgmap v1348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:56.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:56 gibba023 bash[31815]: cluster 2021-03-10T20:52:55.155846+0000 mgr.gibba044.wflcwh (mgr.34466) 2392 : cluster [DBG] pgmap v1348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:56.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:56 gibba044 bash[25485]: cluster 2021-03-10T20:52:55.155846+0000 mgr.gibba044.wflcwh (mgr.34466) 2392 : cluster [DBG] pgmap v1348: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:58.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:58 gibba023 bash[30844]: cluster 2021-03-10T20:52:57.157330+0000 mgr.gibba044.wflcwh (mgr.34466) 2393 : cluster [DBG] pgmap v1349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:58.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:58 gibba023 bash[31815]: cluster 2021-03-10T20:52:57.157330+0000 mgr.gibba044.wflcwh (mgr.34466) 2393 : cluster [DBG] pgmap v1349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:58.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:58 gibba044 bash[25485]: cluster 2021-03-10T20:52:57.157330+0000 mgr.gibba044.wflcwh (mgr.34466) 2393 : cluster [DBG] pgmap v1349: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:59.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:52:59 gibba023 bash[30844]: cluster 2021-03-10T20:52:59.158838+0000 mgr.gibba044.wflcwh (mgr.34466) 2394 : cluster [DBG] pgmap v1350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:59.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:52:59 gibba023 bash[31815]: cluster 2021-03-10T20:52:59.158838+0000 mgr.gibba044.wflcwh (mgr.34466) 2394 : cluster [DBG] pgmap v1350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:52:59.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:52:59 gibba044 bash[25485]: cluster 2021-03-10T20:52:59.158838+0000 mgr.gibba044.wflcwh (mgr.34466) 2394 : cluster [DBG] pgmap v1350: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:02.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:02 gibba044 bash[25485]: cluster 2021-03-10T20:53:01.160393+0000 mgr.gibba044.wflcwh (mgr.34466) 2395 : cluster [DBG] pgmap v1351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:02.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:02 gibba023 bash[30844]: cluster 2021-03-10T20:53:01.160393+0000 mgr.gibba044.wflcwh (mgr.34466) 2395 : cluster [DBG] pgmap v1351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:02.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:02 gibba023 bash[31815]: cluster 2021-03-10T20:53:01.160393+0000 mgr.gibba044.wflcwh (mgr.34466) 2395 : cluster [DBG] pgmap v1351: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:04.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:04 gibba023 bash[30844]: cluster 2021-03-10T20:53:03.161800+0000 mgr.gibba044.wflcwh (mgr.34466) 2396 : cluster [DBG] pgmap v1352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:04.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:04 gibba023 bash[31815]: cluster 2021-03-10T20:53:03.161800+0000 mgr.gibba044.wflcwh (mgr.34466) 2396 : cluster [DBG] pgmap v1352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:04.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:04 gibba044 bash[25485]: cluster 2021-03-10T20:53:03.161800+0000 mgr.gibba044.wflcwh (mgr.34466) 2396 : cluster [DBG] pgmap v1352: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:06.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:06 gibba023 bash[30844]: cluster 2021-03-10T20:53:05.163016+0000 mgr.gibba044.wflcwh (mgr.34466) 2397 : cluster [DBG] pgmap v1353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:06.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:06 gibba023 bash[31815]: cluster 2021-03-10T20:53:05.163016+0000 mgr.gibba044.wflcwh (mgr.34466) 2397 : cluster [DBG] pgmap v1353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:06.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:06 gibba044 bash[25485]: cluster 2021-03-10T20:53:05.163016+0000 mgr.gibba044.wflcwh (mgr.34466) 2397 : cluster [DBG] pgmap v1353: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:08.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:08 gibba044 bash[25485]: cluster 2021-03-10T20:53:07.164799+0000 mgr.gibba044.wflcwh (mgr.34466) 2398 : cluster [DBG] pgmap v1354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:08.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:08 gibba023 bash[30844]: cluster 2021-03-10T20:53:07.164799+0000 mgr.gibba044.wflcwh (mgr.34466) 2398 : cluster [DBG] pgmap v1354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:08.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:08 gibba023 bash[31815]: cluster 2021-03-10T20:53:07.164799+0000 mgr.gibba044.wflcwh (mgr.34466) 2398 : cluster [DBG] pgmap v1354: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:09.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:09 gibba023 bash[30844]: cephadm 2021-03-10T20:53:08.188310+0000 mgr.gibba044.wflcwh (mgr.34466) 2399 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:53:09.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:09 gibba023 bash[31815]: cephadm 2021-03-10T20:53:08.188310+0000 mgr.gibba044.wflcwh (mgr.34466) 2399 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:53:09.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:09 gibba044 bash[25485]: cephadm 2021-03-10T20:53:08.188310+0000 mgr.gibba044.wflcwh (mgr.34466) 2399 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:53:10.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:10 gibba023 bash[30844]: cluster 2021-03-10T20:53:09.166429+0000 mgr.gibba044.wflcwh (mgr.34466) 2400 : cluster [DBG] pgmap v1355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:10.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:10 gibba023 bash[31815]: cluster 2021-03-10T20:53:09.166429+0000 mgr.gibba044.wflcwh (mgr.34466) 2400 : cluster [DBG] pgmap v1355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:10.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:10 gibba044 bash[25485]: cluster 2021-03-10T20:53:09.166429+0000 mgr.gibba044.wflcwh (mgr.34466) 2400 : cluster [DBG] pgmap v1355: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:12.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:12 gibba023 bash[30844]: cluster 2021-03-10T20:53:11.167966+0000 mgr.gibba044.wflcwh (mgr.34466) 2401 : cluster [DBG] pgmap v1356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:12.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:12 gibba023 bash[31815]: cluster 2021-03-10T20:53:11.167966+0000 mgr.gibba044.wflcwh (mgr.34466) 2401 : cluster [DBG] pgmap v1356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:12.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:12 gibba044 bash[25485]: cluster 2021-03-10T20:53:11.167966+0000 mgr.gibba044.wflcwh (mgr.34466) 2401 : cluster [DBG] pgmap v1356: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:14.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:14 gibba023 bash[30844]: cluster 2021-03-10T20:53:13.169378+0000 mgr.gibba044.wflcwh (mgr.34466) 2402 : cluster [DBG] pgmap v1357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:14.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:14 gibba023 bash[31815]: cluster 2021-03-10T20:53:13.169378+0000 mgr.gibba044.wflcwh (mgr.34466) 2402 : cluster [DBG] pgmap v1357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:14.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:14 gibba044 bash[25485]: cluster 2021-03-10T20:53:13.169378+0000 mgr.gibba044.wflcwh (mgr.34466) 2402 : cluster [DBG] pgmap v1357: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:16.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:16 gibba023 bash[30844]: cluster 2021-03-10T20:53:15.170597+0000 mgr.gibba044.wflcwh (mgr.34466) 2403 : cluster [DBG] pgmap v1358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:16.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:16 gibba023 bash[31815]: cluster 2021-03-10T20:53:15.170597+0000 mgr.gibba044.wflcwh (mgr.34466) 2403 : cluster [DBG] pgmap v1358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:16.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:16 gibba044 bash[25485]: cluster 2021-03-10T20:53:15.170597+0000 mgr.gibba044.wflcwh (mgr.34466) 2403 : cluster [DBG] pgmap v1358: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:18.439 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:53:18.668 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:53:18.669 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (44m) 10m ago 50m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:53:18.669 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (49m) 8m ago 49m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:53:18.669 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (44m) 8m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:53:18.670 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (45m) 8m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:53:18.670 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (44m) 10m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:53:18.670 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (43m) 10m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:53:18.670 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (43m) 8m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:53:18.670 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (43m) 10m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:53:18.671 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (50m) 10m ago 50m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:53:18.671 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (50m) 8m ago 50m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:53:18.671 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (42m) 10m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:53:18.671 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (42m) 10m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:53:18.671 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (41m) 10m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:53:18.672 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (41m) 10m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:53:18.672 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (40m) 8m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:53:18.672 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (40m) 8m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:53:18.672 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (40m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:53:18.673 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (39m) 8m ago 50m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:53:18.673 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (49m) 8m ago 50m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:53:18.673 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 10m ago 47m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:53:18.673 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 8m ago 47m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:53:18.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:18 gibba023 bash[30844]: cluster 2021-03-10T20:53:17.172387+0000 mgr.gibba044.wflcwh (mgr.34466) 2404 : cluster [DBG] pgmap v1359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:18.675 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:18 gibba023 bash[31815]: cluster 2021-03-10T20:53:17.172387+0000 mgr.gibba044.wflcwh (mgr.34466) 2404 : cluster [DBG] pgmap v1359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:18.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:18 gibba044 bash[25485]: cluster 2021-03-10T20:53:17.172387+0000 mgr.gibba044.wflcwh (mgr.34466) 2404 : cluster [DBG] pgmap v1359: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:18.920 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:53:18.920 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:53:18.920 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:53:18.921 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:53:18.921 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:53:18.921 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:53:18.921 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:53:18.922 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:53:18.922 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:53:18.922 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:53:18.922 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:53:18.923 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:53:18.923 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:53:18.923 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:53:18.923 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:53:19.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:19 gibba023 bash[30844]: audit 2021-03-10T20:53:18.918998+0000 mon.a (mon.0) 1202 : audit [DBG] from='client.? 172.21.2.123:0/1784891879' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:19.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:19 gibba023 bash[31815]: audit 2021-03-10T20:53:18.918998+0000 mon.a (mon.0) 1202 : audit [DBG] from='client.? 172.21.2.123:0/1784891879' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:19.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:19 gibba044 bash[25485]: audit 2021-03-10T20:53:18.918998+0000 mon.a (mon.0) 1202 : audit [DBG] from='client.? 172.21.2.123:0/1784891879' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:20.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:20 gibba023 bash[30844]: audit 2021-03-10T20:53:18.429370+0000 mgr.gibba044.wflcwh (mgr.34466) 2405 : audit [DBG] from='client.45678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:53:20.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:20 gibba023 bash[30844]: audit 2021-03-10T20:53:18.655774+0000 mgr.gibba044.wflcwh (mgr.34466) 2406 : audit [DBG] from='client.55663 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:53:20.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:20 gibba023 bash[30844]: cluster 2021-03-10T20:53:19.174122+0000 mgr.gibba044.wflcwh (mgr.34466) 2407 : cluster [DBG] pgmap v1360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:20.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:20 gibba023 bash[31815]: audit 2021-03-10T20:53:18.429370+0000 mgr.gibba044.wflcwh (mgr.34466) 2405 : audit [DBG] from='client.45678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:53:20.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:20 gibba023 bash[31815]: audit 2021-03-10T20:53:18.655774+0000 mgr.gibba044.wflcwh (mgr.34466) 2406 : audit [DBG] from='client.55663 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:53:20.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:20 gibba023 bash[31815]: cluster 2021-03-10T20:53:19.174122+0000 mgr.gibba044.wflcwh (mgr.34466) 2407 : cluster [DBG] pgmap v1360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:20.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:20 gibba044 bash[25485]: audit 2021-03-10T20:53:18.429370+0000 mgr.gibba044.wflcwh (mgr.34466) 2405 : audit [DBG] from='client.45678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:53:20.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:20 gibba044 bash[25485]: audit 2021-03-10T20:53:18.655774+0000 mgr.gibba044.wflcwh (mgr.34466) 2406 : audit [DBG] from='client.55663 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:53:20.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:20 gibba044 bash[25485]: cluster 2021-03-10T20:53:19.174122+0000 mgr.gibba044.wflcwh (mgr.34466) 2407 : cluster [DBG] pgmap v1360: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:22.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:22 gibba023 bash[30844]: cluster 2021-03-10T20:53:21.175747+0000 mgr.gibba044.wflcwh (mgr.34466) 2408 : cluster [DBG] pgmap v1361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:22.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:22 gibba023 bash[31815]: cluster 2021-03-10T20:53:21.175747+0000 mgr.gibba044.wflcwh (mgr.34466) 2408 : cluster [DBG] pgmap v1361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:22.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:22 gibba044 bash[25485]: cluster 2021-03-10T20:53:21.175747+0000 mgr.gibba044.wflcwh (mgr.34466) 2408 : cluster [DBG] pgmap v1361: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:23.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:23 gibba023 bash[30844]: audit 2021-03-10T20:53:23.206309+0000 mon.a (mon.0) 1203 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:53:23.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:23 gibba023 bash[31815]: audit 2021-03-10T20:53:23.206309+0000 mon.a (mon.0) 1203 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:53:23.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:23 gibba044 bash[25485]: audit 2021-03-10T20:53:23.206309+0000 mon.a (mon.0) 1203 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:53:24.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:24 gibba023 bash[30844]: cluster 2021-03-10T20:53:23.177086+0000 mgr.gibba044.wflcwh (mgr.34466) 2409 : cluster [DBG] pgmap v1362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:24.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:24 gibba023 bash[30844]: cephadm 2021-03-10T20:53:23.205949+0000 mgr.gibba044.wflcwh (mgr.34466) 2410 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:53:24.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:24 gibba023 bash[31815]: cluster 2021-03-10T20:53:23.177086+0000 mgr.gibba044.wflcwh (mgr.34466) 2409 : cluster [DBG] pgmap v1362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:24.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:24 gibba023 bash[31815]: cephadm 2021-03-10T20:53:23.205949+0000 mgr.gibba044.wflcwh (mgr.34466) 2410 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:53:24.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:24 gibba044 bash[25485]: cluster 2021-03-10T20:53:23.177086+0000 mgr.gibba044.wflcwh (mgr.34466) 2409 : cluster [DBG] pgmap v1362: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:24.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:24 gibba044 bash[25485]: cephadm 2021-03-10T20:53:23.205949+0000 mgr.gibba044.wflcwh (mgr.34466) 2410 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:53:26.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:26 gibba023 bash[30844]: cluster 2021-03-10T20:53:25.178327+0000 mgr.gibba044.wflcwh (mgr.34466) 2411 : cluster [DBG] pgmap v1363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:26.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:26 gibba023 bash[31815]: cluster 2021-03-10T20:53:25.178327+0000 mgr.gibba044.wflcwh (mgr.34466) 2411 : cluster [DBG] pgmap v1363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:26.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:26 gibba044 bash[25485]: cluster 2021-03-10T20:53:25.178327+0000 mgr.gibba044.wflcwh (mgr.34466) 2411 : cluster [DBG] pgmap v1363: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:27.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: audit 2021-03-10T20:53:26.654082+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:53:27.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: cephadm 2021-03-10T20:53:26.654960+0000 mgr.gibba044.wflcwh (mgr.34466) 2412 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:53:27.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: audit 2021-03-10T20:53:26.872825+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:53:27.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: cephadm 2021-03-10T20:53:26.879857+0000 mgr.gibba044.wflcwh (mgr.34466) 2413 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:53:27.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: audit 2021-03-10T20:53:26.880368+0000 mon.a (mon.0) 1206 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:53:27.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: cephadm 2021-03-10T20:53:26.881935+0000 mgr.gibba044.wflcwh (mgr.34466) 2414 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:53:27.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: audit 2021-03-10T20:53:26.881944+0000 mon.a (mon.0) 1207 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: cephadm 2021-03-10T20:53:26.883407+0000 mgr.gibba044.wflcwh (mgr.34466) 2415 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:53:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: cephadm 2021-03-10T20:53:26.883446+0000 mgr.gibba044.wflcwh (mgr.34466) 2416 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:53:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: audit 2021-03-10T20:53:26.883647+0000 mon.a (mon.0) 1208 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: cephadm 2021-03-10T20:53:26.884899+0000 mgr.gibba044.wflcwh (mgr.34466) 2417 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:53:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: cephadm 2021-03-10T20:53:26.884938+0000 mgr.gibba044.wflcwh (mgr.34466) 2418 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:53:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: audit 2021-03-10T20:53:26.885030+0000 mon.a (mon.0) 1209 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: cephadm 2021-03-10T20:53:26.886074+0000 mgr.gibba044.wflcwh (mgr.34466) 2419 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:53:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: cephadm 2021-03-10T20:53:26.887455+0000 mgr.gibba044.wflcwh (mgr.34466) 2420 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:53:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: cephadm 2021-03-10T20:53:26.887497+0000 mgr.gibba044.wflcwh (mgr.34466) 2421 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:53:27.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: audit 2021-03-10T20:53:26.887700+0000 mon.a (mon.0) 1210 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:27.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: cephadm 2021-03-10T20:53:26.888898+0000 mgr.gibba044.wflcwh (mgr.34466) 2422 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:53:27.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: audit 2021-03-10T20:53:26.889232+0000 mon.a (mon.0) 1211 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:27.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: cephadm 2021-03-10T20:53:26.889250+0000 mgr.gibba044.wflcwh (mgr.34466) 2423 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:53:27.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: cephadm 2021-03-10T20:53:26.890548+0000 mgr.gibba044.wflcwh (mgr.34466) 2424 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:53:27.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: audit 2021-03-10T20:53:26.654082+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:53:27.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: cephadm 2021-03-10T20:53:26.654960+0000 mgr.gibba044.wflcwh (mgr.34466) 2412 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:53:27.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: audit 2021-03-10T20:53:26.872825+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:53:27.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: cephadm 2021-03-10T20:53:26.879857+0000 mgr.gibba044.wflcwh (mgr.34466) 2413 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:53:27.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: audit 2021-03-10T20:53:26.880368+0000 mon.a (mon.0) 1206 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:53:27.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: cephadm 2021-03-10T20:53:26.881935+0000 mgr.gibba044.wflcwh (mgr.34466) 2414 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:53:27.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: audit 2021-03-10T20:53:26.881944+0000 mon.a (mon.0) 1207 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:27.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: cephadm 2021-03-10T20:53:26.883407+0000 mgr.gibba044.wflcwh (mgr.34466) 2415 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:53:27.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: cephadm 2021-03-10T20:53:26.883446+0000 mgr.gibba044.wflcwh (mgr.34466) 2416 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:53:27.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: audit 2021-03-10T20:53:26.883647+0000 mon.a (mon.0) 1208 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:27.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: cephadm 2021-03-10T20:53:26.884899+0000 mgr.gibba044.wflcwh (mgr.34466) 2417 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:53:27.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: cephadm 2021-03-10T20:53:26.884938+0000 mgr.gibba044.wflcwh (mgr.34466) 2418 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:53:27.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: audit 2021-03-10T20:53:26.885030+0000 mon.a (mon.0) 1209 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:27.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: cephadm 2021-03-10T20:53:26.886074+0000 mgr.gibba044.wflcwh (mgr.34466) 2419 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:53:27.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: cephadm 2021-03-10T20:53:26.887455+0000 mgr.gibba044.wflcwh (mgr.34466) 2420 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:53:27.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: cephadm 2021-03-10T20:53:26.887497+0000 mgr.gibba044.wflcwh (mgr.34466) 2421 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:53:27.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: audit 2021-03-10T20:53:26.887700+0000 mon.a (mon.0) 1210 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:27.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: cephadm 2021-03-10T20:53:26.888898+0000 mgr.gibba044.wflcwh (mgr.34466) 2422 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:53:27.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: audit 2021-03-10T20:53:26.889232+0000 mon.a (mon.0) 1211 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:27.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: cephadm 2021-03-10T20:53:26.889250+0000 mgr.gibba044.wflcwh (mgr.34466) 2423 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:53:27.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: cephadm 2021-03-10T20:53:26.890548+0000 mgr.gibba044.wflcwh (mgr.34466) 2424 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:53:27.936 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: cephadm 2021-03-10T20:53:26.890592+0000 mgr.gibba044.wflcwh (mgr.34466) 2425 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:53:27.936 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: cephadm 2021-03-10T20:53:26.890732+0000 mgr.gibba044.wflcwh (mgr.34466) 2426 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:53:27.936 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: cluster 2021-03-10T20:53:27.180147+0000 mgr.gibba044.wflcwh (mgr.34466) 2427 : cluster [DBG] pgmap v1364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:27.937 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: audit 2021-03-10T20:53:27.328891+0000 mon.a (mon.0) 1212 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:53:27.937 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: audit 2021-03-10T20:53:27.329211+0000 mon.a (mon.0) 1213 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:53:27.937 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: audit 2021-03-10T20:53:27.339792+0000 mon.a (mon.0) 1214 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T20:53:27.937 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: audit 2021-03-10T20:53:27.340361+0000 mon.a (mon.0) 1215 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:53:27.938 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: audit 2021-03-10T20:53:27.340868+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:53:27.938 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[30844]: audit 2021-03-10T20:53:27.341548+0000 mon.a (mon.0) 1217 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T20:53:27.938 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: cephadm 2021-03-10T20:53:26.890592+0000 mgr.gibba044.wflcwh (mgr.34466) 2425 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:53:27.939 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: cephadm 2021-03-10T20:53:26.890732+0000 mgr.gibba044.wflcwh (mgr.34466) 2426 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:53:27.939 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: cluster 2021-03-10T20:53:27.180147+0000 mgr.gibba044.wflcwh (mgr.34466) 2427 : cluster [DBG] pgmap v1364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:27.939 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: audit 2021-03-10T20:53:27.328891+0000 mon.a (mon.0) 1212 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:53:27.939 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: audit 2021-03-10T20:53:27.329211+0000 mon.a (mon.0) 1213 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:53:27.939 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: audit 2021-03-10T20:53:27.339792+0000 mon.a (mon.0) 1214 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T20:53:27.940 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: audit 2021-03-10T20:53:27.340361+0000 mon.a (mon.0) 1215 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:53:27.940 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: audit 2021-03-10T20:53:27.340868+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:53:27.940 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:27 gibba023 bash[31815]: audit 2021-03-10T20:53:27.341548+0000 mon.a (mon.0) 1217 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T20:53:28.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: audit 2021-03-10T20:53:26.654082+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:53:28.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: cephadm 2021-03-10T20:53:26.654960+0000 mgr.gibba044.wflcwh (mgr.34466) 2412 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:53:28.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: audit 2021-03-10T20:53:26.872825+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:53:28.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: cephadm 2021-03-10T20:53:26.879857+0000 mgr.gibba044.wflcwh (mgr.34466) 2413 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:53:28.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: audit 2021-03-10T20:53:26.880368+0000 mon.a (mon.0) 1206 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:53:28.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: cephadm 2021-03-10T20:53:26.881935+0000 mgr.gibba044.wflcwh (mgr.34466) 2414 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:53:28.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: audit 2021-03-10T20:53:26.881944+0000 mon.a (mon.0) 1207 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:28.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: cephadm 2021-03-10T20:53:26.883407+0000 mgr.gibba044.wflcwh (mgr.34466) 2415 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:53:28.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: cephadm 2021-03-10T20:53:26.883446+0000 mgr.gibba044.wflcwh (mgr.34466) 2416 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:53:28.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: audit 2021-03-10T20:53:26.883647+0000 mon.a (mon.0) 1208 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:28.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: cephadm 2021-03-10T20:53:26.884899+0000 mgr.gibba044.wflcwh (mgr.34466) 2417 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:53:28.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: cephadm 2021-03-10T20:53:26.884938+0000 mgr.gibba044.wflcwh (mgr.34466) 2418 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:53:28.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: audit 2021-03-10T20:53:26.885030+0000 mon.a (mon.0) 1209 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:28.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: cephadm 2021-03-10T20:53:26.886074+0000 mgr.gibba044.wflcwh (mgr.34466) 2419 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:53:28.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: cephadm 2021-03-10T20:53:26.887455+0000 mgr.gibba044.wflcwh (mgr.34466) 2420 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:53:28.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: cephadm 2021-03-10T20:53:26.887497+0000 mgr.gibba044.wflcwh (mgr.34466) 2421 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:53:28.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: audit 2021-03-10T20:53:26.887700+0000 mon.a (mon.0) 1210 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:28.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: cephadm 2021-03-10T20:53:26.888898+0000 mgr.gibba044.wflcwh (mgr.34466) 2422 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:53:28.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: audit 2021-03-10T20:53:26.889232+0000 mon.a (mon.0) 1211 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:28.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: cephadm 2021-03-10T20:53:26.889250+0000 mgr.gibba044.wflcwh (mgr.34466) 2423 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:53:28.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: cephadm 2021-03-10T20:53:26.890548+0000 mgr.gibba044.wflcwh (mgr.34466) 2424 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:53:28.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: cephadm 2021-03-10T20:53:26.890592+0000 mgr.gibba044.wflcwh (mgr.34466) 2425 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:53:28.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: cephadm 2021-03-10T20:53:26.890732+0000 mgr.gibba044.wflcwh (mgr.34466) 2426 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:53:28.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: cluster 2021-03-10T20:53:27.180147+0000 mgr.gibba044.wflcwh (mgr.34466) 2427 : cluster [DBG] pgmap v1364: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:28.009 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: audit 2021-03-10T20:53:27.328891+0000 mon.a (mon.0) 1212 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:53:28.009 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: audit 2021-03-10T20:53:27.329211+0000 mon.a (mon.0) 1213 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:53:28.009 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: audit 2021-03-10T20:53:27.339792+0000 mon.a (mon.0) 1214 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2021-03-10T20:53:28.009 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: audit 2021-03-10T20:53:27.340361+0000 mon.a (mon.0) 1215 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:53:28.010 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: audit 2021-03-10T20:53:27.340868+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:53:28.010 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:27 gibba044 bash[25485]: audit 2021-03-10T20:53:27.341548+0000 mon.a (mon.0) 1217 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T20:53:30.502 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:30 gibba044 bash[25485]: cluster 2021-03-10T20:53:29.181681+0000 mgr.gibba044.wflcwh (mgr.34466) 2428 : cluster [DBG] pgmap v1365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:30.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:30 gibba023 bash[30844]: cluster 2021-03-10T20:53:29.181681+0000 mgr.gibba044.wflcwh (mgr.34466) 2428 : cluster [DBG] pgmap v1365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:30.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:30 gibba023 bash[31815]: cluster 2021-03-10T20:53:29.181681+0000 mgr.gibba044.wflcwh (mgr.34466) 2428 : cluster [DBG] pgmap v1365: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:32.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:32 gibba023 bash[30844]: cluster 2021-03-10T20:53:31.183251+0000 mgr.gibba044.wflcwh (mgr.34466) 2429 : cluster [DBG] pgmap v1366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:32.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:32 gibba023 bash[31815]: cluster 2021-03-10T20:53:31.183251+0000 mgr.gibba044.wflcwh (mgr.34466) 2429 : cluster [DBG] pgmap v1366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:32.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:32 gibba044 bash[25485]: cluster 2021-03-10T20:53:31.183251+0000 mgr.gibba044.wflcwh (mgr.34466) 2429 : cluster [DBG] pgmap v1366: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:34.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:34 gibba023 bash[30844]: cluster 2021-03-10T20:53:33.184917+0000 mgr.gibba044.wflcwh (mgr.34466) 2430 : cluster [DBG] pgmap v1367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:34.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:34 gibba023 bash[31815]: cluster 2021-03-10T20:53:33.184917+0000 mgr.gibba044.wflcwh (mgr.34466) 2430 : cluster [DBG] pgmap v1367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:34.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:34 gibba044 bash[25485]: cluster 2021-03-10T20:53:33.184917+0000 mgr.gibba044.wflcwh (mgr.34466) 2430 : cluster [DBG] pgmap v1367: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:36.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:36 gibba023 bash[30844]: cluster 2021-03-10T20:53:35.186168+0000 mgr.gibba044.wflcwh (mgr.34466) 2431 : cluster [DBG] pgmap v1368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:36.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:36 gibba023 bash[31815]: cluster 2021-03-10T20:53:35.186168+0000 mgr.gibba044.wflcwh (mgr.34466) 2431 : cluster [DBG] pgmap v1368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:36.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:36 gibba044 bash[25485]: cluster 2021-03-10T20:53:35.186168+0000 mgr.gibba044.wflcwh (mgr.34466) 2431 : cluster [DBG] pgmap v1368: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:38.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:38 gibba023 bash[30844]: cluster 2021-03-10T20:53:37.187851+0000 mgr.gibba044.wflcwh (mgr.34466) 2432 : cluster [DBG] pgmap v1369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:38.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:38 gibba023 bash[31815]: cluster 2021-03-10T20:53:37.187851+0000 mgr.gibba044.wflcwh (mgr.34466) 2432 : cluster [DBG] pgmap v1369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:38.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:38 gibba044 bash[25485]: cluster 2021-03-10T20:53:37.187851+0000 mgr.gibba044.wflcwh (mgr.34466) 2432 : cluster [DBG] pgmap v1369: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:40.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:40 gibba023 bash[30844]: cluster 2021-03-10T20:53:39.189662+0000 mgr.gibba044.wflcwh (mgr.34466) 2433 : cluster [DBG] pgmap v1370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:40.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:40 gibba023 bash[31815]: cluster 2021-03-10T20:53:39.189662+0000 mgr.gibba044.wflcwh (mgr.34466) 2433 : cluster [DBG] pgmap v1370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:40.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:40 gibba044 bash[25485]: cluster 2021-03-10T20:53:39.189662+0000 mgr.gibba044.wflcwh (mgr.34466) 2433 : cluster [DBG] pgmap v1370: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:42.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:42 gibba023 bash[30844]: cluster 2021-03-10T20:53:41.191114+0000 mgr.gibba044.wflcwh (mgr.34466) 2434 : cluster [DBG] pgmap v1371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:42.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:42 gibba023 bash[31815]: cluster 2021-03-10T20:53:41.191114+0000 mgr.gibba044.wflcwh (mgr.34466) 2434 : cluster [DBG] pgmap v1371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:42.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:42 gibba044 bash[25485]: cluster 2021-03-10T20:53:41.191114+0000 mgr.gibba044.wflcwh (mgr.34466) 2434 : cluster [DBG] pgmap v1371: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:43.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:43 gibba023 bash[30844]: cephadm 2021-03-10T20:53:41.903817+0000 mgr.gibba044.wflcwh (mgr.34466) 2435 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:53:43.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:43 gibba023 bash[31815]: cephadm 2021-03-10T20:53:41.903817+0000 mgr.gibba044.wflcwh (mgr.34466) 2435 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:53:43.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:43 gibba044 bash[25485]: cephadm 2021-03-10T20:53:41.903817+0000 mgr.gibba044.wflcwh (mgr.34466) 2435 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:53:44.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:44 gibba023 bash[30844]: cluster 2021-03-10T20:53:43.192708+0000 mgr.gibba044.wflcwh (mgr.34466) 2436 : cluster [DBG] pgmap v1372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:44.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:44 gibba023 bash[31815]: cluster 2021-03-10T20:53:43.192708+0000 mgr.gibba044.wflcwh (mgr.34466) 2436 : cluster [DBG] pgmap v1372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:44.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:44 gibba044 bash[25485]: cluster 2021-03-10T20:53:43.192708+0000 mgr.gibba044.wflcwh (mgr.34466) 2436 : cluster [DBG] pgmap v1372: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:46.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:46 gibba023 bash[30844]: cluster 2021-03-10T20:53:45.193964+0000 mgr.gibba044.wflcwh (mgr.34466) 2437 : cluster [DBG] pgmap v1373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:46.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:46 gibba023 bash[31815]: cluster 2021-03-10T20:53:45.193964+0000 mgr.gibba044.wflcwh (mgr.34466) 2437 : cluster [DBG] pgmap v1373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:46.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:46 gibba044 bash[25485]: cluster 2021-03-10T20:53:45.193964+0000 mgr.gibba044.wflcwh (mgr.34466) 2437 : cluster [DBG] pgmap v1373: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:48.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:48 gibba023 bash[30844]: cluster 2021-03-10T20:53:47.195564+0000 mgr.gibba044.wflcwh (mgr.34466) 2438 : cluster [DBG] pgmap v1374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:48.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:48 gibba023 bash[31815]: cluster 2021-03-10T20:53:47.195564+0000 mgr.gibba044.wflcwh (mgr.34466) 2438 : cluster [DBG] pgmap v1374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:48.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:48 gibba044 bash[25485]: cluster 2021-03-10T20:53:47.195564+0000 mgr.gibba044.wflcwh (mgr.34466) 2438 : cluster [DBG] pgmap v1374: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:49.166 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:53:49.393 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:53:49.393 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (44m) 22s ago 50m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:53:49.394 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (50m) 9m ago 50m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:53:49.394 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (45m) 9m ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:53:49.394 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (45m) 9m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:53:49.394 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (44m) 22s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:53:49.395 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (44m) 22s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:53:49.395 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (44m) 9m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:53:49.395 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (44m) 22s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:53:49.395 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (50m) 22s ago 50m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:53:49.395 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (50m) 9m ago 50m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:53:49.396 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (43m) 22s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:53:49.396 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (42m) 22s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:53:49.396 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (42m) 22s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:53:49.396 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (41m) 22s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:53:49.396 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (41m) 9m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:53:49.397 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (41m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:53:49.397 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (40m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:53:49.397 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (40m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:53:49.397 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (50m) 9m ago 50m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:53:49.398 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 22s ago 48m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:53:49.398 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 9m ago 48m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:53:49.646 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:53:49.646 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:53:49.646 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:53:49.646 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:53:49.647 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:53:49.647 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:53:49.647 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:53:49.647 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:53:49.648 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:53:49.648 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:53:49.648 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:53:49.648 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:53:49.648 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:53:49.649 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:53:49.649 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:53:50.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:50 gibba023 bash[30844]: audit 2021-03-10T20:53:49.156363+0000 mgr.gibba044.wflcwh (mgr.34466) 2439 : audit [DBG] from='client.45696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:53:50.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:50 gibba023 bash[30844]: cluster 2021-03-10T20:53:49.197117+0000 mgr.gibba044.wflcwh (mgr.34466) 2440 : cluster [DBG] pgmap v1375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:50.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:50 gibba023 bash[30844]: audit 2021-03-10T20:53:49.382364+0000 mgr.gibba044.wflcwh (mgr.34466) 2441 : audit [DBG] from='client.55681 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:53:50.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:50 gibba023 bash[30844]: audit 2021-03-10T20:53:49.644608+0000 mon.a (mon.0) 1218 : audit [DBG] from='client.? 172.21.2.123:0/522438265' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:50.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:50 gibba023 bash[31815]: audit 2021-03-10T20:53:49.156363+0000 mgr.gibba044.wflcwh (mgr.34466) 2439 : audit [DBG] from='client.45696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:53:50.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:50 gibba023 bash[31815]: cluster 2021-03-10T20:53:49.197117+0000 mgr.gibba044.wflcwh (mgr.34466) 2440 : cluster [DBG] pgmap v1375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:50.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:50 gibba023 bash[31815]: audit 2021-03-10T20:53:49.382364+0000 mgr.gibba044.wflcwh (mgr.34466) 2441 : audit [DBG] from='client.55681 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:53:50.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:50 gibba023 bash[31815]: audit 2021-03-10T20:53:49.644608+0000 mon.a (mon.0) 1218 : audit [DBG] from='client.? 172.21.2.123:0/522438265' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:50.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:50 gibba044 bash[25485]: audit 2021-03-10T20:53:49.156363+0000 mgr.gibba044.wflcwh (mgr.34466) 2439 : audit [DBG] from='client.45696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:53:50.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:50 gibba044 bash[25485]: cluster 2021-03-10T20:53:49.197117+0000 mgr.gibba044.wflcwh (mgr.34466) 2440 : cluster [DBG] pgmap v1375: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:50.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:50 gibba044 bash[25485]: audit 2021-03-10T20:53:49.382364+0000 mgr.gibba044.wflcwh (mgr.34466) 2441 : audit [DBG] from='client.55681 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:53:50.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:50 gibba044 bash[25485]: audit 2021-03-10T20:53:49.644608+0000 mon.a (mon.0) 1218 : audit [DBG] from='client.? 172.21.2.123:0/522438265' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:53:52.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:52 gibba023 bash[30844]: cluster 2021-03-10T20:53:51.198724+0000 mgr.gibba044.wflcwh (mgr.34466) 2442 : cluster [DBG] pgmap v1376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:52.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:52 gibba023 bash[31815]: cluster 2021-03-10T20:53:51.198724+0000 mgr.gibba044.wflcwh (mgr.34466) 2442 : cluster [DBG] pgmap v1376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:52.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:52 gibba044 bash[25485]: cluster 2021-03-10T20:53:51.198724+0000 mgr.gibba044.wflcwh (mgr.34466) 2442 : cluster [DBG] pgmap v1376: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:54.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:54 gibba023 bash[30844]: cluster 2021-03-10T20:53:53.200450+0000 mgr.gibba044.wflcwh (mgr.34466) 2443 : cluster [DBG] pgmap v1377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:54.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:54 gibba023 bash[31815]: cluster 2021-03-10T20:53:53.200450+0000 mgr.gibba044.wflcwh (mgr.34466) 2443 : cluster [DBG] pgmap v1377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:54.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:54 gibba044 bash[25485]: cluster 2021-03-10T20:53:53.200450+0000 mgr.gibba044.wflcwh (mgr.34466) 2443 : cluster [DBG] pgmap v1377: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:56.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:56 gibba023 bash[30844]: cluster 2021-03-10T20:53:55.201641+0000 mgr.gibba044.wflcwh (mgr.34466) 2444 : cluster [DBG] pgmap v1378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:56.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:56 gibba023 bash[31815]: cluster 2021-03-10T20:53:55.201641+0000 mgr.gibba044.wflcwh (mgr.34466) 2444 : cluster [DBG] pgmap v1378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:56.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:56 gibba044 bash[25485]: cluster 2021-03-10T20:53:55.201641+0000 mgr.gibba044.wflcwh (mgr.34466) 2444 : cluster [DBG] pgmap v1378: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:58.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:58 gibba023 bash[30844]: cephadm 2021-03-10T20:53:56.915945+0000 mgr.gibba044.wflcwh (mgr.34466) 2445 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:53:58.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:53:58 gibba023 bash[30844]: cluster 2021-03-10T20:53:57.203443+0000 mgr.gibba044.wflcwh (mgr.34466) 2446 : cluster [DBG] pgmap v1379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:58.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:58 gibba023 bash[31815]: cephadm 2021-03-10T20:53:56.915945+0000 mgr.gibba044.wflcwh (mgr.34466) 2445 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:53:58.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:53:58 gibba023 bash[31815]: cluster 2021-03-10T20:53:57.203443+0000 mgr.gibba044.wflcwh (mgr.34466) 2446 : cluster [DBG] pgmap v1379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:53:58.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:58 gibba044 bash[25485]: cephadm 2021-03-10T20:53:56.915945+0000 mgr.gibba044.wflcwh (mgr.34466) 2445 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:53:58.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:53:58 gibba044 bash[25485]: cluster 2021-03-10T20:53:57.203443+0000 mgr.gibba044.wflcwh (mgr.34466) 2446 : cluster [DBG] pgmap v1379: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:00.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:00 gibba023 bash[30844]: cluster 2021-03-10T20:53:59.205187+0000 mgr.gibba044.wflcwh (mgr.34466) 2447 : cluster [DBG] pgmap v1380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:00.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:00 gibba023 bash[31815]: cluster 2021-03-10T20:53:59.205187+0000 mgr.gibba044.wflcwh (mgr.34466) 2447 : cluster [DBG] pgmap v1380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:00.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:00 gibba044 bash[25485]: cluster 2021-03-10T20:53:59.205187+0000 mgr.gibba044.wflcwh (mgr.34466) 2447 : cluster [DBG] pgmap v1380: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:02.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:02 gibba023 bash[30844]: cluster 2021-03-10T20:54:01.206736+0000 mgr.gibba044.wflcwh (mgr.34466) 2448 : cluster [DBG] pgmap v1381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:02.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:02 gibba023 bash[31815]: cluster 2021-03-10T20:54:01.206736+0000 mgr.gibba044.wflcwh (mgr.34466) 2448 : cluster [DBG] pgmap v1381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:02.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:02 gibba044 bash[25485]: cluster 2021-03-10T20:54:01.206736+0000 mgr.gibba044.wflcwh (mgr.34466) 2448 : cluster [DBG] pgmap v1381: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:04.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:04 gibba023 bash[30844]: cluster 2021-03-10T20:54:03.208460+0000 mgr.gibba044.wflcwh (mgr.34466) 2449 : cluster [DBG] pgmap v1382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:04.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:04 gibba023 bash[31815]: cluster 2021-03-10T20:54:03.208460+0000 mgr.gibba044.wflcwh (mgr.34466) 2449 : cluster [DBG] pgmap v1382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:04.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:04 gibba044 bash[25485]: cluster 2021-03-10T20:54:03.208460+0000 mgr.gibba044.wflcwh (mgr.34466) 2449 : cluster [DBG] pgmap v1382: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:05.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:05 gibba023 bash[30844]: cluster 2021-03-10T20:54:05.209645+0000 mgr.gibba044.wflcwh (mgr.34466) 2450 : cluster [DBG] pgmap v1383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:05.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:05 gibba023 bash[31815]: cluster 2021-03-10T20:54:05.209645+0000 mgr.gibba044.wflcwh (mgr.34466) 2450 : cluster [DBG] pgmap v1383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:05.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:05 gibba044 bash[25485]: cluster 2021-03-10T20:54:05.209645+0000 mgr.gibba044.wflcwh (mgr.34466) 2450 : cluster [DBG] pgmap v1383: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:08.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:08 gibba023 bash[30844]: cluster 2021-03-10T20:54:07.211376+0000 mgr.gibba044.wflcwh (mgr.34466) 2451 : cluster [DBG] pgmap v1384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:08.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:08 gibba023 bash[31815]: cluster 2021-03-10T20:54:07.211376+0000 mgr.gibba044.wflcwh (mgr.34466) 2451 : cluster [DBG] pgmap v1384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:08.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:08 gibba044 bash[25485]: cluster 2021-03-10T20:54:07.211376+0000 mgr.gibba044.wflcwh (mgr.34466) 2451 : cluster [DBG] pgmap v1384: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:10.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:10 gibba023 bash[30844]: cluster 2021-03-10T20:54:09.213099+0000 mgr.gibba044.wflcwh (mgr.34466) 2452 : cluster [DBG] pgmap v1385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:10.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:10 gibba023 bash[31815]: cluster 2021-03-10T20:54:09.213099+0000 mgr.gibba044.wflcwh (mgr.34466) 2452 : cluster [DBG] pgmap v1385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:10.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:10 gibba044 bash[25485]: cluster 2021-03-10T20:54:09.213099+0000 mgr.gibba044.wflcwh (mgr.34466) 2452 : cluster [DBG] pgmap v1385: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:12.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:12 gibba023 bash[30844]: cluster 2021-03-10T20:54:11.214570+0000 mgr.gibba044.wflcwh (mgr.34466) 2453 : cluster [DBG] pgmap v1386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:12.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:12 gibba023 bash[31815]: cluster 2021-03-10T20:54:11.214570+0000 mgr.gibba044.wflcwh (mgr.34466) 2453 : cluster [DBG] pgmap v1386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:12.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:12 gibba044 bash[25485]: cluster 2021-03-10T20:54:11.214570+0000 mgr.gibba044.wflcwh (mgr.34466) 2453 : cluster [DBG] pgmap v1386: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:13.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:13 gibba023 bash[30844]: cephadm 2021-03-10T20:54:11.931238+0000 mgr.gibba044.wflcwh (mgr.34466) 2454 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:54:13.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:13 gibba023 bash[31815]: cephadm 2021-03-10T20:54:11.931238+0000 mgr.gibba044.wflcwh (mgr.34466) 2454 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:54:13.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:13 gibba044 bash[25485]: cephadm 2021-03-10T20:54:11.931238+0000 mgr.gibba044.wflcwh (mgr.34466) 2454 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:54:14.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:14 gibba023 bash[30844]: cluster 2021-03-10T20:54:13.216315+0000 mgr.gibba044.wflcwh (mgr.34466) 2455 : cluster [DBG] pgmap v1387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:14.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:14 gibba023 bash[31815]: cluster 2021-03-10T20:54:13.216315+0000 mgr.gibba044.wflcwh (mgr.34466) 2455 : cluster [DBG] pgmap v1387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:14.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:14 gibba044 bash[25485]: cluster 2021-03-10T20:54:13.216315+0000 mgr.gibba044.wflcwh (mgr.34466) 2455 : cluster [DBG] pgmap v1387: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:16.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:16 gibba023 bash[30844]: cluster 2021-03-10T20:54:15.217835+0000 mgr.gibba044.wflcwh (mgr.34466) 2456 : cluster [DBG] pgmap v1388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:16.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:16 gibba023 bash[31815]: cluster 2021-03-10T20:54:15.217835+0000 mgr.gibba044.wflcwh (mgr.34466) 2456 : cluster [DBG] pgmap v1388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:16.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:16 gibba044 bash[25485]: cluster 2021-03-10T20:54:15.217835+0000 mgr.gibba044.wflcwh (mgr.34466) 2456 : cluster [DBG] pgmap v1388: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:18.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:18 gibba023 bash[30844]: cluster 2021-03-10T20:54:17.219766+0000 mgr.gibba044.wflcwh (mgr.34466) 2457 : cluster [DBG] pgmap v1389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:18.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:18 gibba023 bash[31815]: cluster 2021-03-10T20:54:17.219766+0000 mgr.gibba044.wflcwh (mgr.34466) 2457 : cluster [DBG] pgmap v1389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:18.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:18 gibba044 bash[25485]: cluster 2021-03-10T20:54:17.219766+0000 mgr.gibba044.wflcwh (mgr.34466) 2457 : cluster [DBG] pgmap v1389: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:19.931 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:54:20.159 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:54:20.160 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (45m) 53s ago 51m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:54:20.160 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (50m) 9m ago 50m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:54:20.160 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (45m) 9m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:54:20.161 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (46m) 9m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:54:20.161 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (45m) 53s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:54:20.161 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (45m) 53s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:54:20.161 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (44m) 9m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:54:20.162 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (44m) 53s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:54:20.162 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (51m) 53s ago 51m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:54:20.162 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (51m) 9m ago 51m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:54:20.162 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (43m) 53s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:54:20.163 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (43m) 53s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:54:20.163 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (42m) 53s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:54:20.163 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (42m) 53s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:54:20.163 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (41m) 9m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:54:20.164 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (41m) 9m ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:54:20.164 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (41m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:54:20.164 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (40m) 9m ago 51m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:54:20.164 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (50m) 9m ago 51m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:54:20.165 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 53s ago 48m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:54:20.165 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 9m ago 48m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:54:20.409 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:54:20.410 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:54:20.410 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:54:20.410 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:54:20.411 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:54:20.411 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:54:20.411 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:54:20.411 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:54:20.411 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:54:20.412 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:54:20.412 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:54:20.412 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:54:20.412 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:54:20.412 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:54:20.413 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:54:20.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:20 gibba023 bash[30844]: cluster 2021-03-10T20:54:19.221589+0000 mgr.gibba044.wflcwh (mgr.34466) 2458 : cluster [DBG] pgmap v1390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:20.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:20 gibba023 bash[31815]: cluster 2021-03-10T20:54:19.221589+0000 mgr.gibba044.wflcwh (mgr.34466) 2458 : cluster [DBG] pgmap v1390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:20.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:20 gibba044 bash[25485]: cluster 2021-03-10T20:54:19.221589+0000 mgr.gibba044.wflcwh (mgr.34466) 2458 : cluster [DBG] pgmap v1390: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:21.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:21 gibba023 bash[30844]: audit 2021-03-10T20:54:19.921479+0000 mgr.gibba044.wflcwh (mgr.34466) 2459 : audit [DBG] from='client.45714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:54:21.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:21 gibba023 bash[30844]: audit 2021-03-10T20:54:20.146040+0000 mgr.gibba044.wflcwh (mgr.34466) 2460 : audit [DBG] from='client.45720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:54:21.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:21 gibba023 bash[30844]: audit 2021-03-10T20:54:20.408385+0000 mon.a (mon.0) 1219 : audit [DBG] from='client.? 172.21.2.123:0/3655279497' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:21.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:21 gibba023 bash[31815]: audit 2021-03-10T20:54:19.921479+0000 mgr.gibba044.wflcwh (mgr.34466) 2459 : audit [DBG] from='client.45714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:54:21.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:21 gibba023 bash[31815]: audit 2021-03-10T20:54:20.146040+0000 mgr.gibba044.wflcwh (mgr.34466) 2460 : audit [DBG] from='client.45720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:54:21.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:21 gibba023 bash[31815]: audit 2021-03-10T20:54:20.408385+0000 mon.a (mon.0) 1219 : audit [DBG] from='client.? 172.21.2.123:0/3655279497' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:21.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:21 gibba044 bash[25485]: audit 2021-03-10T20:54:19.921479+0000 mgr.gibba044.wflcwh (mgr.34466) 2459 : audit [DBG] from='client.45714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:54:21.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:21 gibba044 bash[25485]: audit 2021-03-10T20:54:20.146040+0000 mgr.gibba044.wflcwh (mgr.34466) 2460 : audit [DBG] from='client.45720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:54:21.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:21 gibba044 bash[25485]: audit 2021-03-10T20:54:20.408385+0000 mon.a (mon.0) 1219 : audit [DBG] from='client.? 172.21.2.123:0/3655279497' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:22.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:22 gibba023 bash[30844]: cluster 2021-03-10T20:54:21.223171+0000 mgr.gibba044.wflcwh (mgr.34466) 2461 : cluster [DBG] pgmap v1391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:22.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:22 gibba023 bash[31815]: cluster 2021-03-10T20:54:21.223171+0000 mgr.gibba044.wflcwh (mgr.34466) 2461 : cluster [DBG] pgmap v1391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:22.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:22 gibba044 bash[25485]: cluster 2021-03-10T20:54:21.223171+0000 mgr.gibba044.wflcwh (mgr.34466) 2461 : cluster [DBG] pgmap v1391: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:24.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:24 gibba023 bash[30844]: cluster 2021-03-10T20:54:23.224846+0000 mgr.gibba044.wflcwh (mgr.34466) 2462 : cluster [DBG] pgmap v1392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:24.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:24 gibba023 bash[31815]: cluster 2021-03-10T20:54:23.224846+0000 mgr.gibba044.wflcwh (mgr.34466) 2462 : cluster [DBG] pgmap v1392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:24.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:24 gibba044 bash[25485]: cluster 2021-03-10T20:54:23.224846+0000 mgr.gibba044.wflcwh (mgr.34466) 2462 : cluster [DBG] pgmap v1392: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:26.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:26 gibba023 bash[30844]: cluster 2021-03-10T20:54:25.225271+0000 mgr.gibba044.wflcwh (mgr.34466) 2463 : cluster [DBG] pgmap v1393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:26.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:26 gibba023 bash[31815]: cluster 2021-03-10T20:54:25.225271+0000 mgr.gibba044.wflcwh (mgr.34466) 2463 : cluster [DBG] pgmap v1393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:26.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:26 gibba044 bash[25485]: cluster 2021-03-10T20:54:25.225271+0000 mgr.gibba044.wflcwh (mgr.34466) 2463 : cluster [DBG] pgmap v1393: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:27.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:27 gibba023 bash[30844]: audit 2021-03-10T20:54:26.939349+0000 mon.a (mon.0) 1220 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:54:27.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:27 gibba023 bash[30844]: audit 2021-03-10T20:54:27.345785+0000 mon.a (mon.0) 1221 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:54:27.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:27 gibba023 bash[30844]: audit 2021-03-10T20:54:27.346080+0000 mon.a (mon.0) 1222 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:54:27.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:27 gibba023 bash[30844]: audit 2021-03-10T20:54:27.357473+0000 mon.a (mon.0) 1223 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T20:54:27.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:27 gibba023 bash[30844]: audit 2021-03-10T20:54:27.357879+0000 mon.a (mon.0) 1224 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:54:27.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:27 gibba023 bash[30844]: audit 2021-03-10T20:54:27.358243+0000 mon.a (mon.0) 1225 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:54:27.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:27 gibba023 bash[30844]: audit 2021-03-10T20:54:27.358628+0000 mon.a (mon.0) 1226 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:54:27.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:27 gibba023 bash[31815]: audit 2021-03-10T20:54:26.939349+0000 mon.a (mon.0) 1220 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:54:27.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:27 gibba023 bash[31815]: audit 2021-03-10T20:54:27.345785+0000 mon.a (mon.0) 1221 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:54:27.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:27 gibba023 bash[31815]: audit 2021-03-10T20:54:27.346080+0000 mon.a (mon.0) 1222 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:54:27.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:27 gibba023 bash[31815]: audit 2021-03-10T20:54:27.357473+0000 mon.a (mon.0) 1223 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T20:54:27.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:27 gibba023 bash[31815]: audit 2021-03-10T20:54:27.357879+0000 mon.a (mon.0) 1224 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:54:27.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:27 gibba023 bash[31815]: audit 2021-03-10T20:54:27.358243+0000 mon.a (mon.0) 1225 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:54:27.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:27 gibba023 bash[31815]: audit 2021-03-10T20:54:27.358628+0000 mon.a (mon.0) 1226 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:54:27.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:27 gibba044 bash[25485]: audit 2021-03-10T20:54:26.939349+0000 mon.a (mon.0) 1220 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T20:54:27.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:27 gibba044 bash[25485]: audit 2021-03-10T20:54:27.345785+0000 mon.a (mon.0) 1221 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:54:27.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:27 gibba044 bash[25485]: audit 2021-03-10T20:54:27.346080+0000 mon.a (mon.0) 1222 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:54:27.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:27 gibba044 bash[25485]: audit 2021-03-10T20:54:27.357473+0000 mon.a (mon.0) 1223 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T20:54:27.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:27 gibba044 bash[25485]: audit 2021-03-10T20:54:27.357879+0000 mon.a (mon.0) 1224 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2021-03-10T20:54:27.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:27 gibba044 bash[25485]: audit 2021-03-10T20:54:27.358243+0000 mon.a (mon.0) 1225 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:54:27.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:27 gibba044 bash[25485]: audit 2021-03-10T20:54:27.358628+0000 mon.a (mon.0) 1226 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T20:54:28.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:28 gibba023 bash[30844]: cephadm 2021-03-10T20:54:26.938260+0000 mgr.gibba044.wflcwh (mgr.34466) 2464 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:54:28.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:28 gibba023 bash[30844]: cluster 2021-03-10T20:54:27.226796+0000 mgr.gibba044.wflcwh (mgr.34466) 2465 : cluster [DBG] pgmap v1394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:28.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:28 gibba023 bash[31815]: cephadm 2021-03-10T20:54:26.938260+0000 mgr.gibba044.wflcwh (mgr.34466) 2464 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:54:28.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:28 gibba023 bash[31815]: cluster 2021-03-10T20:54:27.226796+0000 mgr.gibba044.wflcwh (mgr.34466) 2465 : cluster [DBG] pgmap v1394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:28.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:28 gibba044 bash[25485]: cephadm 2021-03-10T20:54:26.938260+0000 mgr.gibba044.wflcwh (mgr.34466) 2464 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:54:28.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:28 gibba044 bash[25485]: cluster 2021-03-10T20:54:27.226796+0000 mgr.gibba044.wflcwh (mgr.34466) 2465 : cluster [DBG] pgmap v1394: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:30.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:30 gibba023 bash[30844]: cluster 2021-03-10T20:54:29.228478+0000 mgr.gibba044.wflcwh (mgr.34466) 2466 : cluster [DBG] pgmap v1395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:30.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:30 gibba023 bash[31815]: cluster 2021-03-10T20:54:29.228478+0000 mgr.gibba044.wflcwh (mgr.34466) 2466 : cluster [DBG] pgmap v1395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:30.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:30 gibba044 bash[25485]: cluster 2021-03-10T20:54:29.228478+0000 mgr.gibba044.wflcwh (mgr.34466) 2466 : cluster [DBG] pgmap v1395: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:32.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:31 gibba044 bash[25485]: audit 2021-03-10T20:54:30.708992+0000 mon.a (mon.0) 1227 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:54:32.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:31 gibba044 bash[25485]: cephadm 2021-03-10T20:54:30.710094+0000 mgr.gibba044.wflcwh (mgr.34466) 2467 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:54:32.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:31 gibba044 bash[25485]: audit 2021-03-10T20:54:30.905709+0000 mon.a (mon.0) 1228 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:54:32.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:31 gibba044 bash[25485]: cephadm 2021-03-10T20:54:30.908667+0000 mgr.gibba044.wflcwh (mgr.34466) 2468 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:54:32.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:31 gibba044 bash[25485]: audit 2021-03-10T20:54:30.909396+0000 mon.a (mon.0) 1229 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:54:32.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:31 gibba044 bash[25485]: cephadm 2021-03-10T20:54:30.910861+0000 mgr.gibba044.wflcwh (mgr.34466) 2469 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:54:32.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:31 gibba044 bash[25485]: audit 2021-03-10T20:54:30.911205+0000 mon.a (mon.0) 1230 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:32.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:31 gibba044 bash[25485]: cephadm 2021-03-10T20:54:30.913041+0000 mgr.gibba044.wflcwh (mgr.34466) 2470 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:54:32.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:31 gibba044 bash[25485]: cephadm 2021-03-10T20:54:30.913082+0000 mgr.gibba044.wflcwh (mgr.34466) 2471 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:54:32.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:31 gibba044 bash[25485]: audit 2021-03-10T20:54:30.913463+0000 mon.a (mon.0) 1231 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:32.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:31 gibba044 bash[25485]: cephadm 2021-03-10T20:54:30.914786+0000 mgr.gibba044.wflcwh (mgr.34466) 2472 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:54:32.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:31 gibba044 bash[25485]: cephadm 2021-03-10T20:54:30.914825+0000 mgr.gibba044.wflcwh (mgr.34466) 2473 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:54:32.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:31 gibba044 bash[25485]: audit 2021-03-10T20:54:30.915145+0000 mon.a (mon.0) 1232 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:32.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:31 gibba044 bash[25485]: cephadm 2021-03-10T20:54:30.916862+0000 mgr.gibba044.wflcwh (mgr.34466) 2474 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:54:32.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:31 gibba044 bash[25485]: cephadm 2021-03-10T20:54:30.918805+0000 mgr.gibba044.wflcwh (mgr.34466) 2475 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:54:32.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:31 gibba044 bash[25485]: cephadm 2021-03-10T20:54:30.918842+0000 mgr.gibba044.wflcwh (mgr.34466) 2476 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:54:32.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:31 gibba044 bash[25485]: audit 2021-03-10T20:54:30.919000+0000 mon.a (mon.0) 1233 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:32.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:31 gibba044 bash[25485]: cephadm 2021-03-10T20:54:30.920240+0000 mgr.gibba044.wflcwh (mgr.34466) 2477 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:54:32.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:31 gibba044 bash[25485]: cephadm 2021-03-10T20:54:30.920634+0000 mgr.gibba044.wflcwh (mgr.34466) 2478 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:54:32.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:31 gibba044 bash[25485]: audit 2021-03-10T20:54:30.920913+0000 mon.a (mon.0) 1234 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:32.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:31 gibba044 bash[25485]: cephadm 2021-03-10T20:54:30.922383+0000 mgr.gibba044.wflcwh (mgr.34466) 2479 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:54:32.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:31 gibba044 bash[25485]: cephadm 2021-03-10T20:54:30.922419+0000 mgr.gibba044.wflcwh (mgr.34466) 2480 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:54:32.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:31 gibba044 bash[25485]: cephadm 2021-03-10T20:54:30.922554+0000 mgr.gibba044.wflcwh (mgr.34466) 2481 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:54:32.009 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:31 gibba044 bash[25485]: cluster 2021-03-10T20:54:31.230046+0000 mgr.gibba044.wflcwh (mgr.34466) 2482 : cluster [DBG] pgmap v1396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:32.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[30844]: audit 2021-03-10T20:54:30.708992+0000 mon.a (mon.0) 1227 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:54:32.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[30844]: cephadm 2021-03-10T20:54:30.710094+0000 mgr.gibba044.wflcwh (mgr.34466) 2467 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:54:32.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[30844]: audit 2021-03-10T20:54:30.905709+0000 mon.a (mon.0) 1228 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:54:32.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[30844]: cephadm 2021-03-10T20:54:30.908667+0000 mgr.gibba044.wflcwh (mgr.34466) 2468 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:54:32.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[30844]: audit 2021-03-10T20:54:30.909396+0000 mon.a (mon.0) 1229 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:54:32.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[30844]: cephadm 2021-03-10T20:54:30.910861+0000 mgr.gibba044.wflcwh (mgr.34466) 2469 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:54:32.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[30844]: audit 2021-03-10T20:54:30.911205+0000 mon.a (mon.0) 1230 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:32.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[30844]: cephadm 2021-03-10T20:54:30.913041+0000 mgr.gibba044.wflcwh (mgr.34466) 2470 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:54:32.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[30844]: cephadm 2021-03-10T20:54:30.913082+0000 mgr.gibba044.wflcwh (mgr.34466) 2471 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:54:32.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[30844]: audit 2021-03-10T20:54:30.913463+0000 mon.a (mon.0) 1231 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:32.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[30844]: cephadm 2021-03-10T20:54:30.914786+0000 mgr.gibba044.wflcwh (mgr.34466) 2472 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:54:32.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[30844]: cephadm 2021-03-10T20:54:30.914825+0000 mgr.gibba044.wflcwh (mgr.34466) 2473 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:54:32.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[30844]: audit 2021-03-10T20:54:30.915145+0000 mon.a (mon.0) 1232 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:32.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[30844]: cephadm 2021-03-10T20:54:30.916862+0000 mgr.gibba044.wflcwh (mgr.34466) 2474 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:54:32.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[30844]: cephadm 2021-03-10T20:54:30.918805+0000 mgr.gibba044.wflcwh (mgr.34466) 2475 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:54:32.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[30844]: cephadm 2021-03-10T20:54:30.918842+0000 mgr.gibba044.wflcwh (mgr.34466) 2476 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:54:32.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[30844]: audit 2021-03-10T20:54:30.919000+0000 mon.a (mon.0) 1233 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:32.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[30844]: cephadm 2021-03-10T20:54:30.920240+0000 mgr.gibba044.wflcwh (mgr.34466) 2477 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:54:32.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[30844]: cephadm 2021-03-10T20:54:30.920634+0000 mgr.gibba044.wflcwh (mgr.34466) 2478 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:54:32.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[30844]: audit 2021-03-10T20:54:30.920913+0000 mon.a (mon.0) 1234 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:32.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[30844]: cephadm 2021-03-10T20:54:30.922383+0000 mgr.gibba044.wflcwh (mgr.34466) 2479 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:54:32.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[31815]: audit 2021-03-10T20:54:30.708992+0000 mon.a (mon.0) 1227 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:54:32.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[31815]: cephadm 2021-03-10T20:54:30.710094+0000 mgr.gibba044.wflcwh (mgr.34466) 2467 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:54:32.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[31815]: audit 2021-03-10T20:54:30.905709+0000 mon.a (mon.0) 1228 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:54:32.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[31815]: cephadm 2021-03-10T20:54:30.908667+0000 mgr.gibba044.wflcwh (mgr.34466) 2468 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:54:32.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[31815]: audit 2021-03-10T20:54:30.909396+0000 mon.a (mon.0) 1229 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:54:32.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[31815]: cephadm 2021-03-10T20:54:30.910861+0000 mgr.gibba044.wflcwh (mgr.34466) 2469 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:54:32.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[31815]: audit 2021-03-10T20:54:30.911205+0000 mon.a (mon.0) 1230 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:32.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[31815]: cephadm 2021-03-10T20:54:30.913041+0000 mgr.gibba044.wflcwh (mgr.34466) 2470 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:54:32.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[31815]: cephadm 2021-03-10T20:54:30.913082+0000 mgr.gibba044.wflcwh (mgr.34466) 2471 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:54:32.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[31815]: audit 2021-03-10T20:54:30.913463+0000 mon.a (mon.0) 1231 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:32.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[31815]: cephadm 2021-03-10T20:54:30.914786+0000 mgr.gibba044.wflcwh (mgr.34466) 2472 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:54:32.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[31815]: cephadm 2021-03-10T20:54:30.914825+0000 mgr.gibba044.wflcwh (mgr.34466) 2473 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:54:32.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[31815]: audit 2021-03-10T20:54:30.915145+0000 mon.a (mon.0) 1232 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:32.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[31815]: cephadm 2021-03-10T20:54:30.916862+0000 mgr.gibba044.wflcwh (mgr.34466) 2474 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:54:32.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[31815]: cephadm 2021-03-10T20:54:30.918805+0000 mgr.gibba044.wflcwh (mgr.34466) 2475 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:54:32.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[31815]: cephadm 2021-03-10T20:54:30.918842+0000 mgr.gibba044.wflcwh (mgr.34466) 2476 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:54:32.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[31815]: audit 2021-03-10T20:54:30.919000+0000 mon.a (mon.0) 1233 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:32.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[31815]: cephadm 2021-03-10T20:54:30.920240+0000 mgr.gibba044.wflcwh (mgr.34466) 2477 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:54:32.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[31815]: cephadm 2021-03-10T20:54:30.920634+0000 mgr.gibba044.wflcwh (mgr.34466) 2478 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:54:32.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[31815]: audit 2021-03-10T20:54:30.920913+0000 mon.a (mon.0) 1234 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:32.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[31815]: cephadm 2021-03-10T20:54:30.922383+0000 mgr.gibba044.wflcwh (mgr.34466) 2479 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:54:32.189 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[30844]: cephadm 2021-03-10T20:54:30.922419+0000 mgr.gibba044.wflcwh (mgr.34466) 2480 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:54:32.189 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[30844]: cephadm 2021-03-10T20:54:30.922554+0000 mgr.gibba044.wflcwh (mgr.34466) 2481 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:54:32.189 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[30844]: cluster 2021-03-10T20:54:31.230046+0000 mgr.gibba044.wflcwh (mgr.34466) 2482 : cluster [DBG] pgmap v1396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:32.189 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[31815]: cephadm 2021-03-10T20:54:30.922419+0000 mgr.gibba044.wflcwh (mgr.34466) 2480 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:54:32.190 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[31815]: cephadm 2021-03-10T20:54:30.922554+0000 mgr.gibba044.wflcwh (mgr.34466) 2481 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:54:32.190 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:31 gibba023 bash[31815]: cluster 2021-03-10T20:54:31.230046+0000 mgr.gibba044.wflcwh (mgr.34466) 2482 : cluster [DBG] pgmap v1396: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:34.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:34 gibba023 bash[30844]: cluster 2021-03-10T20:54:33.230526+0000 mgr.gibba044.wflcwh (mgr.34466) 2483 : cluster [DBG] pgmap v1397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:34.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:34 gibba023 bash[31815]: cluster 2021-03-10T20:54:33.230526+0000 mgr.gibba044.wflcwh (mgr.34466) 2483 : cluster [DBG] pgmap v1397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:34.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:34 gibba044 bash[25485]: cluster 2021-03-10T20:54:33.230526+0000 mgr.gibba044.wflcwh (mgr.34466) 2483 : cluster [DBG] pgmap v1397: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:36.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:36 gibba023 bash[30844]: cluster 2021-03-10T20:54:35.231601+0000 mgr.gibba044.wflcwh (mgr.34466) 2484 : cluster [DBG] pgmap v1398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:36.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:36 gibba023 bash[31815]: cluster 2021-03-10T20:54:35.231601+0000 mgr.gibba044.wflcwh (mgr.34466) 2484 : cluster [DBG] pgmap v1398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:36.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:36 gibba044 bash[25485]: cluster 2021-03-10T20:54:35.231601+0000 mgr.gibba044.wflcwh (mgr.34466) 2484 : cluster [DBG] pgmap v1398: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:38.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:38 gibba023 bash[30844]: cluster 2021-03-10T20:54:37.233364+0000 mgr.gibba044.wflcwh (mgr.34466) 2485 : cluster [DBG] pgmap v1399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:38.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:38 gibba023 bash[31815]: cluster 2021-03-10T20:54:37.233364+0000 mgr.gibba044.wflcwh (mgr.34466) 2485 : cluster [DBG] pgmap v1399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:38.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:38 gibba044 bash[25485]: cluster 2021-03-10T20:54:37.233364+0000 mgr.gibba044.wflcwh (mgr.34466) 2485 : cluster [DBG] pgmap v1399: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:40.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:40 gibba023 bash[30844]: cluster 2021-03-10T20:54:39.235142+0000 mgr.gibba044.wflcwh (mgr.34466) 2486 : cluster [DBG] pgmap v1400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:40.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:40 gibba023 bash[31815]: cluster 2021-03-10T20:54:39.235142+0000 mgr.gibba044.wflcwh (mgr.34466) 2486 : cluster [DBG] pgmap v1400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:40.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:40 gibba044 bash[25485]: cluster 2021-03-10T20:54:39.235142+0000 mgr.gibba044.wflcwh (mgr.34466) 2486 : cluster [DBG] pgmap v1400: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:42.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:42 gibba023 bash[30844]: cluster 2021-03-10T20:54:41.236464+0000 mgr.gibba044.wflcwh (mgr.34466) 2487 : cluster [DBG] pgmap v1401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:42.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:42 gibba023 bash[31815]: cluster 2021-03-10T20:54:41.236464+0000 mgr.gibba044.wflcwh (mgr.34466) 2487 : cluster [DBG] pgmap v1401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:42.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:42 gibba044 bash[25485]: cluster 2021-03-10T20:54:41.236464+0000 mgr.gibba044.wflcwh (mgr.34466) 2487 : cluster [DBG] pgmap v1401: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:44.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:44 gibba023 bash[30844]: cluster 2021-03-10T20:54:43.238066+0000 mgr.gibba044.wflcwh (mgr.34466) 2488 : cluster [DBG] pgmap v1402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:44.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:44 gibba023 bash[31815]: cluster 2021-03-10T20:54:43.238066+0000 mgr.gibba044.wflcwh (mgr.34466) 2488 : cluster [DBG] pgmap v1402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:44.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:44 gibba044 bash[25485]: cluster 2021-03-10T20:54:43.238066+0000 mgr.gibba044.wflcwh (mgr.34466) 2488 : cluster [DBG] pgmap v1402: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:46.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:46 gibba023 bash[30844]: cluster 2021-03-10T20:54:45.239287+0000 mgr.gibba044.wflcwh (mgr.34466) 2489 : cluster [DBG] pgmap v1403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:46.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:46 gibba023 bash[31815]: cluster 2021-03-10T20:54:45.239287+0000 mgr.gibba044.wflcwh (mgr.34466) 2489 : cluster [DBG] pgmap v1403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:46.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:46 gibba044 bash[25485]: cluster 2021-03-10T20:54:45.239287+0000 mgr.gibba044.wflcwh (mgr.34466) 2489 : cluster [DBG] pgmap v1403: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:47.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:47 gibba023 bash[30844]: cephadm 2021-03-10T20:54:45.938529+0000 mgr.gibba044.wflcwh (mgr.34466) 2490 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:54:47.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:47 gibba023 bash[31815]: cephadm 2021-03-10T20:54:45.938529+0000 mgr.gibba044.wflcwh (mgr.34466) 2490 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:54:47.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:47 gibba044 bash[25485]: cephadm 2021-03-10T20:54:45.938529+0000 mgr.gibba044.wflcwh (mgr.34466) 2490 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:54:48.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:48 gibba023 bash[30844]: cluster 2021-03-10T20:54:47.241098+0000 mgr.gibba044.wflcwh (mgr.34466) 2491 : cluster [DBG] pgmap v1404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:48.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:48 gibba023 bash[31815]: cluster 2021-03-10T20:54:47.241098+0000 mgr.gibba044.wflcwh (mgr.34466) 2491 : cluster [DBG] pgmap v1404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:48.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:48 gibba044 bash[25485]: cluster 2021-03-10T20:54:47.241098+0000 mgr.gibba044.wflcwh (mgr.34466) 2491 : cluster [DBG] pgmap v1404: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:50.664 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:54:50.675 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:50 gibba023 bash[30844]: cluster 2021-03-10T20:54:49.241927+0000 mgr.gibba044.wflcwh (mgr.34466) 2492 : cluster [DBG] pgmap v1405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:50.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:50 gibba023 bash[31815]: cluster 2021-03-10T20:54:49.241927+0000 mgr.gibba044.wflcwh (mgr.34466) 2492 : cluster [DBG] pgmap v1405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:50.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:50 gibba044 bash[25485]: cluster 2021-03-10T20:54:49.241927+0000 mgr.gibba044.wflcwh (mgr.34466) 2492 : cluster [DBG] pgmap v1405: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:50.893 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:54:50.894 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (46m) 84s ago 51m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:54:50.894 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (51m) 20s ago 51m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:54:50.894 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (46m) 20s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:54:50.895 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (46m) 20s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:54:50.895 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (45m) 84s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:54:50.896 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (45m) 84s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:54:50.896 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (45m) 20s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:54:50.896 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (45m) 84s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:54:50.897 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (51m) 84s ago 51m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:54:50.897 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (51m) 20s ago 51m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:54:50.897 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (44m) 84s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:54:50.898 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (43m) 84s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:54:50.898 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (43m) 84s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:54:50.898 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (42m) 84s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:54:50.899 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (42m) 20s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:54:50.899 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (42m) 20s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:54:50.899 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (41m) 20s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:54:50.900 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (41m) 20s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:54:50.900 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (51m) 20s ago 51m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:54:50.901 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 84s ago 49m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:54:50.901 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 20s ago 49m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:54:51.145 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:54:51.146 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:54:51.146 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:54:51.146 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:54:51.147 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:54:51.147 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:54:51.147 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:54:51.148 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:54:51.148 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:54:51.149 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:54:51.149 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:54:51.149 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:54:51.150 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:54:51.150 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:54:51.151 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:54:51.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:51 gibba023 bash[30844]: audit 2021-03-10T20:54:51.143630+0000 mon.c (mon.1) 58 : audit [DBG] from='client.? 172.21.2.123:0/4004456222' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:51.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:51 gibba023 bash[31815]: audit 2021-03-10T20:54:51.143630+0000 mon.c (mon.1) 58 : audit [DBG] from='client.? 172.21.2.123:0/4004456222' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:51.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:51 gibba044 bash[25485]: audit 2021-03-10T20:54:51.143630+0000 mon.c (mon.1) 58 : audit [DBG] from='client.? 172.21.2.123:0/4004456222' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:54:52.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:52 gibba023 bash[30844]: audit 2021-03-10T20:54:50.653542+0000 mgr.gibba044.wflcwh (mgr.34466) 2493 : audit [DBG] from='client.45732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:54:52.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:52 gibba023 bash[30844]: audit 2021-03-10T20:54:50.879323+0000 mgr.gibba044.wflcwh (mgr.34466) 2494 : audit [DBG] from='client.55717 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:54:52.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:52 gibba023 bash[30844]: cluster 2021-03-10T20:54:51.243405+0000 mgr.gibba044.wflcwh (mgr.34466) 2495 : cluster [DBG] pgmap v1406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:52.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:52 gibba023 bash[31815]: audit 2021-03-10T20:54:50.653542+0000 mgr.gibba044.wflcwh (mgr.34466) 2493 : audit [DBG] from='client.45732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:54:52.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:52 gibba023 bash[31815]: audit 2021-03-10T20:54:50.879323+0000 mgr.gibba044.wflcwh (mgr.34466) 2494 : audit [DBG] from='client.55717 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:54:52.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:52 gibba023 bash[31815]: cluster 2021-03-10T20:54:51.243405+0000 mgr.gibba044.wflcwh (mgr.34466) 2495 : cluster [DBG] pgmap v1406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:52.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:52 gibba044 bash[25485]: audit 2021-03-10T20:54:50.653542+0000 mgr.gibba044.wflcwh (mgr.34466) 2493 : audit [DBG] from='client.45732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:54:52.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:52 gibba044 bash[25485]: audit 2021-03-10T20:54:50.879323+0000 mgr.gibba044.wflcwh (mgr.34466) 2494 : audit [DBG] from='client.55717 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:54:52.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:52 gibba044 bash[25485]: cluster 2021-03-10T20:54:51.243405+0000 mgr.gibba044.wflcwh (mgr.34466) 2495 : cluster [DBG] pgmap v1406: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:54.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:54 gibba023 bash[30844]: cluster 2021-03-10T20:54:53.245123+0000 mgr.gibba044.wflcwh (mgr.34466) 2496 : cluster [DBG] pgmap v1407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:54.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:54 gibba023 bash[31815]: cluster 2021-03-10T20:54:53.245123+0000 mgr.gibba044.wflcwh (mgr.34466) 2496 : cluster [DBG] pgmap v1407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:54.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:54 gibba044 bash[25485]: cluster 2021-03-10T20:54:53.245123+0000 mgr.gibba044.wflcwh (mgr.34466) 2496 : cluster [DBG] pgmap v1407: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:56.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:56 gibba023 bash[30844]: cluster 2021-03-10T20:54:55.246318+0000 mgr.gibba044.wflcwh (mgr.34466) 2497 : cluster [DBG] pgmap v1408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:56.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:56 gibba023 bash[31815]: cluster 2021-03-10T20:54:55.246318+0000 mgr.gibba044.wflcwh (mgr.34466) 2497 : cluster [DBG] pgmap v1408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:56.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:56 gibba044 bash[25485]: cluster 2021-03-10T20:54:55.246318+0000 mgr.gibba044.wflcwh (mgr.34466) 2497 : cluster [DBG] pgmap v1408: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:58.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:54:58 gibba023 bash[30844]: cluster 2021-03-10T20:54:57.246905+0000 mgr.gibba044.wflcwh (mgr.34466) 2498 : cluster [DBG] pgmap v1409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:58.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:54:58 gibba023 bash[31815]: cluster 2021-03-10T20:54:57.246905+0000 mgr.gibba044.wflcwh (mgr.34466) 2498 : cluster [DBG] pgmap v1409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:54:58.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:54:58 gibba044 bash[25485]: cluster 2021-03-10T20:54:57.246905+0000 mgr.gibba044.wflcwh (mgr.34466) 2498 : cluster [DBG] pgmap v1409: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:00.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:00 gibba023 bash[30844]: cluster 2021-03-10T20:54:59.248576+0000 mgr.gibba044.wflcwh (mgr.34466) 2499 : cluster [DBG] pgmap v1410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:00.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:00 gibba023 bash[31815]: cluster 2021-03-10T20:54:59.248576+0000 mgr.gibba044.wflcwh (mgr.34466) 2499 : cluster [DBG] pgmap v1410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:00.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:00 gibba044 bash[25485]: cluster 2021-03-10T20:54:59.248576+0000 mgr.gibba044.wflcwh (mgr.34466) 2499 : cluster [DBG] pgmap v1410: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:02.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:02 gibba023 bash[30844]: cephadm 2021-03-10T20:55:00.954340+0000 mgr.gibba044.wflcwh (mgr.34466) 2500 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:55:02.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:02 gibba023 bash[30844]: cluster 2021-03-10T20:55:01.249865+0000 mgr.gibba044.wflcwh (mgr.34466) 2501 : cluster [DBG] pgmap v1411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:02.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:02 gibba023 bash[31815]: cephadm 2021-03-10T20:55:00.954340+0000 mgr.gibba044.wflcwh (mgr.34466) 2500 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:55:02.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:02 gibba023 bash[31815]: cluster 2021-03-10T20:55:01.249865+0000 mgr.gibba044.wflcwh (mgr.34466) 2501 : cluster [DBG] pgmap v1411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:02.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:02 gibba044 bash[25485]: cephadm 2021-03-10T20:55:00.954340+0000 mgr.gibba044.wflcwh (mgr.34466) 2500 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:55:02.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:02 gibba044 bash[25485]: cluster 2021-03-10T20:55:01.249865+0000 mgr.gibba044.wflcwh (mgr.34466) 2501 : cluster [DBG] pgmap v1411: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:04.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:04 gibba023 bash[30844]: cluster 2021-03-10T20:55:03.251491+0000 mgr.gibba044.wflcwh (mgr.34466) 2502 : cluster [DBG] pgmap v1412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:04.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:04 gibba023 bash[31815]: cluster 2021-03-10T20:55:03.251491+0000 mgr.gibba044.wflcwh (mgr.34466) 2502 : cluster [DBG] pgmap v1412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:04.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:04 gibba044 bash[25485]: cluster 2021-03-10T20:55:03.251491+0000 mgr.gibba044.wflcwh (mgr.34466) 2502 : cluster [DBG] pgmap v1412: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:06.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:06 gibba023 bash[30844]: cluster 2021-03-10T20:55:05.252689+0000 mgr.gibba044.wflcwh (mgr.34466) 2503 : cluster [DBG] pgmap v1413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:06.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:06 gibba023 bash[31815]: cluster 2021-03-10T20:55:05.252689+0000 mgr.gibba044.wflcwh (mgr.34466) 2503 : cluster [DBG] pgmap v1413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:06.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:06 gibba044 bash[25485]: cluster 2021-03-10T20:55:05.252689+0000 mgr.gibba044.wflcwh (mgr.34466) 2503 : cluster [DBG] pgmap v1413: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:08.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:08 gibba023 bash[30844]: cluster 2021-03-10T20:55:07.254279+0000 mgr.gibba044.wflcwh (mgr.34466) 2504 : cluster [DBG] pgmap v1414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:08.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:08 gibba023 bash[31815]: cluster 2021-03-10T20:55:07.254279+0000 mgr.gibba044.wflcwh (mgr.34466) 2504 : cluster [DBG] pgmap v1414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:08.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:08 gibba044 bash[25485]: cluster 2021-03-10T20:55:07.254279+0000 mgr.gibba044.wflcwh (mgr.34466) 2504 : cluster [DBG] pgmap v1414: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:10.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:10 gibba023 bash[30844]: cluster 2021-03-10T20:55:09.255951+0000 mgr.gibba044.wflcwh (mgr.34466) 2505 : cluster [DBG] pgmap v1415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:10.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:10 gibba023 bash[31815]: cluster 2021-03-10T20:55:09.255951+0000 mgr.gibba044.wflcwh (mgr.34466) 2505 : cluster [DBG] pgmap v1415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:10.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:10 gibba044 bash[25485]: cluster 2021-03-10T20:55:09.255951+0000 mgr.gibba044.wflcwh (mgr.34466) 2505 : cluster [DBG] pgmap v1415: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:12.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:12 gibba023 bash[30844]: cluster 2021-03-10T20:55:11.257286+0000 mgr.gibba044.wflcwh (mgr.34466) 2506 : cluster [DBG] pgmap v1416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:12.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:12 gibba023 bash[31815]: cluster 2021-03-10T20:55:11.257286+0000 mgr.gibba044.wflcwh (mgr.34466) 2506 : cluster [DBG] pgmap v1416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:12.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:12 gibba044 bash[25485]: cluster 2021-03-10T20:55:11.257286+0000 mgr.gibba044.wflcwh (mgr.34466) 2506 : cluster [DBG] pgmap v1416: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:14.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:14 gibba023 bash[30844]: cluster 2021-03-10T20:55:13.257968+0000 mgr.gibba044.wflcwh (mgr.34466) 2507 : cluster [DBG] pgmap v1417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:14.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:14 gibba023 bash[31815]: cluster 2021-03-10T20:55:13.257968+0000 mgr.gibba044.wflcwh (mgr.34466) 2507 : cluster [DBG] pgmap v1417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:14.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:14 gibba044 bash[25485]: cluster 2021-03-10T20:55:13.257968+0000 mgr.gibba044.wflcwh (mgr.34466) 2507 : cluster [DBG] pgmap v1417: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:16.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:16 gibba023 bash[30844]: cluster 2021-03-10T20:55:15.259338+0000 mgr.gibba044.wflcwh (mgr.34466) 2508 : cluster [DBG] pgmap v1418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:16.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:16 gibba023 bash[31815]: cluster 2021-03-10T20:55:15.259338+0000 mgr.gibba044.wflcwh (mgr.34466) 2508 : cluster [DBG] pgmap v1418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:16.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:16 gibba044 bash[25485]: cluster 2021-03-10T20:55:15.259338+0000 mgr.gibba044.wflcwh (mgr.34466) 2508 : cluster [DBG] pgmap v1418: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:17.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:17 gibba023 bash[30844]: cephadm 2021-03-10T20:55:15.968874+0000 mgr.gibba044.wflcwh (mgr.34466) 2509 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:55:17.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:17 gibba023 bash[31815]: cephadm 2021-03-10T20:55:15.968874+0000 mgr.gibba044.wflcwh (mgr.34466) 2509 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:55:17.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:17 gibba044 bash[25485]: cephadm 2021-03-10T20:55:15.968874+0000 mgr.gibba044.wflcwh (mgr.34466) 2509 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:55:18.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:18 gibba023 bash[30844]: cluster 2021-03-10T20:55:17.261121+0000 mgr.gibba044.wflcwh (mgr.34466) 2510 : cluster [DBG] pgmap v1419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:18.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:18 gibba023 bash[31815]: cluster 2021-03-10T20:55:17.261121+0000 mgr.gibba044.wflcwh (mgr.34466) 2510 : cluster [DBG] pgmap v1419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:18.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:18 gibba044 bash[25485]: cluster 2021-03-10T20:55:17.261121+0000 mgr.gibba044.wflcwh (mgr.34466) 2510 : cluster [DBG] pgmap v1419: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:20.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:20 gibba023 bash[30844]: cluster 2021-03-10T20:55:19.262922+0000 mgr.gibba044.wflcwh (mgr.34466) 2511 : cluster [DBG] pgmap v1420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:20.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:20 gibba023 bash[31815]: cluster 2021-03-10T20:55:19.262922+0000 mgr.gibba044.wflcwh (mgr.34466) 2511 : cluster [DBG] pgmap v1420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:20.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:20 gibba044 bash[25485]: cluster 2021-03-10T20:55:19.262922+0000 mgr.gibba044.wflcwh (mgr.34466) 2511 : cluster [DBG] pgmap v1420: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:21.393 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:55:21.627 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:55:21.627 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (46m) 114s ago 52m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:55:21.627 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (51m) 50s ago 51m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:55:21.628 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (46m) 50s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:55:21.628 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (47m) 50s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:55:21.628 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (46m) 114s ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:55:21.628 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (46m) 114s ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:55:21.628 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (45m) 50s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:55:21.629 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (45m) 114s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:55:21.629 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (52m) 114s ago 52m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:55:21.629 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (52m) 50s ago 52m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:55:21.629 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (44m) 114s ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:55:21.630 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (44m) 114s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:55:21.630 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (43m) 114s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:55:21.630 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (43m) 114s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:55:21.630 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (42m) 50s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:55:21.630 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (42m) 50s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:55:21.631 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (42m) 50s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:55:21.631 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (41m) 50s ago 52m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:55:21.631 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (51m) 50s ago 52m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:55:21.631 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 114s ago 49m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:55:21.632 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 50s ago 50m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:55:21.877 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:55:21.877 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:55:21.878 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:55:21.878 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:55:21.878 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:55:21.878 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:55:21.879 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:55:21.879 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:55:21.879 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:55:21.879 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:55:21.879 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:55:21.880 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:55:21.880 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:55:21.880 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:55:21.880 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:55:22.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:22 gibba023 bash[30844]: cluster 2021-03-10T20:55:21.263806+0000 mgr.gibba044.wflcwh (mgr.34466) 2512 : cluster [DBG] pgmap v1421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:22.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:22 gibba023 bash[30844]: audit 2021-03-10T20:55:21.383402+0000 mgr.gibba044.wflcwh (mgr.34466) 2513 : audit [DBG] from='client.55729 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:55:22.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:22 gibba023 bash[30844]: audit 2021-03-10T20:55:21.875555+0000 mon.c (mon.1) 59 : audit [DBG] from='client.? 172.21.2.123:0/2992917540' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:22.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:22 gibba023 bash[31815]: cluster 2021-03-10T20:55:21.263806+0000 mgr.gibba044.wflcwh (mgr.34466) 2512 : cluster [DBG] pgmap v1421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:22.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:22 gibba023 bash[31815]: audit 2021-03-10T20:55:21.383402+0000 mgr.gibba044.wflcwh (mgr.34466) 2513 : audit [DBG] from='client.55729 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:55:22.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:22 gibba023 bash[31815]: audit 2021-03-10T20:55:21.875555+0000 mon.c (mon.1) 59 : audit [DBG] from='client.? 172.21.2.123:0/2992917540' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:22.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:22 gibba044 bash[25485]: cluster 2021-03-10T20:55:21.263806+0000 mgr.gibba044.wflcwh (mgr.34466) 2512 : cluster [DBG] pgmap v1421: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:22.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:22 gibba044 bash[25485]: audit 2021-03-10T20:55:21.383402+0000 mgr.gibba044.wflcwh (mgr.34466) 2513 : audit [DBG] from='client.55729 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:55:22.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:22 gibba044 bash[25485]: audit 2021-03-10T20:55:21.875555+0000 mon.c (mon.1) 59 : audit [DBG] from='client.? 172.21.2.123:0/2992917540' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:23.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:23 gibba023 bash[30844]: audit 2021-03-10T20:55:21.613186+0000 mgr.gibba044.wflcwh (mgr.34466) 2514 : audit [DBG] from='client.45756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:55:23.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:23 gibba023 bash[31815]: audit 2021-03-10T20:55:21.613186+0000 mgr.gibba044.wflcwh (mgr.34466) 2514 : audit [DBG] from='client.45756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:55:23.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:23 gibba044 bash[25485]: audit 2021-03-10T20:55:21.613186+0000 mgr.gibba044.wflcwh (mgr.34466) 2514 : audit [DBG] from='client.45756 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:55:24.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:24 gibba044 bash[25485]: cluster 2021-03-10T20:55:23.265078+0000 mgr.gibba044.wflcwh (mgr.34466) 2515 : cluster [DBG] pgmap v1422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:24.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:24 gibba023 bash[30844]: cluster 2021-03-10T20:55:23.265078+0000 mgr.gibba044.wflcwh (mgr.34466) 2515 : cluster [DBG] pgmap v1422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:24.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:24 gibba023 bash[31815]: cluster 2021-03-10T20:55:23.265078+0000 mgr.gibba044.wflcwh (mgr.34466) 2515 : cluster [DBG] pgmap v1422: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:25.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:25 gibba044 bash[25485]: cluster 2021-03-10T20:55:25.266472+0000 mgr.gibba044.wflcwh (mgr.34466) 2516 : cluster [DBG] pgmap v1423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:25.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:25 gibba023 bash[30844]: cluster 2021-03-10T20:55:25.266472+0000 mgr.gibba044.wflcwh (mgr.34466) 2516 : cluster [DBG] pgmap v1423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:25.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:25 gibba023 bash[31815]: cluster 2021-03-10T20:55:25.266472+0000 mgr.gibba044.wflcwh (mgr.34466) 2516 : cluster [DBG] pgmap v1423: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:28.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:28 gibba023 bash[30844]: cluster 2021-03-10T20:55:27.268300+0000 mgr.gibba044.wflcwh (mgr.34466) 2517 : cluster [DBG] pgmap v1424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:28.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:28 gibba023 bash[30844]: audit 2021-03-10T20:55:27.353516+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:55:28.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:28 gibba023 bash[30844]: audit 2021-03-10T20:55:27.355408+0000 mon.a (mon.0) 1236 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:55:28.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:28 gibba023 bash[30844]: audit 2021-03-10T20:55:27.362718+0000 mon.a (mon.0) 1237 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T20:55:28.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:28 gibba023 bash[30844]: audit 2021-03-10T20:55:27.362934+0000 mon.a (mon.0) 1238 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:55:28.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:28 gibba023 bash[30844]: audit 2021-03-10T20:55:27.363118+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T20:55:28.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:28 gibba023 bash[30844]: audit 2021-03-10T20:55:27.363311+0000 mon.a (mon.0) 1240 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:55:28.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:28 gibba023 bash[31815]: cluster 2021-03-10T20:55:27.268300+0000 mgr.gibba044.wflcwh (mgr.34466) 2517 : cluster [DBG] pgmap v1424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:28.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:28 gibba023 bash[31815]: audit 2021-03-10T20:55:27.353516+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:55:28.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:28 gibba023 bash[31815]: audit 2021-03-10T20:55:27.355408+0000 mon.a (mon.0) 1236 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:55:28.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:28 gibba023 bash[31815]: audit 2021-03-10T20:55:27.362718+0000 mon.a (mon.0) 1237 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T20:55:28.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:28 gibba023 bash[31815]: audit 2021-03-10T20:55:27.362934+0000 mon.a (mon.0) 1238 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:55:28.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:28 gibba023 bash[31815]: audit 2021-03-10T20:55:27.363118+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T20:55:28.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:28 gibba023 bash[31815]: audit 2021-03-10T20:55:27.363311+0000 mon.a (mon.0) 1240 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:55:28.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:28 gibba044 bash[25485]: cluster 2021-03-10T20:55:27.268300+0000 mgr.gibba044.wflcwh (mgr.34466) 2517 : cluster [DBG] pgmap v1424: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:28.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:28 gibba044 bash[25485]: audit 2021-03-10T20:55:27.353516+0000 mon.a (mon.0) 1235 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:55:28.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:28 gibba044 bash[25485]: audit 2021-03-10T20:55:27.355408+0000 mon.a (mon.0) 1236 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:55:28.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:28 gibba044 bash[25485]: audit 2021-03-10T20:55:27.362718+0000 mon.a (mon.0) 1237 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2021-03-10T20:55:28.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:28 gibba044 bash[25485]: audit 2021-03-10T20:55:27.362934+0000 mon.a (mon.0) 1238 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T20:55:28.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:28 gibba044 bash[25485]: audit 2021-03-10T20:55:27.363118+0000 mon.a (mon.0) 1239 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 5]}]: dispatch 2021-03-10T20:55:28.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:28 gibba044 bash[25485]: audit 2021-03-10T20:55:27.363311+0000 mon.a (mon.0) 1240 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T20:55:30.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:30 gibba023 bash[30844]: cluster 2021-03-10T20:55:29.269882+0000 mgr.gibba044.wflcwh (mgr.34466) 2518 : cluster [DBG] pgmap v1425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:30.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:30 gibba023 bash[31815]: cluster 2021-03-10T20:55:29.269882+0000 mgr.gibba044.wflcwh (mgr.34466) 2518 : cluster [DBG] pgmap v1425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:30.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:30 gibba044 bash[25485]: cluster 2021-03-10T20:55:29.269882+0000 mgr.gibba044.wflcwh (mgr.34466) 2518 : cluster [DBG] pgmap v1425: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:32.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:32 gibba044 bash[25485]: cephadm 2021-03-10T20:55:30.985687+0000 mgr.gibba044.wflcwh (mgr.34466) 2519 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:55:32.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:32 gibba044 bash[25485]: cephadm 2021-03-10T20:55:30.987309+0000 mgr.gibba044.wflcwh (mgr.34466) 2520 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:55:32.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:32 gibba044 bash[25485]: audit 2021-03-10T20:55:31.209468+0000 mon.a (mon.0) 1241 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:55:32.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:32 gibba044 bash[25485]: cephadm 2021-03-10T20:55:31.212558+0000 mgr.gibba044.wflcwh (mgr.34466) 2521 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:55:32.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:32 gibba044 bash[25485]: audit 2021-03-10T20:55:31.213315+0000 mon.a (mon.0) 1242 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:55:32.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:32 gibba044 bash[25485]: cephadm 2021-03-10T20:55:31.214738+0000 mgr.gibba044.wflcwh (mgr.34466) 2522 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:55:32.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:32 gibba044 bash[25485]: audit 2021-03-10T20:55:31.214957+0000 mon.a (mon.0) 1243 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:32 gibba044 bash[25485]: cephadm 2021-03-10T20:55:31.216512+0000 mgr.gibba044.wflcwh (mgr.34466) 2523 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:55:32.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:32 gibba044 bash[25485]: cephadm 2021-03-10T20:55:31.216547+0000 mgr.gibba044.wflcwh (mgr.34466) 2524 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:55:32.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:32 gibba044 bash[25485]: audit 2021-03-10T20:55:31.216863+0000 mon.a (mon.0) 1244 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:32 gibba044 bash[25485]: cephadm 2021-03-10T20:55:31.218172+0000 mgr.gibba044.wflcwh (mgr.34466) 2525 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:55:32.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:32 gibba044 bash[25485]: cephadm 2021-03-10T20:55:31.218238+0000 mgr.gibba044.wflcwh (mgr.34466) 2526 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:55:32.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:32 gibba044 bash[25485]: audit 2021-03-10T20:55:31.218438+0000 mon.a (mon.0) 1245 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:32 gibba044 bash[25485]: cephadm 2021-03-10T20:55:31.219932+0000 mgr.gibba044.wflcwh (mgr.34466) 2527 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:55:32.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:32 gibba044 bash[25485]: cephadm 2021-03-10T20:55:31.221364+0000 mgr.gibba044.wflcwh (mgr.34466) 2528 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:55:32.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:32 gibba044 bash[25485]: cephadm 2021-03-10T20:55:31.221401+0000 mgr.gibba044.wflcwh (mgr.34466) 2529 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:55:32.508 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:32 gibba044 bash[25485]: audit 2021-03-10T20:55:31.221672+0000 mon.a (mon.0) 1246 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.508 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:32 gibba044 bash[25485]: cephadm 2021-03-10T20:55:31.222963+0000 mgr.gibba044.wflcwh (mgr.34466) 2530 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:55:32.508 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:32 gibba044 bash[25485]: cephadm 2021-03-10T20:55:31.223287+0000 mgr.gibba044.wflcwh (mgr.34466) 2531 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:55:32.508 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:32 gibba044 bash[25485]: audit 2021-03-10T20:55:31.223429+0000 mon.a (mon.0) 1247 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.509 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:32 gibba044 bash[25485]: cephadm 2021-03-10T20:55:31.224851+0000 mgr.gibba044.wflcwh (mgr.34466) 2532 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:55:32.509 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:32 gibba044 bash[25485]: cephadm 2021-03-10T20:55:31.224887+0000 mgr.gibba044.wflcwh (mgr.34466) 2533 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:55:32.509 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:32 gibba044 bash[25485]: cephadm 2021-03-10T20:55:31.225015+0000 mgr.gibba044.wflcwh (mgr.34466) 2534 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:55:32.510 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:32 gibba044 bash[25485]: cluster 2021-03-10T20:55:31.270582+0000 mgr.gibba044.wflcwh (mgr.34466) 2535 : cluster [DBG] pgmap v1426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:32.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[30844]: cephadm 2021-03-10T20:55:30.985687+0000 mgr.gibba044.wflcwh (mgr.34466) 2519 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:55:32.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[30844]: cephadm 2021-03-10T20:55:30.987309+0000 mgr.gibba044.wflcwh (mgr.34466) 2520 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:55:32.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[30844]: audit 2021-03-10T20:55:31.209468+0000 mon.a (mon.0) 1241 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:55:32.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[30844]: cephadm 2021-03-10T20:55:31.212558+0000 mgr.gibba044.wflcwh (mgr.34466) 2521 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:55:32.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[30844]: audit 2021-03-10T20:55:31.213315+0000 mon.a (mon.0) 1242 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:55:32.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[30844]: cephadm 2021-03-10T20:55:31.214738+0000 mgr.gibba044.wflcwh (mgr.34466) 2522 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:55:32.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[30844]: audit 2021-03-10T20:55:31.214957+0000 mon.a (mon.0) 1243 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.681 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[30844]: cephadm 2021-03-10T20:55:31.216512+0000 mgr.gibba044.wflcwh (mgr.34466) 2523 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:55:32.681 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[30844]: cephadm 2021-03-10T20:55:31.216547+0000 mgr.gibba044.wflcwh (mgr.34466) 2524 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:55:32.681 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[30844]: audit 2021-03-10T20:55:31.216863+0000 mon.a (mon.0) 1244 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.682 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[30844]: cephadm 2021-03-10T20:55:31.218172+0000 mgr.gibba044.wflcwh (mgr.34466) 2525 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:55:32.682 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[30844]: cephadm 2021-03-10T20:55:31.218238+0000 mgr.gibba044.wflcwh (mgr.34466) 2526 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:55:32.683 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[30844]: audit 2021-03-10T20:55:31.218438+0000 mon.a (mon.0) 1245 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.684 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[30844]: cephadm 2021-03-10T20:55:31.219932+0000 mgr.gibba044.wflcwh (mgr.34466) 2527 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:55:32.684 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[30844]: cephadm 2021-03-10T20:55:31.221364+0000 mgr.gibba044.wflcwh (mgr.34466) 2528 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:55:32.684 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[30844]: cephadm 2021-03-10T20:55:31.221401+0000 mgr.gibba044.wflcwh (mgr.34466) 2529 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:55:32.684 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[30844]: audit 2021-03-10T20:55:31.221672+0000 mon.a (mon.0) 1246 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.685 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[30844]: cephadm 2021-03-10T20:55:31.222963+0000 mgr.gibba044.wflcwh (mgr.34466) 2530 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:55:32.685 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[30844]: cephadm 2021-03-10T20:55:31.223287+0000 mgr.gibba044.wflcwh (mgr.34466) 2531 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:55:32.686 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[30844]: audit 2021-03-10T20:55:31.223429+0000 mon.a (mon.0) 1247 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.686 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[30844]: cephadm 2021-03-10T20:55:31.224851+0000 mgr.gibba044.wflcwh (mgr.34466) 2532 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:55:32.686 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[30844]: cephadm 2021-03-10T20:55:31.224887+0000 mgr.gibba044.wflcwh (mgr.34466) 2533 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:55:32.687 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[30844]: cephadm 2021-03-10T20:55:31.225015+0000 mgr.gibba044.wflcwh (mgr.34466) 2534 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:55:32.687 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[30844]: cluster 2021-03-10T20:55:31.270582+0000 mgr.gibba044.wflcwh (mgr.34466) 2535 : cluster [DBG] pgmap v1426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:32.687 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[31815]: cephadm 2021-03-10T20:55:30.985687+0000 mgr.gibba044.wflcwh (mgr.34466) 2519 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:55:32.688 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[31815]: cephadm 2021-03-10T20:55:30.987309+0000 mgr.gibba044.wflcwh (mgr.34466) 2520 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:55:32.688 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[31815]: audit 2021-03-10T20:55:31.209468+0000 mon.a (mon.0) 1241 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:55:32.689 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[31815]: cephadm 2021-03-10T20:55:31.212558+0000 mgr.gibba044.wflcwh (mgr.34466) 2521 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:55:32.689 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[31815]: audit 2021-03-10T20:55:31.213315+0000 mon.a (mon.0) 1242 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:55:32.690 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[31815]: cephadm 2021-03-10T20:55:31.214738+0000 mgr.gibba044.wflcwh (mgr.34466) 2522 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:55:32.690 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[31815]: audit 2021-03-10T20:55:31.214957+0000 mon.a (mon.0) 1243 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.690 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[31815]: cephadm 2021-03-10T20:55:31.216512+0000 mgr.gibba044.wflcwh (mgr.34466) 2523 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:55:32.691 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[31815]: cephadm 2021-03-10T20:55:31.216547+0000 mgr.gibba044.wflcwh (mgr.34466) 2524 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:55:32.691 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[31815]: audit 2021-03-10T20:55:31.216863+0000 mon.a (mon.0) 1244 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.692 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[31815]: cephadm 2021-03-10T20:55:31.218172+0000 mgr.gibba044.wflcwh (mgr.34466) 2525 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:55:32.692 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[31815]: cephadm 2021-03-10T20:55:31.218238+0000 mgr.gibba044.wflcwh (mgr.34466) 2526 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:55:32.693 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[31815]: audit 2021-03-10T20:55:31.218438+0000 mon.a (mon.0) 1245 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.693 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[31815]: cephadm 2021-03-10T20:55:31.219932+0000 mgr.gibba044.wflcwh (mgr.34466) 2527 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:55:32.693 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[31815]: cephadm 2021-03-10T20:55:31.221364+0000 mgr.gibba044.wflcwh (mgr.34466) 2528 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:55:32.694 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[31815]: cephadm 2021-03-10T20:55:31.221401+0000 mgr.gibba044.wflcwh (mgr.34466) 2529 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:55:32.694 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[31815]: audit 2021-03-10T20:55:31.221672+0000 mon.a (mon.0) 1246 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.695 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[31815]: cephadm 2021-03-10T20:55:31.222963+0000 mgr.gibba044.wflcwh (mgr.34466) 2530 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:55:32.695 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[31815]: cephadm 2021-03-10T20:55:31.223287+0000 mgr.gibba044.wflcwh (mgr.34466) 2531 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:55:32.696 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[31815]: audit 2021-03-10T20:55:31.223429+0000 mon.a (mon.0) 1247 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:32.696 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[31815]: cephadm 2021-03-10T20:55:31.224851+0000 mgr.gibba044.wflcwh (mgr.34466) 2532 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:55:32.696 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[31815]: cephadm 2021-03-10T20:55:31.224887+0000 mgr.gibba044.wflcwh (mgr.34466) 2533 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:55:32.697 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[31815]: cephadm 2021-03-10T20:55:31.225015+0000 mgr.gibba044.wflcwh (mgr.34466) 2534 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:55:32.697 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:32 gibba023 bash[31815]: cluster 2021-03-10T20:55:31.270582+0000 mgr.gibba044.wflcwh (mgr.34466) 2535 : cluster [DBG] pgmap v1426: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:34.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:34 gibba023 bash[30844]: cluster 2021-03-10T20:55:33.272097+0000 mgr.gibba044.wflcwh (mgr.34466) 2536 : cluster [DBG] pgmap v1427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:34.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:34 gibba023 bash[31815]: cluster 2021-03-10T20:55:33.272097+0000 mgr.gibba044.wflcwh (mgr.34466) 2536 : cluster [DBG] pgmap v1427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:34.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:34 gibba044 bash[25485]: cluster 2021-03-10T20:55:33.272097+0000 mgr.gibba044.wflcwh (mgr.34466) 2536 : cluster [DBG] pgmap v1427: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:36.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:36 gibba023 bash[30844]: cluster 2021-03-10T20:55:35.273347+0000 mgr.gibba044.wflcwh (mgr.34466) 2537 : cluster [DBG] pgmap v1428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:36.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:36 gibba023 bash[31815]: cluster 2021-03-10T20:55:35.273347+0000 mgr.gibba044.wflcwh (mgr.34466) 2537 : cluster [DBG] pgmap v1428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:36.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:36 gibba044 bash[25485]: cluster 2021-03-10T20:55:35.273347+0000 mgr.gibba044.wflcwh (mgr.34466) 2537 : cluster [DBG] pgmap v1428: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:38.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:38 gibba023 bash[30844]: cluster 2021-03-10T20:55:37.274112+0000 mgr.gibba044.wflcwh (mgr.34466) 2538 : cluster [DBG] pgmap v1429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:38.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:38 gibba023 bash[31815]: cluster 2021-03-10T20:55:37.274112+0000 mgr.gibba044.wflcwh (mgr.34466) 2538 : cluster [DBG] pgmap v1429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:38.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:38 gibba044 bash[25485]: cluster 2021-03-10T20:55:37.274112+0000 mgr.gibba044.wflcwh (mgr.34466) 2538 : cluster [DBG] pgmap v1429: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:40.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:40 gibba023 bash[30844]: cluster 2021-03-10T20:55:39.275895+0000 mgr.gibba044.wflcwh (mgr.34466) 2539 : cluster [DBG] pgmap v1430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:40.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:40 gibba023 bash[31815]: cluster 2021-03-10T20:55:39.275895+0000 mgr.gibba044.wflcwh (mgr.34466) 2539 : cluster [DBG] pgmap v1430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:40.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:40 gibba044 bash[25485]: cluster 2021-03-10T20:55:39.275895+0000 mgr.gibba044.wflcwh (mgr.34466) 2539 : cluster [DBG] pgmap v1430: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:42.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:42 gibba023 bash[30844]: cluster 2021-03-10T20:55:41.277507+0000 mgr.gibba044.wflcwh (mgr.34466) 2540 : cluster [DBG] pgmap v1431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:42.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:42 gibba023 bash[31815]: cluster 2021-03-10T20:55:41.277507+0000 mgr.gibba044.wflcwh (mgr.34466) 2540 : cluster [DBG] pgmap v1431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:42.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:42 gibba044 bash[25485]: cluster 2021-03-10T20:55:41.277507+0000 mgr.gibba044.wflcwh (mgr.34466) 2540 : cluster [DBG] pgmap v1431: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:44.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:44 gibba023 bash[30844]: cluster 2021-03-10T20:55:43.279181+0000 mgr.gibba044.wflcwh (mgr.34466) 2541 : cluster [DBG] pgmap v1432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:44.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:44 gibba023 bash[31815]: cluster 2021-03-10T20:55:43.279181+0000 mgr.gibba044.wflcwh (mgr.34466) 2541 : cluster [DBG] pgmap v1432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:44.752 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:44 gibba044 bash[25485]: cluster 2021-03-10T20:55:43.279181+0000 mgr.gibba044.wflcwh (mgr.34466) 2541 : cluster [DBG] pgmap v1432: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:46.503 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:46 gibba044 bash[25485]: cluster 2021-03-10T20:55:45.280534+0000 mgr.gibba044.wflcwh (mgr.34466) 2542 : cluster [DBG] pgmap v1433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:46.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:46 gibba023 bash[30844]: cluster 2021-03-10T20:55:45.280534+0000 mgr.gibba044.wflcwh (mgr.34466) 2542 : cluster [DBG] pgmap v1433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:46.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:46 gibba023 bash[31815]: cluster 2021-03-10T20:55:45.280534+0000 mgr.gibba044.wflcwh (mgr.34466) 2542 : cluster [DBG] pgmap v1433: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:47.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:47 gibba023 bash[30844]: cephadm 2021-03-10T20:55:46.241101+0000 mgr.gibba044.wflcwh (mgr.34466) 2543 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:55:47.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:47 gibba023 bash[31815]: cephadm 2021-03-10T20:55:46.241101+0000 mgr.gibba044.wflcwh (mgr.34466) 2543 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:55:47.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:47 gibba044 bash[25485]: cephadm 2021-03-10T20:55:46.241101+0000 mgr.gibba044.wflcwh (mgr.34466) 2543 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:55:48.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:48 gibba023 bash[30844]: cluster 2021-03-10T20:55:47.282348+0000 mgr.gibba044.wflcwh (mgr.34466) 2544 : cluster [DBG] pgmap v1434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:48.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:48 gibba023 bash[31815]: cluster 2021-03-10T20:55:47.282348+0000 mgr.gibba044.wflcwh (mgr.34466) 2544 : cluster [DBG] pgmap v1434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:48.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:48 gibba044 bash[25485]: cluster 2021-03-10T20:55:47.282348+0000 mgr.gibba044.wflcwh (mgr.34466) 2544 : cluster [DBG] pgmap v1434: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:50.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:50 gibba023 bash[30844]: cluster 2021-03-10T20:55:49.284123+0000 mgr.gibba044.wflcwh (mgr.34466) 2545 : cluster [DBG] pgmap v1435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:50.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:50 gibba023 bash[31815]: cluster 2021-03-10T20:55:49.284123+0000 mgr.gibba044.wflcwh (mgr.34466) 2545 : cluster [DBG] pgmap v1435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:50.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:50 gibba044 bash[25485]: cluster 2021-03-10T20:55:49.284123+0000 mgr.gibba044.wflcwh (mgr.34466) 2545 : cluster [DBG] pgmap v1435: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:52.122 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:55:52.348 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:55:52.349 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (47m) 2m ago 52m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:55:52.349 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (52m) 81s ago 52m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:55:52.349 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (47m) 81s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:55:52.349 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (47m) 81s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:55:52.350 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (46m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:55:52.350 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (46m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:55:52.350 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (46m) 81s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:55:52.350 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (46m) 2m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:55:52.350 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (52m) 2m ago 52m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:55:52.351 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (52m) 81s ago 52m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:55:52.351 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (45m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:55:52.351 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (44m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:55:52.351 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (44m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:55:52.352 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (43m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:55:52.352 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (43m) 81s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:55:52.352 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (43m) 81s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:55:52.352 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (42m) 81s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:55:52.352 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (42m) 81s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:55:52.353 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (52m) 81s ago 52m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:55:52.353 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 2m ago 50m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:55:52.353 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 81s ago 50m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:55:52.602 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:55:52.602 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:55:52.602 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:55:52.603 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:55:52.603 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:55:52.603 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:55:52.603 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:55:52.603 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:55:52.604 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:55:52.604 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:55:52.604 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:55:52.604 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:55:52.604 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:55:52.605 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:55:52.605 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:55:52.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:52 gibba023 bash[30844]: cluster 2021-03-10T20:55:51.285528+0000 mgr.gibba044.wflcwh (mgr.34466) 2546 : cluster [DBG] pgmap v1436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:52.676 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:52 gibba023 bash[31815]: cluster 2021-03-10T20:55:51.285528+0000 mgr.gibba044.wflcwh (mgr.34466) 2546 : cluster [DBG] pgmap v1436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:52.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:52 gibba044 bash[25485]: cluster 2021-03-10T20:55:51.285528+0000 mgr.gibba044.wflcwh (mgr.34466) 2546 : cluster [DBG] pgmap v1436: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:53.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:53 gibba023 bash[30844]: audit 2021-03-10T20:55:52.109814+0000 mgr.gibba044.wflcwh (mgr.34466) 2547 : audit [DBG] from='client.55747 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:55:53.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:53 gibba023 bash[30844]: audit 2021-03-10T20:55:52.335307+0000 mgr.gibba044.wflcwh (mgr.34466) 2548 : audit [DBG] from='client.55753 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:55:53.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:53 gibba023 bash[30844]: audit 2021-03-10T20:55:52.600251+0000 mon.c (mon.1) 60 : audit [DBG] from='client.? 172.21.2.123:0/2013106881' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:53.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:53 gibba023 bash[31815]: audit 2021-03-10T20:55:52.109814+0000 mgr.gibba044.wflcwh (mgr.34466) 2547 : audit [DBG] from='client.55747 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:55:53.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:53 gibba023 bash[31815]: audit 2021-03-10T20:55:52.335307+0000 mgr.gibba044.wflcwh (mgr.34466) 2548 : audit [DBG] from='client.55753 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:55:53.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:53 gibba023 bash[31815]: audit 2021-03-10T20:55:52.600251+0000 mon.c (mon.1) 60 : audit [DBG] from='client.? 172.21.2.123:0/2013106881' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:53.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:53 gibba044 bash[25485]: audit 2021-03-10T20:55:52.109814+0000 mgr.gibba044.wflcwh (mgr.34466) 2547 : audit [DBG] from='client.55747 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:55:53.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:53 gibba044 bash[25485]: audit 2021-03-10T20:55:52.335307+0000 mgr.gibba044.wflcwh (mgr.34466) 2548 : audit [DBG] from='client.55753 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:55:53.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:53 gibba044 bash[25485]: audit 2021-03-10T20:55:52.600251+0000 mon.c (mon.1) 60 : audit [DBG] from='client.? 172.21.2.123:0/2013106881' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:55:54.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:54 gibba044 bash[25485]: cluster 2021-03-10T20:55:53.286431+0000 mgr.gibba044.wflcwh (mgr.34466) 2549 : cluster [DBG] pgmap v1437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:54.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:54 gibba023 bash[30844]: cluster 2021-03-10T20:55:53.286431+0000 mgr.gibba044.wflcwh (mgr.34466) 2549 : cluster [DBG] pgmap v1437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:54.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:54 gibba023 bash[31815]: cluster 2021-03-10T20:55:53.286431+0000 mgr.gibba044.wflcwh (mgr.34466) 2549 : cluster [DBG] pgmap v1437: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:55.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:55 gibba044 bash[25485]: cluster 2021-03-10T20:55:55.287684+0000 mgr.gibba044.wflcwh (mgr.34466) 2550 : cluster [DBG] pgmap v1438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:55.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:55 gibba023 bash[30844]: cluster 2021-03-10T20:55:55.287684+0000 mgr.gibba044.wflcwh (mgr.34466) 2550 : cluster [DBG] pgmap v1438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:55.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:55 gibba023 bash[31815]: cluster 2021-03-10T20:55:55.287684+0000 mgr.gibba044.wflcwh (mgr.34466) 2550 : cluster [DBG] pgmap v1438: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:58.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:55:58 gibba023 bash[30844]: cluster 2021-03-10T20:55:57.289418+0000 mgr.gibba044.wflcwh (mgr.34466) 2551 : cluster [DBG] pgmap v1439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:58.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:55:58 gibba023 bash[31815]: cluster 2021-03-10T20:55:57.289418+0000 mgr.gibba044.wflcwh (mgr.34466) 2551 : cluster [DBG] pgmap v1439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:55:58.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:55:58 gibba044 bash[25485]: cluster 2021-03-10T20:55:57.289418+0000 mgr.gibba044.wflcwh (mgr.34466) 2551 : cluster [DBG] pgmap v1439: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:00.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:00 gibba023 bash[30844]: cluster 2021-03-10T20:55:59.291125+0000 mgr.gibba044.wflcwh (mgr.34466) 2552 : cluster [DBG] pgmap v1440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:00.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:00 gibba023 bash[31815]: cluster 2021-03-10T20:55:59.291125+0000 mgr.gibba044.wflcwh (mgr.34466) 2552 : cluster [DBG] pgmap v1440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:00.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:00 gibba044 bash[25485]: cluster 2021-03-10T20:55:59.291125+0000 mgr.gibba044.wflcwh (mgr.34466) 2552 : cluster [DBG] pgmap v1440: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:02.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:02 gibba023 bash[30844]: cephadm 2021-03-10T20:56:01.256445+0000 mgr.gibba044.wflcwh (mgr.34466) 2553 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:56:02.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:02 gibba023 bash[30844]: cluster 2021-03-10T20:56:01.292295+0000 mgr.gibba044.wflcwh (mgr.34466) 2554 : cluster [DBG] pgmap v1441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:02.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:02 gibba023 bash[31815]: cephadm 2021-03-10T20:56:01.256445+0000 mgr.gibba044.wflcwh (mgr.34466) 2553 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:56:02.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:02 gibba023 bash[31815]: cluster 2021-03-10T20:56:01.292295+0000 mgr.gibba044.wflcwh (mgr.34466) 2554 : cluster [DBG] pgmap v1441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:02.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:02 gibba044 bash[25485]: cephadm 2021-03-10T20:56:01.256445+0000 mgr.gibba044.wflcwh (mgr.34466) 2553 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:56:02.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:02 gibba044 bash[25485]: cluster 2021-03-10T20:56:01.292295+0000 mgr.gibba044.wflcwh (mgr.34466) 2554 : cluster [DBG] pgmap v1441: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:04.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:04 gibba023 bash[30844]: cluster 2021-03-10T20:56:03.293628+0000 mgr.gibba044.wflcwh (mgr.34466) 2555 : cluster [DBG] pgmap v1442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:04.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:04 gibba023 bash[31815]: cluster 2021-03-10T20:56:03.293628+0000 mgr.gibba044.wflcwh (mgr.34466) 2555 : cluster [DBG] pgmap v1442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:04.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:04 gibba044 bash[25485]: cluster 2021-03-10T20:56:03.293628+0000 mgr.gibba044.wflcwh (mgr.34466) 2555 : cluster [DBG] pgmap v1442: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:06.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:06 gibba023 bash[30844]: cluster 2021-03-10T20:56:05.294898+0000 mgr.gibba044.wflcwh (mgr.34466) 2556 : cluster [DBG] pgmap v1443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:06.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:06 gibba023 bash[31815]: cluster 2021-03-10T20:56:05.294898+0000 mgr.gibba044.wflcwh (mgr.34466) 2556 : cluster [DBG] pgmap v1443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:06.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:06 gibba044 bash[25485]: cluster 2021-03-10T20:56:05.294898+0000 mgr.gibba044.wflcwh (mgr.34466) 2556 : cluster [DBG] pgmap v1443: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:08.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:08 gibba023 bash[30844]: cluster 2021-03-10T20:56:07.296459+0000 mgr.gibba044.wflcwh (mgr.34466) 2557 : cluster [DBG] pgmap v1444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:08.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:08 gibba023 bash[31815]: cluster 2021-03-10T20:56:07.296459+0000 mgr.gibba044.wflcwh (mgr.34466) 2557 : cluster [DBG] pgmap v1444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:08.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:08 gibba044 bash[25485]: cluster 2021-03-10T20:56:07.296459+0000 mgr.gibba044.wflcwh (mgr.34466) 2557 : cluster [DBG] pgmap v1444: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:10.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:10 gibba023 bash[30844]: cluster 2021-03-10T20:56:09.298246+0000 mgr.gibba044.wflcwh (mgr.34466) 2558 : cluster [DBG] pgmap v1445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:10.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:10 gibba023 bash[31815]: cluster 2021-03-10T20:56:09.298246+0000 mgr.gibba044.wflcwh (mgr.34466) 2558 : cluster [DBG] pgmap v1445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:10.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:10 gibba044 bash[25485]: cluster 2021-03-10T20:56:09.298246+0000 mgr.gibba044.wflcwh (mgr.34466) 2558 : cluster [DBG] pgmap v1445: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:12.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:12 gibba023 bash[30844]: cluster 2021-03-10T20:56:11.299889+0000 mgr.gibba044.wflcwh (mgr.34466) 2559 : cluster [DBG] pgmap v1446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:12.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:12 gibba023 bash[31815]: cluster 2021-03-10T20:56:11.299889+0000 mgr.gibba044.wflcwh (mgr.34466) 2559 : cluster [DBG] pgmap v1446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:12.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:12 gibba044 bash[25485]: cluster 2021-03-10T20:56:11.299889+0000 mgr.gibba044.wflcwh (mgr.34466) 2559 : cluster [DBG] pgmap v1446: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:14.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:14 gibba023 bash[30844]: cluster 2021-03-10T20:56:13.301639+0000 mgr.gibba044.wflcwh (mgr.34466) 2560 : cluster [DBG] pgmap v1447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:14.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:14 gibba023 bash[31815]: cluster 2021-03-10T20:56:13.301639+0000 mgr.gibba044.wflcwh (mgr.34466) 2560 : cluster [DBG] pgmap v1447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:14.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:14 gibba044 bash[25485]: cluster 2021-03-10T20:56:13.301639+0000 mgr.gibba044.wflcwh (mgr.34466) 2560 : cluster [DBG] pgmap v1447: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:16.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:16 gibba023 bash[30844]: cluster 2021-03-10T20:56:15.303138+0000 mgr.gibba044.wflcwh (mgr.34466) 2561 : cluster [DBG] pgmap v1448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:16.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:16 gibba023 bash[31815]: cluster 2021-03-10T20:56:15.303138+0000 mgr.gibba044.wflcwh (mgr.34466) 2561 : cluster [DBG] pgmap v1448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:16.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:16 gibba044 bash[25485]: cluster 2021-03-10T20:56:15.303138+0000 mgr.gibba044.wflcwh (mgr.34466) 2561 : cluster [DBG] pgmap v1448: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:17.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:17 gibba044 bash[25485]: cephadm 2021-03-10T20:56:16.264830+0000 mgr.gibba044.wflcwh (mgr.34466) 2562 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:56:17.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:17 gibba023 bash[30844]: cephadm 2021-03-10T20:56:16.264830+0000 mgr.gibba044.wflcwh (mgr.34466) 2562 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:56:17.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:17 gibba023 bash[31815]: cephadm 2021-03-10T20:56:16.264830+0000 mgr.gibba044.wflcwh (mgr.34466) 2562 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:56:18.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:18 gibba044 bash[25485]: cluster 2021-03-10T20:56:17.304366+0000 mgr.gibba044.wflcwh (mgr.34466) 2563 : cluster [DBG] pgmap v1449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:18.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:18 gibba023 bash[30844]: cluster 2021-03-10T20:56:17.304366+0000 mgr.gibba044.wflcwh (mgr.34466) 2563 : cluster [DBG] pgmap v1449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:18.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:18 gibba023 bash[31815]: cluster 2021-03-10T20:56:17.304366+0000 mgr.gibba044.wflcwh (mgr.34466) 2563 : cluster [DBG] pgmap v1449: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:20.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:20 gibba044 bash[25485]: cluster 2021-03-10T20:56:19.306067+0000 mgr.gibba044.wflcwh (mgr.34466) 2564 : cluster [DBG] pgmap v1450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:20.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:20 gibba023 bash[30844]: cluster 2021-03-10T20:56:19.306067+0000 mgr.gibba044.wflcwh (mgr.34466) 2564 : cluster [DBG] pgmap v1450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:20.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:20 gibba023 bash[31815]: cluster 2021-03-10T20:56:19.306067+0000 mgr.gibba044.wflcwh (mgr.34466) 2564 : cluster [DBG] pgmap v1450: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:21.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:21 gibba023 bash[30844]: cluster 2021-03-10T20:56:21.307770+0000 mgr.gibba044.wflcwh (mgr.34466) 2565 : cluster [DBG] pgmap v1451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:21.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:21 gibba023 bash[31815]: cluster 2021-03-10T20:56:21.307770+0000 mgr.gibba044.wflcwh (mgr.34466) 2565 : cluster [DBG] pgmap v1451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:22.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:21 gibba044 bash[25485]: cluster 2021-03-10T20:56:21.307770+0000 mgr.gibba044.wflcwh (mgr.34466) 2565 : cluster [DBG] pgmap v1451: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:22.846 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:56:23.080 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:56:23.081 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (47m) 2m ago 53m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:56:23.081 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (52m) 112s ago 52m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:56:23.081 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (47m) 112s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:56:23.081 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (48m) 112s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:56:23.082 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (47m) 2m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:56:23.082 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (47m) 2m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:56:23.082 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (46m) 112s ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:56:23.082 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (46m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:56:23.082 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (53m) 2m ago 53m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:56:23.083 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (53m) 112s ago 53m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:56:23.083 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (45m) 2m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:56:23.083 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (45m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:56:23.083 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (44m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:56:23.084 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (44m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:56:23.084 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (44m) 112s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:56:23.084 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (43m) 112s ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:56:23.084 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (43m) 112s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:56:23.084 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (42m) 112s ago 53m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:56:23.085 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (52m) 112s ago 53m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:56:23.085 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 2m ago 50m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:56:23.085 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 112s ago 51m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:56:23.327 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:56:23.328 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:56:23.328 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:56:23.328 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:56:23.329 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:56:23.329 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:56:23.329 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:56:23.329 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:56:23.329 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:56:23.330 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:56:23.330 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:56:23.330 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:56:23.330 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:56:23.331 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:56:23.331 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:56:23.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:23 gibba023 bash[30844]: audit 2021-03-10T20:56:23.325010+0000 mon.a (mon.0) 1248 : audit [DBG] from='client.? 172.21.2.123:0/3181824843' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:23.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:23 gibba023 bash[31815]: audit 2021-03-10T20:56:23.325010+0000 mon.a (mon.0) 1248 : audit [DBG] from='client.? 172.21.2.123:0/3181824843' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:23.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:23 gibba044 bash[25485]: audit 2021-03-10T20:56:23.325010+0000 mon.a (mon.0) 1248 : audit [DBG] from='client.? 172.21.2.123:0/3181824843' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:24.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:24 gibba023 bash[30844]: audit 2021-03-10T20:56:22.836426+0000 mgr.gibba044.wflcwh (mgr.34466) 2566 : audit [DBG] from='client.45786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:56:24.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:24 gibba023 bash[30844]: audit 2021-03-10T20:56:23.066249+0000 mgr.gibba044.wflcwh (mgr.34466) 2567 : audit [DBG] from='client.55771 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:56:24.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:24 gibba023 bash[30844]: cluster 2021-03-10T20:56:23.309445+0000 mgr.gibba044.wflcwh (mgr.34466) 2568 : cluster [DBG] pgmap v1452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:24.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:24 gibba023 bash[31815]: audit 2021-03-10T20:56:22.836426+0000 mgr.gibba044.wflcwh (mgr.34466) 2566 : audit [DBG] from='client.45786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:56:24.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:24 gibba023 bash[31815]: audit 2021-03-10T20:56:23.066249+0000 mgr.gibba044.wflcwh (mgr.34466) 2567 : audit [DBG] from='client.55771 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:56:24.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:24 gibba023 bash[31815]: cluster 2021-03-10T20:56:23.309445+0000 mgr.gibba044.wflcwh (mgr.34466) 2568 : cluster [DBG] pgmap v1452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:24.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:24 gibba044 bash[25485]: audit 2021-03-10T20:56:22.836426+0000 mgr.gibba044.wflcwh (mgr.34466) 2566 : audit [DBG] from='client.45786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:56:24.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:24 gibba044 bash[25485]: audit 2021-03-10T20:56:23.066249+0000 mgr.gibba044.wflcwh (mgr.34466) 2567 : audit [DBG] from='client.55771 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:56:24.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:24 gibba044 bash[25485]: cluster 2021-03-10T20:56:23.309445+0000 mgr.gibba044.wflcwh (mgr.34466) 2568 : cluster [DBG] pgmap v1452: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:26.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:26 gibba023 bash[30844]: cluster 2021-03-10T20:56:25.310699+0000 mgr.gibba044.wflcwh (mgr.34466) 2569 : cluster [DBG] pgmap v1453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:26.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:26 gibba023 bash[31815]: cluster 2021-03-10T20:56:25.310699+0000 mgr.gibba044.wflcwh (mgr.34466) 2569 : cluster [DBG] pgmap v1453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:26.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:26 gibba044 bash[25485]: cluster 2021-03-10T20:56:25.310699+0000 mgr.gibba044.wflcwh (mgr.34466) 2569 : cluster [DBG] pgmap v1453: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:28.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:28 gibba023 bash[30844]: cluster 2021-03-10T20:56:27.312408+0000 mgr.gibba044.wflcwh (mgr.34466) 2570 : cluster [DBG] pgmap v1454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:28.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:28 gibba023 bash[30844]: audit 2021-03-10T20:56:27.356466+0000 mon.a (mon.0) 1249 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:56:28.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:28 gibba023 bash[30844]: audit 2021-03-10T20:56:27.356628+0000 mon.a (mon.0) 1250 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:56:28.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:28 gibba023 bash[30844]: audit 2021-03-10T20:56:27.366084+0000 mon.a (mon.0) 1251 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:56:28.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:28 gibba023 bash[30844]: audit 2021-03-10T20:56:27.366221+0000 mon.a (mon.0) 1252 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:56:28.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:28 gibba023 bash[30844]: audit 2021-03-10T20:56:27.366355+0000 mon.a (mon.0) 1253 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T20:56:28.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:28 gibba023 bash[30844]: audit 2021-03-10T20:56:27.366482+0000 mon.a (mon.0) 1254 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:56:28.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:28 gibba023 bash[31815]: cluster 2021-03-10T20:56:27.312408+0000 mgr.gibba044.wflcwh (mgr.34466) 2570 : cluster [DBG] pgmap v1454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:28.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:28 gibba023 bash[31815]: audit 2021-03-10T20:56:27.356466+0000 mon.a (mon.0) 1249 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:56:28.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:28 gibba023 bash[31815]: audit 2021-03-10T20:56:27.356628+0000 mon.a (mon.0) 1250 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:56:28.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:28 gibba023 bash[31815]: audit 2021-03-10T20:56:27.366084+0000 mon.a (mon.0) 1251 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:56:28.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:28 gibba023 bash[31815]: audit 2021-03-10T20:56:27.366221+0000 mon.a (mon.0) 1252 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:56:28.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:28 gibba023 bash[31815]: audit 2021-03-10T20:56:27.366355+0000 mon.a (mon.0) 1253 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T20:56:28.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:28 gibba023 bash[31815]: audit 2021-03-10T20:56:27.366482+0000 mon.a (mon.0) 1254 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:56:28.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:28 gibba044 bash[25485]: cluster 2021-03-10T20:56:27.312408+0000 mgr.gibba044.wflcwh (mgr.34466) 2570 : cluster [DBG] pgmap v1454: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:28.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:28 gibba044 bash[25485]: audit 2021-03-10T20:56:27.356466+0000 mon.a (mon.0) 1249 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:56:28.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:28 gibba044 bash[25485]: audit 2021-03-10T20:56:27.356628+0000 mon.a (mon.0) 1250 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:56:28.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:28 gibba044 bash[25485]: audit 2021-03-10T20:56:27.366084+0000 mon.a (mon.0) 1251 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T20:56:28.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:28 gibba044 bash[25485]: audit 2021-03-10T20:56:27.366221+0000 mon.a (mon.0) 1252 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T20:56:28.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:28 gibba044 bash[25485]: audit 2021-03-10T20:56:27.366355+0000 mon.a (mon.0) 1253 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2021-03-10T20:56:28.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:28 gibba044 bash[25485]: audit 2021-03-10T20:56:27.366482+0000 mon.a (mon.0) 1254 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2021-03-10T20:56:30.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:30 gibba023 bash[30844]: cluster 2021-03-10T20:56:29.314217+0000 mgr.gibba044.wflcwh (mgr.34466) 2571 : cluster [DBG] pgmap v1455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:30.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:30 gibba023 bash[31815]: cluster 2021-03-10T20:56:29.314217+0000 mgr.gibba044.wflcwh (mgr.34466) 2571 : cluster [DBG] pgmap v1455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:30.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:30 gibba044 bash[25485]: cluster 2021-03-10T20:56:29.314217+0000 mgr.gibba044.wflcwh (mgr.34466) 2571 : cluster [DBG] pgmap v1455: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:32.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:32 gibba023 bash[30844]: cephadm 2021-03-10T20:56:31.281679+0000 mgr.gibba044.wflcwh (mgr.34466) 2572 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:56:32.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:32 gibba023 bash[30844]: cephadm 2021-03-10T20:56:31.283263+0000 mgr.gibba044.wflcwh (mgr.34466) 2573 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:56:32.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:32 gibba023 bash[30844]: cluster 2021-03-10T20:56:31.314703+0000 mgr.gibba044.wflcwh (mgr.34466) 2574 : cluster [DBG] pgmap v1456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:32.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:32 gibba023 bash[30844]: audit 2021-03-10T20:56:31.498060+0000 mon.a (mon.0) 1255 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:56:32.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:32 gibba023 bash[30844]: audit 2021-03-10T20:56:31.501951+0000 mon.a (mon.0) 1256 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:56:32.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:32 gibba023 bash[30844]: audit 2021-03-10T20:56:31.504948+0000 mon.a (mon.0) 1257 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:32.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:32 gibba023 bash[30844]: audit 2021-03-10T20:56:31.508010+0000 mon.a (mon.0) 1258 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:32.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:32 gibba023 bash[30844]: audit 2021-03-10T20:56:31.510589+0000 mon.a (mon.0) 1259 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:32.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:32 gibba023 bash[30844]: audit 2021-03-10T20:56:31.516079+0000 mon.a (mon.0) 1260 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:32.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:32 gibba023 bash[30844]: audit 2021-03-10T20:56:31.518707+0000 mon.a (mon.0) 1261 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:32.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:32 gibba023 bash[31815]: cephadm 2021-03-10T20:56:31.281679+0000 mgr.gibba044.wflcwh (mgr.34466) 2572 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:56:32.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:32 gibba023 bash[31815]: cephadm 2021-03-10T20:56:31.283263+0000 mgr.gibba044.wflcwh (mgr.34466) 2573 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:56:32.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:32 gibba023 bash[31815]: cluster 2021-03-10T20:56:31.314703+0000 mgr.gibba044.wflcwh (mgr.34466) 2574 : cluster [DBG] pgmap v1456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:32.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:32 gibba023 bash[31815]: audit 2021-03-10T20:56:31.498060+0000 mon.a (mon.0) 1255 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:56:32.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:32 gibba023 bash[31815]: audit 2021-03-10T20:56:31.501951+0000 mon.a (mon.0) 1256 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:56:32.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:32 gibba023 bash[31815]: audit 2021-03-10T20:56:31.504948+0000 mon.a (mon.0) 1257 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:32.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:32 gibba023 bash[31815]: audit 2021-03-10T20:56:31.508010+0000 mon.a (mon.0) 1258 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:32.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:32 gibba023 bash[31815]: audit 2021-03-10T20:56:31.510589+0000 mon.a (mon.0) 1259 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:32.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:32 gibba023 bash[31815]: audit 2021-03-10T20:56:31.516079+0000 mon.a (mon.0) 1260 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:32.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:32 gibba023 bash[31815]: audit 2021-03-10T20:56:31.518707+0000 mon.a (mon.0) 1261 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:32.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:32 gibba044 bash[25485]: cephadm 2021-03-10T20:56:31.281679+0000 mgr.gibba044.wflcwh (mgr.34466) 2572 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:56:32.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:32 gibba044 bash[25485]: cephadm 2021-03-10T20:56:31.283263+0000 mgr.gibba044.wflcwh (mgr.34466) 2573 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:56:32.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:32 gibba044 bash[25485]: cluster 2021-03-10T20:56:31.314703+0000 mgr.gibba044.wflcwh (mgr.34466) 2574 : cluster [DBG] pgmap v1456: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:32.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:32 gibba044 bash[25485]: audit 2021-03-10T20:56:31.498060+0000 mon.a (mon.0) 1255 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:56:32.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:32 gibba044 bash[25485]: audit 2021-03-10T20:56:31.501951+0000 mon.a (mon.0) 1256 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:56:32.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:32 gibba044 bash[25485]: audit 2021-03-10T20:56:31.504948+0000 mon.a (mon.0) 1257 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:32.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:32 gibba044 bash[25485]: audit 2021-03-10T20:56:31.508010+0000 mon.a (mon.0) 1258 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:32.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:32 gibba044 bash[25485]: audit 2021-03-10T20:56:31.510589+0000 mon.a (mon.0) 1259 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:32.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:32 gibba044 bash[25485]: audit 2021-03-10T20:56:31.516079+0000 mon.a (mon.0) 1260 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:32.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:32 gibba044 bash[25485]: audit 2021-03-10T20:56:31.518707+0000 mon.a (mon.0) 1261 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:33.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:33 gibba023 bash[30844]: cephadm 2021-03-10T20:56:31.501206+0000 mgr.gibba044.wflcwh (mgr.34466) 2575 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:56:33.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:33 gibba023 bash[30844]: cephadm 2021-03-10T20:56:31.504569+0000 mgr.gibba044.wflcwh (mgr.34466) 2576 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:56:33.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:33 gibba023 bash[30844]: cephadm 2021-03-10T20:56:31.507305+0000 mgr.gibba044.wflcwh (mgr.34466) 2577 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:56:33.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:33 gibba023 bash[30844]: cephadm 2021-03-10T20:56:31.507382+0000 mgr.gibba044.wflcwh (mgr.34466) 2578 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:56:33.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:33 gibba023 bash[30844]: cephadm 2021-03-10T20:56:31.510194+0000 mgr.gibba044.wflcwh (mgr.34466) 2579 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:56:33.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:33 gibba023 bash[30844]: cephadm 2021-03-10T20:56:31.510230+0000 mgr.gibba044.wflcwh (mgr.34466) 2580 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:56:33.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:33 gibba023 bash[30844]: cephadm 2021-03-10T20:56:31.513030+0000 mgr.gibba044.wflcwh (mgr.34466) 2581 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:56:33.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:33 gibba023 bash[30844]: cephadm 2021-03-10T20:56:31.515534+0000 mgr.gibba044.wflcwh (mgr.34466) 2582 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:56:33.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:33 gibba023 bash[30844]: cephadm 2021-03-10T20:56:31.515587+0000 mgr.gibba044.wflcwh (mgr.34466) 2583 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:56:33.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:33 gibba023 bash[30844]: cephadm 2021-03-10T20:56:31.518078+0000 mgr.gibba044.wflcwh (mgr.34466) 2584 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:56:33.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:33 gibba023 bash[30844]: cephadm 2021-03-10T20:56:31.518398+0000 mgr.gibba044.wflcwh (mgr.34466) 2585 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:56:33.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:33 gibba023 bash[30844]: cephadm 2021-03-10T20:56:31.520687+0000 mgr.gibba044.wflcwh (mgr.34466) 2586 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:56:33.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:33 gibba023 bash[30844]: cephadm 2021-03-10T20:56:31.520724+0000 mgr.gibba044.wflcwh (mgr.34466) 2587 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:56:33.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:33 gibba023 bash[30844]: cephadm 2021-03-10T20:56:31.520897+0000 mgr.gibba044.wflcwh (mgr.34466) 2588 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:56:33.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:33 gibba023 bash[31815]: cephadm 2021-03-10T20:56:31.501206+0000 mgr.gibba044.wflcwh (mgr.34466) 2575 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:56:33.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:33 gibba023 bash[31815]: cephadm 2021-03-10T20:56:31.504569+0000 mgr.gibba044.wflcwh (mgr.34466) 2576 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:56:33.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:33 gibba023 bash[31815]: cephadm 2021-03-10T20:56:31.507305+0000 mgr.gibba044.wflcwh (mgr.34466) 2577 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:56:33.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:33 gibba023 bash[31815]: cephadm 2021-03-10T20:56:31.507382+0000 mgr.gibba044.wflcwh (mgr.34466) 2578 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:56:33.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:33 gibba023 bash[31815]: cephadm 2021-03-10T20:56:31.510194+0000 mgr.gibba044.wflcwh (mgr.34466) 2579 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:56:33.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:33 gibba023 bash[31815]: cephadm 2021-03-10T20:56:31.510230+0000 mgr.gibba044.wflcwh (mgr.34466) 2580 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:56:33.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:33 gibba023 bash[31815]: cephadm 2021-03-10T20:56:31.513030+0000 mgr.gibba044.wflcwh (mgr.34466) 2581 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:56:33.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:33 gibba023 bash[31815]: cephadm 2021-03-10T20:56:31.515534+0000 mgr.gibba044.wflcwh (mgr.34466) 2582 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:56:33.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:33 gibba023 bash[31815]: cephadm 2021-03-10T20:56:31.515587+0000 mgr.gibba044.wflcwh (mgr.34466) 2583 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:56:33.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:33 gibba023 bash[31815]: cephadm 2021-03-10T20:56:31.518078+0000 mgr.gibba044.wflcwh (mgr.34466) 2584 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:56:33.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:33 gibba023 bash[31815]: cephadm 2021-03-10T20:56:31.518398+0000 mgr.gibba044.wflcwh (mgr.34466) 2585 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:56:33.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:33 gibba023 bash[31815]: cephadm 2021-03-10T20:56:31.520687+0000 mgr.gibba044.wflcwh (mgr.34466) 2586 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:56:33.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:33 gibba023 bash[31815]: cephadm 2021-03-10T20:56:31.520724+0000 mgr.gibba044.wflcwh (mgr.34466) 2587 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:56:33.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:33 gibba023 bash[31815]: cephadm 2021-03-10T20:56:31.520897+0000 mgr.gibba044.wflcwh (mgr.34466) 2588 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:56:33.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:33 gibba044 bash[25485]: cephadm 2021-03-10T20:56:31.501206+0000 mgr.gibba044.wflcwh (mgr.34466) 2575 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:56:33.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:33 gibba044 bash[25485]: cephadm 2021-03-10T20:56:31.504569+0000 mgr.gibba044.wflcwh (mgr.34466) 2576 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:56:33.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:33 gibba044 bash[25485]: cephadm 2021-03-10T20:56:31.507305+0000 mgr.gibba044.wflcwh (mgr.34466) 2577 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:56:33.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:33 gibba044 bash[25485]: cephadm 2021-03-10T20:56:31.507382+0000 mgr.gibba044.wflcwh (mgr.34466) 2578 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:56:33.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:33 gibba044 bash[25485]: cephadm 2021-03-10T20:56:31.510194+0000 mgr.gibba044.wflcwh (mgr.34466) 2579 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:56:33.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:33 gibba044 bash[25485]: cephadm 2021-03-10T20:56:31.510230+0000 mgr.gibba044.wflcwh (mgr.34466) 2580 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:56:33.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:33 gibba044 bash[25485]: cephadm 2021-03-10T20:56:31.513030+0000 mgr.gibba044.wflcwh (mgr.34466) 2581 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:56:33.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:33 gibba044 bash[25485]: cephadm 2021-03-10T20:56:31.515534+0000 mgr.gibba044.wflcwh (mgr.34466) 2582 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:56:33.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:33 gibba044 bash[25485]: cephadm 2021-03-10T20:56:31.515587+0000 mgr.gibba044.wflcwh (mgr.34466) 2583 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:56:33.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:33 gibba044 bash[25485]: cephadm 2021-03-10T20:56:31.518078+0000 mgr.gibba044.wflcwh (mgr.34466) 2584 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:56:33.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:33 gibba044 bash[25485]: cephadm 2021-03-10T20:56:31.518398+0000 mgr.gibba044.wflcwh (mgr.34466) 2585 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:56:33.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:33 gibba044 bash[25485]: cephadm 2021-03-10T20:56:31.520687+0000 mgr.gibba044.wflcwh (mgr.34466) 2586 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:56:33.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:33 gibba044 bash[25485]: cephadm 2021-03-10T20:56:31.520724+0000 mgr.gibba044.wflcwh (mgr.34466) 2587 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:56:33.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:33 gibba044 bash[25485]: cephadm 2021-03-10T20:56:31.520897+0000 mgr.gibba044.wflcwh (mgr.34466) 2588 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:56:34.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:34 gibba023 bash[30844]: cluster 2021-03-10T20:56:33.316331+0000 mgr.gibba044.wflcwh (mgr.34466) 2589 : cluster [DBG] pgmap v1457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:34.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:34 gibba023 bash[31815]: cluster 2021-03-10T20:56:33.316331+0000 mgr.gibba044.wflcwh (mgr.34466) 2589 : cluster [DBG] pgmap v1457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:34.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:34 gibba044 bash[25485]: cluster 2021-03-10T20:56:33.316331+0000 mgr.gibba044.wflcwh (mgr.34466) 2589 : cluster [DBG] pgmap v1457: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:36.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:36 gibba023 bash[30844]: cluster 2021-03-10T20:56:35.317777+0000 mgr.gibba044.wflcwh (mgr.34466) 2590 : cluster [DBG] pgmap v1458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:36.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:36 gibba023 bash[31815]: cluster 2021-03-10T20:56:35.317777+0000 mgr.gibba044.wflcwh (mgr.34466) 2590 : cluster [DBG] pgmap v1458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:36.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:36 gibba044 bash[25485]: cluster 2021-03-10T20:56:35.317777+0000 mgr.gibba044.wflcwh (mgr.34466) 2590 : cluster [DBG] pgmap v1458: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:38.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:38 gibba023 bash[30844]: cluster 2021-03-10T20:56:37.319460+0000 mgr.gibba044.wflcwh (mgr.34466) 2591 : cluster [DBG] pgmap v1459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:38.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:38 gibba023 bash[31815]: cluster 2021-03-10T20:56:37.319460+0000 mgr.gibba044.wflcwh (mgr.34466) 2591 : cluster [DBG] pgmap v1459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:38.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:38 gibba044 bash[25485]: cluster 2021-03-10T20:56:37.319460+0000 mgr.gibba044.wflcwh (mgr.34466) 2591 : cluster [DBG] pgmap v1459: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:40.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:40 gibba023 bash[30844]: cluster 2021-03-10T20:56:39.321224+0000 mgr.gibba044.wflcwh (mgr.34466) 2592 : cluster [DBG] pgmap v1460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:40.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:40 gibba023 bash[31815]: cluster 2021-03-10T20:56:39.321224+0000 mgr.gibba044.wflcwh (mgr.34466) 2592 : cluster [DBG] pgmap v1460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:40.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:40 gibba044 bash[25485]: cluster 2021-03-10T20:56:39.321224+0000 mgr.gibba044.wflcwh (mgr.34466) 2592 : cluster [DBG] pgmap v1460: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:42.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:42 gibba023 bash[30844]: cluster 2021-03-10T20:56:41.322836+0000 mgr.gibba044.wflcwh (mgr.34466) 2593 : cluster [DBG] pgmap v1461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:42.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:42 gibba023 bash[31815]: cluster 2021-03-10T20:56:41.322836+0000 mgr.gibba044.wflcwh (mgr.34466) 2593 : cluster [DBG] pgmap v1461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:42.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:42 gibba044 bash[25485]: cluster 2021-03-10T20:56:41.322836+0000 mgr.gibba044.wflcwh (mgr.34466) 2593 : cluster [DBG] pgmap v1461: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:44.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:44 gibba044 bash[25485]: cluster 2021-03-10T20:56:43.324548+0000 mgr.gibba044.wflcwh (mgr.34466) 2594 : cluster [DBG] pgmap v1462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:44.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:44 gibba023 bash[30844]: cluster 2021-03-10T20:56:43.324548+0000 mgr.gibba044.wflcwh (mgr.34466) 2594 : cluster [DBG] pgmap v1462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:44.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:44 gibba023 bash[31815]: cluster 2021-03-10T20:56:43.324548+0000 mgr.gibba044.wflcwh (mgr.34466) 2594 : cluster [DBG] pgmap v1462: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:46.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:46 gibba044 bash[25485]: cluster 2021-03-10T20:56:45.326100+0000 mgr.gibba044.wflcwh (mgr.34466) 2595 : cluster [DBG] pgmap v1463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:46.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:46 gibba023 bash[30844]: cluster 2021-03-10T20:56:45.326100+0000 mgr.gibba044.wflcwh (mgr.34466) 2595 : cluster [DBG] pgmap v1463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:46.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:46 gibba023 bash[31815]: cluster 2021-03-10T20:56:45.326100+0000 mgr.gibba044.wflcwh (mgr.34466) 2595 : cluster [DBG] pgmap v1463: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:48.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:48 gibba044 bash[25485]: cephadm 2021-03-10T20:56:46.536701+0000 mgr.gibba044.wflcwh (mgr.34466) 2596 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:56:48.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:48 gibba044 bash[25485]: cluster 2021-03-10T20:56:47.327894+0000 mgr.gibba044.wflcwh (mgr.34466) 2597 : cluster [DBG] pgmap v1464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:48.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:48 gibba023 bash[30844]: cephadm 2021-03-10T20:56:46.536701+0000 mgr.gibba044.wflcwh (mgr.34466) 2596 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:56:48.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:48 gibba023 bash[30844]: cluster 2021-03-10T20:56:47.327894+0000 mgr.gibba044.wflcwh (mgr.34466) 2597 : cluster [DBG] pgmap v1464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:48.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:48 gibba023 bash[31815]: cephadm 2021-03-10T20:56:46.536701+0000 mgr.gibba044.wflcwh (mgr.34466) 2596 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:56:48.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:48 gibba023 bash[31815]: cluster 2021-03-10T20:56:47.327894+0000 mgr.gibba044.wflcwh (mgr.34466) 2597 : cluster [DBG] pgmap v1464: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:50.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:50 gibba044 bash[25485]: cluster 2021-03-10T20:56:49.329335+0000 mgr.gibba044.wflcwh (mgr.34466) 2598 : cluster [DBG] pgmap v1465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:50.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:50 gibba023 bash[30844]: cluster 2021-03-10T20:56:49.329335+0000 mgr.gibba044.wflcwh (mgr.34466) 2598 : cluster [DBG] pgmap v1465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:50.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:50 gibba023 bash[31815]: cluster 2021-03-10T20:56:49.329335+0000 mgr.gibba044.wflcwh (mgr.34466) 2598 : cluster [DBG] pgmap v1465: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:52.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:52 gibba044 bash[25485]: cluster 2021-03-10T20:56:51.330836+0000 mgr.gibba044.wflcwh (mgr.34466) 2599 : cluster [DBG] pgmap v1466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:52.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:52 gibba023 bash[30844]: cluster 2021-03-10T20:56:51.330836+0000 mgr.gibba044.wflcwh (mgr.34466) 2599 : cluster [DBG] pgmap v1466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:52.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:52 gibba023 bash[31815]: cluster 2021-03-10T20:56:51.330836+0000 mgr.gibba044.wflcwh (mgr.34466) 2599 : cluster [DBG] pgmap v1466: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:53.570 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:56:53.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:53 gibba044 bash[25485]: cluster 2021-03-10T20:56:53.332554+0000 mgr.gibba044.wflcwh (mgr.34466) 2600 : cluster [DBG] pgmap v1467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:53.802 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:56:53.803 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (48m) 3m ago 53m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:56:53.803 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (53m) 2m ago 53m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:56:53.803 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (48m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:56:53.803 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (48m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:56:53.803 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (47m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:56:53.804 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (47m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:56:53.804 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (47m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:56:53.804 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (47m) 3m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:56:53.804 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (53m) 3m ago 53m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:56:53.805 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (53m) 2m ago 53m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:56:53.805 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (46m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:56:53.805 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (45m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:56:53.805 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (45m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:56:53.805 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (44m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:56:53.806 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (44m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:56:53.806 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (44m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:56:53.806 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (43m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:56:53.806 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (43m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:56:53.807 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (53m) 2m ago 53m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:56:53.807 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 3m ago 51m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:56:53.807 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 2m ago 51m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:56:53.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:53 gibba023 bash[30844]: cluster 2021-03-10T20:56:53.332554+0000 mgr.gibba044.wflcwh (mgr.34466) 2600 : cluster [DBG] pgmap v1467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:53.926 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:53 gibba023 bash[31815]: cluster 2021-03-10T20:56:53.332554+0000 mgr.gibba044.wflcwh (mgr.34466) 2600 : cluster [DBG] pgmap v1467: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:54.061 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:56:54.061 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:56:54.061 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:56:54.062 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:56:54.062 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:56:54.062 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:56:54.062 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:56:54.063 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:56:54.063 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:56:54.063 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:56:54.063 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:56:54.064 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:56:54.064 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:56:54.064 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:56:54.064 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:56:54.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:54 gibba044 bash[25485]: audit 2021-03-10T20:56:53.559804+0000 mgr.gibba044.wflcwh (mgr.34466) 2601 : audit [DBG] from='client.55783 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:56:54.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:54 gibba044 bash[25485]: audit 2021-03-10T20:56:53.788847+0000 mgr.gibba044.wflcwh (mgr.34466) 2602 : audit [DBG] from='client.45810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:56:54.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:54 gibba044 bash[25485]: audit 2021-03-10T20:56:54.059346+0000 mon.c (mon.1) 61 : audit [DBG] from='client.? 172.21.2.123:0/3734082030' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:54.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:54 gibba023 bash[30844]: audit 2021-03-10T20:56:53.559804+0000 mgr.gibba044.wflcwh (mgr.34466) 2601 : audit [DBG] from='client.55783 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:56:54.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:54 gibba023 bash[30844]: audit 2021-03-10T20:56:53.788847+0000 mgr.gibba044.wflcwh (mgr.34466) 2602 : audit [DBG] from='client.45810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:56:54.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:54 gibba023 bash[30844]: audit 2021-03-10T20:56:54.059346+0000 mon.c (mon.1) 61 : audit [DBG] from='client.? 172.21.2.123:0/3734082030' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:54.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:54 gibba023 bash[31815]: audit 2021-03-10T20:56:53.559804+0000 mgr.gibba044.wflcwh (mgr.34466) 2601 : audit [DBG] from='client.55783 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:56:54.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:54 gibba023 bash[31815]: audit 2021-03-10T20:56:53.788847+0000 mgr.gibba044.wflcwh (mgr.34466) 2602 : audit [DBG] from='client.45810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:56:54.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:54 gibba023 bash[31815]: audit 2021-03-10T20:56:54.059346+0000 mon.c (mon.1) 61 : audit [DBG] from='client.? 172.21.2.123:0/3734082030' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:56:55.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:55 gibba044 bash[25485]: cluster 2021-03-10T20:56:55.333891+0000 mgr.gibba044.wflcwh (mgr.34466) 2603 : cluster [DBG] pgmap v1468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:55.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:55 gibba023 bash[30844]: cluster 2021-03-10T20:56:55.333891+0000 mgr.gibba044.wflcwh (mgr.34466) 2603 : cluster [DBG] pgmap v1468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:55.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:55 gibba023 bash[31815]: cluster 2021-03-10T20:56:55.333891+0000 mgr.gibba044.wflcwh (mgr.34466) 2603 : cluster [DBG] pgmap v1468: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:58.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:56:58 gibba023 bash[30844]: cluster 2021-03-10T20:56:57.335762+0000 mgr.gibba044.wflcwh (mgr.34466) 2604 : cluster [DBG] pgmap v1469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:58.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:56:58 gibba023 bash[31815]: cluster 2021-03-10T20:56:57.335762+0000 mgr.gibba044.wflcwh (mgr.34466) 2604 : cluster [DBG] pgmap v1469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:56:58.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:56:58 gibba044 bash[25485]: cluster 2021-03-10T20:56:57.335762+0000 mgr.gibba044.wflcwh (mgr.34466) 2604 : cluster [DBG] pgmap v1469: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:00.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:00 gibba023 bash[30844]: cluster 2021-03-10T20:56:59.337432+0000 mgr.gibba044.wflcwh (mgr.34466) 2605 : cluster [DBG] pgmap v1470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:00.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:00 gibba023 bash[31815]: cluster 2021-03-10T20:56:59.337432+0000 mgr.gibba044.wflcwh (mgr.34466) 2605 : cluster [DBG] pgmap v1470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:00.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:00 gibba044 bash[25485]: cluster 2021-03-10T20:56:59.337432+0000 mgr.gibba044.wflcwh (mgr.34466) 2605 : cluster [DBG] pgmap v1470: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:02.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:02 gibba023 bash[30844]: cluster 2021-03-10T20:57:01.338975+0000 mgr.gibba044.wflcwh (mgr.34466) 2606 : cluster [DBG] pgmap v1471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:02.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:02 gibba023 bash[31815]: cluster 2021-03-10T20:57:01.338975+0000 mgr.gibba044.wflcwh (mgr.34466) 2606 : cluster [DBG] pgmap v1471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:02.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:02 gibba044 bash[25485]: cluster 2021-03-10T20:57:01.338975+0000 mgr.gibba044.wflcwh (mgr.34466) 2606 : cluster [DBG] pgmap v1471: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:03.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:03 gibba023 bash[30844]: cephadm 2021-03-10T20:57:01.552778+0000 mgr.gibba044.wflcwh (mgr.34466) 2607 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:57:03.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:03 gibba023 bash[31815]: cephadm 2021-03-10T20:57:01.552778+0000 mgr.gibba044.wflcwh (mgr.34466) 2607 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:57:03.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:03 gibba044 bash[25485]: cephadm 2021-03-10T20:57:01.552778+0000 mgr.gibba044.wflcwh (mgr.34466) 2607 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:57:04.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:04 gibba044 bash[25485]: cluster 2021-03-10T20:57:03.340601+0000 mgr.gibba044.wflcwh (mgr.34466) 2608 : cluster [DBG] pgmap v1472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:04.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:04 gibba023 bash[30844]: cluster 2021-03-10T20:57:03.340601+0000 mgr.gibba044.wflcwh (mgr.34466) 2608 : cluster [DBG] pgmap v1472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:04.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:04 gibba023 bash[31815]: cluster 2021-03-10T20:57:03.340601+0000 mgr.gibba044.wflcwh (mgr.34466) 2608 : cluster [DBG] pgmap v1472: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:06.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:06 gibba044 bash[25485]: cluster 2021-03-10T20:57:05.342053+0000 mgr.gibba044.wflcwh (mgr.34466) 2609 : cluster [DBG] pgmap v1473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:06.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:06 gibba023 bash[30844]: cluster 2021-03-10T20:57:05.342053+0000 mgr.gibba044.wflcwh (mgr.34466) 2609 : cluster [DBG] pgmap v1473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:06.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:06 gibba023 bash[31815]: cluster 2021-03-10T20:57:05.342053+0000 mgr.gibba044.wflcwh (mgr.34466) 2609 : cluster [DBG] pgmap v1473: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:08.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:08 gibba044 bash[25485]: cluster 2021-03-10T20:57:07.343834+0000 mgr.gibba044.wflcwh (mgr.34466) 2610 : cluster [DBG] pgmap v1474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:08.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:08 gibba023 bash[30844]: cluster 2021-03-10T20:57:07.343834+0000 mgr.gibba044.wflcwh (mgr.34466) 2610 : cluster [DBG] pgmap v1474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:08.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:08 gibba023 bash[31815]: cluster 2021-03-10T20:57:07.343834+0000 mgr.gibba044.wflcwh (mgr.34466) 2610 : cluster [DBG] pgmap v1474: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:10.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:10 gibba044 bash[25485]: cluster 2021-03-10T20:57:09.345657+0000 mgr.gibba044.wflcwh (mgr.34466) 2611 : cluster [DBG] pgmap v1475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:10.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:10 gibba023 bash[30844]: cluster 2021-03-10T20:57:09.345657+0000 mgr.gibba044.wflcwh (mgr.34466) 2611 : cluster [DBG] pgmap v1475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:10.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:10 gibba023 bash[31815]: cluster 2021-03-10T20:57:09.345657+0000 mgr.gibba044.wflcwh (mgr.34466) 2611 : cluster [DBG] pgmap v1475: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:12.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:12 gibba044 bash[25485]: cluster 2021-03-10T20:57:11.347328+0000 mgr.gibba044.wflcwh (mgr.34466) 2612 : cluster [DBG] pgmap v1476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:12.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:12 gibba023 bash[30844]: cluster 2021-03-10T20:57:11.347328+0000 mgr.gibba044.wflcwh (mgr.34466) 2612 : cluster [DBG] pgmap v1476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:12.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:12 gibba023 bash[31815]: cluster 2021-03-10T20:57:11.347328+0000 mgr.gibba044.wflcwh (mgr.34466) 2612 : cluster [DBG] pgmap v1476: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:13.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:13 gibba023 bash[30844]: cluster 2021-03-10T20:57:13.348777+0000 mgr.gibba044.wflcwh (mgr.34466) 2613 : cluster [DBG] pgmap v1477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:13.949 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:13 gibba023 bash[31815]: cluster 2021-03-10T20:57:13.348777+0000 mgr.gibba044.wflcwh (mgr.34466) 2613 : cluster [DBG] pgmap v1477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:14.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:13 gibba044 bash[25485]: cluster 2021-03-10T20:57:13.348777+0000 mgr.gibba044.wflcwh (mgr.34466) 2613 : cluster [DBG] pgmap v1477: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:16.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:16 gibba023 bash[30844]: cluster 2021-03-10T20:57:15.350321+0000 mgr.gibba044.wflcwh (mgr.34466) 2614 : cluster [DBG] pgmap v1478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:16.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:16 gibba023 bash[31815]: cluster 2021-03-10T20:57:15.350321+0000 mgr.gibba044.wflcwh (mgr.34466) 2614 : cluster [DBG] pgmap v1478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:16.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:16 gibba044 bash[25485]: cluster 2021-03-10T20:57:15.350321+0000 mgr.gibba044.wflcwh (mgr.34466) 2614 : cluster [DBG] pgmap v1478: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:18.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:18 gibba023 bash[30844]: cephadm 2021-03-10T20:57:16.568588+0000 mgr.gibba044.wflcwh (mgr.34466) 2615 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:57:18.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:18 gibba023 bash[30844]: cluster 2021-03-10T20:57:17.352153+0000 mgr.gibba044.wflcwh (mgr.34466) 2616 : cluster [DBG] pgmap v1479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:18.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:18 gibba023 bash[31815]: cephadm 2021-03-10T20:57:16.568588+0000 mgr.gibba044.wflcwh (mgr.34466) 2615 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:57:18.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:18 gibba023 bash[31815]: cluster 2021-03-10T20:57:17.352153+0000 mgr.gibba044.wflcwh (mgr.34466) 2616 : cluster [DBG] pgmap v1479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:18.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:18 gibba044 bash[25485]: cephadm 2021-03-10T20:57:16.568588+0000 mgr.gibba044.wflcwh (mgr.34466) 2615 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:57:18.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:18 gibba044 bash[25485]: cluster 2021-03-10T20:57:17.352153+0000 mgr.gibba044.wflcwh (mgr.34466) 2616 : cluster [DBG] pgmap v1479: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:20.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:20 gibba044 bash[25485]: cluster 2021-03-10T20:57:19.353833+0000 mgr.gibba044.wflcwh (mgr.34466) 2617 : cluster [DBG] pgmap v1480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:20.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:20 gibba023 bash[30844]: cluster 2021-03-10T20:57:19.353833+0000 mgr.gibba044.wflcwh (mgr.34466) 2617 : cluster [DBG] pgmap v1480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:20.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:20 gibba023 bash[31815]: cluster 2021-03-10T20:57:19.353833+0000 mgr.gibba044.wflcwh (mgr.34466) 2617 : cluster [DBG] pgmap v1480: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:22.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:22 gibba044 bash[25485]: cluster 2021-03-10T20:57:21.355204+0000 mgr.gibba044.wflcwh (mgr.34466) 2618 : cluster [DBG] pgmap v1481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:22.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:22 gibba023 bash[30844]: cluster 2021-03-10T20:57:21.355204+0000 mgr.gibba044.wflcwh (mgr.34466) 2618 : cluster [DBG] pgmap v1481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:22.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:22 gibba023 bash[31815]: cluster 2021-03-10T20:57:21.355204+0000 mgr.gibba044.wflcwh (mgr.34466) 2618 : cluster [DBG] pgmap v1481: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:24.307 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:57:24.535 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:57:24.535 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (48m) 3m ago 54m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:57:24.536 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (53m) 2m ago 53m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:57:24.536 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (48m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:57:24.536 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (49m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:57:24.536 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (48m) 3m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:57:24.536 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (48m) 3m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:57:24.537 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (47m) 2m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:57:24.537 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (47m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:57:24.537 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (54m) 3m ago 54m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:57:24.537 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (54m) 2m ago 54m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:57:24.538 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (46m) 3m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:57:24.538 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (46m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:57:24.538 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (45m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:57:24.538 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (45m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:57:24.538 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (45m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:57:24.539 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (44m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:57:24.539 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (44m) 2m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:57:24.539 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (43m) 2m ago 54m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:57:24.539 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (53m) 2m ago 54m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:57:24.540 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 3m ago 52m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:57:24.541 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 2m ago 52m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:57:24.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:24 gibba044 bash[25485]: cluster 2021-03-10T20:57:23.356895+0000 mgr.gibba044.wflcwh (mgr.34466) 2619 : cluster [DBG] pgmap v1482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:24.782 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:57:24.783 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:57:24.783 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:57:24.783 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:57:24.783 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:57:24.784 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:57:24.784 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:57:24.784 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:57:24.784 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:57:24.785 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:57:24.785 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:57:24.785 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:57:24.785 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:57:24.785 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:57:24.786 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:57:24.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:24 gibba023 bash[30844]: cluster 2021-03-10T20:57:23.356895+0000 mgr.gibba044.wflcwh (mgr.34466) 2619 : cluster [DBG] pgmap v1482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:24.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:24 gibba023 bash[31815]: cluster 2021-03-10T20:57:23.356895+0000 mgr.gibba044.wflcwh (mgr.34466) 2619 : cluster [DBG] pgmap v1482: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:25.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:25 gibba044 bash[25485]: audit 2021-03-10T20:57:24.297062+0000 mgr.gibba044.wflcwh (mgr.34466) 2620 : audit [DBG] from='client.45822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:57:25.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:25 gibba044 bash[25485]: audit 2021-03-10T20:57:24.780492+0000 mon.c (mon.1) 62 : audit [DBG] from='client.? 172.21.2.123:0/3630162075' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:25.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:25 gibba023 bash[30844]: audit 2021-03-10T20:57:24.297062+0000 mgr.gibba044.wflcwh (mgr.34466) 2620 : audit [DBG] from='client.45822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:57:25.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:25 gibba023 bash[30844]: audit 2021-03-10T20:57:24.780492+0000 mon.c (mon.1) 62 : audit [DBG] from='client.? 172.21.2.123:0/3630162075' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:25.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:25 gibba023 bash[31815]: audit 2021-03-10T20:57:24.297062+0000 mgr.gibba044.wflcwh (mgr.34466) 2620 : audit [DBG] from='client.45822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:57:25.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:25 gibba023 bash[31815]: audit 2021-03-10T20:57:24.780492+0000 mon.c (mon.1) 62 : audit [DBG] from='client.? 172.21.2.123:0/3630162075' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:26.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:26 gibba044 bash[25485]: audit 2021-03-10T20:57:24.522821+0000 mgr.gibba044.wflcwh (mgr.34466) 2621 : audit [DBG] from='client.45828 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:57:26.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:26 gibba044 bash[25485]: cluster 2021-03-10T20:57:25.358368+0000 mgr.gibba044.wflcwh (mgr.34466) 2622 : cluster [DBG] pgmap v1483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:26.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:26 gibba023 bash[30844]: audit 2021-03-10T20:57:24.522821+0000 mgr.gibba044.wflcwh (mgr.34466) 2621 : audit [DBG] from='client.45828 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:57:26.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:26 gibba023 bash[30844]: cluster 2021-03-10T20:57:25.358368+0000 mgr.gibba044.wflcwh (mgr.34466) 2622 : cluster [DBG] pgmap v1483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:26.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:26 gibba023 bash[31815]: audit 2021-03-10T20:57:24.522821+0000 mgr.gibba044.wflcwh (mgr.34466) 2621 : audit [DBG] from='client.45828 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:57:26.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:26 gibba023 bash[31815]: cluster 2021-03-10T20:57:25.358368+0000 mgr.gibba044.wflcwh (mgr.34466) 2622 : cluster [DBG] pgmap v1483: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:27.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:27 gibba044 bash[25485]: audit 2021-03-10T20:57:27.361354+0000 mon.a (mon.0) 1262 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:57:27.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:27 gibba044 bash[25485]: audit 2021-03-10T20:57:27.361941+0000 mon.a (mon.0) 1263 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:57:27.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:27 gibba044 bash[25485]: audit 2021-03-10T20:57:27.369270+0000 mon.a (mon.0) 1264 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T20:57:27.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:27 gibba044 bash[25485]: audit 2021-03-10T20:57:27.370024+0000 mon.a (mon.0) 1265 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:57:27.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:27 gibba044 bash[25485]: audit 2021-03-10T20:57:27.370740+0000 mon.a (mon.0) 1266 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:57:27.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:27 gibba044 bash[25485]: audit 2021-03-10T20:57:27.371432+0000 mon.a (mon.0) 1267 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:57:27.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:27 gibba023 bash[30844]: audit 2021-03-10T20:57:27.361354+0000 mon.a (mon.0) 1262 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:57:27.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:27 gibba023 bash[30844]: audit 2021-03-10T20:57:27.361941+0000 mon.a (mon.0) 1263 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:57:27.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:27 gibba023 bash[30844]: audit 2021-03-10T20:57:27.369270+0000 mon.a (mon.0) 1264 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T20:57:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:27 gibba023 bash[30844]: audit 2021-03-10T20:57:27.370024+0000 mon.a (mon.0) 1265 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:57:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:27 gibba023 bash[30844]: audit 2021-03-10T20:57:27.370740+0000 mon.a (mon.0) 1266 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:57:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:27 gibba023 bash[30844]: audit 2021-03-10T20:57:27.371432+0000 mon.a (mon.0) 1267 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:57:27.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:27 gibba023 bash[31815]: audit 2021-03-10T20:57:27.361354+0000 mon.a (mon.0) 1262 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:57:27.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:27 gibba023 bash[31815]: audit 2021-03-10T20:57:27.361941+0000 mon.a (mon.0) 1263 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:57:27.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:27 gibba023 bash[31815]: audit 2021-03-10T20:57:27.369270+0000 mon.a (mon.0) 1264 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.18", "id": [7, 2]}]: dispatch 2021-03-10T20:57:27.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:27 gibba023 bash[31815]: audit 2021-03-10T20:57:27.370024+0000 mon.a (mon.0) 1265 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:57:27.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:27 gibba023 bash[31815]: audit 2021-03-10T20:57:27.370740+0000 mon.a (mon.0) 1266 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T20:57:27.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:27 gibba023 bash[31815]: audit 2021-03-10T20:57:27.371432+0000 mon.a (mon.0) 1267 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2021-03-10T20:57:28.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:28 gibba044 bash[25485]: cluster 2021-03-10T20:57:27.358931+0000 mgr.gibba044.wflcwh (mgr.34466) 2623 : cluster [DBG] pgmap v1484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:28.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:28 gibba023 bash[30844]: cluster 2021-03-10T20:57:27.358931+0000 mgr.gibba044.wflcwh (mgr.34466) 2623 : cluster [DBG] pgmap v1484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:28.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:28 gibba023 bash[31815]: cluster 2021-03-10T20:57:27.358931+0000 mgr.gibba044.wflcwh (mgr.34466) 2623 : cluster [DBG] pgmap v1484: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:29.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:29 gibba044 bash[25485]: cluster 2021-03-10T20:57:29.360490+0000 mgr.gibba044.wflcwh (mgr.34466) 2624 : cluster [DBG] pgmap v1485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:29.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:29 gibba023 bash[30844]: cluster 2021-03-10T20:57:29.360490+0000 mgr.gibba044.wflcwh (mgr.34466) 2624 : cluster [DBG] pgmap v1485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:29.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:29 gibba023 bash[31815]: cluster 2021-03-10T20:57:29.360490+0000 mgr.gibba044.wflcwh (mgr.34466) 2624 : cluster [DBG] pgmap v1485: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:32.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:32 gibba023 bash[30844]: cluster 2021-03-10T20:57:31.362102+0000 mgr.gibba044.wflcwh (mgr.34466) 2625 : cluster [DBG] pgmap v1486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:32.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:32 gibba023 bash[30844]: audit 2021-03-10T20:57:31.812309+0000 mon.a (mon.0) 1268 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:57:32.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:32 gibba023 bash[30844]: audit 2021-03-10T20:57:31.816155+0000 mon.a (mon.0) 1269 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:57:32.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:32 gibba023 bash[30844]: audit 2021-03-10T20:57:31.817677+0000 mon.a (mon.0) 1270 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:32.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:32 gibba023 bash[30844]: audit 2021-03-10T20:57:31.819163+0000 mon.a (mon.0) 1271 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:32.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:32 gibba023 bash[30844]: audit 2021-03-10T20:57:31.820869+0000 mon.a (mon.0) 1272 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:32.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:32 gibba023 bash[30844]: audit 2021-03-10T20:57:31.823529+0000 mon.a (mon.0) 1273 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:32.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:32 gibba023 bash[30844]: audit 2021-03-10T20:57:31.825252+0000 mon.a (mon.0) 1274 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:32.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:32 gibba023 bash[31815]: cluster 2021-03-10T20:57:31.362102+0000 mgr.gibba044.wflcwh (mgr.34466) 2625 : cluster [DBG] pgmap v1486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:32.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:32 gibba023 bash[31815]: audit 2021-03-10T20:57:31.812309+0000 mon.a (mon.0) 1268 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:57:32.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:32 gibba023 bash[31815]: audit 2021-03-10T20:57:31.816155+0000 mon.a (mon.0) 1269 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:57:32.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:32 gibba023 bash[31815]: audit 2021-03-10T20:57:31.817677+0000 mon.a (mon.0) 1270 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:32.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:32 gibba023 bash[31815]: audit 2021-03-10T20:57:31.819163+0000 mon.a (mon.0) 1271 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:32.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:32 gibba023 bash[31815]: audit 2021-03-10T20:57:31.820869+0000 mon.a (mon.0) 1272 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:32.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:32 gibba023 bash[31815]: audit 2021-03-10T20:57:31.823529+0000 mon.a (mon.0) 1273 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:32.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:32 gibba023 bash[31815]: audit 2021-03-10T20:57:31.825252+0000 mon.a (mon.0) 1274 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:32.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:32 gibba044 bash[25485]: cluster 2021-03-10T20:57:31.362102+0000 mgr.gibba044.wflcwh (mgr.34466) 2625 : cluster [DBG] pgmap v1486: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:32.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:32 gibba044 bash[25485]: audit 2021-03-10T20:57:31.812309+0000 mon.a (mon.0) 1268 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:57:32.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:32 gibba044 bash[25485]: audit 2021-03-10T20:57:31.816155+0000 mon.a (mon.0) 1269 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:57:32.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:32 gibba044 bash[25485]: audit 2021-03-10T20:57:31.817677+0000 mon.a (mon.0) 1270 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:32.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:32 gibba044 bash[25485]: audit 2021-03-10T20:57:31.819163+0000 mon.a (mon.0) 1271 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:32.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:32 gibba044 bash[25485]: audit 2021-03-10T20:57:31.820869+0000 mon.a (mon.0) 1272 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:32.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:32 gibba044 bash[25485]: audit 2021-03-10T20:57:31.823529+0000 mon.a (mon.0) 1273 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:32.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:32 gibba044 bash[25485]: audit 2021-03-10T20:57:31.825252+0000 mon.a (mon.0) 1274 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:33.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:33 gibba044 bash[25485]: cephadm 2021-03-10T20:57:31.585462+0000 mgr.gibba044.wflcwh (mgr.34466) 2626 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:57:33.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:33 gibba044 bash[25485]: cephadm 2021-03-10T20:57:31.587054+0000 mgr.gibba044.wflcwh (mgr.34466) 2627 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:57:33.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:33 gibba044 bash[25485]: cephadm 2021-03-10T20:57:31.815593+0000 mgr.gibba044.wflcwh (mgr.34466) 2628 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:57:33.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:33 gibba044 bash[25485]: cephadm 2021-03-10T20:57:31.817587+0000 mgr.gibba044.wflcwh (mgr.34466) 2629 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:57:33.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:33 gibba044 bash[25485]: cephadm 2021-03-10T20:57:31.819050+0000 mgr.gibba044.wflcwh (mgr.34466) 2630 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:57:33.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:33 gibba044 bash[25485]: cephadm 2021-03-10T20:57:31.819089+0000 mgr.gibba044.wflcwh (mgr.34466) 2631 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:57:33.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:33 gibba044 bash[25485]: cephadm 2021-03-10T20:57:31.820727+0000 mgr.gibba044.wflcwh (mgr.34466) 2632 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:57:33.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:33 gibba044 bash[25485]: cephadm 2021-03-10T20:57:31.820767+0000 mgr.gibba044.wflcwh (mgr.34466) 2633 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:57:33.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:33 gibba044 bash[25485]: cephadm 2021-03-10T20:57:31.822022+0000 mgr.gibba044.wflcwh (mgr.34466) 2634 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:57:33.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:33 gibba044 bash[25485]: cephadm 2021-03-10T20:57:31.823299+0000 mgr.gibba044.wflcwh (mgr.34466) 2635 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:57:33.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:33 gibba044 bash[25485]: cephadm 2021-03-10T20:57:31.823339+0000 mgr.gibba044.wflcwh (mgr.34466) 2636 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:57:33.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:33 gibba044 bash[25485]: cephadm 2021-03-10T20:57:31.824847+0000 mgr.gibba044.wflcwh (mgr.34466) 2637 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:57:33.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:33 gibba044 bash[25485]: cephadm 2021-03-10T20:57:31.825210+0000 mgr.gibba044.wflcwh (mgr.34466) 2638 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:57:33.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:33 gibba044 bash[25485]: cephadm 2021-03-10T20:57:31.826549+0000 mgr.gibba044.wflcwh (mgr.34466) 2639 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:57:33.758 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:33 gibba044 bash[25485]: cephadm 2021-03-10T20:57:31.826592+0000 mgr.gibba044.wflcwh (mgr.34466) 2640 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:57:33.758 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:33 gibba044 bash[25485]: cephadm 2021-03-10T20:57:31.826736+0000 mgr.gibba044.wflcwh (mgr.34466) 2641 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:57:33.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[30844]: cephadm 2021-03-10T20:57:31.585462+0000 mgr.gibba044.wflcwh (mgr.34466) 2626 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:57:33.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[30844]: cephadm 2021-03-10T20:57:31.587054+0000 mgr.gibba044.wflcwh (mgr.34466) 2627 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:57:33.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[30844]: cephadm 2021-03-10T20:57:31.815593+0000 mgr.gibba044.wflcwh (mgr.34466) 2628 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:57:33.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[30844]: cephadm 2021-03-10T20:57:31.817587+0000 mgr.gibba044.wflcwh (mgr.34466) 2629 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:57:33.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[30844]: cephadm 2021-03-10T20:57:31.819050+0000 mgr.gibba044.wflcwh (mgr.34466) 2630 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:57:33.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[30844]: cephadm 2021-03-10T20:57:31.819089+0000 mgr.gibba044.wflcwh (mgr.34466) 2631 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:57:33.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[30844]: cephadm 2021-03-10T20:57:31.820727+0000 mgr.gibba044.wflcwh (mgr.34466) 2632 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:57:33.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[30844]: cephadm 2021-03-10T20:57:31.820767+0000 mgr.gibba044.wflcwh (mgr.34466) 2633 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:57:33.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[30844]: cephadm 2021-03-10T20:57:31.822022+0000 mgr.gibba044.wflcwh (mgr.34466) 2634 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:57:33.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[30844]: cephadm 2021-03-10T20:57:31.823299+0000 mgr.gibba044.wflcwh (mgr.34466) 2635 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:57:33.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[30844]: cephadm 2021-03-10T20:57:31.823339+0000 mgr.gibba044.wflcwh (mgr.34466) 2636 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:57:33.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[30844]: cephadm 2021-03-10T20:57:31.824847+0000 mgr.gibba044.wflcwh (mgr.34466) 2637 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:57:33.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[30844]: cephadm 2021-03-10T20:57:31.825210+0000 mgr.gibba044.wflcwh (mgr.34466) 2638 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:57:33.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[30844]: cephadm 2021-03-10T20:57:31.826549+0000 mgr.gibba044.wflcwh (mgr.34466) 2639 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:57:33.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[30844]: cephadm 2021-03-10T20:57:31.826592+0000 mgr.gibba044.wflcwh (mgr.34466) 2640 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:57:33.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[30844]: cephadm 2021-03-10T20:57:31.826736+0000 mgr.gibba044.wflcwh (mgr.34466) 2641 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:57:33.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[31815]: cephadm 2021-03-10T20:57:31.585462+0000 mgr.gibba044.wflcwh (mgr.34466) 2626 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:57:33.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[31815]: cephadm 2021-03-10T20:57:31.587054+0000 mgr.gibba044.wflcwh (mgr.34466) 2627 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:57:33.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[31815]: cephadm 2021-03-10T20:57:31.815593+0000 mgr.gibba044.wflcwh (mgr.34466) 2628 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:57:33.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[31815]: cephadm 2021-03-10T20:57:31.817587+0000 mgr.gibba044.wflcwh (mgr.34466) 2629 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:57:33.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[31815]: cephadm 2021-03-10T20:57:31.819050+0000 mgr.gibba044.wflcwh (mgr.34466) 2630 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:57:33.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[31815]: cephadm 2021-03-10T20:57:31.819089+0000 mgr.gibba044.wflcwh (mgr.34466) 2631 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:57:33.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[31815]: cephadm 2021-03-10T20:57:31.820727+0000 mgr.gibba044.wflcwh (mgr.34466) 2632 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:57:33.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[31815]: cephadm 2021-03-10T20:57:31.820767+0000 mgr.gibba044.wflcwh (mgr.34466) 2633 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:57:33.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[31815]: cephadm 2021-03-10T20:57:31.822022+0000 mgr.gibba044.wflcwh (mgr.34466) 2634 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:57:33.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[31815]: cephadm 2021-03-10T20:57:31.823299+0000 mgr.gibba044.wflcwh (mgr.34466) 2635 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:57:33.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[31815]: cephadm 2021-03-10T20:57:31.823339+0000 mgr.gibba044.wflcwh (mgr.34466) 2636 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:57:33.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[31815]: cephadm 2021-03-10T20:57:31.824847+0000 mgr.gibba044.wflcwh (mgr.34466) 2637 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:57:33.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[31815]: cephadm 2021-03-10T20:57:31.825210+0000 mgr.gibba044.wflcwh (mgr.34466) 2638 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:57:33.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[31815]: cephadm 2021-03-10T20:57:31.826549+0000 mgr.gibba044.wflcwh (mgr.34466) 2639 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:57:33.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[31815]: cephadm 2021-03-10T20:57:31.826592+0000 mgr.gibba044.wflcwh (mgr.34466) 2640 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:57:33.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:33 gibba023 bash[31815]: cephadm 2021-03-10T20:57:31.826736+0000 mgr.gibba044.wflcwh (mgr.34466) 2641 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:57:34.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:34 gibba044 bash[25485]: cluster 2021-03-10T20:57:33.363812+0000 mgr.gibba044.wflcwh (mgr.34466) 2642 : cluster [DBG] pgmap v1487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:34.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:34 gibba023 bash[30844]: cluster 2021-03-10T20:57:33.363812+0000 mgr.gibba044.wflcwh (mgr.34466) 2642 : cluster [DBG] pgmap v1487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:34.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:34 gibba023 bash[31815]: cluster 2021-03-10T20:57:33.363812+0000 mgr.gibba044.wflcwh (mgr.34466) 2642 : cluster [DBG] pgmap v1487: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:36.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:36 gibba044 bash[25485]: cluster 2021-03-10T20:57:35.365064+0000 mgr.gibba044.wflcwh (mgr.34466) 2643 : cluster [DBG] pgmap v1488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:36.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:36 gibba023 bash[30844]: cluster 2021-03-10T20:57:35.365064+0000 mgr.gibba044.wflcwh (mgr.34466) 2643 : cluster [DBG] pgmap v1488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:36.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:36 gibba023 bash[31815]: cluster 2021-03-10T20:57:35.365064+0000 mgr.gibba044.wflcwh (mgr.34466) 2643 : cluster [DBG] pgmap v1488: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:38.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:38 gibba044 bash[25485]: cluster 2021-03-10T20:57:37.367043+0000 mgr.gibba044.wflcwh (mgr.34466) 2644 : cluster [DBG] pgmap v1489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:38.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:38 gibba023 bash[30844]: cluster 2021-03-10T20:57:37.367043+0000 mgr.gibba044.wflcwh (mgr.34466) 2644 : cluster [DBG] pgmap v1489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:38.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:38 gibba023 bash[31815]: cluster 2021-03-10T20:57:37.367043+0000 mgr.gibba044.wflcwh (mgr.34466) 2644 : cluster [DBG] pgmap v1489: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:40.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:40 gibba044 bash[25485]: cluster 2021-03-10T20:57:39.368585+0000 mgr.gibba044.wflcwh (mgr.34466) 2645 : cluster [DBG] pgmap v1490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:40.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:40 gibba023 bash[30844]: cluster 2021-03-10T20:57:39.368585+0000 mgr.gibba044.wflcwh (mgr.34466) 2645 : cluster [DBG] pgmap v1490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:40.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:40 gibba023 bash[31815]: cluster 2021-03-10T20:57:39.368585+0000 mgr.gibba044.wflcwh (mgr.34466) 2645 : cluster [DBG] pgmap v1490: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:42.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:42 gibba044 bash[25485]: cluster 2021-03-10T20:57:41.370212+0000 mgr.gibba044.wflcwh (mgr.34466) 2646 : cluster [DBG] pgmap v1491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:42.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:42 gibba023 bash[30844]: cluster 2021-03-10T20:57:41.370212+0000 mgr.gibba044.wflcwh (mgr.34466) 2646 : cluster [DBG] pgmap v1491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:42.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:42 gibba023 bash[31815]: cluster 2021-03-10T20:57:41.370212+0000 mgr.gibba044.wflcwh (mgr.34466) 2646 : cluster [DBG] pgmap v1491: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:44.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:44 gibba044 bash[25485]: cluster 2021-03-10T20:57:43.371920+0000 mgr.gibba044.wflcwh (mgr.34466) 2647 : cluster [DBG] pgmap v1492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:44.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:44 gibba023 bash[30844]: cluster 2021-03-10T20:57:43.371920+0000 mgr.gibba044.wflcwh (mgr.34466) 2647 : cluster [DBG] pgmap v1492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:44.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:44 gibba023 bash[31815]: cluster 2021-03-10T20:57:43.371920+0000 mgr.gibba044.wflcwh (mgr.34466) 2647 : cluster [DBG] pgmap v1492: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:45.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:45 gibba044 bash[25485]: cluster 2021-03-10T20:57:45.373462+0000 mgr.gibba044.wflcwh (mgr.34466) 2648 : cluster [DBG] pgmap v1493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:45.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:45 gibba023 bash[30844]: cluster 2021-03-10T20:57:45.373462+0000 mgr.gibba044.wflcwh (mgr.34466) 2648 : cluster [DBG] pgmap v1493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:45.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:45 gibba023 bash[31815]: cluster 2021-03-10T20:57:45.373462+0000 mgr.gibba044.wflcwh (mgr.34466) 2648 : cluster [DBG] pgmap v1493: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:48.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:48 gibba044 bash[25485]: cephadm 2021-03-10T20:57:46.842641+0000 mgr.gibba044.wflcwh (mgr.34466) 2649 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:57:48.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:48 gibba044 bash[25485]: cluster 2021-03-10T20:57:47.375230+0000 mgr.gibba044.wflcwh (mgr.34466) 2650 : cluster [DBG] pgmap v1494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:48.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:48 gibba023 bash[30844]: cephadm 2021-03-10T20:57:46.842641+0000 mgr.gibba044.wflcwh (mgr.34466) 2649 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:57:48.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:48 gibba023 bash[30844]: cluster 2021-03-10T20:57:47.375230+0000 mgr.gibba044.wflcwh (mgr.34466) 2650 : cluster [DBG] pgmap v1494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:48.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:48 gibba023 bash[31815]: cephadm 2021-03-10T20:57:46.842641+0000 mgr.gibba044.wflcwh (mgr.34466) 2649 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:57:48.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:48 gibba023 bash[31815]: cluster 2021-03-10T20:57:47.375230+0000 mgr.gibba044.wflcwh (mgr.34466) 2650 : cluster [DBG] pgmap v1494: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:50.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:50 gibba044 bash[25485]: cluster 2021-03-10T20:57:49.376648+0000 mgr.gibba044.wflcwh (mgr.34466) 2651 : cluster [DBG] pgmap v1495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:50.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:50 gibba023 bash[30844]: cluster 2021-03-10T20:57:49.376648+0000 mgr.gibba044.wflcwh (mgr.34466) 2651 : cluster [DBG] pgmap v1495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:50.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:50 gibba023 bash[31815]: cluster 2021-03-10T20:57:49.376648+0000 mgr.gibba044.wflcwh (mgr.34466) 2651 : cluster [DBG] pgmap v1495: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:52.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:52 gibba044 bash[25485]: cluster 2021-03-10T20:57:51.378303+0000 mgr.gibba044.wflcwh (mgr.34466) 2652 : cluster [DBG] pgmap v1496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:52.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:52 gibba023 bash[30844]: cluster 2021-03-10T20:57:51.378303+0000 mgr.gibba044.wflcwh (mgr.34466) 2652 : cluster [DBG] pgmap v1496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:52.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:52 gibba023 bash[31815]: cluster 2021-03-10T20:57:51.378303+0000 mgr.gibba044.wflcwh (mgr.34466) 2652 : cluster [DBG] pgmap v1496: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:54.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:54 gibba044 bash[25485]: cluster 2021-03-10T20:57:53.379922+0000 mgr.gibba044.wflcwh (mgr.34466) 2653 : cluster [DBG] pgmap v1497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:54.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:54 gibba023 bash[30844]: cluster 2021-03-10T20:57:53.379922+0000 mgr.gibba044.wflcwh (mgr.34466) 2653 : cluster [DBG] pgmap v1497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:54.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:54 gibba023 bash[31815]: cluster 2021-03-10T20:57:53.379922+0000 mgr.gibba044.wflcwh (mgr.34466) 2653 : cluster [DBG] pgmap v1497: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:55.030 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:57:55.287 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:57:55.287 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (49m) 4m ago 54m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:57:55.287 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (54m) 3m ago 54m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:57:55.288 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (49m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:57:55.288 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (49m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:57:55.288 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (48m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:57:55.288 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (48m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:57:55.288 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (48m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:57:55.289 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (48m) 4m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:57:55.289 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (54m) 4m ago 54m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:57:55.289 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (54m) 3m ago 54m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:57:55.289 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (47m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:57:55.290 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (46m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:57:55.290 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (46m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:57:55.290 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (45m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:57:55.290 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (45m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:57:55.290 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (45m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:57:55.291 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (44m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:57:55.291 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (44m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:57:55.291 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (54m) 3m ago 54m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:57:55.291 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 4m ago 52m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:57:55.292 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 3m ago 52m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:57:55.543 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:57:55.544 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:57:55.544 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:57:55.544 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:57:55.544 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:57:55.545 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:57:55.545 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:57:55.545 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:57:55.545 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:57:55.546 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:57:55.546 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:57:55.546 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:57:55.547 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:57:55.547 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:57:55.547 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:57:56.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:56 gibba044 bash[25485]: audit 2021-03-10T20:57:55.018852+0000 mgr.gibba044.wflcwh (mgr.34466) 2654 : audit [DBG] from='client.55819 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:57:56.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:56 gibba044 bash[25485]: audit 2021-03-10T20:57:55.244160+0000 mgr.gibba044.wflcwh (mgr.34466) 2655 : audit [DBG] from='client.55825 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:57:56.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:56 gibba044 bash[25485]: cluster 2021-03-10T20:57:55.381183+0000 mgr.gibba044.wflcwh (mgr.34466) 2656 : cluster [DBG] pgmap v1498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:56.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:56 gibba044 bash[25485]: audit 2021-03-10T20:57:55.541433+0000 mon.c (mon.1) 63 : audit [DBG] from='client.? 172.21.2.123:0/3907922099' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:56.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:56 gibba023 bash[30844]: audit 2021-03-10T20:57:55.018852+0000 mgr.gibba044.wflcwh (mgr.34466) 2654 : audit [DBG] from='client.55819 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:57:56.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:56 gibba023 bash[30844]: audit 2021-03-10T20:57:55.244160+0000 mgr.gibba044.wflcwh (mgr.34466) 2655 : audit [DBG] from='client.55825 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:57:56.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:56 gibba023 bash[30844]: cluster 2021-03-10T20:57:55.381183+0000 mgr.gibba044.wflcwh (mgr.34466) 2656 : cluster [DBG] pgmap v1498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:56.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:56 gibba023 bash[30844]: audit 2021-03-10T20:57:55.541433+0000 mon.c (mon.1) 63 : audit [DBG] from='client.? 172.21.2.123:0/3907922099' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:56.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:56 gibba023 bash[31815]: audit 2021-03-10T20:57:55.018852+0000 mgr.gibba044.wflcwh (mgr.34466) 2654 : audit [DBG] from='client.55819 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:57:56.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:56 gibba023 bash[31815]: audit 2021-03-10T20:57:55.244160+0000 mgr.gibba044.wflcwh (mgr.34466) 2655 : audit [DBG] from='client.55825 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:57:56.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:56 gibba023 bash[31815]: cluster 2021-03-10T20:57:55.381183+0000 mgr.gibba044.wflcwh (mgr.34466) 2656 : cluster [DBG] pgmap v1498: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:56.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:56 gibba023 bash[31815]: audit 2021-03-10T20:57:55.541433+0000 mon.c (mon.1) 63 : audit [DBG] from='client.? 172.21.2.123:0/3907922099' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:57:58.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:57:58 gibba023 bash[30844]: cluster 2021-03-10T20:57:57.383055+0000 mgr.gibba044.wflcwh (mgr.34466) 2657 : cluster [DBG] pgmap v1499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:58.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:57:58 gibba023 bash[31815]: cluster 2021-03-10T20:57:57.383055+0000 mgr.gibba044.wflcwh (mgr.34466) 2657 : cluster [DBG] pgmap v1499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:57:58.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:57:58 gibba044 bash[25485]: cluster 2021-03-10T20:57:57.383055+0000 mgr.gibba044.wflcwh (mgr.34466) 2657 : cluster [DBG] pgmap v1499: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:00.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:00 gibba023 bash[30844]: cluster 2021-03-10T20:57:59.384738+0000 mgr.gibba044.wflcwh (mgr.34466) 2658 : cluster [DBG] pgmap v1500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:00.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:00 gibba023 bash[31815]: cluster 2021-03-10T20:57:59.384738+0000 mgr.gibba044.wflcwh (mgr.34466) 2658 : cluster [DBG] pgmap v1500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:00.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:00 gibba044 bash[25485]: cluster 2021-03-10T20:57:59.384738+0000 mgr.gibba044.wflcwh (mgr.34466) 2658 : cluster [DBG] pgmap v1500: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:02.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:02 gibba023 bash[30844]: cluster 2021-03-10T20:58:01.386367+0000 mgr.gibba044.wflcwh (mgr.34466) 2659 : cluster [DBG] pgmap v1501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:02.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:02 gibba023 bash[31815]: cluster 2021-03-10T20:58:01.386367+0000 mgr.gibba044.wflcwh (mgr.34466) 2659 : cluster [DBG] pgmap v1501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:02.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:02 gibba044 bash[25485]: cluster 2021-03-10T20:58:01.386367+0000 mgr.gibba044.wflcwh (mgr.34466) 2659 : cluster [DBG] pgmap v1501: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:03.676 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:03 gibba023 bash[30844]: cephadm 2021-03-10T20:58:01.858766+0000 mgr.gibba044.wflcwh (mgr.34466) 2660 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:58:03.677 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:03 gibba023 bash[31815]: cephadm 2021-03-10T20:58:01.858766+0000 mgr.gibba044.wflcwh (mgr.34466) 2660 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:58:03.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:03 gibba044 bash[25485]: cephadm 2021-03-10T20:58:01.858766+0000 mgr.gibba044.wflcwh (mgr.34466) 2660 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:58:04.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:04 gibba044 bash[25485]: cluster 2021-03-10T20:58:03.387970+0000 mgr.gibba044.wflcwh (mgr.34466) 2661 : cluster [DBG] pgmap v1502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:04.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:04 gibba023 bash[30844]: cluster 2021-03-10T20:58:03.387970+0000 mgr.gibba044.wflcwh (mgr.34466) 2661 : cluster [DBG] pgmap v1502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:04.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:04 gibba023 bash[31815]: cluster 2021-03-10T20:58:03.387970+0000 mgr.gibba044.wflcwh (mgr.34466) 2661 : cluster [DBG] pgmap v1502: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:06.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:06 gibba044 bash[25485]: cluster 2021-03-10T20:58:05.389306+0000 mgr.gibba044.wflcwh (mgr.34466) 2662 : cluster [DBG] pgmap v1503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:06.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:06 gibba023 bash[30844]: cluster 2021-03-10T20:58:05.389306+0000 mgr.gibba044.wflcwh (mgr.34466) 2662 : cluster [DBG] pgmap v1503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:06.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:06 gibba023 bash[31815]: cluster 2021-03-10T20:58:05.389306+0000 mgr.gibba044.wflcwh (mgr.34466) 2662 : cluster [DBG] pgmap v1503: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:08.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:08 gibba044 bash[25485]: cluster 2021-03-10T20:58:07.391232+0000 mgr.gibba044.wflcwh (mgr.34466) 2663 : cluster [DBG] pgmap v1504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:08.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:08 gibba023 bash[30844]: cluster 2021-03-10T20:58:07.391232+0000 mgr.gibba044.wflcwh (mgr.34466) 2663 : cluster [DBG] pgmap v1504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:08.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:08 gibba023 bash[31815]: cluster 2021-03-10T20:58:07.391232+0000 mgr.gibba044.wflcwh (mgr.34466) 2663 : cluster [DBG] pgmap v1504: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:10.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:10 gibba044 bash[25485]: cluster 2021-03-10T20:58:09.392692+0000 mgr.gibba044.wflcwh (mgr.34466) 2664 : cluster [DBG] pgmap v1505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:10.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:10 gibba023 bash[30844]: cluster 2021-03-10T20:58:09.392692+0000 mgr.gibba044.wflcwh (mgr.34466) 2664 : cluster [DBG] pgmap v1505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:10.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:10 gibba023 bash[31815]: cluster 2021-03-10T20:58:09.392692+0000 mgr.gibba044.wflcwh (mgr.34466) 2664 : cluster [DBG] pgmap v1505: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:12.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:12 gibba044 bash[25485]: cluster 2021-03-10T20:58:11.394066+0000 mgr.gibba044.wflcwh (mgr.34466) 2665 : cluster [DBG] pgmap v1506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:12.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:12 gibba023 bash[30844]: cluster 2021-03-10T20:58:11.394066+0000 mgr.gibba044.wflcwh (mgr.34466) 2665 : cluster [DBG] pgmap v1506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:12.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:12 gibba023 bash[31815]: cluster 2021-03-10T20:58:11.394066+0000 mgr.gibba044.wflcwh (mgr.34466) 2665 : cluster [DBG] pgmap v1506: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:14.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:14 gibba044 bash[25485]: cluster 2021-03-10T20:58:13.395692+0000 mgr.gibba044.wflcwh (mgr.34466) 2666 : cluster [DBG] pgmap v1507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:14.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:14 gibba023 bash[30844]: cluster 2021-03-10T20:58:13.395692+0000 mgr.gibba044.wflcwh (mgr.34466) 2666 : cluster [DBG] pgmap v1507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:14.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:14 gibba023 bash[31815]: cluster 2021-03-10T20:58:13.395692+0000 mgr.gibba044.wflcwh (mgr.34466) 2666 : cluster [DBG] pgmap v1507: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:16.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:16 gibba044 bash[25485]: cluster 2021-03-10T20:58:15.396898+0000 mgr.gibba044.wflcwh (mgr.34466) 2667 : cluster [DBG] pgmap v1508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:16.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:16 gibba023 bash[30844]: cluster 2021-03-10T20:58:15.396898+0000 mgr.gibba044.wflcwh (mgr.34466) 2667 : cluster [DBG] pgmap v1508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:16.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:16 gibba023 bash[31815]: cluster 2021-03-10T20:58:15.396898+0000 mgr.gibba044.wflcwh (mgr.34466) 2667 : cluster [DBG] pgmap v1508: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:18.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:18 gibba044 bash[25485]: cephadm 2021-03-10T20:58:16.874818+0000 mgr.gibba044.wflcwh (mgr.34466) 2668 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:58:18.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:18 gibba044 bash[25485]: cluster 2021-03-10T20:58:17.398696+0000 mgr.gibba044.wflcwh (mgr.34466) 2669 : cluster [DBG] pgmap v1509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:18.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:18 gibba023 bash[30844]: cephadm 2021-03-10T20:58:16.874818+0000 mgr.gibba044.wflcwh (mgr.34466) 2668 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:58:18.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:18 gibba023 bash[30844]: cluster 2021-03-10T20:58:17.398696+0000 mgr.gibba044.wflcwh (mgr.34466) 2669 : cluster [DBG] pgmap v1509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:18.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:18 gibba023 bash[31815]: cephadm 2021-03-10T20:58:16.874818+0000 mgr.gibba044.wflcwh (mgr.34466) 2668 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:58:18.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:18 gibba023 bash[31815]: cluster 2021-03-10T20:58:17.398696+0000 mgr.gibba044.wflcwh (mgr.34466) 2669 : cluster [DBG] pgmap v1509: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:19.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:19 gibba023 bash[30844]: cluster 2021-03-10T20:58:19.400116+0000 mgr.gibba044.wflcwh (mgr.34466) 2670 : cluster [DBG] pgmap v1510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:19.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:19 gibba023 bash[31815]: cluster 2021-03-10T20:58:19.400116+0000 mgr.gibba044.wflcwh (mgr.34466) 2670 : cluster [DBG] pgmap v1510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:20.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:19 gibba044 bash[25485]: cluster 2021-03-10T20:58:19.400116+0000 mgr.gibba044.wflcwh (mgr.34466) 2670 : cluster [DBG] pgmap v1510: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:22.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:22 gibba044 bash[25485]: cluster 2021-03-10T20:58:21.401718+0000 mgr.gibba044.wflcwh (mgr.34466) 2671 : cluster [DBG] pgmap v1511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:22.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:22 gibba023 bash[30844]: cluster 2021-03-10T20:58:21.401718+0000 mgr.gibba044.wflcwh (mgr.34466) 2671 : cluster [DBG] pgmap v1511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:22.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:22 gibba023 bash[31815]: cluster 2021-03-10T20:58:21.401718+0000 mgr.gibba044.wflcwh (mgr.34466) 2671 : cluster [DBG] pgmap v1511: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:24.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:24 gibba044 bash[25485]: cluster 2021-03-10T20:58:23.403418+0000 mgr.gibba044.wflcwh (mgr.34466) 2672 : cluster [DBG] pgmap v1512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:24.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:24 gibba023 bash[30844]: cluster 2021-03-10T20:58:23.403418+0000 mgr.gibba044.wflcwh (mgr.34466) 2672 : cluster [DBG] pgmap v1512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:24.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:24 gibba023 bash[31815]: cluster 2021-03-10T20:58:23.403418+0000 mgr.gibba044.wflcwh (mgr.34466) 2672 : cluster [DBG] pgmap v1512: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:25.785 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:58:26.011 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:58:26.011 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (49m) 4m ago 55m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:58:26.012 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (54m) 3m ago 54m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:58:26.012 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (49m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:58:26.012 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (50m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:58:26.012 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (49m) 4m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:58:26.013 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (49m) 4m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:58:26.013 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (48m) 3m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:58:26.013 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (48m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:58:26.013 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (55m) 4m ago 55m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:58:26.013 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (55m) 3m ago 55m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:58:26.014 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (47m) 4m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:58:26.014 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (47m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:58:26.014 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (46m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:58:26.014 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (46m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:58:26.015 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (46m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:58:26.015 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (45m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:58:26.015 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (45m) 3m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:58:26.015 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (44m) 3m ago 55m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:58:26.015 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (54m) 3m ago 55m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:58:26.016 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 4m ago 53m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:58:26.016 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 3m ago 53m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:58:26.261 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:58:26.261 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:58:26.261 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:58:26.262 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:58:26.262 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:58:26.262 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:58:26.262 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:58:26.263 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:58:26.263 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:58:26.263 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:58:26.263 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:58:26.263 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:58:26.264 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:58:26.264 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:58:26.264 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:58:26.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:26 gibba044 bash[25485]: cluster 2021-03-10T20:58:25.404947+0000 mgr.gibba044.wflcwh (mgr.34466) 2673 : cluster [DBG] pgmap v1513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:26.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:26 gibba044 bash[25485]: audit 2021-03-10T20:58:26.258733+0000 mon.c (mon.1) 64 : audit [DBG] from='client.? 172.21.2.123:0/1336784056' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:26.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:26 gibba023 bash[30844]: cluster 2021-03-10T20:58:25.404947+0000 mgr.gibba044.wflcwh (mgr.34466) 2673 : cluster [DBG] pgmap v1513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:26.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:26 gibba023 bash[30844]: audit 2021-03-10T20:58:26.258733+0000 mon.c (mon.1) 64 : audit [DBG] from='client.? 172.21.2.123:0/1336784056' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:26.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:26 gibba023 bash[31815]: cluster 2021-03-10T20:58:25.404947+0000 mgr.gibba044.wflcwh (mgr.34466) 2673 : cluster [DBG] pgmap v1513: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:26.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:26 gibba023 bash[31815]: audit 2021-03-10T20:58:26.258733+0000 mon.c (mon.1) 64 : audit [DBG] from='client.? 172.21.2.123:0/1336784056' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:27.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:27 gibba044 bash[25485]: audit 2021-03-10T20:58:25.773760+0000 mgr.gibba044.wflcwh (mgr.34466) 2674 : audit [DBG] from='client.55837 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:58:27.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:27 gibba044 bash[25485]: audit 2021-03-10T20:58:25.997354+0000 mgr.gibba044.wflcwh (mgr.34466) 2675 : audit [DBG] from='client.45864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:58:27.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:27 gibba044 bash[25485]: audit 2021-03-10T20:58:27.367236+0000 mon.a (mon.0) 1275 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:58:27.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:27 gibba044 bash[25485]: audit 2021-03-10T20:58:27.367963+0000 mon.a (mon.0) 1276 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:58:27.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:27 gibba044 bash[25485]: audit 2021-03-10T20:58:27.374942+0000 mon.a (mon.0) 1277 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:58:27.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:27 gibba044 bash[25485]: audit 2021-03-10T20:58:27.375747+0000 mon.a (mon.0) 1278 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T20:58:27.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:27 gibba044 bash[25485]: audit 2021-03-10T20:58:27.376559+0000 mon.a (mon.0) 1279 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:58:27.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:27 gibba044 bash[25485]: audit 2021-03-10T20:58:27.377345+0000 mon.a (mon.0) 1280 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:58:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:27 gibba023 bash[30844]: audit 2021-03-10T20:58:25.773760+0000 mgr.gibba044.wflcwh (mgr.34466) 2674 : audit [DBG] from='client.55837 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:58:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:27 gibba023 bash[30844]: audit 2021-03-10T20:58:25.997354+0000 mgr.gibba044.wflcwh (mgr.34466) 2675 : audit [DBG] from='client.45864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:58:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:27 gibba023 bash[30844]: audit 2021-03-10T20:58:27.367236+0000 mon.a (mon.0) 1275 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:58:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:27 gibba023 bash[30844]: audit 2021-03-10T20:58:27.367963+0000 mon.a (mon.0) 1276 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:58:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:27 gibba023 bash[30844]: audit 2021-03-10T20:58:27.374942+0000 mon.a (mon.0) 1277 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:58:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:27 gibba023 bash[30844]: audit 2021-03-10T20:58:27.375747+0000 mon.a (mon.0) 1278 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T20:58:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:27 gibba023 bash[30844]: audit 2021-03-10T20:58:27.376559+0000 mon.a (mon.0) 1279 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:58:27.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:27 gibba023 bash[30844]: audit 2021-03-10T20:58:27.377345+0000 mon.a (mon.0) 1280 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:58:27.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:27 gibba023 bash[31815]: audit 2021-03-10T20:58:25.773760+0000 mgr.gibba044.wflcwh (mgr.34466) 2674 : audit [DBG] from='client.55837 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:58:27.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:27 gibba023 bash[31815]: audit 2021-03-10T20:58:25.997354+0000 mgr.gibba044.wflcwh (mgr.34466) 2675 : audit [DBG] from='client.45864 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:58:27.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:27 gibba023 bash[31815]: audit 2021-03-10T20:58:27.367236+0000 mon.a (mon.0) 1275 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:58:27.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:27 gibba023 bash[31815]: audit 2021-03-10T20:58:27.367963+0000 mon.a (mon.0) 1276 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:58:27.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:27 gibba023 bash[31815]: audit 2021-03-10T20:58:27.374942+0000 mon.a (mon.0) 1277 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T20:58:27.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:27 gibba023 bash[31815]: audit 2021-03-10T20:58:27.375747+0000 mon.a (mon.0) 1278 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-03-10T20:58:27.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:27 gibba023 bash[31815]: audit 2021-03-10T20:58:27.376559+0000 mon.a (mon.0) 1279 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T20:58:27.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:27 gibba023 bash[31815]: audit 2021-03-10T20:58:27.377345+0000 mon.a (mon.0) 1280 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T20:58:28.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:28 gibba044 bash[25485]: cluster 2021-03-10T20:58:27.405946+0000 mgr.gibba044.wflcwh (mgr.34466) 2676 : cluster [DBG] pgmap v1514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:28.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:28 gibba023 bash[30844]: cluster 2021-03-10T20:58:27.405946+0000 mgr.gibba044.wflcwh (mgr.34466) 2676 : cluster [DBG] pgmap v1514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:28.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:28 gibba023 bash[31815]: cluster 2021-03-10T20:58:27.405946+0000 mgr.gibba044.wflcwh (mgr.34466) 2676 : cluster [DBG] pgmap v1514: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:29.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:29 gibba023 bash[30844]: cluster 2021-03-10T20:58:29.407367+0000 mgr.gibba044.wflcwh (mgr.34466) 2677 : cluster [DBG] pgmap v1515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:29.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:29 gibba023 bash[31815]: cluster 2021-03-10T20:58:29.407367+0000 mgr.gibba044.wflcwh (mgr.34466) 2677 : cluster [DBG] pgmap v1515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:30.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:29 gibba044 bash[25485]: cluster 2021-03-10T20:58:29.407367+0000 mgr.gibba044.wflcwh (mgr.34466) 2677 : cluster [DBG] pgmap v1515: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:32.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:32 gibba044 bash[25485]: cluster 2021-03-10T20:58:31.408779+0000 mgr.gibba044.wflcwh (mgr.34466) 2678 : cluster [DBG] pgmap v1516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:32.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:32 gibba044 bash[25485]: audit 2021-03-10T20:58:32.086746+0000 mon.a (mon.0) 1281 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:58:32.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:32 gibba044 bash[25485]: audit 2021-03-10T20:58:32.090631+0000 mon.a (mon.0) 1282 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:58:32.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:32 gibba044 bash[25485]: audit 2021-03-10T20:58:32.092215+0000 mon.a (mon.0) 1283 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:32.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:32 gibba044 bash[25485]: audit 2021-03-10T20:58:32.093498+0000 mon.a (mon.0) 1284 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:32.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:32 gibba044 bash[25485]: audit 2021-03-10T20:58:32.094878+0000 mon.a (mon.0) 1285 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:32.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:32 gibba044 bash[25485]: audit 2021-03-10T20:58:32.098103+0000 mon.a (mon.0) 1286 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:32.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:32 gibba044 bash[25485]: audit 2021-03-10T20:58:32.099377+0000 mon.a (mon.0) 1287 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:32.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:32 gibba023 bash[30844]: cluster 2021-03-10T20:58:31.408779+0000 mgr.gibba044.wflcwh (mgr.34466) 2678 : cluster [DBG] pgmap v1516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:32.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:32 gibba023 bash[30844]: audit 2021-03-10T20:58:32.086746+0000 mon.a (mon.0) 1281 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:58:32.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:32 gibba023 bash[30844]: audit 2021-03-10T20:58:32.090631+0000 mon.a (mon.0) 1282 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:58:32.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:32 gibba023 bash[30844]: audit 2021-03-10T20:58:32.092215+0000 mon.a (mon.0) 1283 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:32.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:32 gibba023 bash[30844]: audit 2021-03-10T20:58:32.093498+0000 mon.a (mon.0) 1284 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:32.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:32 gibba023 bash[30844]: audit 2021-03-10T20:58:32.094878+0000 mon.a (mon.0) 1285 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:32.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:32 gibba023 bash[30844]: audit 2021-03-10T20:58:32.098103+0000 mon.a (mon.0) 1286 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:32.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:32 gibba023 bash[30844]: audit 2021-03-10T20:58:32.099377+0000 mon.a (mon.0) 1287 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:32.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:32 gibba023 bash[31815]: cluster 2021-03-10T20:58:31.408779+0000 mgr.gibba044.wflcwh (mgr.34466) 2678 : cluster [DBG] pgmap v1516: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:32.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:32 gibba023 bash[31815]: audit 2021-03-10T20:58:32.086746+0000 mon.a (mon.0) 1281 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:58:32.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:32 gibba023 bash[31815]: audit 2021-03-10T20:58:32.090631+0000 mon.a (mon.0) 1282 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:58:32.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:32 gibba023 bash[31815]: audit 2021-03-10T20:58:32.092215+0000 mon.a (mon.0) 1283 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:32.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:32 gibba023 bash[31815]: audit 2021-03-10T20:58:32.093498+0000 mon.a (mon.0) 1284 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:32.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:32 gibba023 bash[31815]: audit 2021-03-10T20:58:32.094878+0000 mon.a (mon.0) 1285 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:32.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:32 gibba023 bash[31815]: audit 2021-03-10T20:58:32.098103+0000 mon.a (mon.0) 1286 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:32.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:32 gibba023 bash[31815]: audit 2021-03-10T20:58:32.099377+0000 mon.a (mon.0) 1287 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:33.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:33 gibba044 bash[25485]: cephadm 2021-03-10T20:58:31.882389+0000 mgr.gibba044.wflcwh (mgr.34466) 2679 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:58:33.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:33 gibba044 bash[25485]: cephadm 2021-03-10T20:58:31.883977+0000 mgr.gibba044.wflcwh (mgr.34466) 2680 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:58:33.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:33 gibba044 bash[25485]: cephadm 2021-03-10T20:58:32.090082+0000 mgr.gibba044.wflcwh (mgr.34466) 2681 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:58:33.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:33 gibba044 bash[25485]: cephadm 2021-03-10T20:58:32.092040+0000 mgr.gibba044.wflcwh (mgr.34466) 2682 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:58:33.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:33 gibba044 bash[25485]: cephadm 2021-03-10T20:58:32.093309+0000 mgr.gibba044.wflcwh (mgr.34466) 2683 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:58:33.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:33 gibba044 bash[25485]: cephadm 2021-03-10T20:58:32.093348+0000 mgr.gibba044.wflcwh (mgr.34466) 2684 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:58:33.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:33 gibba044 bash[25485]: cephadm 2021-03-10T20:58:32.094719+0000 mgr.gibba044.wflcwh (mgr.34466) 2685 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:58:33.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:33 gibba044 bash[25485]: cephadm 2021-03-10T20:58:32.094757+0000 mgr.gibba044.wflcwh (mgr.34466) 2686 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:58:33.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:33 gibba044 bash[25485]: cephadm 2021-03-10T20:58:32.096148+0000 mgr.gibba044.wflcwh (mgr.34466) 2687 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:58:33.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:33 gibba044 bash[25485]: cephadm 2021-03-10T20:58:32.097817+0000 mgr.gibba044.wflcwh (mgr.34466) 2688 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:58:33.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:33 gibba044 bash[25485]: cephadm 2021-03-10T20:58:32.097855+0000 mgr.gibba044.wflcwh (mgr.34466) 2689 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:58:33.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:33 gibba044 bash[25485]: cephadm 2021-03-10T20:58:32.099141+0000 mgr.gibba044.wflcwh (mgr.34466) 2690 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:58:33.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:33 gibba044 bash[25485]: cephadm 2021-03-10T20:58:32.099457+0000 mgr.gibba044.wflcwh (mgr.34466) 2691 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:58:33.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:33 gibba044 bash[25485]: cephadm 2021-03-10T20:58:32.100878+0000 mgr.gibba044.wflcwh (mgr.34466) 2692 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:58:33.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:33 gibba044 bash[25485]: cephadm 2021-03-10T20:58:32.100913+0000 mgr.gibba044.wflcwh (mgr.34466) 2693 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:58:33.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:33 gibba044 bash[25485]: cephadm 2021-03-10T20:58:32.101040+0000 mgr.gibba044.wflcwh (mgr.34466) 2694 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:58:33.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[30844]: cephadm 2021-03-10T20:58:31.882389+0000 mgr.gibba044.wflcwh (mgr.34466) 2679 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:58:33.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[30844]: cephadm 2021-03-10T20:58:31.883977+0000 mgr.gibba044.wflcwh (mgr.34466) 2680 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:58:33.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[30844]: cephadm 2021-03-10T20:58:32.090082+0000 mgr.gibba044.wflcwh (mgr.34466) 2681 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:58:33.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[30844]: cephadm 2021-03-10T20:58:32.092040+0000 mgr.gibba044.wflcwh (mgr.34466) 2682 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:58:33.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[30844]: cephadm 2021-03-10T20:58:32.093309+0000 mgr.gibba044.wflcwh (mgr.34466) 2683 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:58:33.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[30844]: cephadm 2021-03-10T20:58:32.093348+0000 mgr.gibba044.wflcwh (mgr.34466) 2684 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:58:33.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[30844]: cephadm 2021-03-10T20:58:32.094719+0000 mgr.gibba044.wflcwh (mgr.34466) 2685 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:58:33.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[30844]: cephadm 2021-03-10T20:58:32.094757+0000 mgr.gibba044.wflcwh (mgr.34466) 2686 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:58:33.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[30844]: cephadm 2021-03-10T20:58:32.096148+0000 mgr.gibba044.wflcwh (mgr.34466) 2687 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:58:33.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[30844]: cephadm 2021-03-10T20:58:32.097817+0000 mgr.gibba044.wflcwh (mgr.34466) 2688 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:58:33.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[30844]: cephadm 2021-03-10T20:58:32.097855+0000 mgr.gibba044.wflcwh (mgr.34466) 2689 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:58:33.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[30844]: cephadm 2021-03-10T20:58:32.099141+0000 mgr.gibba044.wflcwh (mgr.34466) 2690 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:58:33.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[30844]: cephadm 2021-03-10T20:58:32.099457+0000 mgr.gibba044.wflcwh (mgr.34466) 2691 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:58:33.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[30844]: cephadm 2021-03-10T20:58:32.100878+0000 mgr.gibba044.wflcwh (mgr.34466) 2692 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:58:33.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[30844]: cephadm 2021-03-10T20:58:32.100913+0000 mgr.gibba044.wflcwh (mgr.34466) 2693 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:58:33.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[30844]: cephadm 2021-03-10T20:58:32.101040+0000 mgr.gibba044.wflcwh (mgr.34466) 2694 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:58:33.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[31815]: cephadm 2021-03-10T20:58:31.882389+0000 mgr.gibba044.wflcwh (mgr.34466) 2679 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:58:33.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[31815]: cephadm 2021-03-10T20:58:31.883977+0000 mgr.gibba044.wflcwh (mgr.34466) 2680 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:58:33.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[31815]: cephadm 2021-03-10T20:58:32.090082+0000 mgr.gibba044.wflcwh (mgr.34466) 2681 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:58:33.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[31815]: cephadm 2021-03-10T20:58:32.092040+0000 mgr.gibba044.wflcwh (mgr.34466) 2682 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:58:33.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[31815]: cephadm 2021-03-10T20:58:32.093309+0000 mgr.gibba044.wflcwh (mgr.34466) 2683 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:58:33.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[31815]: cephadm 2021-03-10T20:58:32.093348+0000 mgr.gibba044.wflcwh (mgr.34466) 2684 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:58:33.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[31815]: cephadm 2021-03-10T20:58:32.094719+0000 mgr.gibba044.wflcwh (mgr.34466) 2685 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:58:33.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[31815]: cephadm 2021-03-10T20:58:32.094757+0000 mgr.gibba044.wflcwh (mgr.34466) 2686 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:58:33.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[31815]: cephadm 2021-03-10T20:58:32.096148+0000 mgr.gibba044.wflcwh (mgr.34466) 2687 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:58:33.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[31815]: cephadm 2021-03-10T20:58:32.097817+0000 mgr.gibba044.wflcwh (mgr.34466) 2688 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:58:33.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[31815]: cephadm 2021-03-10T20:58:32.097855+0000 mgr.gibba044.wflcwh (mgr.34466) 2689 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:58:33.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[31815]: cephadm 2021-03-10T20:58:32.099141+0000 mgr.gibba044.wflcwh (mgr.34466) 2690 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:58:33.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[31815]: cephadm 2021-03-10T20:58:32.099457+0000 mgr.gibba044.wflcwh (mgr.34466) 2691 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:58:33.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[31815]: cephadm 2021-03-10T20:58:32.100878+0000 mgr.gibba044.wflcwh (mgr.34466) 2692 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:58:33.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[31815]: cephadm 2021-03-10T20:58:32.100913+0000 mgr.gibba044.wflcwh (mgr.34466) 2693 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:58:33.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:33 gibba023 bash[31815]: cephadm 2021-03-10T20:58:32.101040+0000 mgr.gibba044.wflcwh (mgr.34466) 2694 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:58:34.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:34 gibba044 bash[25485]: cluster 2021-03-10T20:58:33.410321+0000 mgr.gibba044.wflcwh (mgr.34466) 2695 : cluster [DBG] pgmap v1517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:34.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:34 gibba023 bash[30844]: cluster 2021-03-10T20:58:33.410321+0000 mgr.gibba044.wflcwh (mgr.34466) 2695 : cluster [DBG] pgmap v1517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:34.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:34 gibba023 bash[31815]: cluster 2021-03-10T20:58:33.410321+0000 mgr.gibba044.wflcwh (mgr.34466) 2695 : cluster [DBG] pgmap v1517: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:36.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:36 gibba044 bash[25485]: cluster 2021-03-10T20:58:35.411856+0000 mgr.gibba044.wflcwh (mgr.34466) 2696 : cluster [DBG] pgmap v1518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:36.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:36 gibba023 bash[30844]: cluster 2021-03-10T20:58:35.411856+0000 mgr.gibba044.wflcwh (mgr.34466) 2696 : cluster [DBG] pgmap v1518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:36.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:36 gibba023 bash[31815]: cluster 2021-03-10T20:58:35.411856+0000 mgr.gibba044.wflcwh (mgr.34466) 2696 : cluster [DBG] pgmap v1518: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:38.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:38 gibba044 bash[25485]: cluster 2021-03-10T20:58:37.413561+0000 mgr.gibba044.wflcwh (mgr.34466) 2697 : cluster [DBG] pgmap v1519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:38.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:38 gibba023 bash[30844]: cluster 2021-03-10T20:58:37.413561+0000 mgr.gibba044.wflcwh (mgr.34466) 2697 : cluster [DBG] pgmap v1519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:38.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:38 gibba023 bash[31815]: cluster 2021-03-10T20:58:37.413561+0000 mgr.gibba044.wflcwh (mgr.34466) 2697 : cluster [DBG] pgmap v1519: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:40.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:40 gibba044 bash[25485]: cluster 2021-03-10T20:58:39.414867+0000 mgr.gibba044.wflcwh (mgr.34466) 2698 : cluster [DBG] pgmap v1520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:40.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:40 gibba023 bash[30844]: cluster 2021-03-10T20:58:39.414867+0000 mgr.gibba044.wflcwh (mgr.34466) 2698 : cluster [DBG] pgmap v1520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:40.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:40 gibba023 bash[31815]: cluster 2021-03-10T20:58:39.414867+0000 mgr.gibba044.wflcwh (mgr.34466) 2698 : cluster [DBG] pgmap v1520: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:42.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:42 gibba044 bash[25485]: cluster 2021-03-10T20:58:41.416431+0000 mgr.gibba044.wflcwh (mgr.34466) 2699 : cluster [DBG] pgmap v1521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:42.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:42 gibba023 bash[30844]: cluster 2021-03-10T20:58:41.416431+0000 mgr.gibba044.wflcwh (mgr.34466) 2699 : cluster [DBG] pgmap v1521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:42.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:42 gibba023 bash[31815]: cluster 2021-03-10T20:58:41.416431+0000 mgr.gibba044.wflcwh (mgr.34466) 2699 : cluster [DBG] pgmap v1521: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:44.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:44 gibba044 bash[25485]: cluster 2021-03-10T20:58:43.417841+0000 mgr.gibba044.wflcwh (mgr.34466) 2700 : cluster [DBG] pgmap v1522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:44.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:44 gibba023 bash[30844]: cluster 2021-03-10T20:58:43.417841+0000 mgr.gibba044.wflcwh (mgr.34466) 2700 : cluster [DBG] pgmap v1522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:44.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:44 gibba023 bash[31815]: cluster 2021-03-10T20:58:43.417841+0000 mgr.gibba044.wflcwh (mgr.34466) 2700 : cluster [DBG] pgmap v1522: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:46.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:46 gibba044 bash[25485]: cluster 2021-03-10T20:58:45.419519+0000 mgr.gibba044.wflcwh (mgr.34466) 2701 : cluster [DBG] pgmap v1523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:46.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:46 gibba023 bash[30844]: cluster 2021-03-10T20:58:45.419519+0000 mgr.gibba044.wflcwh (mgr.34466) 2701 : cluster [DBG] pgmap v1523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:46.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:46 gibba023 bash[31815]: cluster 2021-03-10T20:58:45.419519+0000 mgr.gibba044.wflcwh (mgr.34466) 2701 : cluster [DBG] pgmap v1523: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:48.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:48 gibba044 bash[25485]: cephadm 2021-03-10T20:58:47.117008+0000 mgr.gibba044.wflcwh (mgr.34466) 2702 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:58:48.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:48 gibba044 bash[25485]: cluster 2021-03-10T20:58:47.421332+0000 mgr.gibba044.wflcwh (mgr.34466) 2703 : cluster [DBG] pgmap v1524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:48.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:48 gibba023 bash[30844]: cephadm 2021-03-10T20:58:47.117008+0000 mgr.gibba044.wflcwh (mgr.34466) 2702 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:58:48.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:48 gibba023 bash[30844]: cluster 2021-03-10T20:58:47.421332+0000 mgr.gibba044.wflcwh (mgr.34466) 2703 : cluster [DBG] pgmap v1524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:48.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:48 gibba023 bash[31815]: cephadm 2021-03-10T20:58:47.117008+0000 mgr.gibba044.wflcwh (mgr.34466) 2702 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:58:48.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:48 gibba023 bash[31815]: cluster 2021-03-10T20:58:47.421332+0000 mgr.gibba044.wflcwh (mgr.34466) 2703 : cluster [DBG] pgmap v1524: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:50.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:50 gibba044 bash[25485]: cluster 2021-03-10T20:58:49.422827+0000 mgr.gibba044.wflcwh (mgr.34466) 2704 : cluster [DBG] pgmap v1525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:50.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:50 gibba023 bash[30844]: cluster 2021-03-10T20:58:49.422827+0000 mgr.gibba044.wflcwh (mgr.34466) 2704 : cluster [DBG] pgmap v1525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:50.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:50 gibba023 bash[31815]: cluster 2021-03-10T20:58:49.422827+0000 mgr.gibba044.wflcwh (mgr.34466) 2704 : cluster [DBG] pgmap v1525: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:52.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:52 gibba044 bash[25485]: cluster 2021-03-10T20:58:51.424535+0000 mgr.gibba044.wflcwh (mgr.34466) 2705 : cluster [DBG] pgmap v1526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:52.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:52 gibba023 bash[30844]: cluster 2021-03-10T20:58:51.424535+0000 mgr.gibba044.wflcwh (mgr.34466) 2705 : cluster [DBG] pgmap v1526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:52.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:52 gibba023 bash[31815]: cluster 2021-03-10T20:58:51.424535+0000 mgr.gibba044.wflcwh (mgr.34466) 2705 : cluster [DBG] pgmap v1526: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:54.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:54 gibba044 bash[25485]: cluster 2021-03-10T20:58:53.426354+0000 mgr.gibba044.wflcwh (mgr.34466) 2706 : cluster [DBG] pgmap v1527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:54.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:54 gibba023 bash[30844]: cluster 2021-03-10T20:58:53.426354+0000 mgr.gibba044.wflcwh (mgr.34466) 2706 : cluster [DBG] pgmap v1527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:54.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:54 gibba023 bash[31815]: cluster 2021-03-10T20:58:53.426354+0000 mgr.gibba044.wflcwh (mgr.34466) 2706 : cluster [DBG] pgmap v1527: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:56.503 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:58:56.737 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:58:56.738 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (50m) 5m ago 55m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:58:56.738 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (55m) 4m ago 55m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:58:56.739 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (50m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:58:56.739 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (50m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:58:56.739 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (49m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:58:56.739 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (49m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:58:56.740 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (49m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:58:56.740 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (49m) 5m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:58:56.740 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (55m) 5m ago 55m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:58:56.740 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (55m) 4m ago 55m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:58:56.741 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (48m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:58:56.741 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (47m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:58:56.742 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (47m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:58:56.742 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (47m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:58:56.742 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (46m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:58:56.742 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (46m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:58:56.743 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (45m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:58:56.743 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (45m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:58:56.743 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (55m) 4m ago 55m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:58:56.743 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 5m ago 53m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:58:56.744 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 4m ago 53m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:58:56.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:56 gibba044 bash[25485]: cluster 2021-03-10T20:58:55.428168+0000 mgr.gibba044.wflcwh (mgr.34466) 2707 : cluster [DBG] pgmap v1528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:56.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:56 gibba023 bash[30844]: cluster 2021-03-10T20:58:55.428168+0000 mgr.gibba044.wflcwh (mgr.34466) 2707 : cluster [DBG] pgmap v1528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:56.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:56 gibba023 bash[31815]: cluster 2021-03-10T20:58:55.428168+0000 mgr.gibba044.wflcwh (mgr.34466) 2707 : cluster [DBG] pgmap v1528: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:56.990 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:58:56.990 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:58:56.990 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:58:56.991 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:58:56.991 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:58:56.991 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:58:56.991 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:58:56.992 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:58:56.992 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:58:56.992 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:58:56.992 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:58:56.992 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:58:56.993 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:58:56.993 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:58:56.993 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:58:57.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:57 gibba023 bash[30844]: audit 2021-03-10T20:58:56.491097+0000 mgr.gibba044.wflcwh (mgr.34466) 2708 : audit [DBG] from='client.45876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:58:57.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:57 gibba023 bash[30844]: audit 2021-03-10T20:58:56.987434+0000 mon.c (mon.1) 65 : audit [DBG] from='client.? 172.21.2.123:0/3327638585' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:57.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:57 gibba023 bash[31815]: audit 2021-03-10T20:58:56.491097+0000 mgr.gibba044.wflcwh (mgr.34466) 2708 : audit [DBG] from='client.45876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:58:57.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:57 gibba023 bash[31815]: audit 2021-03-10T20:58:56.987434+0000 mon.c (mon.1) 65 : audit [DBG] from='client.? 172.21.2.123:0/3327638585' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:58.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:57 gibba044 bash[25485]: audit 2021-03-10T20:58:56.491097+0000 mgr.gibba044.wflcwh (mgr.34466) 2708 : audit [DBG] from='client.45876 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:58:58.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:57 gibba044 bash[25485]: audit 2021-03-10T20:58:56.987434+0000 mon.c (mon.1) 65 : audit [DBG] from='client.? 172.21.2.123:0/3327638585' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:58:58.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:58 gibba023 bash[30844]: audit 2021-03-10T20:58:56.721574+0000 mgr.gibba044.wflcwh (mgr.34466) 2709 : audit [DBG] from='client.55861 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:58:58.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:58 gibba023 bash[30844]: cluster 2021-03-10T20:58:57.430027+0000 mgr.gibba044.wflcwh (mgr.34466) 2710 : cluster [DBG] pgmap v1529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:58.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:58 gibba023 bash[31815]: audit 2021-03-10T20:58:56.721574+0000 mgr.gibba044.wflcwh (mgr.34466) 2709 : audit [DBG] from='client.55861 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:58:58.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:58 gibba023 bash[31815]: cluster 2021-03-10T20:58:57.430027+0000 mgr.gibba044.wflcwh (mgr.34466) 2710 : cluster [DBG] pgmap v1529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:59.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:58 gibba044 bash[25485]: audit 2021-03-10T20:58:56.721574+0000 mgr.gibba044.wflcwh (mgr.34466) 2709 : audit [DBG] from='client.55861 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:58:59.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:58 gibba044 bash[25485]: cluster 2021-03-10T20:58:57.430027+0000 mgr.gibba044.wflcwh (mgr.34466) 2710 : cluster [DBG] pgmap v1529: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:59.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:58:59 gibba023 bash[30844]: cluster 2021-03-10T20:58:59.431853+0000 mgr.gibba044.wflcwh (mgr.34466) 2711 : cluster [DBG] pgmap v1530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:58:59.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:58:59 gibba023 bash[31815]: cluster 2021-03-10T20:58:59.431853+0000 mgr.gibba044.wflcwh (mgr.34466) 2711 : cluster [DBG] pgmap v1530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:00.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:58:59 gibba044 bash[25485]: cluster 2021-03-10T20:58:59.431853+0000 mgr.gibba044.wflcwh (mgr.34466) 2711 : cluster [DBG] pgmap v1530: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:02.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:02 gibba044 bash[25485]: cluster 2021-03-10T20:59:01.433210+0000 mgr.gibba044.wflcwh (mgr.34466) 2712 : cluster [DBG] pgmap v1531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:02.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:02 gibba023 bash[30844]: cluster 2021-03-10T20:59:01.433210+0000 mgr.gibba044.wflcwh (mgr.34466) 2712 : cluster [DBG] pgmap v1531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:02.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:02 gibba023 bash[31815]: cluster 2021-03-10T20:59:01.433210+0000 mgr.gibba044.wflcwh (mgr.34466) 2712 : cluster [DBG] pgmap v1531: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:03.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:03 gibba023 bash[30844]: cephadm 2021-03-10T20:59:02.124818+0000 mgr.gibba044.wflcwh (mgr.34466) 2713 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:59:03.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:03 gibba023 bash[31815]: cephadm 2021-03-10T20:59:02.124818+0000 mgr.gibba044.wflcwh (mgr.34466) 2713 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:59:04.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:03 gibba044 bash[25485]: cephadm 2021-03-10T20:59:02.124818+0000 mgr.gibba044.wflcwh (mgr.34466) 2713 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:59:04.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:04 gibba023 bash[30844]: cluster 2021-03-10T20:59:03.434898+0000 mgr.gibba044.wflcwh (mgr.34466) 2714 : cluster [DBG] pgmap v1532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:04.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:04 gibba023 bash[31815]: cluster 2021-03-10T20:59:03.434898+0000 mgr.gibba044.wflcwh (mgr.34466) 2714 : cluster [DBG] pgmap v1532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:05.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:04 gibba044 bash[25485]: cluster 2021-03-10T20:59:03.434898+0000 mgr.gibba044.wflcwh (mgr.34466) 2714 : cluster [DBG] pgmap v1532: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:05.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:05 gibba023 bash[30844]: cluster 2021-03-10T20:59:05.436467+0000 mgr.gibba044.wflcwh (mgr.34466) 2715 : cluster [DBG] pgmap v1533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:05.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:05 gibba023 bash[31815]: cluster 2021-03-10T20:59:05.436467+0000 mgr.gibba044.wflcwh (mgr.34466) 2715 : cluster [DBG] pgmap v1533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:06.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:05 gibba044 bash[25485]: cluster 2021-03-10T20:59:05.436467+0000 mgr.gibba044.wflcwh (mgr.34466) 2715 : cluster [DBG] pgmap v1533: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:08.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:08 gibba044 bash[25485]: cluster 2021-03-10T20:59:07.437832+0000 mgr.gibba044.wflcwh (mgr.34466) 2716 : cluster [DBG] pgmap v1534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:08.947 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:08 gibba023 bash[30844]: cluster 2021-03-10T20:59:07.437832+0000 mgr.gibba044.wflcwh (mgr.34466) 2716 : cluster [DBG] pgmap v1534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:08.948 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:08 gibba023 bash[31815]: cluster 2021-03-10T20:59:07.437832+0000 mgr.gibba044.wflcwh (mgr.34466) 2716 : cluster [DBG] pgmap v1534: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:10.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:10 gibba044 bash[25485]: cluster 2021-03-10T20:59:09.439437+0000 mgr.gibba044.wflcwh (mgr.34466) 2717 : cluster [DBG] pgmap v1535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:10.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:10 gibba023 bash[30844]: cluster 2021-03-10T20:59:09.439437+0000 mgr.gibba044.wflcwh (mgr.34466) 2717 : cluster [DBG] pgmap v1535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:10.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:10 gibba023 bash[31815]: cluster 2021-03-10T20:59:09.439437+0000 mgr.gibba044.wflcwh (mgr.34466) 2717 : cluster [DBG] pgmap v1535: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:12.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:12 gibba044 bash[25485]: cluster 2021-03-10T20:59:11.440877+0000 mgr.gibba044.wflcwh (mgr.34466) 2718 : cluster [DBG] pgmap v1536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:12.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:12 gibba023 bash[30844]: cluster 2021-03-10T20:59:11.440877+0000 mgr.gibba044.wflcwh (mgr.34466) 2718 : cluster [DBG] pgmap v1536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:12.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:12 gibba023 bash[31815]: cluster 2021-03-10T20:59:11.440877+0000 mgr.gibba044.wflcwh (mgr.34466) 2718 : cluster [DBG] pgmap v1536: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:14.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:14 gibba044 bash[25485]: cluster 2021-03-10T20:59:13.442594+0000 mgr.gibba044.wflcwh (mgr.34466) 2719 : cluster [DBG] pgmap v1537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:14.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:14 gibba023 bash[30844]: cluster 2021-03-10T20:59:13.442594+0000 mgr.gibba044.wflcwh (mgr.34466) 2719 : cluster [DBG] pgmap v1537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:14.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:14 gibba023 bash[31815]: cluster 2021-03-10T20:59:13.442594+0000 mgr.gibba044.wflcwh (mgr.34466) 2719 : cluster [DBG] pgmap v1537: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:16.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:16 gibba044 bash[25485]: cluster 2021-03-10T20:59:15.444386+0000 mgr.gibba044.wflcwh (mgr.34466) 2720 : cluster [DBG] pgmap v1538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:16.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:16 gibba023 bash[30844]: cluster 2021-03-10T20:59:15.444386+0000 mgr.gibba044.wflcwh (mgr.34466) 2720 : cluster [DBG] pgmap v1538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:16.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:16 gibba023 bash[31815]: cluster 2021-03-10T20:59:15.444386+0000 mgr.gibba044.wflcwh (mgr.34466) 2720 : cluster [DBG] pgmap v1538: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:18.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:18 gibba044 bash[25485]: cephadm 2021-03-10T20:59:17.132645+0000 mgr.gibba044.wflcwh (mgr.34466) 2721 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:59:18.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:18 gibba044 bash[25485]: cluster 2021-03-10T20:59:17.445698+0000 mgr.gibba044.wflcwh (mgr.34466) 2722 : cluster [DBG] pgmap v1539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:18.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:18 gibba023 bash[30844]: cephadm 2021-03-10T20:59:17.132645+0000 mgr.gibba044.wflcwh (mgr.34466) 2721 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:59:18.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:18 gibba023 bash[30844]: cluster 2021-03-10T20:59:17.445698+0000 mgr.gibba044.wflcwh (mgr.34466) 2722 : cluster [DBG] pgmap v1539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:18.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:18 gibba023 bash[31815]: cephadm 2021-03-10T20:59:17.132645+0000 mgr.gibba044.wflcwh (mgr.34466) 2721 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:59:18.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:18 gibba023 bash[31815]: cluster 2021-03-10T20:59:17.445698+0000 mgr.gibba044.wflcwh (mgr.34466) 2722 : cluster [DBG] pgmap v1539: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:20.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:20 gibba044 bash[25485]: cluster 2021-03-10T20:59:19.447469+0000 mgr.gibba044.wflcwh (mgr.34466) 2723 : cluster [DBG] pgmap v1540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:20.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:20 gibba023 bash[30844]: cluster 2021-03-10T20:59:19.447469+0000 mgr.gibba044.wflcwh (mgr.34466) 2723 : cluster [DBG] pgmap v1540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:20.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:20 gibba023 bash[31815]: cluster 2021-03-10T20:59:19.447469+0000 mgr.gibba044.wflcwh (mgr.34466) 2723 : cluster [DBG] pgmap v1540: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:22.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:22 gibba044 bash[25485]: cluster 2021-03-10T20:59:21.448889+0000 mgr.gibba044.wflcwh (mgr.34466) 2724 : cluster [DBG] pgmap v1541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:22.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:22 gibba023 bash[30844]: cluster 2021-03-10T20:59:21.448889+0000 mgr.gibba044.wflcwh (mgr.34466) 2724 : cluster [DBG] pgmap v1541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:22.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:22 gibba023 bash[31815]: cluster 2021-03-10T20:59:21.448889+0000 mgr.gibba044.wflcwh (mgr.34466) 2724 : cluster [DBG] pgmap v1541: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:24.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:24 gibba044 bash[25485]: cluster 2021-03-10T20:59:23.450561+0000 mgr.gibba044.wflcwh (mgr.34466) 2725 : cluster [DBG] pgmap v1542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:24.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:24 gibba023 bash[30844]: cluster 2021-03-10T20:59:23.450561+0000 mgr.gibba044.wflcwh (mgr.34466) 2725 : cluster [DBG] pgmap v1542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:24.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:24 gibba023 bash[31815]: cluster 2021-03-10T20:59:23.450561+0000 mgr.gibba044.wflcwh (mgr.34466) 2725 : cluster [DBG] pgmap v1542: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:26.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:26 gibba044 bash[25485]: cluster 2021-03-10T20:59:25.452277+0000 mgr.gibba044.wflcwh (mgr.34466) 2726 : cluster [DBG] pgmap v1543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:26.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:26 gibba023 bash[30844]: cluster 2021-03-10T20:59:25.452277+0000 mgr.gibba044.wflcwh (mgr.34466) 2726 : cluster [DBG] pgmap v1543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:26.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:26 gibba023 bash[31815]: cluster 2021-03-10T20:59:25.452277+0000 mgr.gibba044.wflcwh (mgr.34466) 2726 : cluster [DBG] pgmap v1543: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:27.232 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:59:27.468 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:59:27.468 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (50m) 6m ago 56m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:59:27.469 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (55m) 4m ago 55m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:59:27.469 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (50m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:59:27.469 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (51m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:59:27.469 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (50m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:59:27.470 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (50m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:59:27.470 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (49m) 4m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:59:27.470 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (49m) 6m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:59:27.470 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (56m) 6m ago 56m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:59:27.471 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (56m) 4m ago 56m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:59:27.471 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (48m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:59:27.471 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (48m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:59:27.471 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (47m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:59:27.471 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (47m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:59:27.472 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (47m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:59:27.472 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (46m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:59:27.472 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (46m) 4m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:59:27.472 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (45m) 4m ago 56m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:59:27.472 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (55m) 4m ago 56m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:59:27.473 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 6m ago 54m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:59:27.473 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 4m ago 54m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:59:27.721 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:59:27.721 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:59:27.722 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:59:27.722 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:59:27.722 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:59:27.722 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:59:27.723 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:59:27.723 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:59:27.723 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:59:27.723 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:59:27.723 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:59:27.724 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:59:27.724 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:59:27.724 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:59:27.724 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:59:27.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:27 gibba044 bash[25485]: audit 2021-03-10T20:59:27.373900+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:59:27.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:27 gibba044 bash[25485]: audit 2021-03-10T20:59:27.374020+0000 mon.a (mon.0) 1289 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:59:27.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:27 gibba044 bash[25485]: audit 2021-03-10T20:59:27.380002+0000 mon.a (mon.0) 1290 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:59:27.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:27 gibba044 bash[25485]: audit 2021-03-10T20:59:27.380156+0000 mon.a (mon.0) 1291 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:59:27.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:27 gibba044 bash[25485]: audit 2021-03-10T20:59:27.380267+0000 mon.a (mon.0) 1292 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:59:27.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:27 gibba044 bash[25485]: audit 2021-03-10T20:59:27.380425+0000 mon.a (mon.0) 1293 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:59:27.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:27 gibba023 bash[30844]: audit 2021-03-10T20:59:27.373900+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:59:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:27 gibba023 bash[30844]: audit 2021-03-10T20:59:27.374020+0000 mon.a (mon.0) 1289 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:59:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:27 gibba023 bash[30844]: audit 2021-03-10T20:59:27.380002+0000 mon.a (mon.0) 1290 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:59:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:27 gibba023 bash[30844]: audit 2021-03-10T20:59:27.380156+0000 mon.a (mon.0) 1291 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:59:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:27 gibba023 bash[30844]: audit 2021-03-10T20:59:27.380267+0000 mon.a (mon.0) 1292 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:59:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:27 gibba023 bash[30844]: audit 2021-03-10T20:59:27.380425+0000 mon.a (mon.0) 1293 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:59:27.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:27 gibba023 bash[31815]: audit 2021-03-10T20:59:27.373900+0000 mon.a (mon.0) 1288 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T20:59:27.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:27 gibba023 bash[31815]: audit 2021-03-10T20:59:27.374020+0000 mon.a (mon.0) 1289 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T20:59:27.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:27 gibba023 bash[31815]: audit 2021-03-10T20:59:27.380002+0000 mon.a (mon.0) 1290 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T20:59:27.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:27 gibba023 bash[31815]: audit 2021-03-10T20:59:27.380156+0000 mon.a (mon.0) 1291 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T20:59:27.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:27 gibba023 bash[31815]: audit 2021-03-10T20:59:27.380267+0000 mon.a (mon.0) 1292 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T20:59:27.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:27 gibba023 bash[31815]: audit 2021-03-10T20:59:27.380425+0000 mon.a (mon.0) 1293 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T20:59:28.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:28 gibba044 bash[25485]: audit 2021-03-10T20:59:27.222183+0000 mgr.gibba044.wflcwh (mgr.34466) 2727 : audit [DBG] from='client.55873 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:59:28.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:28 gibba044 bash[25485]: audit 2021-03-10T20:59:27.450779+0000 mgr.gibba044.wflcwh (mgr.34466) 2728 : audit [DBG] from='client.45900 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:59:28.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:28 gibba044 bash[25485]: cluster 2021-03-10T20:59:27.458258+0000 mgr.gibba044.wflcwh (mgr.34466) 2729 : cluster [DBG] pgmap v1544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:28.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:28 gibba044 bash[25485]: audit 2021-03-10T20:59:27.718915+0000 mon.c (mon.1) 66 : audit [DBG] from='client.? 172.21.2.123:0/238547055' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:28.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:28 gibba023 bash[30844]: audit 2021-03-10T20:59:27.222183+0000 mgr.gibba044.wflcwh (mgr.34466) 2727 : audit [DBG] from='client.55873 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:59:28.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:28 gibba023 bash[30844]: audit 2021-03-10T20:59:27.450779+0000 mgr.gibba044.wflcwh (mgr.34466) 2728 : audit [DBG] from='client.45900 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:59:28.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:28 gibba023 bash[30844]: cluster 2021-03-10T20:59:27.458258+0000 mgr.gibba044.wflcwh (mgr.34466) 2729 : cluster [DBG] pgmap v1544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:28.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:28 gibba023 bash[30844]: audit 2021-03-10T20:59:27.718915+0000 mon.c (mon.1) 66 : audit [DBG] from='client.? 172.21.2.123:0/238547055' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:28.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:28 gibba023 bash[31815]: audit 2021-03-10T20:59:27.222183+0000 mgr.gibba044.wflcwh (mgr.34466) 2727 : audit [DBG] from='client.55873 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:59:28.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:28 gibba023 bash[31815]: audit 2021-03-10T20:59:27.450779+0000 mgr.gibba044.wflcwh (mgr.34466) 2728 : audit [DBG] from='client.45900 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:59:28.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:28 gibba023 bash[31815]: cluster 2021-03-10T20:59:27.458258+0000 mgr.gibba044.wflcwh (mgr.34466) 2729 : cluster [DBG] pgmap v1544: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:28.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:28 gibba023 bash[31815]: audit 2021-03-10T20:59:27.718915+0000 mon.c (mon.1) 66 : audit [DBG] from='client.? 172.21.2.123:0/238547055' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:30.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:30 gibba023 bash[30844]: cluster 2021-03-10T20:59:29.459687+0000 mgr.gibba044.wflcwh (mgr.34466) 2730 : cluster [DBG] pgmap v1545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:30.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:30 gibba023 bash[31815]: cluster 2021-03-10T20:59:29.459687+0000 mgr.gibba044.wflcwh (mgr.34466) 2730 : cluster [DBG] pgmap v1545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:31.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:30 gibba044 bash[25485]: cluster 2021-03-10T20:59:29.459687+0000 mgr.gibba044.wflcwh (mgr.34466) 2730 : cluster [DBG] pgmap v1545: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:32.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:32 gibba023 bash[30844]: cluster 2021-03-10T20:59:31.460973+0000 mgr.gibba044.wflcwh (mgr.34466) 2731 : cluster [DBG] pgmap v1546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:32.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:32 gibba023 bash[30844]: audit 2021-03-10T20:59:32.357670+0000 mon.a (mon.0) 1294 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:59:32.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:32 gibba023 bash[31815]: cluster 2021-03-10T20:59:31.460973+0000 mgr.gibba044.wflcwh (mgr.34466) 2731 : cluster [DBG] pgmap v1546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:32.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:32 gibba023 bash[31815]: audit 2021-03-10T20:59:32.357670+0000 mon.a (mon.0) 1294 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:59:33.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:32 gibba044 bash[25485]: cluster 2021-03-10T20:59:31.460973+0000 mgr.gibba044.wflcwh (mgr.34466) 2731 : cluster [DBG] pgmap v1546: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:33.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:32 gibba044 bash[25485]: audit 2021-03-10T20:59:32.357670+0000 mon.a (mon.0) 1294 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:59:33.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:33 gibba023 bash[30844]: cephadm 2021-03-10T20:59:32.150624+0000 mgr.gibba044.wflcwh (mgr.34466) 2732 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:59:33.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:33 gibba023 bash[30844]: cephadm 2021-03-10T20:59:32.358666+0000 mgr.gibba044.wflcwh (mgr.34466) 2733 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:59:33.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:33 gibba023 bash[30844]: audit 2021-03-10T20:59:32.543701+0000 mon.a (mon.0) 1295 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:59:33.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:33 gibba023 bash[30844]: audit 2021-03-10T20:59:32.548776+0000 mon.a (mon.0) 1296 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:59:33.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:33 gibba023 bash[30844]: audit 2021-03-10T20:59:32.550538+0000 mon.a (mon.0) 1297 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:33.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:33 gibba023 bash[30844]: audit 2021-03-10T20:59:32.552391+0000 mon.a (mon.0) 1298 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:33.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:33 gibba023 bash[30844]: audit 2021-03-10T20:59:32.553999+0000 mon.a (mon.0) 1299 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:33.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:33 gibba023 bash[30844]: audit 2021-03-10T20:59:32.557864+0000 mon.a (mon.0) 1300 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:33.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:33 gibba023 bash[30844]: audit 2021-03-10T20:59:32.560164+0000 mon.a (mon.0) 1301 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:33.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:33 gibba023 bash[31815]: cephadm 2021-03-10T20:59:32.150624+0000 mgr.gibba044.wflcwh (mgr.34466) 2732 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:59:33.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:33 gibba023 bash[31815]: cephadm 2021-03-10T20:59:32.358666+0000 mgr.gibba044.wflcwh (mgr.34466) 2733 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:59:33.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:33 gibba023 bash[31815]: audit 2021-03-10T20:59:32.543701+0000 mon.a (mon.0) 1295 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:59:33.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:33 gibba023 bash[31815]: audit 2021-03-10T20:59:32.548776+0000 mon.a (mon.0) 1296 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:59:33.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:33 gibba023 bash[31815]: audit 2021-03-10T20:59:32.550538+0000 mon.a (mon.0) 1297 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:33.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:33 gibba023 bash[31815]: audit 2021-03-10T20:59:32.552391+0000 mon.a (mon.0) 1298 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:33.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:33 gibba023 bash[31815]: audit 2021-03-10T20:59:32.553999+0000 mon.a (mon.0) 1299 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:33.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:33 gibba023 bash[31815]: audit 2021-03-10T20:59:32.557864+0000 mon.a (mon.0) 1300 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:33.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:33 gibba023 bash[31815]: audit 2021-03-10T20:59:32.560164+0000 mon.a (mon.0) 1301 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:34.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:33 gibba044 bash[25485]: cephadm 2021-03-10T20:59:32.150624+0000 mgr.gibba044.wflcwh (mgr.34466) 2732 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T20:59:34.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:33 gibba044 bash[25485]: cephadm 2021-03-10T20:59:32.358666+0000 mgr.gibba044.wflcwh (mgr.34466) 2733 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T20:59:34.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:33 gibba044 bash[25485]: audit 2021-03-10T20:59:32.543701+0000 mon.a (mon.0) 1295 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T20:59:34.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:33 gibba044 bash[25485]: audit 2021-03-10T20:59:32.548776+0000 mon.a (mon.0) 1296 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T20:59:34.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:33 gibba044 bash[25485]: audit 2021-03-10T20:59:32.550538+0000 mon.a (mon.0) 1297 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:34.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:33 gibba044 bash[25485]: audit 2021-03-10T20:59:32.552391+0000 mon.a (mon.0) 1298 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:34.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:33 gibba044 bash[25485]: audit 2021-03-10T20:59:32.553999+0000 mon.a (mon.0) 1299 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:34.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:33 gibba044 bash[25485]: audit 2021-03-10T20:59:32.557864+0000 mon.a (mon.0) 1300 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:34.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:33 gibba044 bash[25485]: audit 2021-03-10T20:59:32.560164+0000 mon.a (mon.0) 1301 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:34.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[30844]: cephadm 2021-03-10T20:59:32.548014+0000 mgr.gibba044.wflcwh (mgr.34466) 2734 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:59:34.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[30844]: cephadm 2021-03-10T20:59:32.550257+0000 mgr.gibba044.wflcwh (mgr.34466) 2735 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:59:34.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[30844]: cephadm 2021-03-10T20:59:32.552072+0000 mgr.gibba044.wflcwh (mgr.34466) 2736 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:59:34.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[30844]: cephadm 2021-03-10T20:59:32.552136+0000 mgr.gibba044.wflcwh (mgr.34466) 2737 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:59:34.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[30844]: cephadm 2021-03-10T20:59:32.553820+0000 mgr.gibba044.wflcwh (mgr.34466) 2738 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:59:34.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[30844]: cephadm 2021-03-10T20:59:32.553885+0000 mgr.gibba044.wflcwh (mgr.34466) 2739 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:59:34.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[30844]: cephadm 2021-03-10T20:59:32.555638+0000 mgr.gibba044.wflcwh (mgr.34466) 2740 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:59:34.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[30844]: cephadm 2021-03-10T20:59:32.557236+0000 mgr.gibba044.wflcwh (mgr.34466) 2741 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:59:34.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[30844]: cephadm 2021-03-10T20:59:32.557440+0000 mgr.gibba044.wflcwh (mgr.34466) 2742 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:59:34.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[30844]: cephadm 2021-03-10T20:59:32.559310+0000 mgr.gibba044.wflcwh (mgr.34466) 2743 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:59:34.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[30844]: cephadm 2021-03-10T20:59:32.560035+0000 mgr.gibba044.wflcwh (mgr.34466) 2744 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:59:34.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[30844]: cephadm 2021-03-10T20:59:32.561471+0000 mgr.gibba044.wflcwh (mgr.34466) 2745 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:59:34.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[30844]: cephadm 2021-03-10T20:59:32.561580+0000 mgr.gibba044.wflcwh (mgr.34466) 2746 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:59:34.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[30844]: cephadm 2021-03-10T20:59:32.561853+0000 mgr.gibba044.wflcwh (mgr.34466) 2747 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:59:34.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[30844]: cluster 2021-03-10T20:59:33.462580+0000 mgr.gibba044.wflcwh (mgr.34466) 2748 : cluster [DBG] pgmap v1547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:34.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[31815]: cephadm 2021-03-10T20:59:32.548014+0000 mgr.gibba044.wflcwh (mgr.34466) 2734 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:59:34.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[31815]: cephadm 2021-03-10T20:59:32.550257+0000 mgr.gibba044.wflcwh (mgr.34466) 2735 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:59:34.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[31815]: cephadm 2021-03-10T20:59:32.552072+0000 mgr.gibba044.wflcwh (mgr.34466) 2736 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:59:34.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[31815]: cephadm 2021-03-10T20:59:32.552136+0000 mgr.gibba044.wflcwh (mgr.34466) 2737 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:59:34.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[31815]: cephadm 2021-03-10T20:59:32.553820+0000 mgr.gibba044.wflcwh (mgr.34466) 2738 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:59:34.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[31815]: cephadm 2021-03-10T20:59:32.553885+0000 mgr.gibba044.wflcwh (mgr.34466) 2739 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:59:34.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[31815]: cephadm 2021-03-10T20:59:32.555638+0000 mgr.gibba044.wflcwh (mgr.34466) 2740 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:59:34.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[31815]: cephadm 2021-03-10T20:59:32.557236+0000 mgr.gibba044.wflcwh (mgr.34466) 2741 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:59:34.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[31815]: cephadm 2021-03-10T20:59:32.557440+0000 mgr.gibba044.wflcwh (mgr.34466) 2742 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:59:34.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[31815]: cephadm 2021-03-10T20:59:32.559310+0000 mgr.gibba044.wflcwh (mgr.34466) 2743 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:59:34.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[31815]: cephadm 2021-03-10T20:59:32.560035+0000 mgr.gibba044.wflcwh (mgr.34466) 2744 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:59:34.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[31815]: cephadm 2021-03-10T20:59:32.561471+0000 mgr.gibba044.wflcwh (mgr.34466) 2745 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:59:34.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[31815]: cephadm 2021-03-10T20:59:32.561580+0000 mgr.gibba044.wflcwh (mgr.34466) 2746 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:59:34.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[31815]: cephadm 2021-03-10T20:59:32.561853+0000 mgr.gibba044.wflcwh (mgr.34466) 2747 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:59:34.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:34 gibba023 bash[31815]: cluster 2021-03-10T20:59:33.462580+0000 mgr.gibba044.wflcwh (mgr.34466) 2748 : cluster [DBG] pgmap v1547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:35.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:34 gibba044 bash[25485]: cephadm 2021-03-10T20:59:32.548014+0000 mgr.gibba044.wflcwh (mgr.34466) 2734 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T20:59:35.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:34 gibba044 bash[25485]: cephadm 2021-03-10T20:59:32.550257+0000 mgr.gibba044.wflcwh (mgr.34466) 2735 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T20:59:35.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:34 gibba044 bash[25485]: cephadm 2021-03-10T20:59:32.552072+0000 mgr.gibba044.wflcwh (mgr.34466) 2736 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T20:59:35.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:34 gibba044 bash[25485]: cephadm 2021-03-10T20:59:32.552136+0000 mgr.gibba044.wflcwh (mgr.34466) 2737 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T20:59:35.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:34 gibba044 bash[25485]: cephadm 2021-03-10T20:59:32.553820+0000 mgr.gibba044.wflcwh (mgr.34466) 2738 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T20:59:35.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:34 gibba044 bash[25485]: cephadm 2021-03-10T20:59:32.553885+0000 mgr.gibba044.wflcwh (mgr.34466) 2739 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T20:59:35.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:34 gibba044 bash[25485]: cephadm 2021-03-10T20:59:32.555638+0000 mgr.gibba044.wflcwh (mgr.34466) 2740 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T20:59:35.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:34 gibba044 bash[25485]: cephadm 2021-03-10T20:59:32.557236+0000 mgr.gibba044.wflcwh (mgr.34466) 2741 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T20:59:35.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:34 gibba044 bash[25485]: cephadm 2021-03-10T20:59:32.557440+0000 mgr.gibba044.wflcwh (mgr.34466) 2742 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T20:59:35.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:34 gibba044 bash[25485]: cephadm 2021-03-10T20:59:32.559310+0000 mgr.gibba044.wflcwh (mgr.34466) 2743 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T20:59:35.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:34 gibba044 bash[25485]: cephadm 2021-03-10T20:59:32.560035+0000 mgr.gibba044.wflcwh (mgr.34466) 2744 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T20:59:35.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:34 gibba044 bash[25485]: cephadm 2021-03-10T20:59:32.561471+0000 mgr.gibba044.wflcwh (mgr.34466) 2745 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T20:59:35.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:34 gibba044 bash[25485]: cephadm 2021-03-10T20:59:32.561580+0000 mgr.gibba044.wflcwh (mgr.34466) 2746 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T20:59:35.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:34 gibba044 bash[25485]: cephadm 2021-03-10T20:59:32.561853+0000 mgr.gibba044.wflcwh (mgr.34466) 2747 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:59:35.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:34 gibba044 bash[25485]: cluster 2021-03-10T20:59:33.462580+0000 mgr.gibba044.wflcwh (mgr.34466) 2748 : cluster [DBG] pgmap v1547: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:35.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:35 gibba023 bash[30844]: cluster 2021-03-10T20:59:35.464116+0000 mgr.gibba044.wflcwh (mgr.34466) 2749 : cluster [DBG] pgmap v1548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:35.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:35 gibba023 bash[31815]: cluster 2021-03-10T20:59:35.464116+0000 mgr.gibba044.wflcwh (mgr.34466) 2749 : cluster [DBG] pgmap v1548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:36.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:35 gibba044 bash[25485]: cluster 2021-03-10T20:59:35.464116+0000 mgr.gibba044.wflcwh (mgr.34466) 2749 : cluster [DBG] pgmap v1548: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:38.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:38 gibba044 bash[25485]: cluster 2021-03-10T20:59:37.464753+0000 mgr.gibba044.wflcwh (mgr.34466) 2750 : cluster [DBG] pgmap v1549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:38.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:38 gibba023 bash[30844]: cluster 2021-03-10T20:59:37.464753+0000 mgr.gibba044.wflcwh (mgr.34466) 2750 : cluster [DBG] pgmap v1549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:38.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:38 gibba023 bash[31815]: cluster 2021-03-10T20:59:37.464753+0000 mgr.gibba044.wflcwh (mgr.34466) 2750 : cluster [DBG] pgmap v1549: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:39.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:39 gibba023 bash[30844]: cluster 2021-03-10T20:59:39.466020+0000 mgr.gibba044.wflcwh (mgr.34466) 2751 : cluster [DBG] pgmap v1550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:39.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:39 gibba023 bash[31815]: cluster 2021-03-10T20:59:39.466020+0000 mgr.gibba044.wflcwh (mgr.34466) 2751 : cluster [DBG] pgmap v1550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:40.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:39 gibba044 bash[25485]: cluster 2021-03-10T20:59:39.466020+0000 mgr.gibba044.wflcwh (mgr.34466) 2751 : cluster [DBG] pgmap v1550: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:41.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:41 gibba023 bash[30844]: cluster 2021-03-10T20:59:41.467475+0000 mgr.gibba044.wflcwh (mgr.34466) 2752 : cluster [DBG] pgmap v1551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:41.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:41 gibba023 bash[31815]: cluster 2021-03-10T20:59:41.467475+0000 mgr.gibba044.wflcwh (mgr.34466) 2752 : cluster [DBG] pgmap v1551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:42.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:41 gibba044 bash[25485]: cluster 2021-03-10T20:59:41.467475+0000 mgr.gibba044.wflcwh (mgr.34466) 2752 : cluster [DBG] pgmap v1551: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:43.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:43 gibba023 bash[30844]: cluster 2021-03-10T20:59:43.469138+0000 mgr.gibba044.wflcwh (mgr.34466) 2753 : cluster [DBG] pgmap v1552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:43.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:43 gibba023 bash[31815]: cluster 2021-03-10T20:59:43.469138+0000 mgr.gibba044.wflcwh (mgr.34466) 2753 : cluster [DBG] pgmap v1552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:44.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:43 gibba044 bash[25485]: cluster 2021-03-10T20:59:43.469138+0000 mgr.gibba044.wflcwh (mgr.34466) 2753 : cluster [DBG] pgmap v1552: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:45.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:45 gibba023 bash[30844]: cluster 2021-03-10T20:59:45.470653+0000 mgr.gibba044.wflcwh (mgr.34466) 2754 : cluster [DBG] pgmap v1553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:45.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:45 gibba023 bash[31815]: cluster 2021-03-10T20:59:45.470653+0000 mgr.gibba044.wflcwh (mgr.34466) 2754 : cluster [DBG] pgmap v1553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:46.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:45 gibba044 bash[25485]: cluster 2021-03-10T20:59:45.470653+0000 mgr.gibba044.wflcwh (mgr.34466) 2754 : cluster [DBG] pgmap v1553: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:48.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:48 gibba044 bash[25485]: cluster 2021-03-10T20:59:47.471409+0000 mgr.gibba044.wflcwh (mgr.34466) 2755 : cluster [DBG] pgmap v1554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:48.926 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:48 gibba023 bash[30844]: cluster 2021-03-10T20:59:47.471409+0000 mgr.gibba044.wflcwh (mgr.34466) 2755 : cluster [DBG] pgmap v1554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:48.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:48 gibba023 bash[31815]: cluster 2021-03-10T20:59:47.471409+0000 mgr.gibba044.wflcwh (mgr.34466) 2755 : cluster [DBG] pgmap v1554: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:49.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:49 gibba044 bash[25485]: cephadm 2021-03-10T20:59:47.577750+0000 mgr.gibba044.wflcwh (mgr.34466) 2756 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:59:49.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:49 gibba023 bash[30844]: cephadm 2021-03-10T20:59:47.577750+0000 mgr.gibba044.wflcwh (mgr.34466) 2756 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:59:49.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:49 gibba023 bash[31815]: cephadm 2021-03-10T20:59:47.577750+0000 mgr.gibba044.wflcwh (mgr.34466) 2756 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T20:59:50.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:50 gibba044 bash[25485]: cluster 2021-03-10T20:59:49.472616+0000 mgr.gibba044.wflcwh (mgr.34466) 2757 : cluster [DBG] pgmap v1555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:50.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:50 gibba023 bash[30844]: cluster 2021-03-10T20:59:49.472616+0000 mgr.gibba044.wflcwh (mgr.34466) 2757 : cluster [DBG] pgmap v1555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:50.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:50 gibba023 bash[31815]: cluster 2021-03-10T20:59:49.472616+0000 mgr.gibba044.wflcwh (mgr.34466) 2757 : cluster [DBG] pgmap v1555: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:52.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:52 gibba044 bash[25485]: cluster 2021-03-10T20:59:51.473973+0000 mgr.gibba044.wflcwh (mgr.34466) 2758 : cluster [DBG] pgmap v1556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:52.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:52 gibba023 bash[30844]: cluster 2021-03-10T20:59:51.473973+0000 mgr.gibba044.wflcwh (mgr.34466) 2758 : cluster [DBG] pgmap v1556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:52.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:52 gibba023 bash[31815]: cluster 2021-03-10T20:59:51.473973+0000 mgr.gibba044.wflcwh (mgr.34466) 2758 : cluster [DBG] pgmap v1556: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:54.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:54 gibba023 bash[30844]: cluster 2021-03-10T20:59:53.475673+0000 mgr.gibba044.wflcwh (mgr.34466) 2759 : cluster [DBG] pgmap v1557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:54.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:54 gibba023 bash[31815]: cluster 2021-03-10T20:59:53.475673+0000 mgr.gibba044.wflcwh (mgr.34466) 2759 : cluster [DBG] pgmap v1557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:55.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:54 gibba044 bash[25485]: cluster 2021-03-10T20:59:53.475673+0000 mgr.gibba044.wflcwh (mgr.34466) 2759 : cluster [DBG] pgmap v1557: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:56.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:56 gibba023 bash[30844]: cluster 2021-03-10T20:59:55.477463+0000 mgr.gibba044.wflcwh (mgr.34466) 2760 : cluster [DBG] pgmap v1558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:56.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:56 gibba023 bash[31815]: cluster 2021-03-10T20:59:55.477463+0000 mgr.gibba044.wflcwh (mgr.34466) 2760 : cluster [DBG] pgmap v1558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:57.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:56 gibba044 bash[25485]: cluster 2021-03-10T20:59:55.477463+0000 mgr.gibba044.wflcwh (mgr.34466) 2760 : cluster [DBG] pgmap v1558: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:57.963 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T20:59:58.192 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T20:59:58.193 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (51m) 6m ago 56m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T20:59:58.193 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (56m) 5m ago 56m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T20:59:58.194 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (51m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T20:59:58.194 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (51m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T20:59:58.195 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (50m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T20:59:58.195 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (50m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T20:59:58.196 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (50m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T20:59:58.196 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (50m) 6m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T20:59:58.197 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (56m) 6m ago 56m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T20:59:58.197 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (56m) 5m ago 56m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T20:59:58.197 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (49m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T20:59:58.198 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (48m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T20:59:58.200 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (48m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T20:59:58.200 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (48m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T20:59:58.201 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (47m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T20:59:58.201 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (47m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T20:59:58.202 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (46m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T20:59:58.202 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (46m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T20:59:58.203 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (56m) 5m ago 56m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T20:59:58.203 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 6m ago 54m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:59:58.203 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 5m ago 54m docker.io/ceph/ceph:v15.2.0 2021-03-10T20:59:58.444 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T20:59:58.444 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T20:59:58.445 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:59:58.445 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:59:58.445 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T20:59:58.445 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T20:59:58.445 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:59:58.446 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T20:59:58.446 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T20:59:58.446 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T20:59:58.446 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T20:59:58.447 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T20:59:58.447 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T20:59:58.447 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T20:59:58.447 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T20:59:58.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:58 gibba044 bash[25485]: cluster 2021-03-10T20:59:57.478273+0000 mgr.gibba044.wflcwh (mgr.34466) 2761 : cluster [DBG] pgmap v1559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:58.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:58 gibba044 bash[25485]: audit 2021-03-10T20:59:58.441394+0000 mon.a (mon.0) 1302 : audit [DBG] from='client.? 172.21.2.123:0/2041689841' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:58.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:58 gibba023 bash[30844]: cluster 2021-03-10T20:59:57.478273+0000 mgr.gibba044.wflcwh (mgr.34466) 2761 : cluster [DBG] pgmap v1559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:58.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:58 gibba023 bash[30844]: audit 2021-03-10T20:59:58.441394+0000 mon.a (mon.0) 1302 : audit [DBG] from='client.? 172.21.2.123:0/2041689841' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:58.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:58 gibba023 bash[31815]: cluster 2021-03-10T20:59:57.478273+0000 mgr.gibba044.wflcwh (mgr.34466) 2761 : cluster [DBG] pgmap v1559: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T20:59:58.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:58 gibba023 bash[31815]: audit 2021-03-10T20:59:58.441394+0000 mon.a (mon.0) 1302 : audit [DBG] from='client.? 172.21.2.123:0/2041689841' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T20:59:59.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:59 gibba044 bash[25485]: audit 2021-03-10T20:59:57.951968+0000 mgr.gibba044.wflcwh (mgr.34466) 2762 : audit [DBG] from='client.45912 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:59:59.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 20:59:59 gibba044 bash[25485]: audit 2021-03-10T20:59:58.178004+0000 mgr.gibba044.wflcwh (mgr.34466) 2763 : audit [DBG] from='client.45918 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:59:59.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:59 gibba023 bash[30844]: audit 2021-03-10T20:59:57.951968+0000 mgr.gibba044.wflcwh (mgr.34466) 2762 : audit [DBG] from='client.45912 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:59:59.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 20:59:59 gibba023 bash[30844]: audit 2021-03-10T20:59:58.178004+0000 mgr.gibba044.wflcwh (mgr.34466) 2763 : audit [DBG] from='client.45918 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:59:59.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:59 gibba023 bash[31815]: audit 2021-03-10T20:59:57.951968+0000 mgr.gibba044.wflcwh (mgr.34466) 2762 : audit [DBG] from='client.45912 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T20:59:59.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 20:59:59 gibba023 bash[31815]: audit 2021-03-10T20:59:58.178004+0000 mgr.gibba044.wflcwh (mgr.34466) 2763 : audit [DBG] from='client.45918 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:00:00.427 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:00 gibba023 bash[30844]: debug 2021-03-10T20:59:59.997+0000 7fa7fde59700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T21:00:00.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:00 gibba044 bash[25485]: cluster 2021-03-10T20:59:59.479501+0000 mgr.gibba044.wflcwh (mgr.34466) 2764 : cluster [DBG] pgmap v1560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:00.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:00 gibba044 bash[25485]: cluster 2021-03-10T21:00:00.000264+0000 mon.a (mon.0) 1303 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T21:00:00.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:00 gibba023 bash[30844]: cluster 2021-03-10T20:59:59.479501+0000 mgr.gibba044.wflcwh (mgr.34466) 2764 : cluster [DBG] pgmap v1560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:00.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:00 gibba023 bash[30844]: cluster 2021-03-10T21:00:00.000264+0000 mon.a (mon.0) 1303 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T21:00:00.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:00 gibba023 bash[31815]: cluster 2021-03-10T20:59:59.479501+0000 mgr.gibba044.wflcwh (mgr.34466) 2764 : cluster [DBG] pgmap v1560: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:00.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:00 gibba023 bash[31815]: cluster 2021-03-10T21:00:00.000264+0000 mon.a (mon.0) 1303 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T21:00:02.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:02 gibba044 bash[25485]: cluster 2021-03-10T21:00:01.480996+0000 mgr.gibba044.wflcwh (mgr.34466) 2765 : cluster [DBG] pgmap v1561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:02.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:02 gibba023 bash[30844]: cluster 2021-03-10T21:00:01.480996+0000 mgr.gibba044.wflcwh (mgr.34466) 2765 : cluster [DBG] pgmap v1561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:02.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:02 gibba023 bash[31815]: cluster 2021-03-10T21:00:01.480996+0000 mgr.gibba044.wflcwh (mgr.34466) 2765 : cluster [DBG] pgmap v1561: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:04.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:04 gibba023 bash[30844]: cephadm 2021-03-10T21:00:02.593672+0000 mgr.gibba044.wflcwh (mgr.34466) 2766 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:00:04.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:04 gibba023 bash[30844]: cluster 2021-03-10T21:00:03.482804+0000 mgr.gibba044.wflcwh (mgr.34466) 2767 : cluster [DBG] pgmap v1562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:04.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:04 gibba023 bash[31815]: cephadm 2021-03-10T21:00:02.593672+0000 mgr.gibba044.wflcwh (mgr.34466) 2766 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:00:04.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:04 gibba023 bash[31815]: cluster 2021-03-10T21:00:03.482804+0000 mgr.gibba044.wflcwh (mgr.34466) 2767 : cluster [DBG] pgmap v1562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:05.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:04 gibba044 bash[25485]: cephadm 2021-03-10T21:00:02.593672+0000 mgr.gibba044.wflcwh (mgr.34466) 2766 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:00:05.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:04 gibba044 bash[25485]: cluster 2021-03-10T21:00:03.482804+0000 mgr.gibba044.wflcwh (mgr.34466) 2767 : cluster [DBG] pgmap v1562: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:06.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:06 gibba023 bash[30844]: cluster 2021-03-10T21:00:05.484532+0000 mgr.gibba044.wflcwh (mgr.34466) 2768 : cluster [DBG] pgmap v1563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:06.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:06 gibba023 bash[31815]: cluster 2021-03-10T21:00:05.484532+0000 mgr.gibba044.wflcwh (mgr.34466) 2768 : cluster [DBG] pgmap v1563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:07.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:06 gibba044 bash[25485]: cluster 2021-03-10T21:00:05.484532+0000 mgr.gibba044.wflcwh (mgr.34466) 2768 : cluster [DBG] pgmap v1563: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:08.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:08 gibba044 bash[25485]: cluster 2021-03-10T21:00:07.485377+0000 mgr.gibba044.wflcwh (mgr.34466) 2769 : cluster [DBG] pgmap v1564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:08.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:08 gibba023 bash[30844]: cluster 2021-03-10T21:00:07.485377+0000 mgr.gibba044.wflcwh (mgr.34466) 2769 : cluster [DBG] pgmap v1564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:08.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:08 gibba023 bash[31815]: cluster 2021-03-10T21:00:07.485377+0000 mgr.gibba044.wflcwh (mgr.34466) 2769 : cluster [DBG] pgmap v1564: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:09.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:09 gibba023 bash[30844]: cluster 2021-03-10T21:00:09.486753+0000 mgr.gibba044.wflcwh (mgr.34466) 2770 : cluster [DBG] pgmap v1565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:09.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:09 gibba023 bash[31815]: cluster 2021-03-10T21:00:09.486753+0000 mgr.gibba044.wflcwh (mgr.34466) 2770 : cluster [DBG] pgmap v1565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:10.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:09 gibba044 bash[25485]: cluster 2021-03-10T21:00:09.486753+0000 mgr.gibba044.wflcwh (mgr.34466) 2770 : cluster [DBG] pgmap v1565: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:11.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:11 gibba023 bash[30844]: cluster 2021-03-10T21:00:11.488086+0000 mgr.gibba044.wflcwh (mgr.34466) 2771 : cluster [DBG] pgmap v1566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:11.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:11 gibba023 bash[31815]: cluster 2021-03-10T21:00:11.488086+0000 mgr.gibba044.wflcwh (mgr.34466) 2771 : cluster [DBG] pgmap v1566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:12.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:11 gibba044 bash[25485]: cluster 2021-03-10T21:00:11.488086+0000 mgr.gibba044.wflcwh (mgr.34466) 2771 : cluster [DBG] pgmap v1566: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:13.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:13 gibba023 bash[30844]: cluster 2021-03-10T21:00:13.489597+0000 mgr.gibba044.wflcwh (mgr.34466) 2772 : cluster [DBG] pgmap v1567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:13.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:13 gibba023 bash[31815]: cluster 2021-03-10T21:00:13.489597+0000 mgr.gibba044.wflcwh (mgr.34466) 2772 : cluster [DBG] pgmap v1567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:14.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:13 gibba044 bash[25485]: cluster 2021-03-10T21:00:13.489597+0000 mgr.gibba044.wflcwh (mgr.34466) 2772 : cluster [DBG] pgmap v1567: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:15.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:15 gibba023 bash[30844]: cluster 2021-03-10T21:00:15.491191+0000 mgr.gibba044.wflcwh (mgr.34466) 2773 : cluster [DBG] pgmap v1568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:15.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:15 gibba023 bash[31815]: cluster 2021-03-10T21:00:15.491191+0000 mgr.gibba044.wflcwh (mgr.34466) 2773 : cluster [DBG] pgmap v1568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:16.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:15 gibba044 bash[25485]: cluster 2021-03-10T21:00:15.491191+0000 mgr.gibba044.wflcwh (mgr.34466) 2773 : cluster [DBG] pgmap v1568: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:18.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:18 gibba044 bash[25485]: cluster 2021-03-10T21:00:17.491933+0000 mgr.gibba044.wflcwh (mgr.34466) 2774 : cluster [DBG] pgmap v1569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:18.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:18 gibba023 bash[30844]: cluster 2021-03-10T21:00:17.491933+0000 mgr.gibba044.wflcwh (mgr.34466) 2774 : cluster [DBG] pgmap v1569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:18.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:18 gibba023 bash[31815]: cluster 2021-03-10T21:00:17.491933+0000 mgr.gibba044.wflcwh (mgr.34466) 2774 : cluster [DBG] pgmap v1569: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:19.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:19 gibba044 bash[25485]: cephadm 2021-03-10T21:00:17.598294+0000 mgr.gibba044.wflcwh (mgr.34466) 2775 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:00:19.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:19 gibba023 bash[30844]: cephadm 2021-03-10T21:00:17.598294+0000 mgr.gibba044.wflcwh (mgr.34466) 2775 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:00:19.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:19 gibba023 bash[31815]: cephadm 2021-03-10T21:00:17.598294+0000 mgr.gibba044.wflcwh (mgr.34466) 2775 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:00:20.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:20 gibba044 bash[25485]: cluster 2021-03-10T21:00:19.492506+0000 mgr.gibba044.wflcwh (mgr.34466) 2776 : cluster [DBG] pgmap v1570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:20.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:20 gibba023 bash[30844]: cluster 2021-03-10T21:00:19.492506+0000 mgr.gibba044.wflcwh (mgr.34466) 2776 : cluster [DBG] pgmap v1570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:20.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:20 gibba023 bash[31815]: cluster 2021-03-10T21:00:19.492506+0000 mgr.gibba044.wflcwh (mgr.34466) 2776 : cluster [DBG] pgmap v1570: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:22.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:22 gibba023 bash[30844]: cluster 2021-03-10T21:00:21.493667+0000 mgr.gibba044.wflcwh (mgr.34466) 2777 : cluster [DBG] pgmap v1571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:22.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:22 gibba023 bash[31815]: cluster 2021-03-10T21:00:21.493667+0000 mgr.gibba044.wflcwh (mgr.34466) 2777 : cluster [DBG] pgmap v1571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:23.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:22 gibba044 bash[25485]: cluster 2021-03-10T21:00:21.493667+0000 mgr.gibba044.wflcwh (mgr.34466) 2777 : cluster [DBG] pgmap v1571: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:24.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:24 gibba023 bash[30844]: cluster 2021-03-10T21:00:23.495433+0000 mgr.gibba044.wflcwh (mgr.34466) 2778 : cluster [DBG] pgmap v1572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:24.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:24 gibba023 bash[31815]: cluster 2021-03-10T21:00:23.495433+0000 mgr.gibba044.wflcwh (mgr.34466) 2778 : cluster [DBG] pgmap v1572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:25.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:24 gibba044 bash[25485]: cluster 2021-03-10T21:00:23.495433+0000 mgr.gibba044.wflcwh (mgr.34466) 2778 : cluster [DBG] pgmap v1572: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:26.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:26 gibba023 bash[30844]: cluster 2021-03-10T21:00:25.497208+0000 mgr.gibba044.wflcwh (mgr.34466) 2779 : cluster [DBG] pgmap v1573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:26.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:26 gibba023 bash[31815]: cluster 2021-03-10T21:00:25.497208+0000 mgr.gibba044.wflcwh (mgr.34466) 2779 : cluster [DBG] pgmap v1573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:27.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:26 gibba044 bash[25485]: cluster 2021-03-10T21:00:25.497208+0000 mgr.gibba044.wflcwh (mgr.34466) 2779 : cluster [DBG] pgmap v1573: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:27.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:27 gibba023 bash[30844]: audit 2021-03-10T21:00:27.381034+0000 mon.a (mon.0) 1304 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:00:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:27 gibba023 bash[30844]: audit 2021-03-10T21:00:27.381716+0000 mon.a (mon.0) 1305 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:00:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:27 gibba023 bash[30844]: audit 2021-03-10T21:00:27.384881+0000 mon.a (mon.0) 1306 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T21:00:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:27 gibba023 bash[30844]: audit 2021-03-10T21:00:27.385637+0000 mon.a (mon.0) 1307 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T21:00:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:27 gibba023 bash[30844]: audit 2021-03-10T21:00:27.386365+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T21:00:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:27 gibba023 bash[30844]: audit 2021-03-10T21:00:27.387050+0000 mon.a (mon.0) 1309 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T21:00:27.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:27 gibba023 bash[31815]: audit 2021-03-10T21:00:27.381034+0000 mon.a (mon.0) 1304 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:00:27.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:27 gibba023 bash[31815]: audit 2021-03-10T21:00:27.381716+0000 mon.a (mon.0) 1305 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:00:27.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:27 gibba023 bash[31815]: audit 2021-03-10T21:00:27.384881+0000 mon.a (mon.0) 1306 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T21:00:27.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:27 gibba023 bash[31815]: audit 2021-03-10T21:00:27.385637+0000 mon.a (mon.0) 1307 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T21:00:27.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:27 gibba023 bash[31815]: audit 2021-03-10T21:00:27.386365+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T21:00:27.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:27 gibba023 bash[31815]: audit 2021-03-10T21:00:27.387050+0000 mon.a (mon.0) 1309 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T21:00:28.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:27 gibba044 bash[25485]: audit 2021-03-10T21:00:27.381034+0000 mon.a (mon.0) 1304 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:00:28.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:27 gibba044 bash[25485]: audit 2021-03-10T21:00:27.381716+0000 mon.a (mon.0) 1305 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:00:28.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:27 gibba044 bash[25485]: audit 2021-03-10T21:00:27.384881+0000 mon.a (mon.0) 1306 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2021-03-10T21:00:28.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:27 gibba044 bash[25485]: audit 2021-03-10T21:00:27.385637+0000 mon.a (mon.0) 1307 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T21:00:28.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:27 gibba044 bash[25485]: audit 2021-03-10T21:00:27.386365+0000 mon.a (mon.0) 1308 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T21:00:28.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:27 gibba044 bash[25485]: audit 2021-03-10T21:00:27.387050+0000 mon.a (mon.0) 1309 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2021-03-10T21:00:28.695 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T21:00:28.918 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:00:28.918 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (51m) 7m ago 57m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T21:00:28.919 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (56m) 5m ago 56m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T21:00:28.919 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (51m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T21:00:28.919 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (52m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T21:00:28.920 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (51m) 7m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T21:00:28.920 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (51m) 7m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T21:00:28.921 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (50m) 5m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T21:00:28.921 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (50m) 7m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T21:00:28.922 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (57m) 7m ago 57m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T21:00:28.922 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (57m) 5m ago 57m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T21:00:28.922 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (49m) 7m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T21:00:28.923 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (49m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T21:00:28.923 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (48m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T21:00:28.924 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (48m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T21:00:28.924 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (48m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T21:00:28.925 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (47m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T21:00:28.925 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (47m) 5m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T21:00:28.926 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (46m) 5m ago 57m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T21:00:28.926 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (56m) 5m ago 57m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T21:00:28.926 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 7m ago 55m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:00:28.927 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 5m ago 55m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:00:28.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:28 gibba023 bash[30844]: cluster 2021-03-10T21:00:27.498122+0000 mgr.gibba044.wflcwh (mgr.34466) 2780 : cluster [DBG] pgmap v1574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:28.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:28 gibba023 bash[31815]: cluster 2021-03-10T21:00:27.498122+0000 mgr.gibba044.wflcwh (mgr.34466) 2780 : cluster [DBG] pgmap v1574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:29.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:28 gibba044 bash[25485]: cluster 2021-03-10T21:00:27.498122+0000 mgr.gibba044.wflcwh (mgr.34466) 2780 : cluster [DBG] pgmap v1574: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:29.167 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T21:00:29.168 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T21:00:29.168 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:00:29.169 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:00:29.169 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T21:00:29.170 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:00:29.170 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:00:29.171 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T21:00:29.179 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:00:29.179 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:00:29.179 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T21:00:29.179 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T21:00:29.180 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:00:29.180 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T21:00:29.180 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T21:00:29.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:29 gibba023 bash[30844]: audit 2021-03-10T21:00:29.164007+0000 mon.a (mon.0) 1310 : audit [DBG] from='client.? 172.21.2.123:0/3936303058' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:29.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:29 gibba023 bash[31815]: audit 2021-03-10T21:00:29.164007+0000 mon.a (mon.0) 1310 : audit [DBG] from='client.? 172.21.2.123:0/3936303058' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:30.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:29 gibba044 bash[25485]: audit 2021-03-10T21:00:29.164007+0000 mon.a (mon.0) 1310 : audit [DBG] from='client.? 172.21.2.123:0/3936303058' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:30.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:30 gibba023 bash[30844]: audit 2021-03-10T21:00:28.683050+0000 mgr.gibba044.wflcwh (mgr.34466) 2781 : audit [DBG] from='client.55909 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:00:30.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:30 gibba023 bash[30844]: audit 2021-03-10T21:00:28.905412+0000 mgr.gibba044.wflcwh (mgr.34466) 2782 : audit [DBG] from='client.45936 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:00:30.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:30 gibba023 bash[30844]: cluster 2021-03-10T21:00:29.499336+0000 mgr.gibba044.wflcwh (mgr.34466) 2783 : cluster [DBG] pgmap v1575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:30.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:30 gibba023 bash[31815]: audit 2021-03-10T21:00:28.683050+0000 mgr.gibba044.wflcwh (mgr.34466) 2781 : audit [DBG] from='client.55909 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:00:30.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:30 gibba023 bash[31815]: audit 2021-03-10T21:00:28.905412+0000 mgr.gibba044.wflcwh (mgr.34466) 2782 : audit [DBG] from='client.45936 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:00:30.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:30 gibba023 bash[31815]: cluster 2021-03-10T21:00:29.499336+0000 mgr.gibba044.wflcwh (mgr.34466) 2783 : cluster [DBG] pgmap v1575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:31.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:30 gibba044 bash[25485]: audit 2021-03-10T21:00:28.683050+0000 mgr.gibba044.wflcwh (mgr.34466) 2781 : audit [DBG] from='client.55909 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:00:31.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:30 gibba044 bash[25485]: audit 2021-03-10T21:00:28.905412+0000 mgr.gibba044.wflcwh (mgr.34466) 2782 : audit [DBG] from='client.45936 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:00:31.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:30 gibba044 bash[25485]: cluster 2021-03-10T21:00:29.499336+0000 mgr.gibba044.wflcwh (mgr.34466) 2783 : cluster [DBG] pgmap v1575: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:31.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:31 gibba023 bash[30844]: cluster 2021-03-10T21:00:31.500702+0000 mgr.gibba044.wflcwh (mgr.34466) 2784 : cluster [DBG] pgmap v1576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:31.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:31 gibba023 bash[31815]: cluster 2021-03-10T21:00:31.500702+0000 mgr.gibba044.wflcwh (mgr.34466) 2784 : cluster [DBG] pgmap v1576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:32.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:31 gibba044 bash[25485]: cluster 2021-03-10T21:00:31.500702+0000 mgr.gibba044.wflcwh (mgr.34466) 2784 : cluster [DBG] pgmap v1576: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:34.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[30844]: cephadm 2021-03-10T21:00:32.606663+0000 mgr.gibba044.wflcwh (mgr.34466) 2785 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:00:34.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[30844]: audit 2021-03-10T21:00:32.804587+0000 mon.a (mon.0) 1311 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:00:34.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[30844]: cephadm 2021-03-10T21:00:32.805488+0000 mgr.gibba044.wflcwh (mgr.34466) 2786 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:00:34.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[30844]: audit 2021-03-10T21:00:33.000853+0000 mon.a (mon.0) 1312 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:00:34.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[30844]: cephadm 2021-03-10T21:00:33.004364+0000 mgr.gibba044.wflcwh (mgr.34466) 2787 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:00:34.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[30844]: audit 2021-03-10T21:00:33.005044+0000 mon.a (mon.0) 1313 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:00:34.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[30844]: cephadm 2021-03-10T21:00:33.006873+0000 mgr.gibba044.wflcwh (mgr.34466) 2788 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:00:34.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[30844]: audit 2021-03-10T21:00:33.007147+0000 mon.a (mon.0) 1314 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:34.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[30844]: cephadm 2021-03-10T21:00:33.008578+0000 mgr.gibba044.wflcwh (mgr.34466) 2789 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:00:34.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[30844]: cephadm 2021-03-10T21:00:33.008614+0000 mgr.gibba044.wflcwh (mgr.34466) 2790 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:00:34.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[30844]: audit 2021-03-10T21:00:33.008948+0000 mon.a (mon.0) 1315 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:34.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[30844]: cephadm 2021-03-10T21:00:33.010465+0000 mgr.gibba044.wflcwh (mgr.34466) 2791 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:00:34.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[30844]: cephadm 2021-03-10T21:00:33.010504+0000 mgr.gibba044.wflcwh (mgr.34466) 2792 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:00:34.185 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[30844]: audit 2021-03-10T21:00:33.010528+0000 mon.a (mon.0) 1316 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:34.186 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[30844]: cephadm 2021-03-10T21:00:33.011974+0000 mgr.gibba044.wflcwh (mgr.34466) 2793 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:00:34.186 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[30844]: cephadm 2021-03-10T21:00:33.013958+0000 mgr.gibba044.wflcwh (mgr.34466) 2794 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:00:34.186 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[30844]: cephadm 2021-03-10T21:00:33.013995+0000 mgr.gibba044.wflcwh (mgr.34466) 2795 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:00:34.187 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[30844]: audit 2021-03-10T21:00:33.014364+0000 mon.a (mon.0) 1317 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:34.187 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[30844]: cephadm 2021-03-10T21:00:33.015857+0000 mgr.gibba044.wflcwh (mgr.34466) 2796 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:00:34.187 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[30844]: cephadm 2021-03-10T21:00:33.016172+0000 mgr.gibba044.wflcwh (mgr.34466) 2797 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:00:34.187 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[30844]: audit 2021-03-10T21:00:33.016444+0000 mon.a (mon.0) 1318 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:34.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[31815]: cephadm 2021-03-10T21:00:32.606663+0000 mgr.gibba044.wflcwh (mgr.34466) 2785 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:00:34.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[31815]: audit 2021-03-10T21:00:32.804587+0000 mon.a (mon.0) 1311 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:00:34.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[31815]: cephadm 2021-03-10T21:00:32.805488+0000 mgr.gibba044.wflcwh (mgr.34466) 2786 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:00:34.189 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[31815]: audit 2021-03-10T21:00:33.000853+0000 mon.a (mon.0) 1312 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:00:34.189 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[31815]: cephadm 2021-03-10T21:00:33.004364+0000 mgr.gibba044.wflcwh (mgr.34466) 2787 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:00:34.189 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[31815]: audit 2021-03-10T21:00:33.005044+0000 mon.a (mon.0) 1313 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:00:34.189 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[31815]: cephadm 2021-03-10T21:00:33.006873+0000 mgr.gibba044.wflcwh (mgr.34466) 2788 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:00:34.190 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[31815]: audit 2021-03-10T21:00:33.007147+0000 mon.a (mon.0) 1314 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:34.190 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[31815]: cephadm 2021-03-10T21:00:33.008578+0000 mgr.gibba044.wflcwh (mgr.34466) 2789 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:00:34.190 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[31815]: cephadm 2021-03-10T21:00:33.008614+0000 mgr.gibba044.wflcwh (mgr.34466) 2790 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:00:34.190 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[31815]: audit 2021-03-10T21:00:33.008948+0000 mon.a (mon.0) 1315 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:34.191 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[31815]: cephadm 2021-03-10T21:00:33.010465+0000 mgr.gibba044.wflcwh (mgr.34466) 2791 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:00:34.191 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[31815]: cephadm 2021-03-10T21:00:33.010504+0000 mgr.gibba044.wflcwh (mgr.34466) 2792 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:00:34.192 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[31815]: audit 2021-03-10T21:00:33.010528+0000 mon.a (mon.0) 1316 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:34.193 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[31815]: cephadm 2021-03-10T21:00:33.011974+0000 mgr.gibba044.wflcwh (mgr.34466) 2793 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:00:34.193 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[31815]: cephadm 2021-03-10T21:00:33.013958+0000 mgr.gibba044.wflcwh (mgr.34466) 2794 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:00:34.193 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[31815]: cephadm 2021-03-10T21:00:33.013995+0000 mgr.gibba044.wflcwh (mgr.34466) 2795 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:00:34.194 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[31815]: audit 2021-03-10T21:00:33.014364+0000 mon.a (mon.0) 1317 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:34.194 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[31815]: cephadm 2021-03-10T21:00:33.015857+0000 mgr.gibba044.wflcwh (mgr.34466) 2796 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:00:34.194 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[31815]: cephadm 2021-03-10T21:00:33.016172+0000 mgr.gibba044.wflcwh (mgr.34466) 2797 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:00:34.195 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[31815]: audit 2021-03-10T21:00:33.016444+0000 mon.a (mon.0) 1318 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:34.195 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[30844]: cephadm 2021-03-10T21:00:33.018057+0000 mgr.gibba044.wflcwh (mgr.34466) 2798 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:00:34.195 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[30844]: cephadm 2021-03-10T21:00:33.018093+0000 mgr.gibba044.wflcwh (mgr.34466) 2799 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:00:34.196 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[30844]: cephadm 2021-03-10T21:00:33.018220+0000 mgr.gibba044.wflcwh (mgr.34466) 2800 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:00:34.196 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[30844]: cluster 2021-03-10T21:00:33.502406+0000 mgr.gibba044.wflcwh (mgr.34466) 2801 : cluster [DBG] pgmap v1577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:34.196 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[31815]: cephadm 2021-03-10T21:00:33.018057+0000 mgr.gibba044.wflcwh (mgr.34466) 2798 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:00:34.197 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[31815]: cephadm 2021-03-10T21:00:33.018093+0000 mgr.gibba044.wflcwh (mgr.34466) 2799 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:00:34.197 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[31815]: cephadm 2021-03-10T21:00:33.018220+0000 mgr.gibba044.wflcwh (mgr.34466) 2800 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:00:34.197 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:33 gibba023 bash[31815]: cluster 2021-03-10T21:00:33.502406+0000 mgr.gibba044.wflcwh (mgr.34466) 2801 : cluster [DBG] pgmap v1577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:34.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:33 gibba044 bash[25485]: cephadm 2021-03-10T21:00:32.606663+0000 mgr.gibba044.wflcwh (mgr.34466) 2785 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:00:34.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:33 gibba044 bash[25485]: audit 2021-03-10T21:00:32.804587+0000 mon.a (mon.0) 1311 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:00:34.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:33 gibba044 bash[25485]: cephadm 2021-03-10T21:00:32.805488+0000 mgr.gibba044.wflcwh (mgr.34466) 2786 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:00:34.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:33 gibba044 bash[25485]: audit 2021-03-10T21:00:33.000853+0000 mon.a (mon.0) 1312 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:00:34.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:33 gibba044 bash[25485]: cephadm 2021-03-10T21:00:33.004364+0000 mgr.gibba044.wflcwh (mgr.34466) 2787 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:00:34.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:33 gibba044 bash[25485]: audit 2021-03-10T21:00:33.005044+0000 mon.a (mon.0) 1313 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:00:34.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:33 gibba044 bash[25485]: cephadm 2021-03-10T21:00:33.006873+0000 mgr.gibba044.wflcwh (mgr.34466) 2788 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:00:34.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:33 gibba044 bash[25485]: audit 2021-03-10T21:00:33.007147+0000 mon.a (mon.0) 1314 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:34.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:33 gibba044 bash[25485]: cephadm 2021-03-10T21:00:33.008578+0000 mgr.gibba044.wflcwh (mgr.34466) 2789 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:00:34.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:33 gibba044 bash[25485]: cephadm 2021-03-10T21:00:33.008614+0000 mgr.gibba044.wflcwh (mgr.34466) 2790 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:00:34.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:33 gibba044 bash[25485]: audit 2021-03-10T21:00:33.008948+0000 mon.a (mon.0) 1315 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:34.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:33 gibba044 bash[25485]: cephadm 2021-03-10T21:00:33.010465+0000 mgr.gibba044.wflcwh (mgr.34466) 2791 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:00:34.258 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:33 gibba044 bash[25485]: cephadm 2021-03-10T21:00:33.010504+0000 mgr.gibba044.wflcwh (mgr.34466) 2792 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:00:34.258 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:33 gibba044 bash[25485]: audit 2021-03-10T21:00:33.010528+0000 mon.a (mon.0) 1316 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:34.258 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:33 gibba044 bash[25485]: cephadm 2021-03-10T21:00:33.011974+0000 mgr.gibba044.wflcwh (mgr.34466) 2793 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:00:34.258 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:33 gibba044 bash[25485]: cephadm 2021-03-10T21:00:33.013958+0000 mgr.gibba044.wflcwh (mgr.34466) 2794 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:00:34.258 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:33 gibba044 bash[25485]: cephadm 2021-03-10T21:00:33.013995+0000 mgr.gibba044.wflcwh (mgr.34466) 2795 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:00:34.259 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:33 gibba044 bash[25485]: audit 2021-03-10T21:00:33.014364+0000 mon.a (mon.0) 1317 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:34.259 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:33 gibba044 bash[25485]: cephadm 2021-03-10T21:00:33.015857+0000 mgr.gibba044.wflcwh (mgr.34466) 2796 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:00:34.259 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:33 gibba044 bash[25485]: cephadm 2021-03-10T21:00:33.016172+0000 mgr.gibba044.wflcwh (mgr.34466) 2797 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:00:34.259 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:33 gibba044 bash[25485]: audit 2021-03-10T21:00:33.016444+0000 mon.a (mon.0) 1318 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:00:34.260 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:33 gibba044 bash[25485]: cephadm 2021-03-10T21:00:33.018057+0000 mgr.gibba044.wflcwh (mgr.34466) 2798 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:00:34.260 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:33 gibba044 bash[25485]: cephadm 2021-03-10T21:00:33.018093+0000 mgr.gibba044.wflcwh (mgr.34466) 2799 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:00:34.261 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:33 gibba044 bash[25485]: cephadm 2021-03-10T21:00:33.018220+0000 mgr.gibba044.wflcwh (mgr.34466) 2800 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:00:34.261 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:33 gibba044 bash[25485]: cluster 2021-03-10T21:00:33.502406+0000 mgr.gibba044.wflcwh (mgr.34466) 2801 : cluster [DBG] pgmap v1577: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:35.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:35 gibba023 bash[30844]: cluster 2021-03-10T21:00:35.504137+0000 mgr.gibba044.wflcwh (mgr.34466) 2802 : cluster [DBG] pgmap v1578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:35.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:35 gibba023 bash[31815]: cluster 2021-03-10T21:00:35.504137+0000 mgr.gibba044.wflcwh (mgr.34466) 2802 : cluster [DBG] pgmap v1578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:36.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:35 gibba044 bash[25485]: cluster 2021-03-10T21:00:35.504137+0000 mgr.gibba044.wflcwh (mgr.34466) 2802 : cluster [DBG] pgmap v1578: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:38.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:38 gibba044 bash[25485]: cluster 2021-03-10T21:00:37.504966+0000 mgr.gibba044.wflcwh (mgr.34466) 2803 : cluster [DBG] pgmap v1579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:38.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:38 gibba023 bash[30844]: cluster 2021-03-10T21:00:37.504966+0000 mgr.gibba044.wflcwh (mgr.34466) 2803 : cluster [DBG] pgmap v1579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:38.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:38 gibba023 bash[31815]: cluster 2021-03-10T21:00:37.504966+0000 mgr.gibba044.wflcwh (mgr.34466) 2803 : cluster [DBG] pgmap v1579: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:39.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:39 gibba023 bash[30844]: cluster 2021-03-10T21:00:39.506519+0000 mgr.gibba044.wflcwh (mgr.34466) 2804 : cluster [DBG] pgmap v1580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:39.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:39 gibba023 bash[31815]: cluster 2021-03-10T21:00:39.506519+0000 mgr.gibba044.wflcwh (mgr.34466) 2804 : cluster [DBG] pgmap v1580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:40.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:39 gibba044 bash[25485]: cluster 2021-03-10T21:00:39.506519+0000 mgr.gibba044.wflcwh (mgr.34466) 2804 : cluster [DBG] pgmap v1580: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:41.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:41 gibba023 bash[30844]: cluster 2021-03-10T21:00:41.508151+0000 mgr.gibba044.wflcwh (mgr.34466) 2805 : cluster [DBG] pgmap v1581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:41.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:41 gibba023 bash[31815]: cluster 2021-03-10T21:00:41.508151+0000 mgr.gibba044.wflcwh (mgr.34466) 2805 : cluster [DBG] pgmap v1581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:42.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:41 gibba044 bash[25485]: cluster 2021-03-10T21:00:41.508151+0000 mgr.gibba044.wflcwh (mgr.34466) 2805 : cluster [DBG] pgmap v1581: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:43.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:43 gibba023 bash[30844]: cluster 2021-03-10T21:00:43.510026+0000 mgr.gibba044.wflcwh (mgr.34466) 2806 : cluster [DBG] pgmap v1582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:43.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:43 gibba023 bash[31815]: cluster 2021-03-10T21:00:43.510026+0000 mgr.gibba044.wflcwh (mgr.34466) 2806 : cluster [DBG] pgmap v1582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:44.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:43 gibba044 bash[25485]: cluster 2021-03-10T21:00:43.510026+0000 mgr.gibba044.wflcwh (mgr.34466) 2806 : cluster [DBG] pgmap v1582: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:45.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:45 gibba023 bash[30844]: cluster 2021-03-10T21:00:45.511736+0000 mgr.gibba044.wflcwh (mgr.34466) 2807 : cluster [DBG] pgmap v1583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:45.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:45 gibba023 bash[31815]: cluster 2021-03-10T21:00:45.511736+0000 mgr.gibba044.wflcwh (mgr.34466) 2807 : cluster [DBG] pgmap v1583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:46.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:45 gibba044 bash[25485]: cluster 2021-03-10T21:00:45.511736+0000 mgr.gibba044.wflcwh (mgr.34466) 2807 : cluster [DBG] pgmap v1583: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:48.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:48 gibba044 bash[25485]: cluster 2021-03-10T21:00:47.512310+0000 mgr.gibba044.wflcwh (mgr.34466) 2808 : cluster [DBG] pgmap v1584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:48.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:48 gibba023 bash[30844]: cluster 2021-03-10T21:00:47.512310+0000 mgr.gibba044.wflcwh (mgr.34466) 2808 : cluster [DBG] pgmap v1584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:48.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:48 gibba023 bash[31815]: cluster 2021-03-10T21:00:47.512310+0000 mgr.gibba044.wflcwh (mgr.34466) 2808 : cluster [DBG] pgmap v1584: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:49.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:49 gibba023 bash[30844]: cephadm 2021-03-10T21:00:48.029040+0000 mgr.gibba044.wflcwh (mgr.34466) 2809 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:00:49.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:49 gibba023 bash[31815]: cephadm 2021-03-10T21:00:48.029040+0000 mgr.gibba044.wflcwh (mgr.34466) 2809 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:00:50.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:49 gibba044 bash[25485]: cephadm 2021-03-10T21:00:48.029040+0000 mgr.gibba044.wflcwh (mgr.34466) 2809 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:00:50.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:50 gibba023 bash[30844]: cluster 2021-03-10T21:00:49.512746+0000 mgr.gibba044.wflcwh (mgr.34466) 2810 : cluster [DBG] pgmap v1585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:50.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:50 gibba023 bash[31815]: cluster 2021-03-10T21:00:49.512746+0000 mgr.gibba044.wflcwh (mgr.34466) 2810 : cluster [DBG] pgmap v1585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:51.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:50 gibba044 bash[25485]: cluster 2021-03-10T21:00:49.512746+0000 mgr.gibba044.wflcwh (mgr.34466) 2810 : cluster [DBG] pgmap v1585: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:51.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:51 gibba023 bash[30844]: cluster 2021-03-10T21:00:51.514194+0000 mgr.gibba044.wflcwh (mgr.34466) 2811 : cluster [DBG] pgmap v1586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:51.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:51 gibba023 bash[31815]: cluster 2021-03-10T21:00:51.514194+0000 mgr.gibba044.wflcwh (mgr.34466) 2811 : cluster [DBG] pgmap v1586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:52.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:51 gibba044 bash[25485]: cluster 2021-03-10T21:00:51.514194+0000 mgr.gibba044.wflcwh (mgr.34466) 2811 : cluster [DBG] pgmap v1586: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:53.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:53 gibba023 bash[30844]: cluster 2021-03-10T21:00:53.516065+0000 mgr.gibba044.wflcwh (mgr.34466) 2812 : cluster [DBG] pgmap v1587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:53.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:53 gibba023 bash[31815]: cluster 2021-03-10T21:00:53.516065+0000 mgr.gibba044.wflcwh (mgr.34466) 2812 : cluster [DBG] pgmap v1587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:54.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:53 gibba044 bash[25485]: cluster 2021-03-10T21:00:53.516065+0000 mgr.gibba044.wflcwh (mgr.34466) 2812 : cluster [DBG] pgmap v1587: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:55.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:55 gibba023 bash[30844]: cluster 2021-03-10T21:00:55.517550+0000 mgr.gibba044.wflcwh (mgr.34466) 2813 : cluster [DBG] pgmap v1588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:55.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:55 gibba023 bash[31815]: cluster 2021-03-10T21:00:55.517550+0000 mgr.gibba044.wflcwh (mgr.34466) 2813 : cluster [DBG] pgmap v1588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:56.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:55 gibba044 bash[25485]: cluster 2021-03-10T21:00:55.517550+0000 mgr.gibba044.wflcwh (mgr.34466) 2813 : cluster [DBG] pgmap v1588: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:58.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:58 gibba023 bash[30844]: cluster 2021-03-10T21:00:57.518240+0000 mgr.gibba044.wflcwh (mgr.34466) 2814 : cluster [DBG] pgmap v1589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:58.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:58 gibba023 bash[31815]: cluster 2021-03-10T21:00:57.518240+0000 mgr.gibba044.wflcwh (mgr.34466) 2814 : cluster [DBG] pgmap v1589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:59.012 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:58 gibba044 bash[25485]: cluster 2021-03-10T21:00:57.518240+0000 mgr.gibba044.wflcwh (mgr.34466) 2814 : cluster [DBG] pgmap v1589: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:59.412 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T21:00:59.641 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:00:59.641 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (52m) 7m ago 57m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T21:00:59.642 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (57m) 6m ago 57m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T21:00:59.642 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (52m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T21:00:59.642 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (52m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T21:00:59.642 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (51m) 7m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T21:00:59.642 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (51m) 7m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T21:00:59.643 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (51m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T21:00:59.643 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (51m) 7m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T21:00:59.643 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (57m) 7m ago 57m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T21:00:59.643 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (57m) 6m ago 57m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T21:00:59.644 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (50m) 7m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T21:00:59.644 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (49m) 7m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T21:00:59.644 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (49m) 7m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T21:00:59.644 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (49m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T21:00:59.644 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (48m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T21:00:59.645 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (48m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T21:00:59.645 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (47m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T21:00:59.645 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (47m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T21:00:59.645 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (57m) 6m ago 57m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T21:00:59.646 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 7m ago 55m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:00:59.646 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 6m ago 55m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:00:59.894 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T21:00:59.895 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T21:00:59.896 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:00:59.896 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:00:59.897 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T21:00:59.902 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:00:59.902 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:00:59.903 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T21:00:59.905 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:00:59.906 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:00:59.907 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T21:00:59.908 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T21:00:59.909 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:00:59.915 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T21:00:59.916 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T21:00:59.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:59 gibba023 bash[30844]: audit 2021-03-10T21:00:59.400725+0000 mgr.gibba044.wflcwh (mgr.34466) 2815 : audit [DBG] from='client.45948 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:00:59.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:00:59 gibba023 bash[30844]: cluster 2021-03-10T21:00:59.519659+0000 mgr.gibba044.wflcwh (mgr.34466) 2816 : cluster [DBG] pgmap v1590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:00:59.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:59 gibba023 bash[31815]: audit 2021-03-10T21:00:59.400725+0000 mgr.gibba044.wflcwh (mgr.34466) 2815 : audit [DBG] from='client.45948 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:00:59.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:00:59 gibba023 bash[31815]: cluster 2021-03-10T21:00:59.519659+0000 mgr.gibba044.wflcwh (mgr.34466) 2816 : cluster [DBG] pgmap v1590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:00.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:59 gibba044 bash[25485]: audit 2021-03-10T21:00:59.400725+0000 mgr.gibba044.wflcwh (mgr.34466) 2815 : audit [DBG] from='client.45948 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:01:00.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:00:59 gibba044 bash[25485]: cluster 2021-03-10T21:00:59.519659+0000 mgr.gibba044.wflcwh (mgr.34466) 2816 : cluster [DBG] pgmap v1590: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:00.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:00 gibba023 bash[30844]: audit 2021-03-10T21:00:59.628973+0000 mgr.gibba044.wflcwh (mgr.34466) 2817 : audit [DBG] from='client.55933 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:01:00.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:00 gibba023 bash[30844]: audit 2021-03-10T21:00:59.888303+0000 mon.a (mon.0) 1319 : audit [DBG] from='client.? 172.21.2.123:0/91704930' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:00.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:00 gibba023 bash[31815]: audit 2021-03-10T21:00:59.628973+0000 mgr.gibba044.wflcwh (mgr.34466) 2817 : audit [DBG] from='client.55933 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:01:00.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:00 gibba023 bash[31815]: audit 2021-03-10T21:00:59.888303+0000 mon.a (mon.0) 1319 : audit [DBG] from='client.? 172.21.2.123:0/91704930' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:01.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:00 gibba044 bash[25485]: audit 2021-03-10T21:00:59.628973+0000 mgr.gibba044.wflcwh (mgr.34466) 2817 : audit [DBG] from='client.55933 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:01:01.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:00 gibba044 bash[25485]: audit 2021-03-10T21:00:59.888303+0000 mon.a (mon.0) 1319 : audit [DBG] from='client.? 172.21.2.123:0/91704930' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:01.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:01 gibba023 bash[30844]: cluster 2021-03-10T21:01:01.520980+0000 mgr.gibba044.wflcwh (mgr.34466) 2818 : cluster [DBG] pgmap v1591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:01.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:01 gibba023 bash[31815]: cluster 2021-03-10T21:01:01.520980+0000 mgr.gibba044.wflcwh (mgr.34466) 2818 : cluster [DBG] pgmap v1591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:02.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:01 gibba044 bash[25485]: cluster 2021-03-10T21:01:01.520980+0000 mgr.gibba044.wflcwh (mgr.34466) 2818 : cluster [DBG] pgmap v1591: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:03.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:03 gibba023 bash[30844]: cephadm 2021-03-10T21:01:03.037389+0000 mgr.gibba044.wflcwh (mgr.34466) 2819 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:01:03.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:03 gibba023 bash[30844]: cluster 2021-03-10T21:01:03.522639+0000 mgr.gibba044.wflcwh (mgr.34466) 2820 : cluster [DBG] pgmap v1592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:03.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:03 gibba023 bash[31815]: cephadm 2021-03-10T21:01:03.037389+0000 mgr.gibba044.wflcwh (mgr.34466) 2819 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:01:03.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:03 gibba023 bash[31815]: cluster 2021-03-10T21:01:03.522639+0000 mgr.gibba044.wflcwh (mgr.34466) 2820 : cluster [DBG] pgmap v1592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:04.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:03 gibba044 bash[25485]: cephadm 2021-03-10T21:01:03.037389+0000 mgr.gibba044.wflcwh (mgr.34466) 2819 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:01:04.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:03 gibba044 bash[25485]: cluster 2021-03-10T21:01:03.522639+0000 mgr.gibba044.wflcwh (mgr.34466) 2820 : cluster [DBG] pgmap v1592: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:05.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:05 gibba023 bash[30844]: cluster 2021-03-10T21:01:05.524296+0000 mgr.gibba044.wflcwh (mgr.34466) 2821 : cluster [DBG] pgmap v1593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:05.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:05 gibba023 bash[31815]: cluster 2021-03-10T21:01:05.524296+0000 mgr.gibba044.wflcwh (mgr.34466) 2821 : cluster [DBG] pgmap v1593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:06.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:05 gibba044 bash[25485]: cluster 2021-03-10T21:01:05.524296+0000 mgr.gibba044.wflcwh (mgr.34466) 2821 : cluster [DBG] pgmap v1593: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:08.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:08 gibba023 bash[30844]: cluster 2021-03-10T21:01:07.524923+0000 mgr.gibba044.wflcwh (mgr.34466) 2822 : cluster [DBG] pgmap v1594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:08.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:08 gibba023 bash[31815]: cluster 2021-03-10T21:01:07.524923+0000 mgr.gibba044.wflcwh (mgr.34466) 2822 : cluster [DBG] pgmap v1594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:09.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:08 gibba044 bash[25485]: cluster 2021-03-10T21:01:07.524923+0000 mgr.gibba044.wflcwh (mgr.34466) 2822 : cluster [DBG] pgmap v1594: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:09.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:09 gibba023 bash[30844]: cluster 2021-03-10T21:01:09.526382+0000 mgr.gibba044.wflcwh (mgr.34466) 2823 : cluster [DBG] pgmap v1595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:09.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:09 gibba023 bash[31815]: cluster 2021-03-10T21:01:09.526382+0000 mgr.gibba044.wflcwh (mgr.34466) 2823 : cluster [DBG] pgmap v1595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:10.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:09 gibba044 bash[25485]: cluster 2021-03-10T21:01:09.526382+0000 mgr.gibba044.wflcwh (mgr.34466) 2823 : cluster [DBG] pgmap v1595: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:11.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:11 gibba023 bash[30844]: cluster 2021-03-10T21:01:11.527999+0000 mgr.gibba044.wflcwh (mgr.34466) 2824 : cluster [DBG] pgmap v1596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:11.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:11 gibba023 bash[31815]: cluster 2021-03-10T21:01:11.527999+0000 mgr.gibba044.wflcwh (mgr.34466) 2824 : cluster [DBG] pgmap v1596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:12.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:11 gibba044 bash[25485]: cluster 2021-03-10T21:01:11.527999+0000 mgr.gibba044.wflcwh (mgr.34466) 2824 : cluster [DBG] pgmap v1596: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:13.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:13 gibba023 bash[30844]: cluster 2021-03-10T21:01:13.529750+0000 mgr.gibba044.wflcwh (mgr.34466) 2825 : cluster [DBG] pgmap v1597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:13.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:13 gibba023 bash[31815]: cluster 2021-03-10T21:01:13.529750+0000 mgr.gibba044.wflcwh (mgr.34466) 2825 : cluster [DBG] pgmap v1597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:14.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:13 gibba044 bash[25485]: cluster 2021-03-10T21:01:13.529750+0000 mgr.gibba044.wflcwh (mgr.34466) 2825 : cluster [DBG] pgmap v1597: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:15.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:15 gibba023 bash[30844]: cluster 2021-03-10T21:01:15.531467+0000 mgr.gibba044.wflcwh (mgr.34466) 2826 : cluster [DBG] pgmap v1598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:15.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:15 gibba023 bash[31815]: cluster 2021-03-10T21:01:15.531467+0000 mgr.gibba044.wflcwh (mgr.34466) 2826 : cluster [DBG] pgmap v1598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:16.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:15 gibba044 bash[25485]: cluster 2021-03-10T21:01:15.531467+0000 mgr.gibba044.wflcwh (mgr.34466) 2826 : cluster [DBG] pgmap v1598: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:18.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:18 gibba023 bash[30844]: cluster 2021-03-10T21:01:17.531998+0000 mgr.gibba044.wflcwh (mgr.34466) 2827 : cluster [DBG] pgmap v1599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:18.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:18 gibba023 bash[31815]: cluster 2021-03-10T21:01:17.531998+0000 mgr.gibba044.wflcwh (mgr.34466) 2827 : cluster [DBG] pgmap v1599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:19.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:18 gibba044 bash[25485]: cluster 2021-03-10T21:01:17.531998+0000 mgr.gibba044.wflcwh (mgr.34466) 2827 : cluster [DBG] pgmap v1599: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:19.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:19 gibba023 bash[30844]: cephadm 2021-03-10T21:01:18.053373+0000 mgr.gibba044.wflcwh (mgr.34466) 2828 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:01:19.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:19 gibba023 bash[31815]: cephadm 2021-03-10T21:01:18.053373+0000 mgr.gibba044.wflcwh (mgr.34466) 2828 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:01:20.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:19 gibba044 bash[25485]: cephadm 2021-03-10T21:01:18.053373+0000 mgr.gibba044.wflcwh (mgr.34466) 2828 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:01:20.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:20 gibba023 bash[30844]: cluster 2021-03-10T21:01:19.533205+0000 mgr.gibba044.wflcwh (mgr.34466) 2829 : cluster [DBG] pgmap v1600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:20.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:20 gibba023 bash[31815]: cluster 2021-03-10T21:01:19.533205+0000 mgr.gibba044.wflcwh (mgr.34466) 2829 : cluster [DBG] pgmap v1600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:21.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:20 gibba044 bash[25485]: cluster 2021-03-10T21:01:19.533205+0000 mgr.gibba044.wflcwh (mgr.34466) 2829 : cluster [DBG] pgmap v1600: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:22.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:22 gibba023 bash[30844]: cluster 2021-03-10T21:01:21.534740+0000 mgr.gibba044.wflcwh (mgr.34466) 2830 : cluster [DBG] pgmap v1601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:22.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:22 gibba023 bash[31815]: cluster 2021-03-10T21:01:21.534740+0000 mgr.gibba044.wflcwh (mgr.34466) 2830 : cluster [DBG] pgmap v1601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:23.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:22 gibba044 bash[25485]: cluster 2021-03-10T21:01:21.534740+0000 mgr.gibba044.wflcwh (mgr.34466) 2830 : cluster [DBG] pgmap v1601: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:24.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:24 gibba023 bash[30844]: cluster 2021-03-10T21:01:23.536335+0000 mgr.gibba044.wflcwh (mgr.34466) 2831 : cluster [DBG] pgmap v1602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:24.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:24 gibba023 bash[31815]: cluster 2021-03-10T21:01:23.536335+0000 mgr.gibba044.wflcwh (mgr.34466) 2831 : cluster [DBG] pgmap v1602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:25.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:24 gibba044 bash[25485]: cluster 2021-03-10T21:01:23.536335+0000 mgr.gibba044.wflcwh (mgr.34466) 2831 : cluster [DBG] pgmap v1602: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:26.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:26 gibba023 bash[30844]: cluster 2021-03-10T21:01:25.538041+0000 mgr.gibba044.wflcwh (mgr.34466) 2832 : cluster [DBG] pgmap v1603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:26.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:26 gibba023 bash[31815]: cluster 2021-03-10T21:01:25.538041+0000 mgr.gibba044.wflcwh (mgr.34466) 2832 : cluster [DBG] pgmap v1603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:27.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:26 gibba044 bash[25485]: cluster 2021-03-10T21:01:25.538041+0000 mgr.gibba044.wflcwh (mgr.34466) 2832 : cluster [DBG] pgmap v1603: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:27 gibba023 bash[30844]: audit 2021-03-10T21:01:27.391145+0000 mon.a (mon.0) 1320 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:01:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:27 gibba023 bash[30844]: audit 2021-03-10T21:01:27.391776+0000 mon.a (mon.0) 1321 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:01:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:27 gibba023 bash[30844]: audit 2021-03-10T21:01:27.392348+0000 mon.a (mon.0) 1322 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T21:01:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:27 gibba023 bash[30844]: audit 2021-03-10T21:01:27.393027+0000 mon.a (mon.0) 1323 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T21:01:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:27 gibba023 bash[30844]: audit 2021-03-10T21:01:27.393760+0000 mon.a (mon.0) 1324 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T21:01:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:27 gibba023 bash[30844]: audit 2021-03-10T21:01:27.394452+0000 mon.a (mon.0) 1325 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T21:01:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:27 gibba023 bash[30844]: cluster 2021-03-10T21:01:27.539548+0000 mgr.gibba044.wflcwh (mgr.34466) 2833 : cluster [DBG] pgmap v1604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:27.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:27 gibba023 bash[31815]: audit 2021-03-10T21:01:27.391145+0000 mon.a (mon.0) 1320 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:01:27.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:27 gibba023 bash[31815]: audit 2021-03-10T21:01:27.391776+0000 mon.a (mon.0) 1321 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:01:27.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:27 gibba023 bash[31815]: audit 2021-03-10T21:01:27.392348+0000 mon.a (mon.0) 1322 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T21:01:27.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:27 gibba023 bash[31815]: audit 2021-03-10T21:01:27.393027+0000 mon.a (mon.0) 1323 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T21:01:27.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:27 gibba023 bash[31815]: audit 2021-03-10T21:01:27.393760+0000 mon.a (mon.0) 1324 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T21:01:27.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:27 gibba023 bash[31815]: audit 2021-03-10T21:01:27.394452+0000 mon.a (mon.0) 1325 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T21:01:27.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:27 gibba023 bash[31815]: cluster 2021-03-10T21:01:27.539548+0000 mgr.gibba044.wflcwh (mgr.34466) 2833 : cluster [DBG] pgmap v1604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:28.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:27 gibba044 bash[25485]: audit 2021-03-10T21:01:27.391145+0000 mon.a (mon.0) 1320 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:01:28.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:27 gibba044 bash[25485]: audit 2021-03-10T21:01:27.391776+0000 mon.a (mon.0) 1321 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:01:28.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:27 gibba044 bash[25485]: audit 2021-03-10T21:01:27.392348+0000 mon.a (mon.0) 1322 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T21:01:28.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:27 gibba044 bash[25485]: audit 2021-03-10T21:01:27.393027+0000 mon.a (mon.0) 1323 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2021-03-10T21:01:28.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:27 gibba044 bash[25485]: audit 2021-03-10T21:01:27.393760+0000 mon.a (mon.0) 1324 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T21:01:28.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:27 gibba044 bash[25485]: audit 2021-03-10T21:01:27.394452+0000 mon.a (mon.0) 1325 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T21:01:28.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:27 gibba044 bash[25485]: cluster 2021-03-10T21:01:27.539548+0000 mgr.gibba044.wflcwh (mgr.34466) 2833 : cluster [DBG] pgmap v1604: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:29.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:29 gibba023 bash[30844]: cluster 2021-03-10T21:01:29.540882+0000 mgr.gibba044.wflcwh (mgr.34466) 2834 : cluster [DBG] pgmap v1605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:29.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:29 gibba023 bash[31815]: cluster 2021-03-10T21:01:29.540882+0000 mgr.gibba044.wflcwh (mgr.34466) 2834 : cluster [DBG] pgmap v1605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:30.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:29 gibba044 bash[25485]: cluster 2021-03-10T21:01:29.540882+0000 mgr.gibba044.wflcwh (mgr.34466) 2834 : cluster [DBG] pgmap v1605: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:30.133 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T21:01:30.360 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:01:30.361 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (52m) 8m ago 58m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T21:01:30.361 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (57m) 6m ago 57m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T21:01:30.362 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (53m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T21:01:30.362 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (53m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T21:01:30.363 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (52m) 8m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T21:01:30.363 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (52m) 8m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T21:01:30.363 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (51m) 6m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T21:01:30.364 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (51m) 8m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T21:01:30.364 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (58m) 8m ago 58m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T21:01:30.365 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (58m) 6m ago 58m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T21:01:30.365 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (50m) 8m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T21:01:30.365 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (50m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T21:01:30.366 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (50m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T21:01:30.366 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (49m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T21:01:30.367 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (49m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T21:01:30.367 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (48m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T21:01:30.368 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (48m) 6m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T21:01:30.368 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (47m) 6m ago 58m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T21:01:30.369 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (57m) 6m ago 58m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T21:01:30.369 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 8m ago 56m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:01:30.370 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 6m ago 56m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:01:30.610 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T21:01:30.610 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T21:01:30.611 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:01:30.611 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:01:30.611 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T21:01:30.612 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:01:30.612 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:01:30.612 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T21:01:30.613 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:01:30.613 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:01:30.613 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T21:01:30.614 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T21:01:30.614 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:01:30.614 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T21:01:30.615 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T21:01:30.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:30 gibba023 bash[30844]: audit 2021-03-10T21:01:30.121909+0000 mgr.gibba044.wflcwh (mgr.34466) 2835 : audit [DBG] from='client.45966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:01:30.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:30 gibba023 bash[30844]: audit 2021-03-10T21:01:30.345848+0000 mgr.gibba044.wflcwh (mgr.34466) 2836 : audit [DBG] from='client.55951 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:01:30.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:30 gibba023 bash[30844]: audit 2021-03-10T21:01:30.607469+0000 mon.a (mon.0) 1326 : audit [DBG] from='client.? 172.21.2.123:0/3340925635' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:30.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:30 gibba023 bash[31815]: audit 2021-03-10T21:01:30.121909+0000 mgr.gibba044.wflcwh (mgr.34466) 2835 : audit [DBG] from='client.45966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:01:30.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:30 gibba023 bash[31815]: audit 2021-03-10T21:01:30.345848+0000 mgr.gibba044.wflcwh (mgr.34466) 2836 : audit [DBG] from='client.55951 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:01:30.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:30 gibba023 bash[31815]: audit 2021-03-10T21:01:30.607469+0000 mon.a (mon.0) 1326 : audit [DBG] from='client.? 172.21.2.123:0/3340925635' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:31.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:30 gibba044 bash[25485]: audit 2021-03-10T21:01:30.121909+0000 mgr.gibba044.wflcwh (mgr.34466) 2835 : audit [DBG] from='client.45966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:01:31.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:30 gibba044 bash[25485]: audit 2021-03-10T21:01:30.345848+0000 mgr.gibba044.wflcwh (mgr.34466) 2836 : audit [DBG] from='client.55951 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:01:31.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:30 gibba044 bash[25485]: audit 2021-03-10T21:01:30.607469+0000 mon.a (mon.0) 1326 : audit [DBG] from='client.? 172.21.2.123:0/3340925635' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:31.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:31 gibba023 bash[30844]: cluster 2021-03-10T21:01:31.542399+0000 mgr.gibba044.wflcwh (mgr.34466) 2837 : cluster [DBG] pgmap v1606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:31.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:31 gibba023 bash[31815]: cluster 2021-03-10T21:01:31.542399+0000 mgr.gibba044.wflcwh (mgr.34466) 2837 : cluster [DBG] pgmap v1606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:32.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:31 gibba044 bash[25485]: cluster 2021-03-10T21:01:31.542399+0000 mgr.gibba044.wflcwh (mgr.34466) 2837 : cluster [DBG] pgmap v1606: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:34.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[30844]: cephadm 2021-03-10T21:01:33.070104+0000 mgr.gibba044.wflcwh (mgr.34466) 2838 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:01:34.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[30844]: cephadm 2021-03-10T21:01:33.071748+0000 mgr.gibba044.wflcwh (mgr.34466) 2839 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:01:34.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[30844]: audit 2021-03-10T21:01:33.263079+0000 mon.a (mon.0) 1327 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:01:34.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[30844]: cephadm 2021-03-10T21:01:33.266197+0000 mgr.gibba044.wflcwh (mgr.34466) 2840 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:01:34.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[30844]: audit 2021-03-10T21:01:33.266600+0000 mon.a (mon.0) 1328 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:01:34.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[30844]: cephadm 2021-03-10T21:01:33.268212+0000 mgr.gibba044.wflcwh (mgr.34466) 2841 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:01:34.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[30844]: audit 2021-03-10T21:01:33.268377+0000 mon.a (mon.0) 1329 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:34.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[30844]: cephadm 2021-03-10T21:01:33.269502+0000 mgr.gibba044.wflcwh (mgr.34466) 2842 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:01:34.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[30844]: cephadm 2021-03-10T21:01:33.269575+0000 mgr.gibba044.wflcwh (mgr.34466) 2843 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:01:34.681 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[30844]: audit 2021-03-10T21:01:33.269711+0000 mon.a (mon.0) 1330 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:34.681 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[30844]: cephadm 2021-03-10T21:01:33.270977+0000 mgr.gibba044.wflcwh (mgr.34466) 2844 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:01:34.681 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[30844]: cephadm 2021-03-10T21:01:33.271044+0000 mgr.gibba044.wflcwh (mgr.34466) 2845 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:01:34.681 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[30844]: audit 2021-03-10T21:01:33.271131+0000 mon.a (mon.0) 1331 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:34.681 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[30844]: cephadm 2021-03-10T21:01:33.272220+0000 mgr.gibba044.wflcwh (mgr.34466) 2846 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:01:34.682 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[30844]: cephadm 2021-03-10T21:01:33.273664+0000 mgr.gibba044.wflcwh (mgr.34466) 2847 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:01:34.682 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[30844]: cephadm 2021-03-10T21:01:33.273729+0000 mgr.gibba044.wflcwh (mgr.34466) 2848 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:01:34.682 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[30844]: audit 2021-03-10T21:01:33.273932+0000 mon.a (mon.0) 1332 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:34.683 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[30844]: cephadm 2021-03-10T21:01:33.275092+0000 mgr.gibba044.wflcwh (mgr.34466) 2849 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:01:34.683 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[30844]: cephadm 2021-03-10T21:01:33.275425+0000 mgr.gibba044.wflcwh (mgr.34466) 2850 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:01:34.683 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[30844]: audit 2021-03-10T21:01:33.275470+0000 mon.a (mon.0) 1333 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:34.683 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[30844]: cephadm 2021-03-10T21:01:33.276973+0000 mgr.gibba044.wflcwh (mgr.34466) 2851 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:01:34.684 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[30844]: cephadm 2021-03-10T21:01:33.277009+0000 mgr.gibba044.wflcwh (mgr.34466) 2852 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:01:34.684 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[30844]: cephadm 2021-03-10T21:01:33.277129+0000 mgr.gibba044.wflcwh (mgr.34466) 2853 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:01:34.684 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[30844]: cluster 2021-03-10T21:01:33.544310+0000 mgr.gibba044.wflcwh (mgr.34466) 2854 : cluster [DBG] pgmap v1607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:34.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[31815]: cephadm 2021-03-10T21:01:33.070104+0000 mgr.gibba044.wflcwh (mgr.34466) 2838 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:01:34.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[31815]: cephadm 2021-03-10T21:01:33.071748+0000 mgr.gibba044.wflcwh (mgr.34466) 2839 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:01:34.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[31815]: audit 2021-03-10T21:01:33.263079+0000 mon.a (mon.0) 1327 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:01:34.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[31815]: cephadm 2021-03-10T21:01:33.266197+0000 mgr.gibba044.wflcwh (mgr.34466) 2840 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:01:34.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[31815]: audit 2021-03-10T21:01:33.266600+0000 mon.a (mon.0) 1328 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:01:34.686 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[31815]: cephadm 2021-03-10T21:01:33.268212+0000 mgr.gibba044.wflcwh (mgr.34466) 2841 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:01:34.686 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[31815]: audit 2021-03-10T21:01:33.268377+0000 mon.a (mon.0) 1329 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:34.686 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[31815]: cephadm 2021-03-10T21:01:33.269502+0000 mgr.gibba044.wflcwh (mgr.34466) 2842 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:01:34.686 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[31815]: cephadm 2021-03-10T21:01:33.269575+0000 mgr.gibba044.wflcwh (mgr.34466) 2843 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:01:34.687 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[31815]: audit 2021-03-10T21:01:33.269711+0000 mon.a (mon.0) 1330 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:34.687 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[31815]: cephadm 2021-03-10T21:01:33.270977+0000 mgr.gibba044.wflcwh (mgr.34466) 2844 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:01:34.687 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[31815]: cephadm 2021-03-10T21:01:33.271044+0000 mgr.gibba044.wflcwh (mgr.34466) 2845 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:01:34.688 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[31815]: audit 2021-03-10T21:01:33.271131+0000 mon.a (mon.0) 1331 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:34.688 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[31815]: cephadm 2021-03-10T21:01:33.272220+0000 mgr.gibba044.wflcwh (mgr.34466) 2846 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:01:34.688 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[31815]: cephadm 2021-03-10T21:01:33.273664+0000 mgr.gibba044.wflcwh (mgr.34466) 2847 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:01:34.688 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[31815]: cephadm 2021-03-10T21:01:33.273729+0000 mgr.gibba044.wflcwh (mgr.34466) 2848 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:01:34.688 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[31815]: audit 2021-03-10T21:01:33.273932+0000 mon.a (mon.0) 1332 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:34.689 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[31815]: cephadm 2021-03-10T21:01:33.275092+0000 mgr.gibba044.wflcwh (mgr.34466) 2849 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:01:34.689 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[31815]: cephadm 2021-03-10T21:01:33.275425+0000 mgr.gibba044.wflcwh (mgr.34466) 2850 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:01:34.689 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[31815]: audit 2021-03-10T21:01:33.275470+0000 mon.a (mon.0) 1333 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:34.689 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[31815]: cephadm 2021-03-10T21:01:33.276973+0000 mgr.gibba044.wflcwh (mgr.34466) 2851 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:01:34.690 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[31815]: cephadm 2021-03-10T21:01:33.277009+0000 mgr.gibba044.wflcwh (mgr.34466) 2852 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:01:34.690 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[31815]: cephadm 2021-03-10T21:01:33.277129+0000 mgr.gibba044.wflcwh (mgr.34466) 2853 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:01:34.690 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:34 gibba023 bash[31815]: cluster 2021-03-10T21:01:33.544310+0000 mgr.gibba044.wflcwh (mgr.34466) 2854 : cluster [DBG] pgmap v1607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:34.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:34 gibba044 bash[25485]: cephadm 2021-03-10T21:01:33.070104+0000 mgr.gibba044.wflcwh (mgr.34466) 2838 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:01:34.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:34 gibba044 bash[25485]: cephadm 2021-03-10T21:01:33.071748+0000 mgr.gibba044.wflcwh (mgr.34466) 2839 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:01:34.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:34 gibba044 bash[25485]: audit 2021-03-10T21:01:33.263079+0000 mon.a (mon.0) 1327 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:01:34.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:34 gibba044 bash[25485]: cephadm 2021-03-10T21:01:33.266197+0000 mgr.gibba044.wflcwh (mgr.34466) 2840 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:01:34.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:34 gibba044 bash[25485]: audit 2021-03-10T21:01:33.266600+0000 mon.a (mon.0) 1328 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:01:34.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:34 gibba044 bash[25485]: cephadm 2021-03-10T21:01:33.268212+0000 mgr.gibba044.wflcwh (mgr.34466) 2841 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:01:34.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:34 gibba044 bash[25485]: audit 2021-03-10T21:01:33.268377+0000 mon.a (mon.0) 1329 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:34.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:34 gibba044 bash[25485]: cephadm 2021-03-10T21:01:33.269502+0000 mgr.gibba044.wflcwh (mgr.34466) 2842 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:01:34.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:34 gibba044 bash[25485]: cephadm 2021-03-10T21:01:33.269575+0000 mgr.gibba044.wflcwh (mgr.34466) 2843 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:01:34.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:34 gibba044 bash[25485]: audit 2021-03-10T21:01:33.269711+0000 mon.a (mon.0) 1330 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:34.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:34 gibba044 bash[25485]: cephadm 2021-03-10T21:01:33.270977+0000 mgr.gibba044.wflcwh (mgr.34466) 2844 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:01:34.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:34 gibba044 bash[25485]: cephadm 2021-03-10T21:01:33.271044+0000 mgr.gibba044.wflcwh (mgr.34466) 2845 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:01:34.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:34 gibba044 bash[25485]: audit 2021-03-10T21:01:33.271131+0000 mon.a (mon.0) 1331 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:34.758 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:34 gibba044 bash[25485]: cephadm 2021-03-10T21:01:33.272220+0000 mgr.gibba044.wflcwh (mgr.34466) 2846 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:01:34.758 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:34 gibba044 bash[25485]: cephadm 2021-03-10T21:01:33.273664+0000 mgr.gibba044.wflcwh (mgr.34466) 2847 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:01:34.758 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:34 gibba044 bash[25485]: cephadm 2021-03-10T21:01:33.273729+0000 mgr.gibba044.wflcwh (mgr.34466) 2848 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:01:34.758 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:34 gibba044 bash[25485]: audit 2021-03-10T21:01:33.273932+0000 mon.a (mon.0) 1332 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:34.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:34 gibba044 bash[25485]: cephadm 2021-03-10T21:01:33.275092+0000 mgr.gibba044.wflcwh (mgr.34466) 2849 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:01:34.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:34 gibba044 bash[25485]: cephadm 2021-03-10T21:01:33.275425+0000 mgr.gibba044.wflcwh (mgr.34466) 2850 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:01:34.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:34 gibba044 bash[25485]: audit 2021-03-10T21:01:33.275470+0000 mon.a (mon.0) 1333 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:01:34.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:34 gibba044 bash[25485]: cephadm 2021-03-10T21:01:33.276973+0000 mgr.gibba044.wflcwh (mgr.34466) 2851 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:01:34.760 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:34 gibba044 bash[25485]: cephadm 2021-03-10T21:01:33.277009+0000 mgr.gibba044.wflcwh (mgr.34466) 2852 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:01:34.760 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:34 gibba044 bash[25485]: cephadm 2021-03-10T21:01:33.277129+0000 mgr.gibba044.wflcwh (mgr.34466) 2853 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:01:34.760 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:34 gibba044 bash[25485]: cluster 2021-03-10T21:01:33.544310+0000 mgr.gibba044.wflcwh (mgr.34466) 2854 : cluster [DBG] pgmap v1607: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:35.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:35 gibba023 bash[30844]: cluster 2021-03-10T21:01:35.546048+0000 mgr.gibba044.wflcwh (mgr.34466) 2855 : cluster [DBG] pgmap v1608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:35.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:35 gibba023 bash[31815]: cluster 2021-03-10T21:01:35.546048+0000 mgr.gibba044.wflcwh (mgr.34466) 2855 : cluster [DBG] pgmap v1608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:36.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:35 gibba044 bash[25485]: cluster 2021-03-10T21:01:35.546048+0000 mgr.gibba044.wflcwh (mgr.34466) 2855 : cluster [DBG] pgmap v1608: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:38.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:38 gibba023 bash[30844]: cluster 2021-03-10T21:01:37.546966+0000 mgr.gibba044.wflcwh (mgr.34466) 2856 : cluster [DBG] pgmap v1609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:38.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:38 gibba023 bash[31815]: cluster 2021-03-10T21:01:37.546966+0000 mgr.gibba044.wflcwh (mgr.34466) 2856 : cluster [DBG] pgmap v1609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:39.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:38 gibba044 bash[25485]: cluster 2021-03-10T21:01:37.546966+0000 mgr.gibba044.wflcwh (mgr.34466) 2856 : cluster [DBG] pgmap v1609: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:39.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:39 gibba023 bash[30844]: cluster 2021-03-10T21:01:39.548344+0000 mgr.gibba044.wflcwh (mgr.34466) 2857 : cluster [DBG] pgmap v1610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:39.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:39 gibba023 bash[31815]: cluster 2021-03-10T21:01:39.548344+0000 mgr.gibba044.wflcwh (mgr.34466) 2857 : cluster [DBG] pgmap v1610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:40.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:39 gibba044 bash[25485]: cluster 2021-03-10T21:01:39.548344+0000 mgr.gibba044.wflcwh (mgr.34466) 2857 : cluster [DBG] pgmap v1610: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:41.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:41 gibba023 bash[30844]: cluster 2021-03-10T21:01:41.549880+0000 mgr.gibba044.wflcwh (mgr.34466) 2858 : cluster [DBG] pgmap v1611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:41.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:41 gibba023 bash[31815]: cluster 2021-03-10T21:01:41.549880+0000 mgr.gibba044.wflcwh (mgr.34466) 2858 : cluster [DBG] pgmap v1611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:42.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:41 gibba044 bash[25485]: cluster 2021-03-10T21:01:41.549880+0000 mgr.gibba044.wflcwh (mgr.34466) 2858 : cluster [DBG] pgmap v1611: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:43.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:43 gibba023 bash[30844]: cluster 2021-03-10T21:01:43.551849+0000 mgr.gibba044.wflcwh (mgr.34466) 2859 : cluster [DBG] pgmap v1612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:43.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:43 gibba023 bash[31815]: cluster 2021-03-10T21:01:43.551849+0000 mgr.gibba044.wflcwh (mgr.34466) 2859 : cluster [DBG] pgmap v1612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:44.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:43 gibba044 bash[25485]: cluster 2021-03-10T21:01:43.551849+0000 mgr.gibba044.wflcwh (mgr.34466) 2859 : cluster [DBG] pgmap v1612: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:45.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:45 gibba023 bash[30844]: cluster 2021-03-10T21:01:45.553717+0000 mgr.gibba044.wflcwh (mgr.34466) 2860 : cluster [DBG] pgmap v1613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:45.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:45 gibba023 bash[31815]: cluster 2021-03-10T21:01:45.553717+0000 mgr.gibba044.wflcwh (mgr.34466) 2860 : cluster [DBG] pgmap v1613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:46.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:45 gibba044 bash[25485]: cluster 2021-03-10T21:01:45.553717+0000 mgr.gibba044.wflcwh (mgr.34466) 2860 : cluster [DBG] pgmap v1613: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:48.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:48 gibba044 bash[25485]: cluster 2021-03-10T21:01:47.554582+0000 mgr.gibba044.wflcwh (mgr.34466) 2861 : cluster [DBG] pgmap v1614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:48.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:48 gibba023 bash[30844]: cluster 2021-03-10T21:01:47.554582+0000 mgr.gibba044.wflcwh (mgr.34466) 2861 : cluster [DBG] pgmap v1614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:48.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:48 gibba023 bash[31815]: cluster 2021-03-10T21:01:47.554582+0000 mgr.gibba044.wflcwh (mgr.34466) 2861 : cluster [DBG] pgmap v1614: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:49.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:49 gibba023 bash[30844]: cephadm 2021-03-10T21:01:48.293091+0000 mgr.gibba044.wflcwh (mgr.34466) 2862 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:01:49.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:49 gibba023 bash[31815]: cephadm 2021-03-10T21:01:48.293091+0000 mgr.gibba044.wflcwh (mgr.34466) 2862 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:01:50.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:49 gibba044 bash[25485]: cephadm 2021-03-10T21:01:48.293091+0000 mgr.gibba044.wflcwh (mgr.34466) 2862 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:01:50.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:50 gibba023 bash[30844]: cluster 2021-03-10T21:01:49.555221+0000 mgr.gibba044.wflcwh (mgr.34466) 2863 : cluster [DBG] pgmap v1615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:50.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:50 gibba023 bash[31815]: cluster 2021-03-10T21:01:49.555221+0000 mgr.gibba044.wflcwh (mgr.34466) 2863 : cluster [DBG] pgmap v1615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:51.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:50 gibba044 bash[25485]: cluster 2021-03-10T21:01:49.555221+0000 mgr.gibba044.wflcwh (mgr.34466) 2863 : cluster [DBG] pgmap v1615: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:51.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:51 gibba023 bash[30844]: cluster 2021-03-10T21:01:51.556661+0000 mgr.gibba044.wflcwh (mgr.34466) 2864 : cluster [DBG] pgmap v1616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:51.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:51 gibba023 bash[31815]: cluster 2021-03-10T21:01:51.556661+0000 mgr.gibba044.wflcwh (mgr.34466) 2864 : cluster [DBG] pgmap v1616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:52.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:51 gibba044 bash[25485]: cluster 2021-03-10T21:01:51.556661+0000 mgr.gibba044.wflcwh (mgr.34466) 2864 : cluster [DBG] pgmap v1616: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:53.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:53 gibba023 bash[30844]: cluster 2021-03-10T21:01:53.558323+0000 mgr.gibba044.wflcwh (mgr.34466) 2865 : cluster [DBG] pgmap v1617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:53.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:53 gibba023 bash[31815]: cluster 2021-03-10T21:01:53.558323+0000 mgr.gibba044.wflcwh (mgr.34466) 2865 : cluster [DBG] pgmap v1617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:54.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:53 gibba044 bash[25485]: cluster 2021-03-10T21:01:53.558323+0000 mgr.gibba044.wflcwh (mgr.34466) 2865 : cluster [DBG] pgmap v1617: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:55.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:55 gibba023 bash[30844]: cluster 2021-03-10T21:01:55.560054+0000 mgr.gibba044.wflcwh (mgr.34466) 2866 : cluster [DBG] pgmap v1618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:55.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:55 gibba023 bash[31815]: cluster 2021-03-10T21:01:55.560054+0000 mgr.gibba044.wflcwh (mgr.34466) 2866 : cluster [DBG] pgmap v1618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:56.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:55 gibba044 bash[25485]: cluster 2021-03-10T21:01:55.560054+0000 mgr.gibba044.wflcwh (mgr.34466) 2866 : cluster [DBG] pgmap v1618: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:58.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:58 gibba023 bash[30844]: cluster 2021-03-10T21:01:57.560831+0000 mgr.gibba044.wflcwh (mgr.34466) 2867 : cluster [DBG] pgmap v1619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:58.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:58 gibba023 bash[31815]: cluster 2021-03-10T21:01:57.560831+0000 mgr.gibba044.wflcwh (mgr.34466) 2867 : cluster [DBG] pgmap v1619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:59.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:58 gibba044 bash[25485]: cluster 2021-03-10T21:01:57.560831+0000 mgr.gibba044.wflcwh (mgr.34466) 2867 : cluster [DBG] pgmap v1619: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:59.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:01:59 gibba023 bash[30844]: cluster 2021-03-10T21:01:59.562314+0000 mgr.gibba044.wflcwh (mgr.34466) 2868 : cluster [DBG] pgmap v1620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:01:59.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:01:59 gibba023 bash[31815]: cluster 2021-03-10T21:01:59.562314+0000 mgr.gibba044.wflcwh (mgr.34466) 2868 : cluster [DBG] pgmap v1620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:00.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:01:59 gibba044 bash[25485]: cluster 2021-03-10T21:01:59.562314+0000 mgr.gibba044.wflcwh (mgr.34466) 2868 : cluster [DBG] pgmap v1620: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:00.855 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T21:02:01.085 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:02:01.085 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (53m) 8m ago 58m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T21:02:01.086 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (58m) 7m ago 58m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T21:02:01.086 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (53m) 7m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T21:02:01.086 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (53m) 7m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T21:02:01.086 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (52m) 8m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T21:02:01.087 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (52m) 8m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T21:02:01.087 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (52m) 7m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T21:02:01.087 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (52m) 8m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T21:02:01.087 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (58m) 8m ago 58m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T21:02:01.087 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (58m) 7m ago 58m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T21:02:01.088 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (51m) 8m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T21:02:01.088 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (50m) 8m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T21:02:01.088 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (50m) 8m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T21:02:01.088 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (50m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T21:02:01.089 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (49m) 7m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T21:02:01.089 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (49m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T21:02:01.089 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (48m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T21:02:01.089 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (48m) 7m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T21:02:01.089 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (58m) 7m ago 58m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T21:02:01.090 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 8m ago 56m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:02:01.092 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 7m ago 56m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:02:01.337 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T21:02:01.338 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T21:02:01.338 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:02:01.338 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:02:01.339 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T21:02:01.339 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:02:01.339 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:02:01.340 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T21:02:01.340 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:02:01.340 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:02:01.340 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T21:02:01.341 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T21:02:01.341 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:02:01.341 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T21:02:01.341 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T21:02:01.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:01 gibba023 bash[30844]: audit 2021-03-10T21:02:01.334524+0000 mon.a (mon.0) 1334 : audit [DBG] from='client.? 172.21.2.123:0/3256343639' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:01.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:01 gibba023 bash[31815]: audit 2021-03-10T21:02:01.334524+0000 mon.a (mon.0) 1334 : audit [DBG] from='client.? 172.21.2.123:0/3256343639' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:01.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:01 gibba044 bash[25485]: audit 2021-03-10T21:02:01.334524+0000 mon.a (mon.0) 1334 : audit [DBG] from='client.? 172.21.2.123:0/3256343639' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:02.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:02 gibba023 bash[30844]: audit 2021-03-10T21:02:00.843997+0000 mgr.gibba044.wflcwh (mgr.34466) 2869 : audit [DBG] from='client.55963 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:02:02.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:02 gibba023 bash[30844]: audit 2021-03-10T21:02:01.070387+0000 mgr.gibba044.wflcwh (mgr.34466) 2870 : audit [DBG] from='client.55969 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:02:02.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:02 gibba023 bash[30844]: cluster 2021-03-10T21:02:01.563874+0000 mgr.gibba044.wflcwh (mgr.34466) 2871 : cluster [DBG] pgmap v1621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:02.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:02 gibba023 bash[31815]: audit 2021-03-10T21:02:00.843997+0000 mgr.gibba044.wflcwh (mgr.34466) 2869 : audit [DBG] from='client.55963 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:02:02.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:02 gibba023 bash[31815]: audit 2021-03-10T21:02:01.070387+0000 mgr.gibba044.wflcwh (mgr.34466) 2870 : audit [DBG] from='client.55969 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:02:02.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:02 gibba023 bash[31815]: cluster 2021-03-10T21:02:01.563874+0000 mgr.gibba044.wflcwh (mgr.34466) 2871 : cluster [DBG] pgmap v1621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:02.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:02 gibba044 bash[25485]: audit 2021-03-10T21:02:00.843997+0000 mgr.gibba044.wflcwh (mgr.34466) 2869 : audit [DBG] from='client.55963 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:02:02.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:02 gibba044 bash[25485]: audit 2021-03-10T21:02:01.070387+0000 mgr.gibba044.wflcwh (mgr.34466) 2870 : audit [DBG] from='client.55969 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:02:02.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:02 gibba044 bash[25485]: cluster 2021-03-10T21:02:01.563874+0000 mgr.gibba044.wflcwh (mgr.34466) 2871 : cluster [DBG] pgmap v1621: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:03.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:03 gibba023 bash[31815]: cephadm 2021-03-10T21:02:03.309152+0000 mgr.gibba044.wflcwh (mgr.34466) 2872 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:02:03.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:03 gibba023 bash[31815]: cluster 2021-03-10T21:02:03.565394+0000 mgr.gibba044.wflcwh (mgr.34466) 2873 : cluster [DBG] pgmap v1622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:03.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:03 gibba023 bash[30844]: cephadm 2021-03-10T21:02:03.309152+0000 mgr.gibba044.wflcwh (mgr.34466) 2872 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:02:03.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:03 gibba023 bash[30844]: cluster 2021-03-10T21:02:03.565394+0000 mgr.gibba044.wflcwh (mgr.34466) 2873 : cluster [DBG] pgmap v1622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:04.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:03 gibba044 bash[25485]: cephadm 2021-03-10T21:02:03.309152+0000 mgr.gibba044.wflcwh (mgr.34466) 2872 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:02:04.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:03 gibba044 bash[25485]: cluster 2021-03-10T21:02:03.565394+0000 mgr.gibba044.wflcwh (mgr.34466) 2873 : cluster [DBG] pgmap v1622: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:05.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:05 gibba023 bash[30844]: cluster 2021-03-10T21:02:05.567050+0000 mgr.gibba044.wflcwh (mgr.34466) 2874 : cluster [DBG] pgmap v1623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:05.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:05 gibba023 bash[31815]: cluster 2021-03-10T21:02:05.567050+0000 mgr.gibba044.wflcwh (mgr.34466) 2874 : cluster [DBG] pgmap v1623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:06.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:05 gibba044 bash[25485]: cluster 2021-03-10T21:02:05.567050+0000 mgr.gibba044.wflcwh (mgr.34466) 2874 : cluster [DBG] pgmap v1623: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:08.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:08 gibba023 bash[30844]: cluster 2021-03-10T21:02:07.568631+0000 mgr.gibba044.wflcwh (mgr.34466) 2875 : cluster [DBG] pgmap v1624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:08.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:08 gibba023 bash[31815]: cluster 2021-03-10T21:02:07.568631+0000 mgr.gibba044.wflcwh (mgr.34466) 2875 : cluster [DBG] pgmap v1624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:09.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:08 gibba044 bash[25485]: cluster 2021-03-10T21:02:07.568631+0000 mgr.gibba044.wflcwh (mgr.34466) 2875 : cluster [DBG] pgmap v1624: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:09.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:09 gibba023 bash[30844]: cluster 2021-03-10T21:02:09.570226+0000 mgr.gibba044.wflcwh (mgr.34466) 2876 : cluster [DBG] pgmap v1625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:09.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:09 gibba023 bash[31815]: cluster 2021-03-10T21:02:09.570226+0000 mgr.gibba044.wflcwh (mgr.34466) 2876 : cluster [DBG] pgmap v1625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:10.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:09 gibba044 bash[25485]: cluster 2021-03-10T21:02:09.570226+0000 mgr.gibba044.wflcwh (mgr.34466) 2876 : cluster [DBG] pgmap v1625: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:11.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:11 gibba023 bash[30844]: cluster 2021-03-10T21:02:11.571905+0000 mgr.gibba044.wflcwh (mgr.34466) 2877 : cluster [DBG] pgmap v1626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:11.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:11 gibba023 bash[31815]: cluster 2021-03-10T21:02:11.571905+0000 mgr.gibba044.wflcwh (mgr.34466) 2877 : cluster [DBG] pgmap v1626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:12.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:11 gibba044 bash[25485]: cluster 2021-03-10T21:02:11.571905+0000 mgr.gibba044.wflcwh (mgr.34466) 2877 : cluster [DBG] pgmap v1626: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:13.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:13 gibba023 bash[30844]: cluster 2021-03-10T21:02:13.573455+0000 mgr.gibba044.wflcwh (mgr.34466) 2878 : cluster [DBG] pgmap v1627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:13.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:13 gibba023 bash[31815]: cluster 2021-03-10T21:02:13.573455+0000 mgr.gibba044.wflcwh (mgr.34466) 2878 : cluster [DBG] pgmap v1627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:14.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:13 gibba044 bash[25485]: cluster 2021-03-10T21:02:13.573455+0000 mgr.gibba044.wflcwh (mgr.34466) 2878 : cluster [DBG] pgmap v1627: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:15.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:15 gibba023 bash[30844]: cluster 2021-03-10T21:02:15.575077+0000 mgr.gibba044.wflcwh (mgr.34466) 2879 : cluster [DBG] pgmap v1628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:15.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:15 gibba023 bash[31815]: cluster 2021-03-10T21:02:15.575077+0000 mgr.gibba044.wflcwh (mgr.34466) 2879 : cluster [DBG] pgmap v1628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:16.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:15 gibba044 bash[25485]: cluster 2021-03-10T21:02:15.575077+0000 mgr.gibba044.wflcwh (mgr.34466) 2879 : cluster [DBG] pgmap v1628: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:18.753 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:18 gibba044 bash[25485]: cluster 2021-03-10T21:02:17.575876+0000 mgr.gibba044.wflcwh (mgr.34466) 2880 : cluster [DBG] pgmap v1629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:18.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:18 gibba023 bash[30844]: cluster 2021-03-10T21:02:17.575876+0000 mgr.gibba044.wflcwh (mgr.34466) 2880 : cluster [DBG] pgmap v1629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:18.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:18 gibba023 bash[31815]: cluster 2021-03-10T21:02:17.575876+0000 mgr.gibba044.wflcwh (mgr.34466) 2880 : cluster [DBG] pgmap v1629: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:19.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:19 gibba023 bash[30844]: cephadm 2021-03-10T21:02:18.325144+0000 mgr.gibba044.wflcwh (mgr.34466) 2881 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:02:19.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:19 gibba023 bash[31815]: cephadm 2021-03-10T21:02:18.325144+0000 mgr.gibba044.wflcwh (mgr.34466) 2881 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:02:20.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:19 gibba044 bash[25485]: cephadm 2021-03-10T21:02:18.325144+0000 mgr.gibba044.wflcwh (mgr.34466) 2881 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:02:20.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:20 gibba023 bash[30844]: cluster 2021-03-10T21:02:19.576298+0000 mgr.gibba044.wflcwh (mgr.34466) 2882 : cluster [DBG] pgmap v1630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:20.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:20 gibba023 bash[31815]: cluster 2021-03-10T21:02:19.576298+0000 mgr.gibba044.wflcwh (mgr.34466) 2882 : cluster [DBG] pgmap v1630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:21.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:20 gibba044 bash[25485]: cluster 2021-03-10T21:02:19.576298+0000 mgr.gibba044.wflcwh (mgr.34466) 2882 : cluster [DBG] pgmap v1630: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:21.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:21 gibba023 bash[30844]: cluster 2021-03-10T21:02:21.577770+0000 mgr.gibba044.wflcwh (mgr.34466) 2883 : cluster [DBG] pgmap v1631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:21.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:21 gibba023 bash[31815]: cluster 2021-03-10T21:02:21.577770+0000 mgr.gibba044.wflcwh (mgr.34466) 2883 : cluster [DBG] pgmap v1631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:22.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:21 gibba044 bash[25485]: cluster 2021-03-10T21:02:21.577770+0000 mgr.gibba044.wflcwh (mgr.34466) 2883 : cluster [DBG] pgmap v1631: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:23.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:23 gibba023 bash[30844]: cluster 2021-03-10T21:02:23.579550+0000 mgr.gibba044.wflcwh (mgr.34466) 2884 : cluster [DBG] pgmap v1632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:23.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:23 gibba023 bash[31815]: cluster 2021-03-10T21:02:23.579550+0000 mgr.gibba044.wflcwh (mgr.34466) 2884 : cluster [DBG] pgmap v1632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:24.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:23 gibba044 bash[25485]: cluster 2021-03-10T21:02:23.579550+0000 mgr.gibba044.wflcwh (mgr.34466) 2884 : cluster [DBG] pgmap v1632: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:25.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:25 gibba023 bash[30844]: cluster 2021-03-10T21:02:25.581320+0000 mgr.gibba044.wflcwh (mgr.34466) 2885 : cluster [DBG] pgmap v1633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:25.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:25 gibba023 bash[31815]: cluster 2021-03-10T21:02:25.581320+0000 mgr.gibba044.wflcwh (mgr.34466) 2885 : cluster [DBG] pgmap v1633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:26.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:25 gibba044 bash[25485]: cluster 2021-03-10T21:02:25.581320+0000 mgr.gibba044.wflcwh (mgr.34466) 2885 : cluster [DBG] pgmap v1633: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:27.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:27 gibba044 bash[25485]: audit 2021-03-10T21:02:27.398232+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:02:27.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:27 gibba044 bash[25485]: audit 2021-03-10T21:02:27.399079+0000 mon.a (mon.0) 1336 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:02:27.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:27 gibba044 bash[25485]: audit 2021-03-10T21:02:27.399705+0000 mon.a (mon.0) 1337 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T21:02:27.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:27 gibba044 bash[25485]: audit 2021-03-10T21:02:27.400419+0000 mon.a (mon.0) 1338 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T21:02:27.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:27 gibba044 bash[25485]: audit 2021-03-10T21:02:27.401136+0000 mon.a (mon.0) 1339 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T21:02:27.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:27 gibba044 bash[25485]: audit 2021-03-10T21:02:27.401794+0000 mon.a (mon.0) 1340 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T21:02:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:27 gibba023 bash[30844]: audit 2021-03-10T21:02:27.398232+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:02:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:27 gibba023 bash[30844]: audit 2021-03-10T21:02:27.399079+0000 mon.a (mon.0) 1336 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:02:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:27 gibba023 bash[30844]: audit 2021-03-10T21:02:27.399705+0000 mon.a (mon.0) 1337 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T21:02:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:27 gibba023 bash[30844]: audit 2021-03-10T21:02:27.400419+0000 mon.a (mon.0) 1338 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T21:02:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:27 gibba023 bash[30844]: audit 2021-03-10T21:02:27.401136+0000 mon.a (mon.0) 1339 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T21:02:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:27 gibba023 bash[30844]: audit 2021-03-10T21:02:27.401794+0000 mon.a (mon.0) 1340 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T21:02:27.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:27 gibba023 bash[31815]: audit 2021-03-10T21:02:27.398232+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:02:27.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:27 gibba023 bash[31815]: audit 2021-03-10T21:02:27.399079+0000 mon.a (mon.0) 1336 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:02:27.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:27 gibba023 bash[31815]: audit 2021-03-10T21:02:27.399705+0000 mon.a (mon.0) 1337 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [7, 4]}]: dispatch 2021-03-10T21:02:27.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:27 gibba023 bash[31815]: audit 2021-03-10T21:02:27.400419+0000 mon.a (mon.0) 1338 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T21:02:27.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:27 gibba023 bash[31815]: audit 2021-03-10T21:02:27.401136+0000 mon.a (mon.0) 1339 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T21:02:27.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:27 gibba023 bash[31815]: audit 2021-03-10T21:02:27.401794+0000 mon.a (mon.0) 1340 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T21:02:28.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:28 gibba023 bash[30844]: cluster 2021-03-10T21:02:27.582160+0000 mgr.gibba044.wflcwh (mgr.34466) 2886 : cluster [DBG] pgmap v1634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:28.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:28 gibba023 bash[31815]: cluster 2021-03-10T21:02:27.582160+0000 mgr.gibba044.wflcwh (mgr.34466) 2886 : cluster [DBG] pgmap v1634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:29.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:28 gibba044 bash[25485]: cluster 2021-03-10T21:02:27.582160+0000 mgr.gibba044.wflcwh (mgr.34466) 2886 : cluster [DBG] pgmap v1634: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:29.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:29 gibba023 bash[30844]: cluster 2021-03-10T21:02:29.583680+0000 mgr.gibba044.wflcwh (mgr.34466) 2887 : cluster [DBG] pgmap v1635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:29.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:29 gibba023 bash[31815]: cluster 2021-03-10T21:02:29.583680+0000 mgr.gibba044.wflcwh (mgr.34466) 2887 : cluster [DBG] pgmap v1635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:30.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:29 gibba044 bash[25485]: cluster 2021-03-10T21:02:29.583680+0000 mgr.gibba044.wflcwh (mgr.34466) 2887 : cluster [DBG] pgmap v1635: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:31.583 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T21:02:31.815 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:02:31.816 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (53m) 9m ago 59m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T21:02:31.816 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (58m) 8m ago 58m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T21:02:31.816 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (54m) 8m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T21:02:31.817 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (54m) 8m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T21:02:31.817 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (53m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T21:02:31.818 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (53m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T21:02:31.818 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (52m) 8m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T21:02:31.818 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (52m) 9m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T21:02:31.819 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (59m) 9m ago 59m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T21:02:31.819 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (59m) 8m ago 59m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T21:02:31.820 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (51m) 9m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T21:02:31.820 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (51m) 9m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T21:02:31.821 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (51m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T21:02:31.821 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (50m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T21:02:31.822 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (50m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T21:02:31.822 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (49m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T21:02:31.822 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (49m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T21:02:31.823 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (48m) 8m ago 59m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T21:02:31.823 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (58m) 8m ago 59m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T21:02:31.824 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 9m ago 57m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:02:31.824 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 8m ago 57m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:02:31.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:31 gibba023 bash[30844]: audit 2021-03-10T21:02:31.572015+0000 mgr.gibba044.wflcwh (mgr.34466) 2888 : audit [DBG] from='client.55981 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:02:31.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:31 gibba023 bash[30844]: cluster 2021-03-10T21:02:31.584954+0000 mgr.gibba044.wflcwh (mgr.34466) 2889 : cluster [DBG] pgmap v1636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:31.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:31 gibba023 bash[31815]: audit 2021-03-10T21:02:31.572015+0000 mgr.gibba044.wflcwh (mgr.34466) 2888 : audit [DBG] from='client.55981 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:02:31.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:31 gibba023 bash[31815]: cluster 2021-03-10T21:02:31.584954+0000 mgr.gibba044.wflcwh (mgr.34466) 2889 : cluster [DBG] pgmap v1636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:32.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:31 gibba044 bash[25485]: audit 2021-03-10T21:02:31.572015+0000 mgr.gibba044.wflcwh (mgr.34466) 2888 : audit [DBG] from='client.55981 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:02:32.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:31 gibba044 bash[25485]: cluster 2021-03-10T21:02:31.584954+0000 mgr.gibba044.wflcwh (mgr.34466) 2889 : cluster [DBG] pgmap v1636: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:32.066 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T21:02:32.067 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T21:02:32.067 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:02:32.067 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:02:32.067 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T21:02:32.068 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:02:32.068 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:02:32.068 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T21:02:32.068 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:02:32.069 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:02:32.069 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T21:02:32.069 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T21:02:32.069 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:02:32.069 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T21:02:32.070 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T21:02:32.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:32 gibba023 bash[30844]: audit 2021-03-10T21:02:31.799968+0000 mgr.gibba044.wflcwh (mgr.34466) 2890 : audit [DBG] from='client.55987 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:02:32.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:32 gibba023 bash[30844]: audit 2021-03-10T21:02:32.063406+0000 mon.a (mon.0) 1341 : audit [DBG] from='client.? 172.21.2.123:0/1231194400' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:32.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:32 gibba023 bash[31815]: audit 2021-03-10T21:02:31.799968+0000 mgr.gibba044.wflcwh (mgr.34466) 2890 : audit [DBG] from='client.55987 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:02:32.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:32 gibba023 bash[31815]: audit 2021-03-10T21:02:32.063406+0000 mon.a (mon.0) 1341 : audit [DBG] from='client.? 172.21.2.123:0/1231194400' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:33.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:32 gibba044 bash[25485]: audit 2021-03-10T21:02:31.799968+0000 mgr.gibba044.wflcwh (mgr.34466) 2890 : audit [DBG] from='client.55987 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:02:33.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:32 gibba044 bash[25485]: audit 2021-03-10T21:02:32.063406+0000 mon.a (mon.0) 1341 : audit [DBG] from='client.? 172.21.2.123:0/1231194400' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:33.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:33 gibba023 bash[30844]: cephadm 2021-03-10T21:02:33.342504+0000 mgr.gibba044.wflcwh (mgr.34466) 2891 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:02:33.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:33 gibba023 bash[30844]: audit 2021-03-10T21:02:33.342889+0000 mon.a (mon.0) 1342 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T21:02:33.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:33 gibba023 bash[30844]: cluster 2021-03-10T21:02:33.585773+0000 mgr.gibba044.wflcwh (mgr.34466) 2892 : cluster [DBG] pgmap v1637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:33.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:33 gibba023 bash[31815]: cephadm 2021-03-10T21:02:33.342504+0000 mgr.gibba044.wflcwh (mgr.34466) 2891 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:02:33.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:33 gibba023 bash[31815]: audit 2021-03-10T21:02:33.342889+0000 mon.a (mon.0) 1342 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T21:02:33.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:33 gibba023 bash[31815]: cluster 2021-03-10T21:02:33.585773+0000 mgr.gibba044.wflcwh (mgr.34466) 2892 : cluster [DBG] pgmap v1637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:34.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:33 gibba044 bash[25485]: cephadm 2021-03-10T21:02:33.342504+0000 mgr.gibba044.wflcwh (mgr.34466) 2891 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:02:34.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:33 gibba044 bash[25485]: audit 2021-03-10T21:02:33.342889+0000 mon.a (mon.0) 1342 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T21:02:34.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:33 gibba044 bash[25485]: cluster 2021-03-10T21:02:33.585773+0000 mgr.gibba044.wflcwh (mgr.34466) 2892 : cluster [DBG] pgmap v1637: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:35.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:35 gibba023 bash[30844]: cluster 2021-03-10T21:02:35.587099+0000 mgr.gibba044.wflcwh (mgr.34466) 2893 : cluster [DBG] pgmap v1638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:35.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:35 gibba023 bash[31815]: cluster 2021-03-10T21:02:35.587099+0000 mgr.gibba044.wflcwh (mgr.34466) 2893 : cluster [DBG] pgmap v1638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:36.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:35 gibba044 bash[25485]: cluster 2021-03-10T21:02:35.587099+0000 mgr.gibba044.wflcwh (mgr.34466) 2893 : cluster [DBG] pgmap v1638: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:38.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:38 gibba023 bash[30844]: cluster 2021-03-10T21:02:37.587988+0000 mgr.gibba044.wflcwh (mgr.34466) 2894 : cluster [DBG] pgmap v1639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:38.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:38 gibba023 bash[30844]: audit 2021-03-10T21:02:38.089511+0000 mon.a (mon.0) 1343 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T21:02:38.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:38 gibba023 bash[30844]: audit 2021-03-10T21:02:38.262693+0000 mon.a (mon.0) 1344 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:02:38.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:38 gibba023 bash[30844]: audit 2021-03-10T21:02:38.515801+0000 mon.a (mon.0) 1345 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:02:38.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:38 gibba023 bash[30844]: audit 2021-03-10T21:02:38.524292+0000 mon.a (mon.0) 1346 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:02:38.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:38 gibba023 bash[30844]: audit 2021-03-10T21:02:38.526295+0000 mon.a (mon.0) 1347 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:38.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:38 gibba023 bash[30844]: audit 2021-03-10T21:02:38.528374+0000 mon.a (mon.0) 1348 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:38.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:38 gibba023 bash[30844]: audit 2021-03-10T21:02:38.529861+0000 mon.a (mon.0) 1349 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:38.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:38 gibba023 bash[30844]: audit 2021-03-10T21:02:38.533067+0000 mon.a (mon.0) 1350 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:38.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:38 gibba023 bash[30844]: audit 2021-03-10T21:02:38.534863+0000 mon.a (mon.0) 1351 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:38.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:38 gibba023 bash[31815]: cluster 2021-03-10T21:02:37.587988+0000 mgr.gibba044.wflcwh (mgr.34466) 2894 : cluster [DBG] pgmap v1639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:38.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:38 gibba023 bash[31815]: audit 2021-03-10T21:02:38.089511+0000 mon.a (mon.0) 1343 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T21:02:38.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:38 gibba023 bash[31815]: audit 2021-03-10T21:02:38.262693+0000 mon.a (mon.0) 1344 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:02:38.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:38 gibba023 bash[31815]: audit 2021-03-10T21:02:38.515801+0000 mon.a (mon.0) 1345 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:02:38.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:38 gibba023 bash[31815]: audit 2021-03-10T21:02:38.524292+0000 mon.a (mon.0) 1346 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:02:38.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:38 gibba023 bash[31815]: audit 2021-03-10T21:02:38.526295+0000 mon.a (mon.0) 1347 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:38.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:38 gibba023 bash[31815]: audit 2021-03-10T21:02:38.528374+0000 mon.a (mon.0) 1348 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:38.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:38 gibba023 bash[31815]: audit 2021-03-10T21:02:38.529861+0000 mon.a (mon.0) 1349 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:38.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:38 gibba023 bash[31815]: audit 2021-03-10T21:02:38.533067+0000 mon.a (mon.0) 1350 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:38.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:38 gibba023 bash[31815]: audit 2021-03-10T21:02:38.534863+0000 mon.a (mon.0) 1351 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:39.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:38 gibba044 bash[25485]: cluster 2021-03-10T21:02:37.587988+0000 mgr.gibba044.wflcwh (mgr.34466) 2894 : cluster [DBG] pgmap v1639: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:39.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:38 gibba044 bash[25485]: audit 2021-03-10T21:02:38.089511+0000 mon.a (mon.0) 1343 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T21:02:39.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:38 gibba044 bash[25485]: audit 2021-03-10T21:02:38.262693+0000 mon.a (mon.0) 1344 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:02:39.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:38 gibba044 bash[25485]: audit 2021-03-10T21:02:38.515801+0000 mon.a (mon.0) 1345 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:02:39.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:38 gibba044 bash[25485]: audit 2021-03-10T21:02:38.524292+0000 mon.a (mon.0) 1346 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:02:39.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:38 gibba044 bash[25485]: audit 2021-03-10T21:02:38.526295+0000 mon.a (mon.0) 1347 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:39.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:38 gibba044 bash[25485]: audit 2021-03-10T21:02:38.528374+0000 mon.a (mon.0) 1348 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:39.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:38 gibba044 bash[25485]: audit 2021-03-10T21:02:38.529861+0000 mon.a (mon.0) 1349 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:39.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:38 gibba044 bash[25485]: audit 2021-03-10T21:02:38.533067+0000 mon.a (mon.0) 1350 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:39.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:38 gibba044 bash[25485]: audit 2021-03-10T21:02:38.534863+0000 mon.a (mon.0) 1351 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:02:39.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[30844]: cephadm 2021-03-10T21:02:38.264830+0000 mgr.gibba044.wflcwh (mgr.34466) 2895 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:02:39.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[30844]: cephadm 2021-03-10T21:02:38.523714+0000 mgr.gibba044.wflcwh (mgr.34466) 2896 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:02:39.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[30844]: cephadm 2021-03-10T21:02:38.526149+0000 mgr.gibba044.wflcwh (mgr.34466) 2897 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:02:39.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[30844]: cephadm 2021-03-10T21:02:38.528113+0000 mgr.gibba044.wflcwh (mgr.34466) 2898 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:02:39.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[30844]: cephadm 2021-03-10T21:02:38.528177+0000 mgr.gibba044.wflcwh (mgr.34466) 2899 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:02:39.932 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[30844]: cephadm 2021-03-10T21:02:38.529780+0000 mgr.gibba044.wflcwh (mgr.34466) 2900 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:02:39.932 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[30844]: cephadm 2021-03-10T21:02:38.529930+0000 mgr.gibba044.wflcwh (mgr.34466) 2901 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:02:39.932 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[30844]: cephadm 2021-03-10T21:02:38.531330+0000 mgr.gibba044.wflcwh (mgr.34466) 2902 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:02:39.933 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[30844]: cephadm 2021-03-10T21:02:38.532902+0000 mgr.gibba044.wflcwh (mgr.34466) 2903 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:02:39.933 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[30844]: cephadm 2021-03-10T21:02:38.532940+0000 mgr.gibba044.wflcwh (mgr.34466) 2904 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:02:39.933 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[30844]: cephadm 2021-03-10T21:02:38.534566+0000 mgr.gibba044.wflcwh (mgr.34466) 2905 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:02:39.934 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[30844]: cephadm 2021-03-10T21:02:38.534888+0000 mgr.gibba044.wflcwh (mgr.34466) 2906 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:02:39.934 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[30844]: cephadm 2021-03-10T21:02:38.536671+0000 mgr.gibba044.wflcwh (mgr.34466) 2907 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:02:39.935 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[30844]: cephadm 2021-03-10T21:02:38.536813+0000 mgr.gibba044.wflcwh (mgr.34466) 2908 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:02:39.935 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[30844]: cephadm 2021-03-10T21:02:38.536986+0000 mgr.gibba044.wflcwh (mgr.34466) 2909 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:02:39.936 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[31815]: cephadm 2021-03-10T21:02:38.264830+0000 mgr.gibba044.wflcwh (mgr.34466) 2895 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:02:39.937 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[31815]: cephadm 2021-03-10T21:02:38.523714+0000 mgr.gibba044.wflcwh (mgr.34466) 2896 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:02:39.937 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[31815]: cephadm 2021-03-10T21:02:38.526149+0000 mgr.gibba044.wflcwh (mgr.34466) 2897 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:02:39.938 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[31815]: cephadm 2021-03-10T21:02:38.528113+0000 mgr.gibba044.wflcwh (mgr.34466) 2898 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:02:39.938 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[31815]: cephadm 2021-03-10T21:02:38.528177+0000 mgr.gibba044.wflcwh (mgr.34466) 2899 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:02:39.939 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[31815]: cephadm 2021-03-10T21:02:38.529780+0000 mgr.gibba044.wflcwh (mgr.34466) 2900 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:02:39.939 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[31815]: cephadm 2021-03-10T21:02:38.529930+0000 mgr.gibba044.wflcwh (mgr.34466) 2901 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:02:39.940 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[31815]: cephadm 2021-03-10T21:02:38.531330+0000 mgr.gibba044.wflcwh (mgr.34466) 2902 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:02:39.940 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[31815]: cephadm 2021-03-10T21:02:38.532902+0000 mgr.gibba044.wflcwh (mgr.34466) 2903 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:02:39.941 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[31815]: cephadm 2021-03-10T21:02:38.532940+0000 mgr.gibba044.wflcwh (mgr.34466) 2904 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:02:39.941 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[31815]: cephadm 2021-03-10T21:02:38.534566+0000 mgr.gibba044.wflcwh (mgr.34466) 2905 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:02:39.942 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[31815]: cephadm 2021-03-10T21:02:38.534888+0000 mgr.gibba044.wflcwh (mgr.34466) 2906 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:02:39.942 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[31815]: cephadm 2021-03-10T21:02:38.536671+0000 mgr.gibba044.wflcwh (mgr.34466) 2907 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:02:39.943 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[31815]: cephadm 2021-03-10T21:02:38.536813+0000 mgr.gibba044.wflcwh (mgr.34466) 2908 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:02:39.943 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:39 gibba023 bash[31815]: cephadm 2021-03-10T21:02:38.536986+0000 mgr.gibba044.wflcwh (mgr.34466) 2909 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:02:40.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:39 gibba044 bash[25485]: cephadm 2021-03-10T21:02:38.264830+0000 mgr.gibba044.wflcwh (mgr.34466) 2895 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:02:40.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:39 gibba044 bash[25485]: cephadm 2021-03-10T21:02:38.523714+0000 mgr.gibba044.wflcwh (mgr.34466) 2896 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:02:40.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:39 gibba044 bash[25485]: cephadm 2021-03-10T21:02:38.526149+0000 mgr.gibba044.wflcwh (mgr.34466) 2897 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:02:40.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:39 gibba044 bash[25485]: cephadm 2021-03-10T21:02:38.528113+0000 mgr.gibba044.wflcwh (mgr.34466) 2898 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:02:40.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:39 gibba044 bash[25485]: cephadm 2021-03-10T21:02:38.528177+0000 mgr.gibba044.wflcwh (mgr.34466) 2899 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:02:40.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:39 gibba044 bash[25485]: cephadm 2021-03-10T21:02:38.529780+0000 mgr.gibba044.wflcwh (mgr.34466) 2900 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:02:40.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:39 gibba044 bash[25485]: cephadm 2021-03-10T21:02:38.529930+0000 mgr.gibba044.wflcwh (mgr.34466) 2901 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:02:40.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:39 gibba044 bash[25485]: cephadm 2021-03-10T21:02:38.531330+0000 mgr.gibba044.wflcwh (mgr.34466) 2902 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:02:40.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:39 gibba044 bash[25485]: cephadm 2021-03-10T21:02:38.532902+0000 mgr.gibba044.wflcwh (mgr.34466) 2903 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:02:40.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:39 gibba044 bash[25485]: cephadm 2021-03-10T21:02:38.532940+0000 mgr.gibba044.wflcwh (mgr.34466) 2904 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:02:40.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:39 gibba044 bash[25485]: cephadm 2021-03-10T21:02:38.534566+0000 mgr.gibba044.wflcwh (mgr.34466) 2905 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:02:40.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:39 gibba044 bash[25485]: cephadm 2021-03-10T21:02:38.534888+0000 mgr.gibba044.wflcwh (mgr.34466) 2906 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:02:40.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:39 gibba044 bash[25485]: cephadm 2021-03-10T21:02:38.536671+0000 mgr.gibba044.wflcwh (mgr.34466) 2907 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:02:40.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:39 gibba044 bash[25485]: cephadm 2021-03-10T21:02:38.536813+0000 mgr.gibba044.wflcwh (mgr.34466) 2908 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:02:40.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:39 gibba044 bash[25485]: cephadm 2021-03-10T21:02:38.536986+0000 mgr.gibba044.wflcwh (mgr.34466) 2909 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:02:40.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:40 gibba023 bash[30844]: cluster 2021-03-10T21:02:39.588446+0000 mgr.gibba044.wflcwh (mgr.34466) 2910 : cluster [DBG] pgmap v1640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:40.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:40 gibba023 bash[31815]: cluster 2021-03-10T21:02:39.588446+0000 mgr.gibba044.wflcwh (mgr.34466) 2910 : cluster [DBG] pgmap v1640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:41.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:40 gibba044 bash[25485]: cluster 2021-03-10T21:02:39.588446+0000 mgr.gibba044.wflcwh (mgr.34466) 2910 : cluster [DBG] pgmap v1640: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:43.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:43 gibba023 bash[30844]: cluster 2021-03-10T21:02:41.589855+0000 mgr.gibba044.wflcwh (mgr.34466) 2911 : cluster [DBG] pgmap v1641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:43.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:43 gibba023 bash[31815]: cluster 2021-03-10T21:02:41.589855+0000 mgr.gibba044.wflcwh (mgr.34466) 2911 : cluster [DBG] pgmap v1641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:44.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:43 gibba044 bash[25485]: cluster 2021-03-10T21:02:41.589855+0000 mgr.gibba044.wflcwh (mgr.34466) 2911 : cluster [DBG] pgmap v1641: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:45.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:45 gibba023 bash[30844]: cluster 2021-03-10T21:02:43.590663+0000 mgr.gibba044.wflcwh (mgr.34466) 2912 : cluster [DBG] pgmap v1642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:45.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:45 gibba023 bash[31815]: cluster 2021-03-10T21:02:43.590663+0000 mgr.gibba044.wflcwh (mgr.34466) 2912 : cluster [DBG] pgmap v1642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:46.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:45 gibba044 bash[25485]: cluster 2021-03-10T21:02:43.590663+0000 mgr.gibba044.wflcwh (mgr.34466) 2912 : cluster [DBG] pgmap v1642: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:47.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:47 gibba023 bash[30844]: cluster 2021-03-10T21:02:45.591403+0000 mgr.gibba044.wflcwh (mgr.34466) 2913 : cluster [DBG] pgmap v1643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:47.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:47 gibba023 bash[31815]: cluster 2021-03-10T21:02:45.591403+0000 mgr.gibba044.wflcwh (mgr.34466) 2913 : cluster [DBG] pgmap v1643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:48.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:47 gibba044 bash[25485]: cluster 2021-03-10T21:02:45.591403+0000 mgr.gibba044.wflcwh (mgr.34466) 2913 : cluster [DBG] pgmap v1643: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:49.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:49 gibba023 bash[30844]: cluster 2021-03-10T21:02:47.592071+0000 mgr.gibba044.wflcwh (mgr.34466) 2914 : cluster [DBG] pgmap v1644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:49.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:49 gibba023 bash[31815]: cluster 2021-03-10T21:02:47.592071+0000 mgr.gibba044.wflcwh (mgr.34466) 2914 : cluster [DBG] pgmap v1644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:50.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:49 gibba044 bash[25485]: cluster 2021-03-10T21:02:47.592071+0000 mgr.gibba044.wflcwh (mgr.34466) 2914 : cluster [DBG] pgmap v1644: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:51.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:51 gibba023 bash[30844]: cluster 2021-03-10T21:02:49.592598+0000 mgr.gibba044.wflcwh (mgr.34466) 2915 : cluster [DBG] pgmap v1645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:51.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:51 gibba023 bash[31815]: cluster 2021-03-10T21:02:49.592598+0000 mgr.gibba044.wflcwh (mgr.34466) 2915 : cluster [DBG] pgmap v1645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:52.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:51 gibba044 bash[25485]: cluster 2021-03-10T21:02:49.592598+0000 mgr.gibba044.wflcwh (mgr.34466) 2915 : cluster [DBG] pgmap v1645: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:53.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:53 gibba023 bash[30844]: cluster 2021-03-10T21:02:51.593767+0000 mgr.gibba044.wflcwh (mgr.34466) 2916 : cluster [DBG] pgmap v1646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:53.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:53 gibba023 bash[31815]: cluster 2021-03-10T21:02:51.593767+0000 mgr.gibba044.wflcwh (mgr.34466) 2916 : cluster [DBG] pgmap v1646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:54.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:53 gibba044 bash[25485]: cluster 2021-03-10T21:02:51.593767+0000 mgr.gibba044.wflcwh (mgr.34466) 2916 : cluster [DBG] pgmap v1646: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:54.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:54 gibba023 bash[30844]: cephadm 2021-03-10T21:02:53.552377+0000 mgr.gibba044.wflcwh (mgr.34466) 2917 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:02:54.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:54 gibba023 bash[31815]: cephadm 2021-03-10T21:02:53.552377+0000 mgr.gibba044.wflcwh (mgr.34466) 2917 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:02:55.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:54 gibba044 bash[25485]: cephadm 2021-03-10T21:02:53.552377+0000 mgr.gibba044.wflcwh (mgr.34466) 2917 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:02:55.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:55 gibba023 bash[30844]: cluster 2021-03-10T21:02:53.595336+0000 mgr.gibba044.wflcwh (mgr.34466) 2918 : cluster [DBG] pgmap v1647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:55.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:55 gibba023 bash[31815]: cluster 2021-03-10T21:02:53.595336+0000 mgr.gibba044.wflcwh (mgr.34466) 2918 : cluster [DBG] pgmap v1647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:56.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:55 gibba044 bash[25485]: cluster 2021-03-10T21:02:53.595336+0000 mgr.gibba044.wflcwh (mgr.34466) 2918 : cluster [DBG] pgmap v1647: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:56.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:56 gibba023 bash[30844]: cluster 2021-03-10T21:02:55.597005+0000 mgr.gibba044.wflcwh (mgr.34466) 2919 : cluster [DBG] pgmap v1648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:56.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:56 gibba023 bash[31815]: cluster 2021-03-10T21:02:55.597005+0000 mgr.gibba044.wflcwh (mgr.34466) 2919 : cluster [DBG] pgmap v1648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:57.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:56 gibba044 bash[25485]: cluster 2021-03-10T21:02:55.597005+0000 mgr.gibba044.wflcwh (mgr.34466) 2919 : cluster [DBG] pgmap v1648: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:59.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:02:59 gibba023 bash[30844]: cluster 2021-03-10T21:02:57.597859+0000 mgr.gibba044.wflcwh (mgr.34466) 2920 : cluster [DBG] pgmap v1649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:02:59.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:02:59 gibba023 bash[31815]: cluster 2021-03-10T21:02:57.597859+0000 mgr.gibba044.wflcwh (mgr.34466) 2920 : cluster [DBG] pgmap v1649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:00.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:02:59 gibba044 bash[25485]: cluster 2021-03-10T21:02:57.597859+0000 mgr.gibba044.wflcwh (mgr.34466) 2920 : cluster [DBG] pgmap v1649: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:01.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:01 gibba023 bash[30844]: cluster 2021-03-10T21:02:59.598560+0000 mgr.gibba044.wflcwh (mgr.34466) 2921 : cluster [DBG] pgmap v1650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:01.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:01 gibba023 bash[31815]: cluster 2021-03-10T21:02:59.598560+0000 mgr.gibba044.wflcwh (mgr.34466) 2921 : cluster [DBG] pgmap v1650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:02.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:01 gibba044 bash[25485]: cluster 2021-03-10T21:02:59.598560+0000 mgr.gibba044.wflcwh (mgr.34466) 2921 : cluster [DBG] pgmap v1650: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:02.309 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T21:03:02.539 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:03:02.540 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (54m) 9m ago 59m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T21:03:02.541 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (59m) 8m ago 59m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T21:03:02.541 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (54m) 8m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T21:03:02.542 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (54m) 8m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T21:03:02.543 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (53m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T21:03:02.543 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (53m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T21:03:02.544 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (53m) 8m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T21:03:02.544 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (53m) 9m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T21:03:02.545 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (59m) 9m ago 59m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T21:03:02.545 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (59m) 8m ago 59m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T21:03:02.546 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (52m) 9m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T21:03:02.547 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (51m) 9m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T21:03:02.547 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (51m) 9m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T21:03:02.548 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (51m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T21:03:02.549 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (50m) 8m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T21:03:02.549 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (50m) 8m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T21:03:02.550 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (49m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T21:03:02.551 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (49m) 8m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T21:03:02.551 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (59m) 8m ago 59m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T21:03:02.552 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 9m ago 57m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:03:02.552 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 8m ago 57m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:03:02.791 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T21:03:02.792 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T21:03:02.792 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:03:02.792 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:03:02.793 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T21:03:02.793 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:03:02.793 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:03:02.793 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T21:03:02.793 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:03:02.794 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:03:02.794 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T21:03:02.794 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T21:03:02.794 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:03:02.795 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T21:03:02.795 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T21:03:03.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:03 gibba023 bash[30844]: cluster 2021-03-10T21:03:01.599302+0000 mgr.gibba044.wflcwh (mgr.34466) 2922 : cluster [DBG] pgmap v1651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:03.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:03 gibba023 bash[30844]: audit 2021-03-10T21:03:02.297905+0000 mgr.gibba044.wflcwh (mgr.34466) 2923 : audit [DBG] from='client.55999 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:03:03.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:03 gibba023 bash[30844]: audit 2021-03-10T21:03:02.523496+0000 mgr.gibba044.wflcwh (mgr.34466) 2924 : audit [DBG] from='client.56005 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:03:03.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:03 gibba023 bash[30844]: audit 2021-03-10T21:03:02.788839+0000 mon.a (mon.0) 1352 : audit [DBG] from='client.? 172.21.2.123:0/2264911354' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:03.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:03 gibba023 bash[31815]: cluster 2021-03-10T21:03:01.599302+0000 mgr.gibba044.wflcwh (mgr.34466) 2922 : cluster [DBG] pgmap v1651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:03.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:03 gibba023 bash[31815]: audit 2021-03-10T21:03:02.297905+0000 mgr.gibba044.wflcwh (mgr.34466) 2923 : audit [DBG] from='client.55999 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:03:03.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:03 gibba023 bash[31815]: audit 2021-03-10T21:03:02.523496+0000 mgr.gibba044.wflcwh (mgr.34466) 2924 : audit [DBG] from='client.56005 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:03:03.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:03 gibba023 bash[31815]: audit 2021-03-10T21:03:02.788839+0000 mon.a (mon.0) 1352 : audit [DBG] from='client.? 172.21.2.123:0/2264911354' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:04.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:03 gibba044 bash[25485]: cluster 2021-03-10T21:03:01.599302+0000 mgr.gibba044.wflcwh (mgr.34466) 2922 : cluster [DBG] pgmap v1651: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:04.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:03 gibba044 bash[25485]: audit 2021-03-10T21:03:02.297905+0000 mgr.gibba044.wflcwh (mgr.34466) 2923 : audit [DBG] from='client.55999 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:03:04.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:03 gibba044 bash[25485]: audit 2021-03-10T21:03:02.523496+0000 mgr.gibba044.wflcwh (mgr.34466) 2924 : audit [DBG] from='client.56005 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:03:04.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:03 gibba044 bash[25485]: audit 2021-03-10T21:03:02.788839+0000 mon.a (mon.0) 1352 : audit [DBG] from='client.? 172.21.2.123:0/2264911354' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:05.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:05 gibba023 bash[30844]: cluster 2021-03-10T21:03:03.600107+0000 mgr.gibba044.wflcwh (mgr.34466) 2925 : cluster [DBG] pgmap v1652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:05.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:05 gibba023 bash[31815]: cluster 2021-03-10T21:03:03.600107+0000 mgr.gibba044.wflcwh (mgr.34466) 2925 : cluster [DBG] pgmap v1652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:06.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:05 gibba044 bash[25485]: cluster 2021-03-10T21:03:03.600107+0000 mgr.gibba044.wflcwh (mgr.34466) 2925 : cluster [DBG] pgmap v1652: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:07.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:07 gibba023 bash[30844]: cluster 2021-03-10T21:03:05.600713+0000 mgr.gibba044.wflcwh (mgr.34466) 2926 : cluster [DBG] pgmap v1653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:07.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:07 gibba023 bash[31815]: cluster 2021-03-10T21:03:05.600713+0000 mgr.gibba044.wflcwh (mgr.34466) 2926 : cluster [DBG] pgmap v1653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:08.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:07 gibba044 bash[25485]: cluster 2021-03-10T21:03:05.600713+0000 mgr.gibba044.wflcwh (mgr.34466) 2926 : cluster [DBG] pgmap v1653: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:09.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:09 gibba023 bash[30844]: cluster 2021-03-10T21:03:07.601346+0000 mgr.gibba044.wflcwh (mgr.34466) 2927 : cluster [DBG] pgmap v1654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:09.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:09 gibba023 bash[30844]: cephadm 2021-03-10T21:03:08.563766+0000 mgr.gibba044.wflcwh (mgr.34466) 2928 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:03:09.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:09 gibba023 bash[31815]: cluster 2021-03-10T21:03:07.601346+0000 mgr.gibba044.wflcwh (mgr.34466) 2927 : cluster [DBG] pgmap v1654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:09.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:09 gibba023 bash[31815]: cephadm 2021-03-10T21:03:08.563766+0000 mgr.gibba044.wflcwh (mgr.34466) 2928 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:03:10.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:09 gibba044 bash[25485]: cluster 2021-03-10T21:03:07.601346+0000 mgr.gibba044.wflcwh (mgr.34466) 2927 : cluster [DBG] pgmap v1654: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:10.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:09 gibba044 bash[25485]: cephadm 2021-03-10T21:03:08.563766+0000 mgr.gibba044.wflcwh (mgr.34466) 2928 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:03:10.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:10 gibba023 bash[30844]: cluster 2021-03-10T21:03:09.602549+0000 mgr.gibba044.wflcwh (mgr.34466) 2929 : cluster [DBG] pgmap v1655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:10.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:10 gibba023 bash[31815]: cluster 2021-03-10T21:03:09.602549+0000 mgr.gibba044.wflcwh (mgr.34466) 2929 : cluster [DBG] pgmap v1655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:11.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:10 gibba044 bash[25485]: cluster 2021-03-10T21:03:09.602549+0000 mgr.gibba044.wflcwh (mgr.34466) 2929 : cluster [DBG] pgmap v1655: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:13.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:13 gibba023 bash[30844]: cluster 2021-03-10T21:03:11.604161+0000 mgr.gibba044.wflcwh (mgr.34466) 2930 : cluster [DBG] pgmap v1656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:13.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:13 gibba023 bash[31815]: cluster 2021-03-10T21:03:11.604161+0000 mgr.gibba044.wflcwh (mgr.34466) 2930 : cluster [DBG] pgmap v1656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:14.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:13 gibba044 bash[25485]: cluster 2021-03-10T21:03:11.604161+0000 mgr.gibba044.wflcwh (mgr.34466) 2930 : cluster [DBG] pgmap v1656: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:15.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:15 gibba023 bash[30844]: cluster 2021-03-10T21:03:13.605734+0000 mgr.gibba044.wflcwh (mgr.34466) 2931 : cluster [DBG] pgmap v1657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:15.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:15 gibba023 bash[31815]: cluster 2021-03-10T21:03:13.605734+0000 mgr.gibba044.wflcwh (mgr.34466) 2931 : cluster [DBG] pgmap v1657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:16.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:15 gibba044 bash[25485]: cluster 2021-03-10T21:03:13.605734+0000 mgr.gibba044.wflcwh (mgr.34466) 2931 : cluster [DBG] pgmap v1657: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:17.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:17 gibba023 bash[30844]: cluster 2021-03-10T21:03:15.607322+0000 mgr.gibba044.wflcwh (mgr.34466) 2932 : cluster [DBG] pgmap v1658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:17.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:17 gibba023 bash[31815]: cluster 2021-03-10T21:03:15.607322+0000 mgr.gibba044.wflcwh (mgr.34466) 2932 : cluster [DBG] pgmap v1658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:18.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:17 gibba044 bash[25485]: cluster 2021-03-10T21:03:15.607322+0000 mgr.gibba044.wflcwh (mgr.34466) 2932 : cluster [DBG] pgmap v1658: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:19.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:19 gibba023 bash[30844]: cluster 2021-03-10T21:03:17.608048+0000 mgr.gibba044.wflcwh (mgr.34466) 2933 : cluster [DBG] pgmap v1659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:19.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:19 gibba023 bash[31815]: cluster 2021-03-10T21:03:17.608048+0000 mgr.gibba044.wflcwh (mgr.34466) 2933 : cluster [DBG] pgmap v1659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:20.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:19 gibba044 bash[25485]: cluster 2021-03-10T21:03:17.608048+0000 mgr.gibba044.wflcwh (mgr.34466) 2933 : cluster [DBG] pgmap v1659: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:21.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:21 gibba023 bash[30844]: cluster 2021-03-10T21:03:19.608638+0000 mgr.gibba044.wflcwh (mgr.34466) 2934 : cluster [DBG] pgmap v1660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:21.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:21 gibba023 bash[31815]: cluster 2021-03-10T21:03:19.608638+0000 mgr.gibba044.wflcwh (mgr.34466) 2934 : cluster [DBG] pgmap v1660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:22.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:21 gibba044 bash[25485]: cluster 2021-03-10T21:03:19.608638+0000 mgr.gibba044.wflcwh (mgr.34466) 2934 : cluster [DBG] pgmap v1660: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:23.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:23 gibba023 bash[30844]: cluster 2021-03-10T21:03:21.609886+0000 mgr.gibba044.wflcwh (mgr.34466) 2935 : cluster [DBG] pgmap v1661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:23.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:23 gibba023 bash[31815]: cluster 2021-03-10T21:03:21.609886+0000 mgr.gibba044.wflcwh (mgr.34466) 2935 : cluster [DBG] pgmap v1661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:24.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:23 gibba044 bash[25485]: cluster 2021-03-10T21:03:21.609886+0000 mgr.gibba044.wflcwh (mgr.34466) 2935 : cluster [DBG] pgmap v1661: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:24.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:24 gibba023 bash[30844]: cephadm 2021-03-10T21:03:23.579591+0000 mgr.gibba044.wflcwh (mgr.34466) 2936 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:03:24.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:24 gibba023 bash[30844]: cluster 2021-03-10T21:03:23.611400+0000 mgr.gibba044.wflcwh (mgr.34466) 2937 : cluster [DBG] pgmap v1662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:24.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:24 gibba023 bash[31815]: cephadm 2021-03-10T21:03:23.579591+0000 mgr.gibba044.wflcwh (mgr.34466) 2936 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:03:24.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:24 gibba023 bash[31815]: cluster 2021-03-10T21:03:23.611400+0000 mgr.gibba044.wflcwh (mgr.34466) 2937 : cluster [DBG] pgmap v1662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:25.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:24 gibba044 bash[25485]: cephadm 2021-03-10T21:03:23.579591+0000 mgr.gibba044.wflcwh (mgr.34466) 2936 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:03:25.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:24 gibba044 bash[25485]: cluster 2021-03-10T21:03:23.611400+0000 mgr.gibba044.wflcwh (mgr.34466) 2937 : cluster [DBG] pgmap v1662: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:26.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:26 gibba023 bash[30844]: cluster 2021-03-10T21:03:25.613061+0000 mgr.gibba044.wflcwh (mgr.34466) 2938 : cluster [DBG] pgmap v1663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:26.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:26 gibba023 bash[31815]: cluster 2021-03-10T21:03:25.613061+0000 mgr.gibba044.wflcwh (mgr.34466) 2938 : cluster [DBG] pgmap v1663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:27.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:26 gibba044 bash[25485]: cluster 2021-03-10T21:03:25.613061+0000 mgr.gibba044.wflcwh (mgr.34466) 2938 : cluster [DBG] pgmap v1663: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:27 gibba023 bash[30844]: audit 2021-03-10T21:03:27.407588+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:03:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:27 gibba023 bash[30844]: audit 2021-03-10T21:03:27.408269+0000 mon.a (mon.0) 1354 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:03:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:27 gibba023 bash[30844]: audit 2021-03-10T21:03:27.408874+0000 mon.a (mon.0) 1355 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T21:03:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:27 gibba023 bash[30844]: audit 2021-03-10T21:03:27.409585+0000 mon.a (mon.0) 1356 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T21:03:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:27 gibba023 bash[30844]: audit 2021-03-10T21:03:27.410366+0000 mon.a (mon.0) 1357 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T21:03:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:27 gibba023 bash[30844]: audit 2021-03-10T21:03:27.411062+0000 mon.a (mon.0) 1358 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T21:03:27.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:27 gibba023 bash[31815]: audit 2021-03-10T21:03:27.407588+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:03:27.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:27 gibba023 bash[31815]: audit 2021-03-10T21:03:27.408269+0000 mon.a (mon.0) 1354 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:03:27.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:27 gibba023 bash[31815]: audit 2021-03-10T21:03:27.408874+0000 mon.a (mon.0) 1355 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T21:03:27.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:27 gibba023 bash[31815]: audit 2021-03-10T21:03:27.409585+0000 mon.a (mon.0) 1356 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T21:03:27.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:27 gibba023 bash[31815]: audit 2021-03-10T21:03:27.410366+0000 mon.a (mon.0) 1357 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T21:03:27.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:27 gibba023 bash[31815]: audit 2021-03-10T21:03:27.411062+0000 mon.a (mon.0) 1358 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T21:03:28.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:27 gibba044 bash[25485]: audit 2021-03-10T21:03:27.407588+0000 mon.a (mon.0) 1353 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:03:28.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:27 gibba044 bash[25485]: audit 2021-03-10T21:03:27.408269+0000 mon.a (mon.0) 1354 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:03:28.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:27 gibba044 bash[25485]: audit 2021-03-10T21:03:27.408874+0000 mon.a (mon.0) 1355 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [7, 2]}]: dispatch 2021-03-10T21:03:28.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:27 gibba044 bash[25485]: audit 2021-03-10T21:03:27.409585+0000 mon.a (mon.0) 1356 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T21:03:28.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:27 gibba044 bash[25485]: audit 2021-03-10T21:03:27.410366+0000 mon.a (mon.0) 1357 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T21:03:28.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:27 gibba044 bash[25485]: audit 2021-03-10T21:03:27.411062+0000 mon.a (mon.0) 1358 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T21:03:29.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:29 gibba023 bash[30844]: cluster 2021-03-10T21:03:27.613821+0000 mgr.gibba044.wflcwh (mgr.34466) 2939 : cluster [DBG] pgmap v1664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:29.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:29 gibba023 bash[31815]: cluster 2021-03-10T21:03:27.613821+0000 mgr.gibba044.wflcwh (mgr.34466) 2939 : cluster [DBG] pgmap v1664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:30.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:29 gibba044 bash[25485]: cluster 2021-03-10T21:03:27.613821+0000 mgr.gibba044.wflcwh (mgr.34466) 2939 : cluster [DBG] pgmap v1664: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:31.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:31 gibba023 bash[30844]: cluster 2021-03-10T21:03:29.614584+0000 mgr.gibba044.wflcwh (mgr.34466) 2940 : cluster [DBG] pgmap v1665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:31.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:31 gibba023 bash[31815]: cluster 2021-03-10T21:03:29.614584+0000 mgr.gibba044.wflcwh (mgr.34466) 2940 : cluster [DBG] pgmap v1665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:32.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:31 gibba044 bash[25485]: cluster 2021-03-10T21:03:29.614584+0000 mgr.gibba044.wflcwh (mgr.34466) 2940 : cluster [DBG] pgmap v1665: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:33.034 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T21:03:33.261 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:03:33.261 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (54m) 10m ago 60m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T21:03:33.261 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (60m) 9m ago 60m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T21:03:33.262 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (55m) 9m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T21:03:33.262 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (55m) 9m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T21:03:33.262 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (54m) 10m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T21:03:33.262 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (54m) 10m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T21:03:33.263 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (53m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T21:03:33.263 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (53m) 10m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T21:03:33.263 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (60m) 10m ago 60m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T21:03:33.264 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (60m) 9m ago 60m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T21:03:33.264 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (52m) 10m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T21:03:33.264 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (52m) 10m ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T21:03:33.265 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (52m) 10m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T21:03:33.265 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (51m) 10m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T21:03:33.266 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (51m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T21:03:33.266 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (50m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T21:03:33.266 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (50m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T21:03:33.267 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (49m) 9m ago 60m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T21:03:33.267 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (59m) 9m ago 60m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T21:03:33.268 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 10m ago 58m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:03:33.268 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 9m ago 58m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:03:33.510 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T21:03:33.511 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T21:03:33.511 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:03:33.511 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:03:33.512 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T21:03:33.512 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:03:33.512 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:03:33.512 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T21:03:33.513 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:03:33.513 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:03:33.513 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T21:03:33.513 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T21:03:33.513 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:03:33.514 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T21:03:33.514 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T21:03:33.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:33 gibba023 bash[30844]: cluster 2021-03-10T21:03:31.615302+0000 mgr.gibba044.wflcwh (mgr.34466) 2941 : cluster [DBG] pgmap v1666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:33.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:33 gibba023 bash[30844]: audit 2021-03-10T21:03:33.507592+0000 mon.c (mon.1) 67 : audit [DBG] from='client.? 172.21.2.123:0/1219851990' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:33.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:33 gibba023 bash[31815]: cluster 2021-03-10T21:03:31.615302+0000 mgr.gibba044.wflcwh (mgr.34466) 2941 : cluster [DBG] pgmap v1666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:33.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:33 gibba023 bash[31815]: audit 2021-03-10T21:03:33.507592+0000 mon.c (mon.1) 67 : audit [DBG] from='client.? 172.21.2.123:0/1219851990' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:34.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:33 gibba044 bash[25485]: cluster 2021-03-10T21:03:31.615302+0000 mgr.gibba044.wflcwh (mgr.34466) 2941 : cluster [DBG] pgmap v1666: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:34.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:33 gibba044 bash[25485]: audit 2021-03-10T21:03:33.507592+0000 mon.c (mon.1) 67 : audit [DBG] from='client.? 172.21.2.123:0/1219851990' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:34.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:34 gibba023 bash[30844]: audit 2021-03-10T21:03:33.022732+0000 mgr.gibba044.wflcwh (mgr.34466) 2942 : audit [DBG] from='client.46038 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:03:34.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:34 gibba023 bash[30844]: audit 2021-03-10T21:03:33.246091+0000 mgr.gibba044.wflcwh (mgr.34466) 2943 : audit [DBG] from='client.46044 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:03:34.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:34 gibba023 bash[31815]: audit 2021-03-10T21:03:33.022732+0000 mgr.gibba044.wflcwh (mgr.34466) 2942 : audit [DBG] from='client.46038 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:03:34.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:34 gibba023 bash[31815]: audit 2021-03-10T21:03:33.246091+0000 mgr.gibba044.wflcwh (mgr.34466) 2943 : audit [DBG] from='client.46044 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:03:35.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:34 gibba044 bash[25485]: audit 2021-03-10T21:03:33.022732+0000 mgr.gibba044.wflcwh (mgr.34466) 2942 : audit [DBG] from='client.46038 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:03:35.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:34 gibba044 bash[25485]: audit 2021-03-10T21:03:33.246091+0000 mgr.gibba044.wflcwh (mgr.34466) 2943 : audit [DBG] from='client.46044 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:03:35.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:35 gibba023 bash[30844]: cluster 2021-03-10T21:03:33.616038+0000 mgr.gibba044.wflcwh (mgr.34466) 2944 : cluster [DBG] pgmap v1667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:35.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:35 gibba023 bash[31815]: cluster 2021-03-10T21:03:33.616038+0000 mgr.gibba044.wflcwh (mgr.34466) 2944 : cluster [DBG] pgmap v1667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:36.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:35 gibba044 bash[25485]: cluster 2021-03-10T21:03:33.616038+0000 mgr.gibba044.wflcwh (mgr.34466) 2944 : cluster [DBG] pgmap v1667: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:36.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:36 gibba023 bash[30844]: cluster 2021-03-10T21:03:35.616727+0000 mgr.gibba044.wflcwh (mgr.34466) 2945 : cluster [DBG] pgmap v1668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:36.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:36 gibba023 bash[31815]: cluster 2021-03-10T21:03:35.616727+0000 mgr.gibba044.wflcwh (mgr.34466) 2945 : cluster [DBG] pgmap v1668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:37.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:36 gibba044 bash[25485]: cluster 2021-03-10T21:03:35.616727+0000 mgr.gibba044.wflcwh (mgr.34466) 2945 : cluster [DBG] pgmap v1668: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:39.895 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:39 gibba044 bash[25485]: cluster 2021-03-10T21:03:37.617548+0000 mgr.gibba044.wflcwh (mgr.34466) 2946 : cluster [DBG] pgmap v1669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:39.896 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:39 gibba044 bash[25485]: audit 2021-03-10T21:03:38.592543+0000 mon.a (mon.0) 1359 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T21:03:39.896 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:39 gibba044 bash[25485]: audit 2021-03-10T21:03:38.592690+0000 mon.a (mon.0) 1360 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T21:03:39.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:39 gibba023 bash[30844]: cluster 2021-03-10T21:03:37.617548+0000 mgr.gibba044.wflcwh (mgr.34466) 2946 : cluster [DBG] pgmap v1669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:39.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:39 gibba023 bash[30844]: audit 2021-03-10T21:03:38.592543+0000 mon.a (mon.0) 1359 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T21:03:39.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:39 gibba023 bash[30844]: audit 2021-03-10T21:03:38.592690+0000 mon.a (mon.0) 1360 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T21:03:39.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:39 gibba023 bash[31815]: cluster 2021-03-10T21:03:37.617548+0000 mgr.gibba044.wflcwh (mgr.34466) 2946 : cluster [DBG] pgmap v1669: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:39.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:39 gibba023 bash[31815]: audit 2021-03-10T21:03:38.592543+0000 mon.a (mon.0) 1359 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T21:03:39.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:39 gibba023 bash[31815]: audit 2021-03-10T21:03:38.592690+0000 mon.a (mon.0) 1360 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "osd","key": "container_image"}]: dispatch 2021-03-10T21:03:41.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:41 gibba023 bash[30844]: cluster 2021-03-10T21:03:39.618787+0000 mgr.gibba044.wflcwh (mgr.34466) 2947 : cluster [DBG] pgmap v1670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:41.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:41 gibba023 bash[31815]: cluster 2021-03-10T21:03:39.618787+0000 mgr.gibba044.wflcwh (mgr.34466) 2947 : cluster [DBG] pgmap v1670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:42.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:41 gibba044 bash[25485]: cluster 2021-03-10T21:03:39.618787+0000 mgr.gibba044.wflcwh (mgr.34466) 2947 : cluster [DBG] pgmap v1670: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:43.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:43 gibba044 bash[25485]: cluster 2021-03-10T21:03:41.619283+0000 mgr.gibba044.wflcwh (mgr.34466) 2948 : cluster [DBG] pgmap v1671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:43.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:43 gibba044 bash[25485]: audit 2021-03-10T21:03:42.176920+0000 mon.a (mon.0) 1361 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:03:43.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:43 gibba044 bash[25485]: cephadm 2021-03-10T21:03:42.177819+0000 mgr.gibba044.wflcwh (mgr.34466) 2949 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:03:43.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:43 gibba044 bash[25485]: audit 2021-03-10T21:03:42.761985+0000 mon.a (mon.0) 1362 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T21:03:43.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:43 gibba044 bash[25485]: audit 2021-03-10T21:03:42.930627+0000 mon.a (mon.0) 1363 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:03:43.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:43 gibba044 bash[25485]: audit 2021-03-10T21:03:43.119103+0000 mon.a (mon.0) 1364 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:03:43.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:43 gibba044 bash[25485]: audit 2021-03-10T21:03:43.122576+0000 mon.a (mon.0) 1365 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:03:43.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:43 gibba044 bash[25485]: audit 2021-03-10T21:03:43.123751+0000 mon.a (mon.0) 1366 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:43.508 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:43 gibba044 bash[25485]: audit 2021-03-10T21:03:43.124914+0000 mon.a (mon.0) 1367 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:43.508 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:43 gibba044 bash[25485]: audit 2021-03-10T21:03:43.125987+0000 mon.a (mon.0) 1368 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:43.509 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:43 gibba044 bash[25485]: audit 2021-03-10T21:03:43.128531+0000 mon.a (mon.0) 1369 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:43.509 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:43 gibba044 bash[25485]: audit 2021-03-10T21:03:43.129945+0000 mon.a (mon.0) 1370 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:43.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:43 gibba023 bash[30844]: cluster 2021-03-10T21:03:41.619283+0000 mgr.gibba044.wflcwh (mgr.34466) 2948 : cluster [DBG] pgmap v1671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:43.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:43 gibba023 bash[30844]: audit 2021-03-10T21:03:42.176920+0000 mon.a (mon.0) 1361 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:03:43.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:43 gibba023 bash[30844]: cephadm 2021-03-10T21:03:42.177819+0000 mgr.gibba044.wflcwh (mgr.34466) 2949 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:03:43.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:43 gibba023 bash[30844]: audit 2021-03-10T21:03:42.761985+0000 mon.a (mon.0) 1362 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T21:03:43.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:43 gibba023 bash[30844]: audit 2021-03-10T21:03:42.930627+0000 mon.a (mon.0) 1363 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:03:43.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:43 gibba023 bash[30844]: audit 2021-03-10T21:03:43.119103+0000 mon.a (mon.0) 1364 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:03:43.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:43 gibba023 bash[30844]: audit 2021-03-10T21:03:43.122576+0000 mon.a (mon.0) 1365 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:03:43.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:43 gibba023 bash[30844]: audit 2021-03-10T21:03:43.123751+0000 mon.a (mon.0) 1366 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:43.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:43 gibba023 bash[30844]: audit 2021-03-10T21:03:43.124914+0000 mon.a (mon.0) 1367 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:43.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:43 gibba023 bash[30844]: audit 2021-03-10T21:03:43.125987+0000 mon.a (mon.0) 1368 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:43.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:43 gibba023 bash[30844]: audit 2021-03-10T21:03:43.128531+0000 mon.a (mon.0) 1369 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:43.681 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:43 gibba023 bash[30844]: audit 2021-03-10T21:03:43.129945+0000 mon.a (mon.0) 1370 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:43.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:43 gibba023 bash[31815]: cluster 2021-03-10T21:03:41.619283+0000 mgr.gibba044.wflcwh (mgr.34466) 2948 : cluster [DBG] pgmap v1671: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:43.681 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:43 gibba023 bash[31815]: audit 2021-03-10T21:03:42.176920+0000 mon.a (mon.0) 1361 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:03:43.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:43 gibba023 bash[31815]: cephadm 2021-03-10T21:03:42.177819+0000 mgr.gibba044.wflcwh (mgr.34466) 2949 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:03:43.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:43 gibba023 bash[31815]: audit 2021-03-10T21:03:42.761985+0000 mon.a (mon.0) 1362 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T21:03:43.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:43 gibba023 bash[31815]: audit 2021-03-10T21:03:42.930627+0000 mon.a (mon.0) 1363 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:03:43.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:43 gibba023 bash[31815]: audit 2021-03-10T21:03:43.119103+0000 mon.a (mon.0) 1364 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:03:43.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:43 gibba023 bash[31815]: audit 2021-03-10T21:03:43.122576+0000 mon.a (mon.0) 1365 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:03:43.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:43 gibba023 bash[31815]: audit 2021-03-10T21:03:43.123751+0000 mon.a (mon.0) 1366 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:43.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:43 gibba023 bash[31815]: audit 2021-03-10T21:03:43.124914+0000 mon.a (mon.0) 1367 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:43.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:43 gibba023 bash[31815]: audit 2021-03-10T21:03:43.125987+0000 mon.a (mon.0) 1368 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:43.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:43 gibba023 bash[31815]: audit 2021-03-10T21:03:43.128531+0000 mon.a (mon.0) 1369 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:43.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:43 gibba023 bash[31815]: audit 2021-03-10T21:03:43.129945+0000 mon.a (mon.0) 1370 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:03:44.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:44 gibba044 bash[25485]: cephadm 2021-03-10T21:03:42.931793+0000 mgr.gibba044.wflcwh (mgr.34466) 2950 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:03:44.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:44 gibba044 bash[25485]: cephadm 2021-03-10T21:03:43.122335+0000 mgr.gibba044.wflcwh (mgr.34466) 2951 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:03:44.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:44 gibba044 bash[25485]: cephadm 2021-03-10T21:03:43.123937+0000 mgr.gibba044.wflcwh (mgr.34466) 2952 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:03:44.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:44 gibba044 bash[25485]: cephadm 2021-03-10T21:03:43.125040+0000 mgr.gibba044.wflcwh (mgr.34466) 2953 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:03:44.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:44 gibba044 bash[25485]: cephadm 2021-03-10T21:03:43.125077+0000 mgr.gibba044.wflcwh (mgr.34466) 2954 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:03:44.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:44 gibba044 bash[25485]: cephadm 2021-03-10T21:03:43.126160+0000 mgr.gibba044.wflcwh (mgr.34466) 2955 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:03:44.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:44 gibba044 bash[25485]: cephadm 2021-03-10T21:03:43.126198+0000 mgr.gibba044.wflcwh (mgr.34466) 2956 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:03:44.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:44 gibba044 bash[25485]: cephadm 2021-03-10T21:03:43.127262+0000 mgr.gibba044.wflcwh (mgr.34466) 2957 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:03:44.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:44 gibba044 bash[25485]: cephadm 2021-03-10T21:03:43.128399+0000 mgr.gibba044.wflcwh (mgr.34466) 2958 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:03:44.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:44 gibba044 bash[25485]: cephadm 2021-03-10T21:03:43.128433+0000 mgr.gibba044.wflcwh (mgr.34466) 2959 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:03:44.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:44 gibba044 bash[25485]: cephadm 2021-03-10T21:03:43.129775+0000 mgr.gibba044.wflcwh (mgr.34466) 2960 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:03:44.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:44 gibba044 bash[25485]: cephadm 2021-03-10T21:03:43.130103+0000 mgr.gibba044.wflcwh (mgr.34466) 2961 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:03:44.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:44 gibba044 bash[25485]: cephadm 2021-03-10T21:03:43.131273+0000 mgr.gibba044.wflcwh (mgr.34466) 2962 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:03:44.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:44 gibba044 bash[25485]: cephadm 2021-03-10T21:03:43.131311+0000 mgr.gibba044.wflcwh (mgr.34466) 2963 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:03:44.508 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:44 gibba044 bash[25485]: cephadm 2021-03-10T21:03:43.131438+0000 mgr.gibba044.wflcwh (mgr.34466) 2964 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:03:44.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[30844]: cephadm 2021-03-10T21:03:42.931793+0000 mgr.gibba044.wflcwh (mgr.34466) 2950 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:03:44.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[30844]: cephadm 2021-03-10T21:03:43.122335+0000 mgr.gibba044.wflcwh (mgr.34466) 2951 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:03:44.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[30844]: cephadm 2021-03-10T21:03:43.123937+0000 mgr.gibba044.wflcwh (mgr.34466) 2952 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:03:44.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[30844]: cephadm 2021-03-10T21:03:43.125040+0000 mgr.gibba044.wflcwh (mgr.34466) 2953 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:03:44.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[30844]: cephadm 2021-03-10T21:03:43.125077+0000 mgr.gibba044.wflcwh (mgr.34466) 2954 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:03:44.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[30844]: cephadm 2021-03-10T21:03:43.126160+0000 mgr.gibba044.wflcwh (mgr.34466) 2955 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:03:44.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[30844]: cephadm 2021-03-10T21:03:43.126198+0000 mgr.gibba044.wflcwh (mgr.34466) 2956 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:03:44.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[30844]: cephadm 2021-03-10T21:03:43.127262+0000 mgr.gibba044.wflcwh (mgr.34466) 2957 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:03:44.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[30844]: cephadm 2021-03-10T21:03:43.128399+0000 mgr.gibba044.wflcwh (mgr.34466) 2958 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:03:44.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[30844]: cephadm 2021-03-10T21:03:43.128433+0000 mgr.gibba044.wflcwh (mgr.34466) 2959 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:03:44.681 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[30844]: cephadm 2021-03-10T21:03:43.129775+0000 mgr.gibba044.wflcwh (mgr.34466) 2960 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:03:44.681 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[30844]: cephadm 2021-03-10T21:03:43.130103+0000 mgr.gibba044.wflcwh (mgr.34466) 2961 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:03:44.681 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[30844]: cephadm 2021-03-10T21:03:43.131273+0000 mgr.gibba044.wflcwh (mgr.34466) 2962 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:03:44.681 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[30844]: cephadm 2021-03-10T21:03:43.131311+0000 mgr.gibba044.wflcwh (mgr.34466) 2963 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:03:44.682 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[30844]: cephadm 2021-03-10T21:03:43.131438+0000 mgr.gibba044.wflcwh (mgr.34466) 2964 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:03:44.682 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[31815]: cephadm 2021-03-10T21:03:42.931793+0000 mgr.gibba044.wflcwh (mgr.34466) 2950 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:03:44.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[31815]: cephadm 2021-03-10T21:03:43.122335+0000 mgr.gibba044.wflcwh (mgr.34466) 2951 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:03:44.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[31815]: cephadm 2021-03-10T21:03:43.123937+0000 mgr.gibba044.wflcwh (mgr.34466) 2952 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:03:44.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[31815]: cephadm 2021-03-10T21:03:43.125040+0000 mgr.gibba044.wflcwh (mgr.34466) 2953 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:03:44.683 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[31815]: cephadm 2021-03-10T21:03:43.125077+0000 mgr.gibba044.wflcwh (mgr.34466) 2954 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:03:44.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[31815]: cephadm 2021-03-10T21:03:43.126160+0000 mgr.gibba044.wflcwh (mgr.34466) 2955 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:03:44.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[31815]: cephadm 2021-03-10T21:03:43.126198+0000 mgr.gibba044.wflcwh (mgr.34466) 2956 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:03:44.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[31815]: cephadm 2021-03-10T21:03:43.127262+0000 mgr.gibba044.wflcwh (mgr.34466) 2957 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:03:44.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[31815]: cephadm 2021-03-10T21:03:43.128399+0000 mgr.gibba044.wflcwh (mgr.34466) 2958 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:03:44.684 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[31815]: cephadm 2021-03-10T21:03:43.128433+0000 mgr.gibba044.wflcwh (mgr.34466) 2959 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:03:44.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[31815]: cephadm 2021-03-10T21:03:43.129775+0000 mgr.gibba044.wflcwh (mgr.34466) 2960 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:03:44.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[31815]: cephadm 2021-03-10T21:03:43.130103+0000 mgr.gibba044.wflcwh (mgr.34466) 2961 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:03:44.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[31815]: cephadm 2021-03-10T21:03:43.131273+0000 mgr.gibba044.wflcwh (mgr.34466) 2962 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:03:44.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[31815]: cephadm 2021-03-10T21:03:43.131311+0000 mgr.gibba044.wflcwh (mgr.34466) 2963 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:03:44.685 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:44 gibba023 bash[31815]: cephadm 2021-03-10T21:03:43.131438+0000 mgr.gibba044.wflcwh (mgr.34466) 2964 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:03:45.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:45 gibba044 bash[25485]: cluster 2021-03-10T21:03:43.620716+0000 mgr.gibba044.wflcwh (mgr.34466) 2965 : cluster [DBG] pgmap v1672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:45.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:45 gibba023 bash[30844]: cluster 2021-03-10T21:03:43.620716+0000 mgr.gibba044.wflcwh (mgr.34466) 2965 : cluster [DBG] pgmap v1672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:45.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:45 gibba023 bash[31815]: cluster 2021-03-10T21:03:43.620716+0000 mgr.gibba044.wflcwh (mgr.34466) 2965 : cluster [DBG] pgmap v1672: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:47.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:47 gibba044 bash[25485]: cluster 2021-03-10T21:03:45.622274+0000 mgr.gibba044.wflcwh (mgr.34466) 2966 : cluster [DBG] pgmap v1673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:47.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:47 gibba023 bash[30844]: cluster 2021-03-10T21:03:45.622274+0000 mgr.gibba044.wflcwh (mgr.34466) 2966 : cluster [DBG] pgmap v1673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:47.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:47 gibba023 bash[31815]: cluster 2021-03-10T21:03:45.622274+0000 mgr.gibba044.wflcwh (mgr.34466) 2966 : cluster [DBG] pgmap v1673: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:49.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:49 gibba023 bash[30844]: cluster 2021-03-10T21:03:47.623186+0000 mgr.gibba044.wflcwh (mgr.34466) 2967 : cluster [DBG] pgmap v1674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:49.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:49 gibba023 bash[31815]: cluster 2021-03-10T21:03:47.623186+0000 mgr.gibba044.wflcwh (mgr.34466) 2967 : cluster [DBG] pgmap v1674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:50.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:49 gibba044 bash[25485]: cluster 2021-03-10T21:03:47.623186+0000 mgr.gibba044.wflcwh (mgr.34466) 2967 : cluster [DBG] pgmap v1674: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:51.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:51 gibba023 bash[30844]: cluster 2021-03-10T21:03:49.623866+0000 mgr.gibba044.wflcwh (mgr.34466) 2968 : cluster [DBG] pgmap v1675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:51.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:51 gibba023 bash[31815]: cluster 2021-03-10T21:03:49.623866+0000 mgr.gibba044.wflcwh (mgr.34466) 2968 : cluster [DBG] pgmap v1675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:52.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:51 gibba044 bash[25485]: cluster 2021-03-10T21:03:49.623866+0000 mgr.gibba044.wflcwh (mgr.34466) 2968 : cluster [DBG] pgmap v1675: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:53.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:53 gibba023 bash[30844]: cluster 2021-03-10T21:03:51.624268+0000 mgr.gibba044.wflcwh (mgr.34466) 2969 : cluster [DBG] pgmap v1676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:53.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:53 gibba023 bash[31815]: cluster 2021-03-10T21:03:51.624268+0000 mgr.gibba044.wflcwh (mgr.34466) 2969 : cluster [DBG] pgmap v1676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:54.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:53 gibba044 bash[25485]: cluster 2021-03-10T21:03:51.624268+0000 mgr.gibba044.wflcwh (mgr.34466) 2969 : cluster [DBG] pgmap v1676: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:55.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:55 gibba023 bash[30844]: cluster 2021-03-10T21:03:53.624825+0000 mgr.gibba044.wflcwh (mgr.34466) 2970 : cluster [DBG] pgmap v1677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:55.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:55 gibba023 bash[31815]: cluster 2021-03-10T21:03:53.624825+0000 mgr.gibba044.wflcwh (mgr.34466) 2970 : cluster [DBG] pgmap v1677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:56.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:55 gibba044 bash[25485]: cluster 2021-03-10T21:03:53.624825+0000 mgr.gibba044.wflcwh (mgr.34466) 2970 : cluster [DBG] pgmap v1677: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:57.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:57 gibba023 bash[30844]: cluster 2021-03-10T21:03:55.625498+0000 mgr.gibba044.wflcwh (mgr.34466) 2971 : cluster [DBG] pgmap v1678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:57.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:57 gibba023 bash[31815]: cluster 2021-03-10T21:03:55.625498+0000 mgr.gibba044.wflcwh (mgr.34466) 2971 : cluster [DBG] pgmap v1678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:58.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:57 gibba044 bash[25485]: cluster 2021-03-10T21:03:55.625498+0000 mgr.gibba044.wflcwh (mgr.34466) 2971 : cluster [DBG] pgmap v1678: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:58.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:58 gibba023 bash[30844]: cluster 2021-03-10T21:03:57.626541+0000 mgr.gibba044.wflcwh (mgr.34466) 2972 : cluster [DBG] pgmap v1679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:58.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:03:58 gibba023 bash[30844]: cephadm 2021-03-10T21:03:58.147305+0000 mgr.gibba044.wflcwh (mgr.34466) 2973 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:03:58.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:58 gibba023 bash[31815]: cluster 2021-03-10T21:03:57.626541+0000 mgr.gibba044.wflcwh (mgr.34466) 2972 : cluster [DBG] pgmap v1679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:58.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:03:58 gibba023 bash[31815]: cephadm 2021-03-10T21:03:58.147305+0000 mgr.gibba044.wflcwh (mgr.34466) 2973 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:03:59.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:58 gibba044 bash[25485]: cluster 2021-03-10T21:03:57.626541+0000 mgr.gibba044.wflcwh (mgr.34466) 2972 : cluster [DBG] pgmap v1679: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:03:59.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:03:58 gibba044 bash[25485]: cephadm 2021-03-10T21:03:58.147305+0000 mgr.gibba044.wflcwh (mgr.34466) 2973 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:04:01.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:00 gibba044 bash[25485]: cluster 2021-03-10T21:03:59.628245+0000 mgr.gibba044.wflcwh (mgr.34466) 2974 : cluster [DBG] pgmap v1680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:01.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:00 gibba023 bash[30844]: cluster 2021-03-10T21:03:59.628245+0000 mgr.gibba044.wflcwh (mgr.34466) 2974 : cluster [DBG] pgmap v1680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:01.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:00 gibba023 bash[31815]: cluster 2021-03-10T21:03:59.628245+0000 mgr.gibba044.wflcwh (mgr.34466) 2974 : cluster [DBG] pgmap v1680: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:03.758 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T21:04:03.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:03 gibba023 bash[30844]: cluster 2021-03-10T21:04:01.629779+0000 mgr.gibba044.wflcwh (mgr.34466) 2975 : cluster [DBG] pgmap v1681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:03.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:03 gibba023 bash[31815]: cluster 2021-03-10T21:04:01.629779+0000 mgr.gibba044.wflcwh (mgr.34466) 2975 : cluster [DBG] pgmap v1681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:03.988 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:04:03.989 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (55m) 21s ago 60m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T21:04:03.989 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (60m) 9m ago 60m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T21:04:03.989 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (55m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T21:04:03.989 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (55m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T21:04:03.990 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (54m) 21s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T21:04:03.990 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (54m) 21s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T21:04:03.990 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (54m) 9m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T21:04:03.990 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (54m) 21s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T21:04:03.990 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (60m) 21s ago 60m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T21:04:03.991 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (60m) 9m ago 60m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T21:04:03.991 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (53m) 21s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T21:04:03.991 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (52m) 21s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T21:04:03.991 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (52m) 21s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T21:04:03.992 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (52m) 21s ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T21:04:03.992 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (51m) 9m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T21:04:03.992 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (51m) 9m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T21:04:03.992 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (50m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T21:04:03.992 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (50m) 9m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T21:04:03.993 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (60m) 9m ago 60m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T21:04:03.993 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 21s ago 58m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:04:03.993 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 9m ago 58m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:04:04.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:03 gibba044 bash[25485]: cluster 2021-03-10T21:04:01.629779+0000 mgr.gibba044.wflcwh (mgr.34466) 2975 : cluster [DBG] pgmap v1681: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:04.242 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T21:04:04.243 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T21:04:04.243 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:04:04.243 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:04:04.243 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T21:04:04.243 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:04:04.244 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:04:04.244 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T21:04:04.244 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:04:04.244 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:04:04.245 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T21:04:04.245 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T21:04:04.245 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:04:04.245 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T21:04:04.245 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T21:04:04.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:04 gibba023 bash[30844]: audit 2021-03-10T21:04:04.238729+0000 mon.c (mon.1) 68 : audit [DBG] from='client.? 172.21.2.123:0/3867061283' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:04.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:04 gibba023 bash[31815]: audit 2021-03-10T21:04:04.238729+0000 mon.c (mon.1) 68 : audit [DBG] from='client.? 172.21.2.123:0/3867061283' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:05.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:04 gibba044 bash[25485]: audit 2021-03-10T21:04:04.238729+0000 mon.c (mon.1) 68 : audit [DBG] from='client.? 172.21.2.123:0/3867061283' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:05.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:05 gibba023 bash[30844]: cluster 2021-03-10T21:04:03.630593+0000 mgr.gibba044.wflcwh (mgr.34466) 2976 : cluster [DBG] pgmap v1682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:05.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:05 gibba023 bash[30844]: audit 2021-03-10T21:04:03.747059+0000 mgr.gibba044.wflcwh (mgr.34466) 2977 : audit [DBG] from='client.46056 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:04:05.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:05 gibba023 bash[30844]: audit 2021-03-10T21:04:03.975080+0000 mgr.gibba044.wflcwh (mgr.34466) 2978 : audit [DBG] from='client.56041 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:04:05.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:05 gibba023 bash[31815]: cluster 2021-03-10T21:04:03.630593+0000 mgr.gibba044.wflcwh (mgr.34466) 2976 : cluster [DBG] pgmap v1682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:05.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:05 gibba023 bash[31815]: audit 2021-03-10T21:04:03.747059+0000 mgr.gibba044.wflcwh (mgr.34466) 2977 : audit [DBG] from='client.46056 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:04:05.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:05 gibba023 bash[31815]: audit 2021-03-10T21:04:03.975080+0000 mgr.gibba044.wflcwh (mgr.34466) 2978 : audit [DBG] from='client.56041 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:04:06.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:05 gibba044 bash[25485]: cluster 2021-03-10T21:04:03.630593+0000 mgr.gibba044.wflcwh (mgr.34466) 2976 : cluster [DBG] pgmap v1682: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:06.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:05 gibba044 bash[25485]: audit 2021-03-10T21:04:03.747059+0000 mgr.gibba044.wflcwh (mgr.34466) 2977 : audit [DBG] from='client.46056 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:04:06.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:05 gibba044 bash[25485]: audit 2021-03-10T21:04:03.975080+0000 mgr.gibba044.wflcwh (mgr.34466) 2978 : audit [DBG] from='client.56041 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:04:07.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:07 gibba023 bash[30844]: cluster 2021-03-10T21:04:05.631150+0000 mgr.gibba044.wflcwh (mgr.34466) 2979 : cluster [DBG] pgmap v1683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:07.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:07 gibba023 bash[31815]: cluster 2021-03-10T21:04:05.631150+0000 mgr.gibba044.wflcwh (mgr.34466) 2979 : cluster [DBG] pgmap v1683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:08.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:07 gibba044 bash[25485]: cluster 2021-03-10T21:04:05.631150+0000 mgr.gibba044.wflcwh (mgr.34466) 2979 : cluster [DBG] pgmap v1683: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:09.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:09 gibba023 bash[30844]: cluster 2021-03-10T21:04:07.631818+0000 mgr.gibba044.wflcwh (mgr.34466) 2980 : cluster [DBG] pgmap v1684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:09.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:09 gibba023 bash[31815]: cluster 2021-03-10T21:04:07.631818+0000 mgr.gibba044.wflcwh (mgr.34466) 2980 : cluster [DBG] pgmap v1684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:10.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:09 gibba044 bash[25485]: cluster 2021-03-10T21:04:07.631818+0000 mgr.gibba044.wflcwh (mgr.34466) 2980 : cluster [DBG] pgmap v1684: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:10.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:10 gibba023 bash[30844]: cluster 2021-03-10T21:04:09.632972+0000 mgr.gibba044.wflcwh (mgr.34466) 2981 : cluster [DBG] pgmap v1685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:10.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:10 gibba023 bash[31815]: cluster 2021-03-10T21:04:09.632972+0000 mgr.gibba044.wflcwh (mgr.34466) 2981 : cluster [DBG] pgmap v1685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:11.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:10 gibba044 bash[25485]: cluster 2021-03-10T21:04:09.632972+0000 mgr.gibba044.wflcwh (mgr.34466) 2981 : cluster [DBG] pgmap v1685: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:13.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:13 gibba023 bash[30844]: cluster 2021-03-10T21:04:11.634423+0000 mgr.gibba044.wflcwh (mgr.34466) 2982 : cluster [DBG] pgmap v1686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:13.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:13 gibba023 bash[31815]: cluster 2021-03-10T21:04:11.634423+0000 mgr.gibba044.wflcwh (mgr.34466) 2982 : cluster [DBG] pgmap v1686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:14.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:13 gibba044 bash[25485]: cluster 2021-03-10T21:04:11.634423+0000 mgr.gibba044.wflcwh (mgr.34466) 2982 : cluster [DBG] pgmap v1686: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:14.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:14 gibba023 bash[30844]: cephadm 2021-03-10T21:04:13.163091+0000 mgr.gibba044.wflcwh (mgr.34466) 2983 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:04:14.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:14 gibba023 bash[31815]: cephadm 2021-03-10T21:04:13.163091+0000 mgr.gibba044.wflcwh (mgr.34466) 2983 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:04:15.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:14 gibba044 bash[25485]: cephadm 2021-03-10T21:04:13.163091+0000 mgr.gibba044.wflcwh (mgr.34466) 2983 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:04:15.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:15 gibba023 bash[30844]: cluster 2021-03-10T21:04:13.635036+0000 mgr.gibba044.wflcwh (mgr.34466) 2984 : cluster [DBG] pgmap v1687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:15.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:15 gibba023 bash[31815]: cluster 2021-03-10T21:04:13.635036+0000 mgr.gibba044.wflcwh (mgr.34466) 2984 : cluster [DBG] pgmap v1687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:16.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:15 gibba044 bash[25485]: cluster 2021-03-10T21:04:13.635036+0000 mgr.gibba044.wflcwh (mgr.34466) 2984 : cluster [DBG] pgmap v1687: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:17.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:17 gibba023 bash[30844]: cluster 2021-03-10T21:04:15.635817+0000 mgr.gibba044.wflcwh (mgr.34466) 2985 : cluster [DBG] pgmap v1688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:17.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:17 gibba023 bash[31815]: cluster 2021-03-10T21:04:15.635817+0000 mgr.gibba044.wflcwh (mgr.34466) 2985 : cluster [DBG] pgmap v1688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:18.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:17 gibba044 bash[25485]: cluster 2021-03-10T21:04:15.635817+0000 mgr.gibba044.wflcwh (mgr.34466) 2985 : cluster [DBG] pgmap v1688: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:19.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:18 gibba044 bash[25485]: cluster 2021-03-10T21:04:17.636969+0000 mgr.gibba044.wflcwh (mgr.34466) 2986 : cluster [DBG] pgmap v1689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:19.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:18 gibba023 bash[30844]: cluster 2021-03-10T21:04:17.636969+0000 mgr.gibba044.wflcwh (mgr.34466) 2986 : cluster [DBG] pgmap v1689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:19.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:18 gibba023 bash[31815]: cluster 2021-03-10T21:04:17.636969+0000 mgr.gibba044.wflcwh (mgr.34466) 2986 : cluster [DBG] pgmap v1689: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:21.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:20 gibba044 bash[25485]: cluster 2021-03-10T21:04:19.638730+0000 mgr.gibba044.wflcwh (mgr.34466) 2987 : cluster [DBG] pgmap v1690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:21.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:20 gibba023 bash[30844]: cluster 2021-03-10T21:04:19.638730+0000 mgr.gibba044.wflcwh (mgr.34466) 2987 : cluster [DBG] pgmap v1690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:21.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:20 gibba023 bash[31815]: cluster 2021-03-10T21:04:19.638730+0000 mgr.gibba044.wflcwh (mgr.34466) 2987 : cluster [DBG] pgmap v1690: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:23.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:23 gibba023 bash[30844]: cluster 2021-03-10T21:04:21.640413+0000 mgr.gibba044.wflcwh (mgr.34466) 2988 : cluster [DBG] pgmap v1691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:23.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:23 gibba023 bash[31815]: cluster 2021-03-10T21:04:21.640413+0000 mgr.gibba044.wflcwh (mgr.34466) 2988 : cluster [DBG] pgmap v1691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:24.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:23 gibba044 bash[25485]: cluster 2021-03-10T21:04:21.640413+0000 mgr.gibba044.wflcwh (mgr.34466) 2988 : cluster [DBG] pgmap v1691: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:25.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:25 gibba023 bash[30844]: cluster 2021-03-10T21:04:23.641326+0000 mgr.gibba044.wflcwh (mgr.34466) 2989 : cluster [DBG] pgmap v1692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:25.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:25 gibba023 bash[31815]: cluster 2021-03-10T21:04:23.641326+0000 mgr.gibba044.wflcwh (mgr.34466) 2989 : cluster [DBG] pgmap v1692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:26.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:25 gibba044 bash[25485]: cluster 2021-03-10T21:04:23.641326+0000 mgr.gibba044.wflcwh (mgr.34466) 2989 : cluster [DBG] pgmap v1692: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:27 gibba023 bash[30844]: cluster 2021-03-10T21:04:25.641992+0000 mgr.gibba044.wflcwh (mgr.34466) 2990 : cluster [DBG] pgmap v1693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:27 gibba023 bash[30844]: audit 2021-03-10T21:04:27.413539+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:04:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:27 gibba023 bash[30844]: audit 2021-03-10T21:04:27.414180+0000 mon.a (mon.0) 1372 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:04:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:27 gibba023 bash[30844]: audit 2021-03-10T21:04:27.414892+0000 mon.a (mon.0) 1373 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T21:04:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:27 gibba023 bash[30844]: audit 2021-03-10T21:04:27.415681+0000 mon.a (mon.0) 1374 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T21:04:27.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:27 gibba023 bash[30844]: audit 2021-03-10T21:04:27.416407+0000 mon.a (mon.0) 1375 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T21:04:27.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:27 gibba023 bash[30844]: audit 2021-03-10T21:04:27.417133+0000 mon.a (mon.0) 1376 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:04:27.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:27 gibba023 bash[31815]: cluster 2021-03-10T21:04:25.641992+0000 mgr.gibba044.wflcwh (mgr.34466) 2990 : cluster [DBG] pgmap v1693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:27.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:27 gibba023 bash[31815]: audit 2021-03-10T21:04:27.413539+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:04:27.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:27 gibba023 bash[31815]: audit 2021-03-10T21:04:27.414180+0000 mon.a (mon.0) 1372 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:04:27.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:27 gibba023 bash[31815]: audit 2021-03-10T21:04:27.414892+0000 mon.a (mon.0) 1373 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T21:04:27.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:27 gibba023 bash[31815]: audit 2021-03-10T21:04:27.415681+0000 mon.a (mon.0) 1374 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T21:04:27.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:27 gibba023 bash[31815]: audit 2021-03-10T21:04:27.416407+0000 mon.a (mon.0) 1375 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T21:04:27.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:27 gibba023 bash[31815]: audit 2021-03-10T21:04:27.417133+0000 mon.a (mon.0) 1376 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:04:28.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:27 gibba044 bash[25485]: cluster 2021-03-10T21:04:25.641992+0000 mgr.gibba044.wflcwh (mgr.34466) 2990 : cluster [DBG] pgmap v1693: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:28.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:27 gibba044 bash[25485]: audit 2021-03-10T21:04:27.413539+0000 mon.a (mon.0) 1371 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:04:28.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:27 gibba044 bash[25485]: audit 2021-03-10T21:04:27.414180+0000 mon.a (mon.0) 1372 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:04:28.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:27 gibba044 bash[25485]: audit 2021-03-10T21:04:27.414892+0000 mon.a (mon.0) 1373 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2021-03-10T21:04:28.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:27 gibba044 bash[25485]: audit 2021-03-10T21:04:27.415681+0000 mon.a (mon.0) 1374 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-03-10T21:04:28.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:27 gibba044 bash[25485]: audit 2021-03-10T21:04:27.416407+0000 mon.a (mon.0) 1375 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T21:04:28.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:27 gibba044 bash[25485]: audit 2021-03-10T21:04:27.417133+0000 mon.a (mon.0) 1376 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:04:29.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:29 gibba023 bash[30844]: cluster 2021-03-10T21:04:27.731940+0000 mgr.gibba044.wflcwh (mgr.34466) 2991 : cluster [DBG] pgmap v1694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:29.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:29 gibba023 bash[30844]: cephadm 2021-03-10T21:04:28.169273+0000 mgr.gibba044.wflcwh (mgr.34466) 2992 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:04:29.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:29 gibba023 bash[31815]: cluster 2021-03-10T21:04:27.731940+0000 mgr.gibba044.wflcwh (mgr.34466) 2991 : cluster [DBG] pgmap v1694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:29.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:29 gibba023 bash[31815]: cephadm 2021-03-10T21:04:28.169273+0000 mgr.gibba044.wflcwh (mgr.34466) 2992 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:04:30.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:29 gibba044 bash[25485]: cluster 2021-03-10T21:04:27.731940+0000 mgr.gibba044.wflcwh (mgr.34466) 2991 : cluster [DBG] pgmap v1694: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:30.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:29 gibba044 bash[25485]: cephadm 2021-03-10T21:04:28.169273+0000 mgr.gibba044.wflcwh (mgr.34466) 2992 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:04:31.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:30 gibba044 bash[25485]: cluster 2021-03-10T21:04:29.733177+0000 mgr.gibba044.wflcwh (mgr.34466) 2993 : cluster [DBG] pgmap v1695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:31.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:30 gibba023 bash[30844]: cluster 2021-03-10T21:04:29.733177+0000 mgr.gibba044.wflcwh (mgr.34466) 2993 : cluster [DBG] pgmap v1695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:31.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:30 gibba023 bash[31815]: cluster 2021-03-10T21:04:29.733177+0000 mgr.gibba044.wflcwh (mgr.34466) 2993 : cluster [DBG] pgmap v1695: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:33.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:33 gibba023 bash[30844]: cluster 2021-03-10T21:04:31.734596+0000 mgr.gibba044.wflcwh (mgr.34466) 2994 : cluster [DBG] pgmap v1696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:33.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:33 gibba023 bash[31815]: cluster 2021-03-10T21:04:31.734596+0000 mgr.gibba044.wflcwh (mgr.34466) 2994 : cluster [DBG] pgmap v1696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:34.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:33 gibba044 bash[25485]: cluster 2021-03-10T21:04:31.734596+0000 mgr.gibba044.wflcwh (mgr.34466) 2994 : cluster [DBG] pgmap v1696: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:34.489 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T21:04:34.715 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:04:34.715 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (55m) 52s ago 61m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T21:04:34.715 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (61m) 10m ago 61m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T21:04:34.716 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (56m) 10m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T21:04:34.716 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (56m) 10m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T21:04:34.716 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (55m) 52s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T21:04:34.716 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (55m) 52s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T21:04:34.716 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (54m) 10m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T21:04:34.717 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (54m) 52s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T21:04:34.717 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (61m) 52s ago 61m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T21:04:34.717 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (61m) 10m ago 61m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T21:04:34.717 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (53m) 52s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T21:04:34.718 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (53m) 52s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T21:04:34.718 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (53m) 52s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T21:04:34.718 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (52m) 52s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T21:04:34.718 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (52m) 10m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T21:04:34.718 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (51m) 10m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T21:04:34.719 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (51m) 10m ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T21:04:34.719 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (50m) 10m ago 61m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T21:04:34.719 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (60m) 10m ago 61m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T21:04:34.719 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 52s ago 59m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:04:34.719 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 10m ago 59m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:04:34.962 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T21:04:34.963 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T21:04:34.963 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:04:34.964 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:04:34.964 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T21:04:34.965 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:04:34.965 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:04:34.966 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T21:04:34.966 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:04:34.967 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:04:34.967 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T21:04:34.967 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T21:04:34.968 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:04:34.968 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T21:04:34.969 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T21:04:35.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:35 gibba023 bash[30844]: cluster 2021-03-10T21:04:33.736311+0000 mgr.gibba044.wflcwh (mgr.34466) 2995 : cluster [DBG] pgmap v1697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:35.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:35 gibba023 bash[30844]: audit 2021-03-10T21:04:34.478037+0000 mgr.gibba044.wflcwh (mgr.34466) 2996 : audit [DBG] from='client.46074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:04:35.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:35 gibba023 bash[30844]: audit 2021-03-10T21:04:34.959408+0000 mon.a (mon.0) 1377 : audit [DBG] from='client.? 172.21.2.123:0/1914238999' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:35.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:35 gibba023 bash[31815]: cluster 2021-03-10T21:04:33.736311+0000 mgr.gibba044.wflcwh (mgr.34466) 2995 : cluster [DBG] pgmap v1697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:35.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:35 gibba023 bash[31815]: audit 2021-03-10T21:04:34.478037+0000 mgr.gibba044.wflcwh (mgr.34466) 2996 : audit [DBG] from='client.46074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:04:35.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:35 gibba023 bash[31815]: audit 2021-03-10T21:04:34.959408+0000 mon.a (mon.0) 1377 : audit [DBG] from='client.? 172.21.2.123:0/1914238999' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:36.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:35 gibba044 bash[25485]: cluster 2021-03-10T21:04:33.736311+0000 mgr.gibba044.wflcwh (mgr.34466) 2995 : cluster [DBG] pgmap v1697: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:36.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:35 gibba044 bash[25485]: audit 2021-03-10T21:04:34.478037+0000 mgr.gibba044.wflcwh (mgr.34466) 2996 : audit [DBG] from='client.46074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:04:36.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:35 gibba044 bash[25485]: audit 2021-03-10T21:04:34.959408+0000 mon.a (mon.0) 1377 : audit [DBG] from='client.? 172.21.2.123:0/1914238999' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:36.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:36 gibba023 bash[30844]: audit 2021-03-10T21:04:34.702483+0000 mgr.gibba044.wflcwh (mgr.34466) 2997 : audit [DBG] from='client.46080 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:04:36.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:36 gibba023 bash[31815]: audit 2021-03-10T21:04:34.702483+0000 mgr.gibba044.wflcwh (mgr.34466) 2997 : audit [DBG] from='client.46080 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:04:37.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:36 gibba044 bash[25485]: audit 2021-03-10T21:04:34.702483+0000 mgr.gibba044.wflcwh (mgr.34466) 2997 : audit [DBG] from='client.46080 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:04:37.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:37 gibba023 bash[30844]: cluster 2021-03-10T21:04:35.737799+0000 mgr.gibba044.wflcwh (mgr.34466) 2998 : cluster [DBG] pgmap v1698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:37.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:37 gibba023 bash[31815]: cluster 2021-03-10T21:04:35.737799+0000 mgr.gibba044.wflcwh (mgr.34466) 2998 : cluster [DBG] pgmap v1698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:38.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:37 gibba044 bash[25485]: cluster 2021-03-10T21:04:35.737799+0000 mgr.gibba044.wflcwh (mgr.34466) 2998 : cluster [DBG] pgmap v1698: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:38.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:38 gibba023 bash[30844]: cluster 2021-03-10T21:04:37.739317+0000 mgr.gibba044.wflcwh (mgr.34466) 2999 : cluster [DBG] pgmap v1699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:38.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:38 gibba023 bash[31815]: cluster 2021-03-10T21:04:37.739317+0000 mgr.gibba044.wflcwh (mgr.34466) 2999 : cluster [DBG] pgmap v1699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:39.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:38 gibba044 bash[25485]: cluster 2021-03-10T21:04:37.739317+0000 mgr.gibba044.wflcwh (mgr.34466) 2999 : cluster [DBG] pgmap v1699: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:41.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:40 gibba023 bash[30844]: cluster 2021-03-10T21:04:39.740565+0000 mgr.gibba044.wflcwh (mgr.34466) 3000 : cluster [DBG] pgmap v1700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:41.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:40 gibba023 bash[31815]: cluster 2021-03-10T21:04:39.740565+0000 mgr.gibba044.wflcwh (mgr.34466) 3000 : cluster [DBG] pgmap v1700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:41.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:40 gibba044 bash[25485]: cluster 2021-03-10T21:04:39.740565+0000 mgr.gibba044.wflcwh (mgr.34466) 3000 : cluster [DBG] pgmap v1700: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:43.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:43 gibba023 bash[30844]: cluster 2021-03-10T21:04:41.741954+0000 mgr.gibba044.wflcwh (mgr.34466) 3001 : cluster [DBG] pgmap v1701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:43.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:43 gibba023 bash[30844]: audit 2021-03-10T21:04:43.187825+0000 mon.a (mon.0) 1378 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T21:04:43.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:43 gibba023 bash[31815]: cluster 2021-03-10T21:04:41.741954+0000 mgr.gibba044.wflcwh (mgr.34466) 3001 : cluster [DBG] pgmap v1701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:43.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:43 gibba023 bash[31815]: audit 2021-03-10T21:04:43.187825+0000 mon.a (mon.0) 1378 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T21:04:44.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:43 gibba044 bash[25485]: cluster 2021-03-10T21:04:41.741954+0000 mgr.gibba044.wflcwh (mgr.34466) 3001 : cluster [DBG] pgmap v1701: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:44.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:43 gibba044 bash[25485]: audit 2021-03-10T21:04:43.187825+0000 mon.a (mon.0) 1378 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2021-03-10T21:04:44.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:44 gibba023 bash[30844]: cephadm 2021-03-10T21:04:43.186127+0000 mgr.gibba044.wflcwh (mgr.34466) 3002 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:04:44.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:44 gibba023 bash[31815]: cephadm 2021-03-10T21:04:43.186127+0000 mgr.gibba044.wflcwh (mgr.34466) 3002 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:04:45.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:44 gibba044 bash[25485]: cephadm 2021-03-10T21:04:43.186127+0000 mgr.gibba044.wflcwh (mgr.34466) 3002 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:04:45.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:45 gibba023 bash[30844]: cluster 2021-03-10T21:04:43.743777+0000 mgr.gibba044.wflcwh (mgr.34466) 3003 : cluster [DBG] pgmap v1702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:45.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:45 gibba023 bash[31815]: cluster 2021-03-10T21:04:43.743777+0000 mgr.gibba044.wflcwh (mgr.34466) 3003 : cluster [DBG] pgmap v1702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:46.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:45 gibba044 bash[25485]: cluster 2021-03-10T21:04:43.743777+0000 mgr.gibba044.wflcwh (mgr.34466) 3003 : cluster [DBG] pgmap v1702: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:47.003 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:46 gibba044 bash[25485]: cluster 2021-03-10T21:04:45.745226+0000 mgr.gibba044.wflcwh (mgr.34466) 3004 : cluster [DBG] pgmap v1703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:47.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:46 gibba023 bash[30844]: cluster 2021-03-10T21:04:45.745226+0000 mgr.gibba044.wflcwh (mgr.34466) 3004 : cluster [DBG] pgmap v1703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:47.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:46 gibba023 bash[31815]: cluster 2021-03-10T21:04:45.745226+0000 mgr.gibba044.wflcwh (mgr.34466) 3004 : cluster [DBG] pgmap v1703: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:48.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[30844]: audit 2021-03-10T21:04:46.888983+0000 mon.a (mon.0) 1379 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:04:48.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[30844]: cephadm 2021-03-10T21:04:46.890218+0000 mgr.gibba044.wflcwh (mgr.34466) 3005 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:04:48.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[30844]: audit 2021-03-10T21:04:47.109478+0000 mon.a (mon.0) 1380 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:04:48.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[30844]: cephadm 2021-03-10T21:04:47.112896+0000 mgr.gibba044.wflcwh (mgr.34466) 3006 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:04:48.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[30844]: audit 2021-03-10T21:04:47.113457+0000 mon.a (mon.0) 1381 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:04:48.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[30844]: cephadm 2021-03-10T21:04:47.115258+0000 mgr.gibba044.wflcwh (mgr.34466) 3007 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:04:48.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[30844]: audit 2021-03-10T21:04:47.115270+0000 mon.a (mon.0) 1382 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:48.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[30844]: cephadm 2021-03-10T21:04:47.116992+0000 mgr.gibba044.wflcwh (mgr.34466) 3008 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:04:48.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[30844]: cephadm 2021-03-10T21:04:47.117072+0000 mgr.gibba044.wflcwh (mgr.34466) 3009 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:04:48.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[30844]: audit 2021-03-10T21:04:47.117328+0000 mon.a (mon.0) 1383 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:48.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[30844]: cephadm 2021-03-10T21:04:47.118998+0000 mgr.gibba044.wflcwh (mgr.34466) 3010 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:04:48.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[30844]: cephadm 2021-03-10T21:04:47.119036+0000 mgr.gibba044.wflcwh (mgr.34466) 3011 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:04:48.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[30844]: audit 2021-03-10T21:04:47.119114+0000 mon.a (mon.0) 1384 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:48.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[30844]: cephadm 2021-03-10T21:04:47.120850+0000 mgr.gibba044.wflcwh (mgr.34466) 3012 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:04:48.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[30844]: cephadm 2021-03-10T21:04:47.122593+0000 mgr.gibba044.wflcwh (mgr.34466) 3013 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:04:48.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[30844]: audit 2021-03-10T21:04:47.122637+0000 mon.a (mon.0) 1385 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:48.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[30844]: cephadm 2021-03-10T21:04:47.122671+0000 mgr.gibba044.wflcwh (mgr.34466) 3014 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:04:48.183 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[30844]: cephadm 2021-03-10T21:04:47.124360+0000 mgr.gibba044.wflcwh (mgr.34466) 3015 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:04:48.183 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[30844]: cephadm 2021-03-10T21:04:47.124668+0000 mgr.gibba044.wflcwh (mgr.34466) 3016 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:04:48.183 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[30844]: audit 2021-03-10T21:04:47.124742+0000 mon.a (mon.0) 1386 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:48.183 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[30844]: cephadm 2021-03-10T21:04:47.126495+0000 mgr.gibba044.wflcwh (mgr.34466) 3017 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:04:48.184 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[30844]: cephadm 2021-03-10T21:04:47.126599+0000 mgr.gibba044.wflcwh (mgr.34466) 3018 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:04:48.184 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[30844]: cephadm 2021-03-10T21:04:47.126754+0000 mgr.gibba044.wflcwh (mgr.34466) 3019 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:04:48.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[31815]: audit 2021-03-10T21:04:46.888983+0000 mon.a (mon.0) 1379 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:04:48.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[31815]: cephadm 2021-03-10T21:04:46.890218+0000 mgr.gibba044.wflcwh (mgr.34466) 3005 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:04:48.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[31815]: audit 2021-03-10T21:04:47.109478+0000 mon.a (mon.0) 1380 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:04:48.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[31815]: cephadm 2021-03-10T21:04:47.112896+0000 mgr.gibba044.wflcwh (mgr.34466) 3006 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:04:48.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[31815]: audit 2021-03-10T21:04:47.113457+0000 mon.a (mon.0) 1381 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:04:48.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[31815]: cephadm 2021-03-10T21:04:47.115258+0000 mgr.gibba044.wflcwh (mgr.34466) 3007 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:04:48.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[31815]: audit 2021-03-10T21:04:47.115270+0000 mon.a (mon.0) 1382 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:48.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[31815]: cephadm 2021-03-10T21:04:47.116992+0000 mgr.gibba044.wflcwh (mgr.34466) 3008 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:04:48.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[31815]: cephadm 2021-03-10T21:04:47.117072+0000 mgr.gibba044.wflcwh (mgr.34466) 3009 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:04:48.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[31815]: audit 2021-03-10T21:04:47.117328+0000 mon.a (mon.0) 1383 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:48.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[31815]: cephadm 2021-03-10T21:04:47.118998+0000 mgr.gibba044.wflcwh (mgr.34466) 3010 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:04:48.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[31815]: cephadm 2021-03-10T21:04:47.119036+0000 mgr.gibba044.wflcwh (mgr.34466) 3011 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:04:48.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[31815]: audit 2021-03-10T21:04:47.119114+0000 mon.a (mon.0) 1384 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:48.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[31815]: cephadm 2021-03-10T21:04:47.120850+0000 mgr.gibba044.wflcwh (mgr.34466) 3012 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:04:48.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[31815]: cephadm 2021-03-10T21:04:47.122593+0000 mgr.gibba044.wflcwh (mgr.34466) 3013 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:04:48.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[31815]: audit 2021-03-10T21:04:47.122637+0000 mon.a (mon.0) 1385 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:48.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[31815]: cephadm 2021-03-10T21:04:47.122671+0000 mgr.gibba044.wflcwh (mgr.34466) 3014 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:04:48.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[31815]: cephadm 2021-03-10T21:04:47.124360+0000 mgr.gibba044.wflcwh (mgr.34466) 3015 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:04:48.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[31815]: cephadm 2021-03-10T21:04:47.124668+0000 mgr.gibba044.wflcwh (mgr.34466) 3016 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:04:48.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[31815]: audit 2021-03-10T21:04:47.124742+0000 mon.a (mon.0) 1386 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:48.189 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[31815]: cephadm 2021-03-10T21:04:47.126495+0000 mgr.gibba044.wflcwh (mgr.34466) 3017 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:04:48.189 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[31815]: cephadm 2021-03-10T21:04:47.126599+0000 mgr.gibba044.wflcwh (mgr.34466) 3018 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:04:48.189 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:47 gibba023 bash[31815]: cephadm 2021-03-10T21:04:47.126754+0000 mgr.gibba044.wflcwh (mgr.34466) 3019 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:04:48.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:47 gibba044 bash[25485]: audit 2021-03-10T21:04:46.888983+0000 mon.a (mon.0) 1379 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:04:48.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:47 gibba044 bash[25485]: cephadm 2021-03-10T21:04:46.890218+0000 mgr.gibba044.wflcwh (mgr.34466) 3005 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:04:48.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:47 gibba044 bash[25485]: audit 2021-03-10T21:04:47.109478+0000 mon.a (mon.0) 1380 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:04:48.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:47 gibba044 bash[25485]: cephadm 2021-03-10T21:04:47.112896+0000 mgr.gibba044.wflcwh (mgr.34466) 3006 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:04:48.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:47 gibba044 bash[25485]: audit 2021-03-10T21:04:47.113457+0000 mon.a (mon.0) 1381 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:04:48.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:47 gibba044 bash[25485]: cephadm 2021-03-10T21:04:47.115258+0000 mgr.gibba044.wflcwh (mgr.34466) 3007 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:04:48.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:47 gibba044 bash[25485]: audit 2021-03-10T21:04:47.115270+0000 mon.a (mon.0) 1382 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:48.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:47 gibba044 bash[25485]: cephadm 2021-03-10T21:04:47.116992+0000 mgr.gibba044.wflcwh (mgr.34466) 3008 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:04:48.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:47 gibba044 bash[25485]: cephadm 2021-03-10T21:04:47.117072+0000 mgr.gibba044.wflcwh (mgr.34466) 3009 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:04:48.258 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:47 gibba044 bash[25485]: audit 2021-03-10T21:04:47.117328+0000 mon.a (mon.0) 1383 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:48.258 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:47 gibba044 bash[25485]: cephadm 2021-03-10T21:04:47.118998+0000 mgr.gibba044.wflcwh (mgr.34466) 3010 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:04:48.258 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:47 gibba044 bash[25485]: cephadm 2021-03-10T21:04:47.119036+0000 mgr.gibba044.wflcwh (mgr.34466) 3011 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:04:48.258 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:47 gibba044 bash[25485]: audit 2021-03-10T21:04:47.119114+0000 mon.a (mon.0) 1384 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:48.259 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:47 gibba044 bash[25485]: cephadm 2021-03-10T21:04:47.120850+0000 mgr.gibba044.wflcwh (mgr.34466) 3012 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:04:48.259 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:47 gibba044 bash[25485]: cephadm 2021-03-10T21:04:47.122593+0000 mgr.gibba044.wflcwh (mgr.34466) 3013 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:04:48.259 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:47 gibba044 bash[25485]: audit 2021-03-10T21:04:47.122637+0000 mon.a (mon.0) 1385 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:48.259 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:47 gibba044 bash[25485]: cephadm 2021-03-10T21:04:47.122671+0000 mgr.gibba044.wflcwh (mgr.34466) 3014 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:04:48.259 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:47 gibba044 bash[25485]: cephadm 2021-03-10T21:04:47.124360+0000 mgr.gibba044.wflcwh (mgr.34466) 3015 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:04:48.260 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:47 gibba044 bash[25485]: cephadm 2021-03-10T21:04:47.124668+0000 mgr.gibba044.wflcwh (mgr.34466) 3016 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:04:48.260 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:47 gibba044 bash[25485]: audit 2021-03-10T21:04:47.124742+0000 mon.a (mon.0) 1386 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:04:48.260 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:47 gibba044 bash[25485]: cephadm 2021-03-10T21:04:47.126495+0000 mgr.gibba044.wflcwh (mgr.34466) 3017 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:04:48.260 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:47 gibba044 bash[25485]: cephadm 2021-03-10T21:04:47.126599+0000 mgr.gibba044.wflcwh (mgr.34466) 3018 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:04:48.261 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:47 gibba044 bash[25485]: cephadm 2021-03-10T21:04:47.126754+0000 mgr.gibba044.wflcwh (mgr.34466) 3019 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:04:49.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:49 gibba023 bash[30844]: cluster 2021-03-10T21:04:47.746941+0000 mgr.gibba044.wflcwh (mgr.34466) 3020 : cluster [DBG] pgmap v1704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:49.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:49 gibba023 bash[31815]: cluster 2021-03-10T21:04:47.746941+0000 mgr.gibba044.wflcwh (mgr.34466) 3020 : cluster [DBG] pgmap v1704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:50.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:49 gibba044 bash[25485]: cluster 2021-03-10T21:04:47.746941+0000 mgr.gibba044.wflcwh (mgr.34466) 3020 : cluster [DBG] pgmap v1704: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:51.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:51 gibba023 bash[30844]: cluster 2021-03-10T21:04:49.748178+0000 mgr.gibba044.wflcwh (mgr.34466) 3021 : cluster [DBG] pgmap v1705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:51.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:51 gibba023 bash[31815]: cluster 2021-03-10T21:04:49.748178+0000 mgr.gibba044.wflcwh (mgr.34466) 3021 : cluster [DBG] pgmap v1705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:52.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:51 gibba044 bash[25485]: cluster 2021-03-10T21:04:49.748178+0000 mgr.gibba044.wflcwh (mgr.34466) 3021 : cluster [DBG] pgmap v1705: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:53.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:53 gibba023 bash[30844]: cluster 2021-03-10T21:04:51.749687+0000 mgr.gibba044.wflcwh (mgr.34466) 3022 : cluster [DBG] pgmap v1706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:53.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:53 gibba023 bash[31815]: cluster 2021-03-10T21:04:51.749687+0000 mgr.gibba044.wflcwh (mgr.34466) 3022 : cluster [DBG] pgmap v1706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:54.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:53 gibba044 bash[25485]: cluster 2021-03-10T21:04:51.749687+0000 mgr.gibba044.wflcwh (mgr.34466) 3022 : cluster [DBG] pgmap v1706: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:54.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:54 gibba023 bash[30844]: cluster 2021-03-10T21:04:53.751474+0000 mgr.gibba044.wflcwh (mgr.34466) 3023 : cluster [DBG] pgmap v1707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:54.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:54 gibba023 bash[31815]: cluster 2021-03-10T21:04:53.751474+0000 mgr.gibba044.wflcwh (mgr.34466) 3023 : cluster [DBG] pgmap v1707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:55.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:54 gibba044 bash[25485]: cluster 2021-03-10T21:04:53.751474+0000 mgr.gibba044.wflcwh (mgr.34466) 3023 : cluster [DBG] pgmap v1707: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:57.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:56 gibba023 bash[30844]: cluster 2021-03-10T21:04:55.752957+0000 mgr.gibba044.wflcwh (mgr.34466) 3024 : cluster [DBG] pgmap v1708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:57.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:56 gibba023 bash[31815]: cluster 2021-03-10T21:04:55.752957+0000 mgr.gibba044.wflcwh (mgr.34466) 3024 : cluster [DBG] pgmap v1708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:57.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:56 gibba044 bash[25485]: cluster 2021-03-10T21:04:55.752957+0000 mgr.gibba044.wflcwh (mgr.34466) 3024 : cluster [DBG] pgmap v1708: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:59.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:04:59 gibba023 bash[30844]: cluster 2021-03-10T21:04:57.754590+0000 mgr.gibba044.wflcwh (mgr.34466) 3025 : cluster [DBG] pgmap v1709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:04:59.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:04:59 gibba023 bash[31815]: cluster 2021-03-10T21:04:57.754590+0000 mgr.gibba044.wflcwh (mgr.34466) 3025 : cluster [DBG] pgmap v1709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:00.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:04:59 gibba044 bash[25485]: cluster 2021-03-10T21:04:57.754590+0000 mgr.gibba044.wflcwh (mgr.34466) 3025 : cluster [DBG] pgmap v1709: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:01.924 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:01 gibba044 bash[25485]: cluster 2021-03-10T21:04:59.755821+0000 mgr.gibba044.wflcwh (mgr.34466) 3026 : cluster [DBG] pgmap v1710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:01.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:01 gibba023 bash[30844]: cluster 2021-03-10T21:04:59.755821+0000 mgr.gibba044.wflcwh (mgr.34466) 3026 : cluster [DBG] pgmap v1710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:01.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:01 gibba023 bash[31815]: cluster 2021-03-10T21:04:59.755821+0000 mgr.gibba044.wflcwh (mgr.34466) 3026 : cluster [DBG] pgmap v1710: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:03.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:03 gibba023 bash[30844]: cluster 2021-03-10T21:05:01.757303+0000 mgr.gibba044.wflcwh (mgr.34466) 3027 : cluster [DBG] pgmap v1711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:03.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:03 gibba023 bash[30844]: cephadm 2021-03-10T21:05:02.142533+0000 mgr.gibba044.wflcwh (mgr.34466) 3028 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:05:03.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:03 gibba023 bash[31815]: cluster 2021-03-10T21:05:01.757303+0000 mgr.gibba044.wflcwh (mgr.34466) 3027 : cluster [DBG] pgmap v1711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:03.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:03 gibba023 bash[31815]: cephadm 2021-03-10T21:05:02.142533+0000 mgr.gibba044.wflcwh (mgr.34466) 3028 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:05:04.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:03 gibba044 bash[25485]: cluster 2021-03-10T21:05:01.757303+0000 mgr.gibba044.wflcwh (mgr.34466) 3027 : cluster [DBG] pgmap v1711: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:04.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:03 gibba044 bash[25485]: cephadm 2021-03-10T21:05:02.142533+0000 mgr.gibba044.wflcwh (mgr.34466) 3028 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:05:04.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:04 gibba023 bash[30844]: cluster 2021-03-10T21:05:03.758988+0000 mgr.gibba044.wflcwh (mgr.34466) 3029 : cluster [DBG] pgmap v1712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:04.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:04 gibba023 bash[31815]: cluster 2021-03-10T21:05:03.758988+0000 mgr.gibba044.wflcwh (mgr.34466) 3029 : cluster [DBG] pgmap v1712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:05.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:04 gibba044 bash[25485]: cluster 2021-03-10T21:05:03.758988+0000 mgr.gibba044.wflcwh (mgr.34466) 3029 : cluster [DBG] pgmap v1712: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:05.207 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T21:05:05.439 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:05:05.439 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (56m) 83s ago 61m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T21:05:05.440 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (61m) 18s ago 61m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T21:05:05.440 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (56m) 18s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T21:05:05.440 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (56m) 18s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T21:05:05.440 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (55m) 83s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T21:05:05.441 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (55m) 83s ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T21:05:05.441 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (55m) 18s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T21:05:05.441 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (55m) 83s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T21:05:05.441 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (61m) 83s ago 61m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T21:05:05.441 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (61m) 18s ago 61m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T21:05:05.442 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (54m) 83s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T21:05:05.442 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (54m) 83s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T21:05:05.442 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (53m) 83s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T21:05:05.442 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (53m) 83s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T21:05:05.443 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (52m) 18s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T21:05:05.443 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (52m) 18s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T21:05:05.443 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (51m) 18s ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T21:05:05.443 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (51m) 18s ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T21:05:05.444 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (61m) 18s ago 61m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T21:05:05.444 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 83s ago 59m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:05:05.444 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 18s ago 59m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:05:05.692 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T21:05:05.692 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T21:05:05.693 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:05:05.693 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:05:05.693 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T21:05:05.693 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:05:05.693 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:05:05.694 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T21:05:05.694 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:05:05.694 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:05:05.694 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T21:05:05.695 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T21:05:05.695 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:05:05.695 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T21:05:05.695 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T21:05:05.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:05 gibba023 bash[30844]: audit 2021-03-10T21:05:05.194635+0000 mgr.gibba044.wflcwh (mgr.34466) 3030 : audit [DBG] from='client.46092 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:05:05.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:05 gibba023 bash[30844]: audit 2021-03-10T21:05:05.423986+0000 mgr.gibba044.wflcwh (mgr.34466) 3031 : audit [DBG] from='client.46098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:05:05.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:05 gibba023 bash[31815]: audit 2021-03-10T21:05:05.194635+0000 mgr.gibba044.wflcwh (mgr.34466) 3030 : audit [DBG] from='client.46092 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:05:05.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:05 gibba023 bash[31815]: audit 2021-03-10T21:05:05.423986+0000 mgr.gibba044.wflcwh (mgr.34466) 3031 : audit [DBG] from='client.46098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:05:06.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:05 gibba044 bash[25485]: audit 2021-03-10T21:05:05.194635+0000 mgr.gibba044.wflcwh (mgr.34466) 3030 : audit [DBG] from='client.46092 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:05:06.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:05 gibba044 bash[25485]: audit 2021-03-10T21:05:05.423986+0000 mgr.gibba044.wflcwh (mgr.34466) 3031 : audit [DBG] from='client.46098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:05:06.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:06 gibba023 bash[30844]: audit 2021-03-10T21:05:05.688015+0000 mon.c (mon.1) 69 : audit [DBG] from='client.? 172.21.2.123:0/2202723495' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:06.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:06 gibba023 bash[30844]: cluster 2021-03-10T21:05:05.760690+0000 mgr.gibba044.wflcwh (mgr.34466) 3032 : cluster [DBG] pgmap v1713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:06.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:06 gibba023 bash[31815]: audit 2021-03-10T21:05:05.688015+0000 mon.c (mon.1) 69 : audit [DBG] from='client.? 172.21.2.123:0/2202723495' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:06.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:06 gibba023 bash[31815]: cluster 2021-03-10T21:05:05.760690+0000 mgr.gibba044.wflcwh (mgr.34466) 3032 : cluster [DBG] pgmap v1713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:07.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:06 gibba044 bash[25485]: audit 2021-03-10T21:05:05.688015+0000 mon.c (mon.1) 69 : audit [DBG] from='client.? 172.21.2.123:0/2202723495' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:07.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:06 gibba044 bash[25485]: cluster 2021-03-10T21:05:05.760690+0000 mgr.gibba044.wflcwh (mgr.34466) 3032 : cluster [DBG] pgmap v1713: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:09.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:09 gibba023 bash[30844]: cluster 2021-03-10T21:05:07.762091+0000 mgr.gibba044.wflcwh (mgr.34466) 3033 : cluster [DBG] pgmap v1714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:09.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:09 gibba023 bash[31815]: cluster 2021-03-10T21:05:07.762091+0000 mgr.gibba044.wflcwh (mgr.34466) 3033 : cluster [DBG] pgmap v1714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:10.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:09 gibba044 bash[25485]: cluster 2021-03-10T21:05:07.762091+0000 mgr.gibba044.wflcwh (mgr.34466) 3033 : cluster [DBG] pgmap v1714: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:11.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:11 gibba023 bash[30844]: cluster 2021-03-10T21:05:09.763243+0000 mgr.gibba044.wflcwh (mgr.34466) 3034 : cluster [DBG] pgmap v1715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:11.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:11 gibba023 bash[31815]: cluster 2021-03-10T21:05:09.763243+0000 mgr.gibba044.wflcwh (mgr.34466) 3034 : cluster [DBG] pgmap v1715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:12.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:11 gibba044 bash[25485]: cluster 2021-03-10T21:05:09.763243+0000 mgr.gibba044.wflcwh (mgr.34466) 3034 : cluster [DBG] pgmap v1715: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:13.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:13 gibba023 bash[30844]: cluster 2021-03-10T21:05:11.764743+0000 mgr.gibba044.wflcwh (mgr.34466) 3035 : cluster [DBG] pgmap v1716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:13.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:13 gibba023 bash[31815]: cluster 2021-03-10T21:05:11.764743+0000 mgr.gibba044.wflcwh (mgr.34466) 3035 : cluster [DBG] pgmap v1716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:14.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:13 gibba044 bash[25485]: cluster 2021-03-10T21:05:11.764743+0000 mgr.gibba044.wflcwh (mgr.34466) 3035 : cluster [DBG] pgmap v1716: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:14.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:14 gibba023 bash[30844]: cluster 2021-03-10T21:05:13.766404+0000 mgr.gibba044.wflcwh (mgr.34466) 3036 : cluster [DBG] pgmap v1717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:14.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:14 gibba023 bash[31815]: cluster 2021-03-10T21:05:13.766404+0000 mgr.gibba044.wflcwh (mgr.34466) 3036 : cluster [DBG] pgmap v1717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:15.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:14 gibba044 bash[25485]: cluster 2021-03-10T21:05:13.766404+0000 mgr.gibba044.wflcwh (mgr.34466) 3036 : cluster [DBG] pgmap v1717: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:17.161 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:16 gibba044 bash[25485]: cluster 2021-03-10T21:05:15.768014+0000 mgr.gibba044.wflcwh (mgr.34466) 3037 : cluster [DBG] pgmap v1718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:17.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:16 gibba023 bash[30844]: cluster 2021-03-10T21:05:15.768014+0000 mgr.gibba044.wflcwh (mgr.34466) 3037 : cluster [DBG] pgmap v1718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:17.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:16 gibba023 bash[31815]: cluster 2021-03-10T21:05:15.768014+0000 mgr.gibba044.wflcwh (mgr.34466) 3037 : cluster [DBG] pgmap v1718: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:18.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:18 gibba023 bash[30844]: cephadm 2021-03-10T21:05:17.158594+0000 mgr.gibba044.wflcwh (mgr.34466) 3038 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:05:18.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:18 gibba023 bash[31815]: cephadm 2021-03-10T21:05:17.158594+0000 mgr.gibba044.wflcwh (mgr.34466) 3038 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:05:19.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:18 gibba044 bash[25485]: cephadm 2021-03-10T21:05:17.158594+0000 mgr.gibba044.wflcwh (mgr.34466) 3038 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:05:19.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:19 gibba023 bash[30844]: cluster 2021-03-10T21:05:17.769425+0000 mgr.gibba044.wflcwh (mgr.34466) 3039 : cluster [DBG] pgmap v1719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:19.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:19 gibba023 bash[31815]: cluster 2021-03-10T21:05:17.769425+0000 mgr.gibba044.wflcwh (mgr.34466) 3039 : cluster [DBG] pgmap v1719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:20.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:19 gibba044 bash[25485]: cluster 2021-03-10T21:05:17.769425+0000 mgr.gibba044.wflcwh (mgr.34466) 3039 : cluster [DBG] pgmap v1719: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:21.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:20 gibba044 bash[25485]: cluster 2021-03-10T21:05:19.770649+0000 mgr.gibba044.wflcwh (mgr.34466) 3040 : cluster [DBG] pgmap v1720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:21.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:20 gibba023 bash[30844]: cluster 2021-03-10T21:05:19.770649+0000 mgr.gibba044.wflcwh (mgr.34466) 3040 : cluster [DBG] pgmap v1720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:21.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:20 gibba023 bash[31815]: cluster 2021-03-10T21:05:19.770649+0000 mgr.gibba044.wflcwh (mgr.34466) 3040 : cluster [DBG] pgmap v1720: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:23.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:23 gibba023 bash[30844]: cluster 2021-03-10T21:05:21.772160+0000 mgr.gibba044.wflcwh (mgr.34466) 3041 : cluster [DBG] pgmap v1721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:23.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:23 gibba023 bash[31815]: cluster 2021-03-10T21:05:21.772160+0000 mgr.gibba044.wflcwh (mgr.34466) 3041 : cluster [DBG] pgmap v1721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:24.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:23 gibba044 bash[25485]: cluster 2021-03-10T21:05:21.772160+0000 mgr.gibba044.wflcwh (mgr.34466) 3041 : cluster [DBG] pgmap v1721: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:25.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:25 gibba023 bash[30844]: cluster 2021-03-10T21:05:23.773973+0000 mgr.gibba044.wflcwh (mgr.34466) 3042 : cluster [DBG] pgmap v1722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:25.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:25 gibba023 bash[31815]: cluster 2021-03-10T21:05:23.773973+0000 mgr.gibba044.wflcwh (mgr.34466) 3042 : cluster [DBG] pgmap v1722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:26.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:25 gibba044 bash[25485]: cluster 2021-03-10T21:05:23.773973+0000 mgr.gibba044.wflcwh (mgr.34466) 3042 : cluster [DBG] pgmap v1722: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:27 gibba023 bash[30844]: cluster 2021-03-10T21:05:25.775696+0000 mgr.gibba044.wflcwh (mgr.34466) 3043 : cluster [DBG] pgmap v1723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:27.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:27 gibba023 bash[30844]: audit 2021-03-10T21:05:27.418598+0000 mon.a (mon.0) 1387 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:05:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:27 gibba023 bash[30844]: audit 2021-03-10T21:05:27.419235+0000 mon.a (mon.0) 1388 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:05:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:27 gibba023 bash[30844]: audit 2021-03-10T21:05:27.421137+0000 mon.a (mon.0) 1389 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T21:05:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:27 gibba023 bash[30844]: audit 2021-03-10T21:05:27.421896+0000 mon.a (mon.0) 1390 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T21:05:27.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:27 gibba023 bash[30844]: audit 2021-03-10T21:05:27.422626+0000 mon.a (mon.0) 1391 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T21:05:27.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:27 gibba023 bash[30844]: audit 2021-03-10T21:05:27.423301+0000 mon.a (mon.0) 1392 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T21:05:27.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:27 gibba023 bash[31815]: cluster 2021-03-10T21:05:25.775696+0000 mgr.gibba044.wflcwh (mgr.34466) 3043 : cluster [DBG] pgmap v1723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:27.930 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:27 gibba023 bash[31815]: audit 2021-03-10T21:05:27.418598+0000 mon.a (mon.0) 1387 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:05:27.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:27 gibba023 bash[31815]: audit 2021-03-10T21:05:27.419235+0000 mon.a (mon.0) 1388 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:05:27.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:27 gibba023 bash[31815]: audit 2021-03-10T21:05:27.421137+0000 mon.a (mon.0) 1389 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T21:05:27.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:27 gibba023 bash[31815]: audit 2021-03-10T21:05:27.421896+0000 mon.a (mon.0) 1390 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T21:05:27.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:27 gibba023 bash[31815]: audit 2021-03-10T21:05:27.422626+0000 mon.a (mon.0) 1391 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T21:05:27.931 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:27 gibba023 bash[31815]: audit 2021-03-10T21:05:27.423301+0000 mon.a (mon.0) 1392 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T21:05:28.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:27 gibba044 bash[25485]: cluster 2021-03-10T21:05:25.775696+0000 mgr.gibba044.wflcwh (mgr.34466) 3043 : cluster [DBG] pgmap v1723: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:28.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:27 gibba044 bash[25485]: audit 2021-03-10T21:05:27.418598+0000 mon.a (mon.0) 1387 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:05:28.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:27 gibba044 bash[25485]: audit 2021-03-10T21:05:27.419235+0000 mon.a (mon.0) 1388 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:05:28.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:27 gibba044 bash[25485]: audit 2021-03-10T21:05:27.421137+0000 mon.a (mon.0) 1389 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T21:05:28.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:27 gibba044 bash[25485]: audit 2021-03-10T21:05:27.421896+0000 mon.a (mon.0) 1390 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2021-03-10T21:05:28.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:27 gibba044 bash[25485]: audit 2021-03-10T21:05:27.422626+0000 mon.a (mon.0) 1391 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 2]}]: dispatch 2021-03-10T21:05:28.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:27 gibba044 bash[25485]: audit 2021-03-10T21:05:27.423301+0000 mon.a (mon.0) 1392 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T21:05:28.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:28 gibba023 bash[30844]: cluster 2021-03-10T21:05:27.777042+0000 mgr.gibba044.wflcwh (mgr.34466) 3044 : cluster [DBG] pgmap v1724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:28.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:28 gibba023 bash[31815]: cluster 2021-03-10T21:05:27.777042+0000 mgr.gibba044.wflcwh (mgr.34466) 3044 : cluster [DBG] pgmap v1724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:29.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:28 gibba044 bash[25485]: cluster 2021-03-10T21:05:27.777042+0000 mgr.gibba044.wflcwh (mgr.34466) 3044 : cluster [DBG] pgmap v1724: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:31.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:30 gibba023 bash[30844]: cluster 2021-03-10T21:05:29.778272+0000 mgr.gibba044.wflcwh (mgr.34466) 3045 : cluster [DBG] pgmap v1725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:31.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:30 gibba023 bash[31815]: cluster 2021-03-10T21:05:29.778272+0000 mgr.gibba044.wflcwh (mgr.34466) 3045 : cluster [DBG] pgmap v1725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:31.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:30 gibba044 bash[25485]: cluster 2021-03-10T21:05:29.778272+0000 mgr.gibba044.wflcwh (mgr.34466) 3045 : cluster [DBG] pgmap v1725: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:33.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:33 gibba023 bash[30844]: cluster 2021-03-10T21:05:31.779670+0000 mgr.gibba044.wflcwh (mgr.34466) 3046 : cluster [DBG] pgmap v1726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:33.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:33 gibba023 bash[30844]: cephadm 2021-03-10T21:05:32.174712+0000 mgr.gibba044.wflcwh (mgr.34466) 3047 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:05:33.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:33 gibba023 bash[31815]: cluster 2021-03-10T21:05:31.779670+0000 mgr.gibba044.wflcwh (mgr.34466) 3046 : cluster [DBG] pgmap v1726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:33.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:33 gibba023 bash[31815]: cephadm 2021-03-10T21:05:32.174712+0000 mgr.gibba044.wflcwh (mgr.34466) 3047 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:05:34.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:33 gibba044 bash[25485]: cluster 2021-03-10T21:05:31.779670+0000 mgr.gibba044.wflcwh (mgr.34466) 3046 : cluster [DBG] pgmap v1726: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:34.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:33 gibba044 bash[25485]: cephadm 2021-03-10T21:05:32.174712+0000 mgr.gibba044.wflcwh (mgr.34466) 3047 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:05:35.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:35 gibba023 bash[30844]: cluster 2021-03-10T21:05:33.781166+0000 mgr.gibba044.wflcwh (mgr.34466) 3048 : cluster [DBG] pgmap v1727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:35.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:35 gibba023 bash[31815]: cluster 2021-03-10T21:05:33.781166+0000 mgr.gibba044.wflcwh (mgr.34466) 3048 : cluster [DBG] pgmap v1727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:35.929 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T21:05:36.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:35 gibba044 bash[25485]: cluster 2021-03-10T21:05:33.781166+0000 mgr.gibba044.wflcwh (mgr.34466) 3048 : cluster [DBG] pgmap v1727: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:36.158 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:05:36.159 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (56m) 113s ago 62m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T21:05:36.159 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (62m) 49s ago 62m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T21:05:36.159 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (57m) 49s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T21:05:36.160 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (57m) 49s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T21:05:36.160 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (56m) 113s ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T21:05:36.160 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (56m) 113s ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T21:05:36.160 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (55m) 49s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T21:05:36.161 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (55m) 113s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T21:05:36.161 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (62m) 113s ago 62m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T21:05:36.161 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (62m) 49s ago 62m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T21:05:36.161 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (54m) 113s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T21:05:36.161 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (54m) 113s ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T21:05:36.162 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (54m) 113s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T21:05:36.162 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (53m) 113s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T21:05:36.162 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (53m) 49s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T21:05:36.162 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (52m) 49s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T21:05:36.163 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (52m) 49s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T21:05:36.163 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (51m) 49s ago 62m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T21:05:36.163 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (61m) 49s ago 62m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T21:05:36.163 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 113s ago 60m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:05:36.164 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 49s ago 60m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:05:36.406 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T21:05:36.407 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T21:05:36.407 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:05:36.407 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:05:36.407 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T21:05:36.408 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:05:36.408 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:05:36.408 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T21:05:36.408 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:05:36.409 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:05:36.409 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T21:05:36.409 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T21:05:36.409 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:05:36.410 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T21:05:36.410 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T21:05:36.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:36 gibba023 bash[30844]: audit 2021-03-10T21:05:36.403356+0000 mon.a (mon.0) 1393 : audit [DBG] from='client.? 172.21.2.123:0/272635283' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:36.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:36 gibba023 bash[31815]: audit 2021-03-10T21:05:36.403356+0000 mon.a (mon.0) 1393 : audit [DBG] from='client.? 172.21.2.123:0/272635283' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:37.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:36 gibba044 bash[25485]: audit 2021-03-10T21:05:36.403356+0000 mon.a (mon.0) 1393 : audit [DBG] from='client.? 172.21.2.123:0/272635283' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:37.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:37 gibba023 bash[30844]: cluster 2021-03-10T21:05:35.782730+0000 mgr.gibba044.wflcwh (mgr.34466) 3049 : cluster [DBG] pgmap v1728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:37.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:37 gibba023 bash[30844]: audit 2021-03-10T21:05:35.919025+0000 mgr.gibba044.wflcwh (mgr.34466) 3050 : audit [DBG] from='client.46110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:05:37.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:37 gibba023 bash[30844]: audit 2021-03-10T21:05:36.144027+0000 mgr.gibba044.wflcwh (mgr.34466) 3051 : audit [DBG] from='client.56095 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:05:37.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:37 gibba023 bash[31815]: cluster 2021-03-10T21:05:35.782730+0000 mgr.gibba044.wflcwh (mgr.34466) 3049 : cluster [DBG] pgmap v1728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:37.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:37 gibba023 bash[31815]: audit 2021-03-10T21:05:35.919025+0000 mgr.gibba044.wflcwh (mgr.34466) 3050 : audit [DBG] from='client.46110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:05:37.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:37 gibba023 bash[31815]: audit 2021-03-10T21:05:36.144027+0000 mgr.gibba044.wflcwh (mgr.34466) 3051 : audit [DBG] from='client.56095 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:05:38.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:37 gibba044 bash[25485]: cluster 2021-03-10T21:05:35.782730+0000 mgr.gibba044.wflcwh (mgr.34466) 3049 : cluster [DBG] pgmap v1728: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:38.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:37 gibba044 bash[25485]: audit 2021-03-10T21:05:35.919025+0000 mgr.gibba044.wflcwh (mgr.34466) 3050 : audit [DBG] from='client.46110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:05:38.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:37 gibba044 bash[25485]: audit 2021-03-10T21:05:36.144027+0000 mgr.gibba044.wflcwh (mgr.34466) 3051 : audit [DBG] from='client.56095 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:05:38.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:38 gibba023 bash[31815]: cluster 2021-03-10T21:05:37.784458+0000 mgr.gibba044.wflcwh (mgr.34466) 3052 : cluster [DBG] pgmap v1729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:38.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:38 gibba023 bash[30844]: cluster 2021-03-10T21:05:37.784458+0000 mgr.gibba044.wflcwh (mgr.34466) 3052 : cluster [DBG] pgmap v1729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:39.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:38 gibba044 bash[25485]: cluster 2021-03-10T21:05:37.784458+0000 mgr.gibba044.wflcwh (mgr.34466) 3052 : cluster [DBG] pgmap v1729: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:41.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:40 gibba023 bash[30844]: cluster 2021-03-10T21:05:39.785733+0000 mgr.gibba044.wflcwh (mgr.34466) 3053 : cluster [DBG] pgmap v1730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:41.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:40 gibba023 bash[31815]: cluster 2021-03-10T21:05:39.785733+0000 mgr.gibba044.wflcwh (mgr.34466) 3053 : cluster [DBG] pgmap v1730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:41.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:40 gibba044 bash[25485]: cluster 2021-03-10T21:05:39.785733+0000 mgr.gibba044.wflcwh (mgr.34466) 3053 : cluster [DBG] pgmap v1730: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:43.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:43 gibba023 bash[30844]: cluster 2021-03-10T21:05:41.787272+0000 mgr.gibba044.wflcwh (mgr.34466) 3054 : cluster [DBG] pgmap v1731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:43.983 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:43 gibba023 bash[31815]: cluster 2021-03-10T21:05:41.787272+0000 mgr.gibba044.wflcwh (mgr.34466) 3054 : cluster [DBG] pgmap v1731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:44.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:43 gibba044 bash[25485]: cluster 2021-03-10T21:05:41.787272+0000 mgr.gibba044.wflcwh (mgr.34466) 3054 : cluster [DBG] pgmap v1731: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:45.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:45 gibba023 bash[30844]: cluster 2021-03-10T21:05:43.789050+0000 mgr.gibba044.wflcwh (mgr.34466) 3055 : cluster [DBG] pgmap v1732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:45.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:45 gibba023 bash[31815]: cluster 2021-03-10T21:05:43.789050+0000 mgr.gibba044.wflcwh (mgr.34466) 3055 : cluster [DBG] pgmap v1732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:46.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:45 gibba044 bash[25485]: cluster 2021-03-10T21:05:43.789050+0000 mgr.gibba044.wflcwh (mgr.34466) 3055 : cluster [DBG] pgmap v1732: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:47.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:46 gibba044 bash[25485]: cluster 2021-03-10T21:05:45.790505+0000 mgr.gibba044.wflcwh (mgr.34466) 3056 : cluster [DBG] pgmap v1733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:47.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:46 gibba023 bash[30844]: cluster 2021-03-10T21:05:45.790505+0000 mgr.gibba044.wflcwh (mgr.34466) 3056 : cluster [DBG] pgmap v1733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:47.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:46 gibba023 bash[31815]: cluster 2021-03-10T21:05:45.790505+0000 mgr.gibba044.wflcwh (mgr.34466) 3056 : cluster [DBG] pgmap v1733: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:48.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[30844]: cephadm 2021-03-10T21:05:47.191515+0000 mgr.gibba044.wflcwh (mgr.34466) 3057 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:05:48.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[30844]: cephadm 2021-03-10T21:05:47.193122+0000 mgr.gibba044.wflcwh (mgr.34466) 3058 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:05:48.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[30844]: audit 2021-03-10T21:05:47.413288+0000 mon.a (mon.0) 1394 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:05:48.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[30844]: cephadm 2021-03-10T21:05:47.416781+0000 mgr.gibba044.wflcwh (mgr.34466) 3059 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:05:48.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[30844]: audit 2021-03-10T21:05:47.417299+0000 mon.a (mon.0) 1395 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:05:48.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[30844]: audit 2021-03-10T21:05:47.418786+0000 mon.a (mon.0) 1396 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.681 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[30844]: cephadm 2021-03-10T21:05:47.418988+0000 mgr.gibba044.wflcwh (mgr.34466) 3060 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:05:48.681 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[30844]: cephadm 2021-03-10T21:05:47.420258+0000 mgr.gibba044.wflcwh (mgr.34466) 3061 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:05:48.682 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[30844]: cephadm 2021-03-10T21:05:47.420301+0000 mgr.gibba044.wflcwh (mgr.34466) 3062 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:05:48.682 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[30844]: audit 2021-03-10T21:05:47.420302+0000 mon.a (mon.0) 1397 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.683 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[30844]: audit 2021-03-10T21:05:47.421571+0000 mon.a (mon.0) 1398 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.683 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[30844]: cephadm 2021-03-10T21:05:47.421742+0000 mgr.gibba044.wflcwh (mgr.34466) 3063 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:05:48.683 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[30844]: cephadm 2021-03-10T21:05:47.421779+0000 mgr.gibba044.wflcwh (mgr.34466) 3064 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:05:48.684 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[30844]: cephadm 2021-03-10T21:05:47.423129+0000 mgr.gibba044.wflcwh (mgr.34466) 3065 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:05:48.684 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[30844]: cephadm 2021-03-10T21:05:47.424451+0000 mgr.gibba044.wflcwh (mgr.34466) 3066 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:05:48.685 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[30844]: cephadm 2021-03-10T21:05:47.424484+0000 mgr.gibba044.wflcwh (mgr.34466) 3067 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:05:48.685 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[30844]: audit 2021-03-10T21:05:47.424506+0000 mon.a (mon.0) 1399 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.686 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[30844]: cephadm 2021-03-10T21:05:47.425933+0000 mgr.gibba044.wflcwh (mgr.34466) 3068 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:05:48.686 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[30844]: audit 2021-03-10T21:05:47.426183+0000 mon.a (mon.0) 1400 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.687 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[30844]: cephadm 2021-03-10T21:05:47.426253+0000 mgr.gibba044.wflcwh (mgr.34466) 3069 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:05:48.687 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[30844]: cephadm 2021-03-10T21:05:47.427625+0000 mgr.gibba044.wflcwh (mgr.34466) 3070 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:05:48.688 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[30844]: cephadm 2021-03-10T21:05:47.427736+0000 mgr.gibba044.wflcwh (mgr.34466) 3071 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:05:48.688 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[30844]: cephadm 2021-03-10T21:05:47.427863+0000 mgr.gibba044.wflcwh (mgr.34466) 3072 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:05:48.689 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[31815]: cephadm 2021-03-10T21:05:47.191515+0000 mgr.gibba044.wflcwh (mgr.34466) 3057 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:05:48.689 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[31815]: cephadm 2021-03-10T21:05:47.193122+0000 mgr.gibba044.wflcwh (mgr.34466) 3058 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:05:48.690 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[31815]: audit 2021-03-10T21:05:47.413288+0000 mon.a (mon.0) 1394 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:05:48.690 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[31815]: cephadm 2021-03-10T21:05:47.416781+0000 mgr.gibba044.wflcwh (mgr.34466) 3059 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:05:48.691 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[31815]: audit 2021-03-10T21:05:47.417299+0000 mon.a (mon.0) 1395 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:05:48.691 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[31815]: audit 2021-03-10T21:05:47.418786+0000 mon.a (mon.0) 1396 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.691 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[31815]: cephadm 2021-03-10T21:05:47.418988+0000 mgr.gibba044.wflcwh (mgr.34466) 3060 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:05:48.692 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[31815]: cephadm 2021-03-10T21:05:47.420258+0000 mgr.gibba044.wflcwh (mgr.34466) 3061 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:05:48.692 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[31815]: cephadm 2021-03-10T21:05:47.420301+0000 mgr.gibba044.wflcwh (mgr.34466) 3062 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:05:48.693 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[31815]: audit 2021-03-10T21:05:47.420302+0000 mon.a (mon.0) 1397 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.693 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[31815]: audit 2021-03-10T21:05:47.421571+0000 mon.a (mon.0) 1398 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.694 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[31815]: cephadm 2021-03-10T21:05:47.421742+0000 mgr.gibba044.wflcwh (mgr.34466) 3063 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:05:48.694 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[31815]: cephadm 2021-03-10T21:05:47.421779+0000 mgr.gibba044.wflcwh (mgr.34466) 3064 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:05:48.694 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[31815]: cephadm 2021-03-10T21:05:47.423129+0000 mgr.gibba044.wflcwh (mgr.34466) 3065 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:05:48.695 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[31815]: cephadm 2021-03-10T21:05:47.424451+0000 mgr.gibba044.wflcwh (mgr.34466) 3066 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:05:48.695 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[31815]: cephadm 2021-03-10T21:05:47.424484+0000 mgr.gibba044.wflcwh (mgr.34466) 3067 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:05:48.696 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[31815]: audit 2021-03-10T21:05:47.424506+0000 mon.a (mon.0) 1399 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.696 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[31815]: cephadm 2021-03-10T21:05:47.425933+0000 mgr.gibba044.wflcwh (mgr.34466) 3068 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:05:48.697 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[31815]: audit 2021-03-10T21:05:47.426183+0000 mon.a (mon.0) 1400 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.697 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[31815]: cephadm 2021-03-10T21:05:47.426253+0000 mgr.gibba044.wflcwh (mgr.34466) 3069 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:05:48.697 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[31815]: cephadm 2021-03-10T21:05:47.427625+0000 mgr.gibba044.wflcwh (mgr.34466) 3070 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:05:48.698 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[31815]: cephadm 2021-03-10T21:05:47.427736+0000 mgr.gibba044.wflcwh (mgr.34466) 3071 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:05:48.698 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:48 gibba023 bash[31815]: cephadm 2021-03-10T21:05:47.427863+0000 mgr.gibba044.wflcwh (mgr.34466) 3072 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:05:48.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:48 gibba044 bash[25485]: cephadm 2021-03-10T21:05:47.191515+0000 mgr.gibba044.wflcwh (mgr.34466) 3057 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:05:48.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:48 gibba044 bash[25485]: cephadm 2021-03-10T21:05:47.193122+0000 mgr.gibba044.wflcwh (mgr.34466) 3058 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:05:48.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:48 gibba044 bash[25485]: audit 2021-03-10T21:05:47.413288+0000 mon.a (mon.0) 1394 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:05:48.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:48 gibba044 bash[25485]: cephadm 2021-03-10T21:05:47.416781+0000 mgr.gibba044.wflcwh (mgr.34466) 3059 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:05:48.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:48 gibba044 bash[25485]: audit 2021-03-10T21:05:47.417299+0000 mon.a (mon.0) 1395 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:05:48.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:48 gibba044 bash[25485]: audit 2021-03-10T21:05:47.418786+0000 mon.a (mon.0) 1396 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.758 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:48 gibba044 bash[25485]: cephadm 2021-03-10T21:05:47.418988+0000 mgr.gibba044.wflcwh (mgr.34466) 3060 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:05:48.758 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:48 gibba044 bash[25485]: cephadm 2021-03-10T21:05:47.420258+0000 mgr.gibba044.wflcwh (mgr.34466) 3061 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:05:48.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:48 gibba044 bash[25485]: cephadm 2021-03-10T21:05:47.420301+0000 mgr.gibba044.wflcwh (mgr.34466) 3062 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:05:48.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:48 gibba044 bash[25485]: audit 2021-03-10T21:05:47.420302+0000 mon.a (mon.0) 1397 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:48 gibba044 bash[25485]: audit 2021-03-10T21:05:47.421571+0000 mon.a (mon.0) 1398 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.760 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:48 gibba044 bash[25485]: cephadm 2021-03-10T21:05:47.421742+0000 mgr.gibba044.wflcwh (mgr.34466) 3063 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:05:48.760 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:48 gibba044 bash[25485]: cephadm 2021-03-10T21:05:47.421779+0000 mgr.gibba044.wflcwh (mgr.34466) 3064 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:05:48.761 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:48 gibba044 bash[25485]: cephadm 2021-03-10T21:05:47.423129+0000 mgr.gibba044.wflcwh (mgr.34466) 3065 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:05:48.761 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:48 gibba044 bash[25485]: cephadm 2021-03-10T21:05:47.424451+0000 mgr.gibba044.wflcwh (mgr.34466) 3066 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:05:48.761 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:48 gibba044 bash[25485]: cephadm 2021-03-10T21:05:47.424484+0000 mgr.gibba044.wflcwh (mgr.34466) 3067 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:05:48.761 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:48 gibba044 bash[25485]: audit 2021-03-10T21:05:47.424506+0000 mon.a (mon.0) 1399 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.762 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:48 gibba044 bash[25485]: cephadm 2021-03-10T21:05:47.425933+0000 mgr.gibba044.wflcwh (mgr.34466) 3068 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:05:48.762 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:48 gibba044 bash[25485]: audit 2021-03-10T21:05:47.426183+0000 mon.a (mon.0) 1400 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:05:48.762 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:48 gibba044 bash[25485]: cephadm 2021-03-10T21:05:47.426253+0000 mgr.gibba044.wflcwh (mgr.34466) 3069 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:05:48.762 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:48 gibba044 bash[25485]: cephadm 2021-03-10T21:05:47.427625+0000 mgr.gibba044.wflcwh (mgr.34466) 3070 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:05:48.763 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:48 gibba044 bash[25485]: cephadm 2021-03-10T21:05:47.427736+0000 mgr.gibba044.wflcwh (mgr.34466) 3071 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:05:48.763 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:48 gibba044 bash[25485]: cephadm 2021-03-10T21:05:47.427863+0000 mgr.gibba044.wflcwh (mgr.34466) 3072 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:05:49.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:49 gibba023 bash[30844]: cluster 2021-03-10T21:05:47.791866+0000 mgr.gibba044.wflcwh (mgr.34466) 3073 : cluster [DBG] pgmap v1734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:49.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:49 gibba023 bash[31815]: cluster 2021-03-10T21:05:47.791866+0000 mgr.gibba044.wflcwh (mgr.34466) 3073 : cluster [DBG] pgmap v1734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:50.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:49 gibba044 bash[25485]: cluster 2021-03-10T21:05:47.791866+0000 mgr.gibba044.wflcwh (mgr.34466) 3073 : cluster [DBG] pgmap v1734: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:51.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:51 gibba023 bash[30844]: cluster 2021-03-10T21:05:49.793008+0000 mgr.gibba044.wflcwh (mgr.34466) 3074 : cluster [DBG] pgmap v1735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:51.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:51 gibba023 bash[31815]: cluster 2021-03-10T21:05:49.793008+0000 mgr.gibba044.wflcwh (mgr.34466) 3074 : cluster [DBG] pgmap v1735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:52.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:51 gibba044 bash[25485]: cluster 2021-03-10T21:05:49.793008+0000 mgr.gibba044.wflcwh (mgr.34466) 3074 : cluster [DBG] pgmap v1735: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:53.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:53 gibba023 bash[30844]: cluster 2021-03-10T21:05:51.794459+0000 mgr.gibba044.wflcwh (mgr.34466) 3075 : cluster [DBG] pgmap v1736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:53.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:53 gibba023 bash[31815]: cluster 2021-03-10T21:05:51.794459+0000 mgr.gibba044.wflcwh (mgr.34466) 3075 : cluster [DBG] pgmap v1736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:54.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:53 gibba044 bash[25485]: cluster 2021-03-10T21:05:51.794459+0000 mgr.gibba044.wflcwh (mgr.34466) 3075 : cluster [DBG] pgmap v1736: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:55.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:55 gibba023 bash[30844]: cluster 2021-03-10T21:05:53.796207+0000 mgr.gibba044.wflcwh (mgr.34466) 3076 : cluster [DBG] pgmap v1737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:55.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:55 gibba023 bash[31815]: cluster 2021-03-10T21:05:53.796207+0000 mgr.gibba044.wflcwh (mgr.34466) 3076 : cluster [DBG] pgmap v1737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:56.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:55 gibba044 bash[25485]: cluster 2021-03-10T21:05:53.796207+0000 mgr.gibba044.wflcwh (mgr.34466) 3076 : cluster [DBG] pgmap v1737: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:57.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:56 gibba044 bash[25485]: cluster 2021-03-10T21:05:55.797661+0000 mgr.gibba044.wflcwh (mgr.34466) 3077 : cluster [DBG] pgmap v1738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:57.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:56 gibba023 bash[30844]: cluster 2021-03-10T21:05:55.797661+0000 mgr.gibba044.wflcwh (mgr.34466) 3077 : cluster [DBG] pgmap v1738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:57.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:56 gibba023 bash[31815]: cluster 2021-03-10T21:05:55.797661+0000 mgr.gibba044.wflcwh (mgr.34466) 3077 : cluster [DBG] pgmap v1738: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:59.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:05:59 gibba023 bash[30844]: cluster 2021-03-10T21:05:57.799283+0000 mgr.gibba044.wflcwh (mgr.34466) 3078 : cluster [DBG] pgmap v1739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:05:59.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:05:59 gibba023 bash[31815]: cluster 2021-03-10T21:05:57.799283+0000 mgr.gibba044.wflcwh (mgr.34466) 3078 : cluster [DBG] pgmap v1739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:00.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:05:59 gibba044 bash[25485]: cluster 2021-03-10T21:05:57.799283+0000 mgr.gibba044.wflcwh (mgr.34466) 3078 : cluster [DBG] pgmap v1739: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:01.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:00 gibba044 bash[25485]: cluster 2021-03-10T21:05:59.800545+0000 mgr.gibba044.wflcwh (mgr.34466) 3079 : cluster [DBG] pgmap v1740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:01.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:00 gibba023 bash[30844]: cluster 2021-03-10T21:05:59.800545+0000 mgr.gibba044.wflcwh (mgr.34466) 3079 : cluster [DBG] pgmap v1740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:01.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:00 gibba023 bash[31815]: cluster 2021-03-10T21:05:59.800545+0000 mgr.gibba044.wflcwh (mgr.34466) 3079 : cluster [DBG] pgmap v1740: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:03.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:03 gibba023 bash[30844]: cluster 2021-03-10T21:06:01.802136+0000 mgr.gibba044.wflcwh (mgr.34466) 3080 : cluster [DBG] pgmap v1741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:03.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:03 gibba023 bash[30844]: cephadm 2021-03-10T21:06:02.443973+0000 mgr.gibba044.wflcwh (mgr.34466) 3081 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:06:03.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:03 gibba023 bash[31815]: cluster 2021-03-10T21:06:01.802136+0000 mgr.gibba044.wflcwh (mgr.34466) 3080 : cluster [DBG] pgmap v1741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:03.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:03 gibba023 bash[31815]: cephadm 2021-03-10T21:06:02.443973+0000 mgr.gibba044.wflcwh (mgr.34466) 3081 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:06:04.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:03 gibba044 bash[25485]: cluster 2021-03-10T21:06:01.802136+0000 mgr.gibba044.wflcwh (mgr.34466) 3080 : cluster [DBG] pgmap v1741: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:04.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:03 gibba044 bash[25485]: cephadm 2021-03-10T21:06:02.443973+0000 mgr.gibba044.wflcwh (mgr.34466) 3081 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:06:05.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:05 gibba023 bash[30844]: cluster 2021-03-10T21:06:03.803967+0000 mgr.gibba044.wflcwh (mgr.34466) 3082 : cluster [DBG] pgmap v1742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:05.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:05 gibba023 bash[31815]: cluster 2021-03-10T21:06:03.803967+0000 mgr.gibba044.wflcwh (mgr.34466) 3082 : cluster [DBG] pgmap v1742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:06.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:05 gibba044 bash[25485]: cluster 2021-03-10T21:06:03.803967+0000 mgr.gibba044.wflcwh (mgr.34466) 3082 : cluster [DBG] pgmap v1742: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:06.653 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T21:06:06.885 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:06:06.885 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (57m) 2m ago 62m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T21:06:06.886 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (62m) 80s ago 62m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T21:06:06.886 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (57m) 80s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T21:06:06.886 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (57m) 80s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T21:06:06.886 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (56m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T21:06:06.887 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (56m) 2m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T21:06:06.887 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (56m) 80s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T21:06:06.887 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (56m) 2m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T21:06:06.887 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (62m) 2m ago 62m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T21:06:06.888 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (62m) 80s ago 62m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T21:06:06.888 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (55m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T21:06:06.889 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (55m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T21:06:06.889 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (54m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T21:06:06.890 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (54m) 2m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T21:06:06.890 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (53m) 80s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T21:06:06.891 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (53m) 80s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T21:06:06.891 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (52m) 80s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T21:06:06.892 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (52m) 80s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T21:06:06.893 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (62m) 80s ago 62m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T21:06:06.893 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 2m ago 60m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:06:06.894 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 80s ago 60m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:06:06.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:06 gibba023 bash[30844]: cluster 2021-03-10T21:06:05.805480+0000 mgr.gibba044.wflcwh (mgr.34466) 3083 : cluster [DBG] pgmap v1743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:06.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:06 gibba023 bash[30844]: audit 2021-03-10T21:06:06.641510+0000 mgr.gibba044.wflcwh (mgr.34466) 3084 : audit [DBG] from='client.46128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:06:06.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:06 gibba023 bash[31815]: cluster 2021-03-10T21:06:05.805480+0000 mgr.gibba044.wflcwh (mgr.34466) 3083 : cluster [DBG] pgmap v1743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:06.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:06 gibba023 bash[31815]: audit 2021-03-10T21:06:06.641510+0000 mgr.gibba044.wflcwh (mgr.34466) 3084 : audit [DBG] from='client.46128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:06:07.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:06 gibba044 bash[25485]: cluster 2021-03-10T21:06:05.805480+0000 mgr.gibba044.wflcwh (mgr.34466) 3083 : cluster [DBG] pgmap v1743: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:07.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:06 gibba044 bash[25485]: audit 2021-03-10T21:06:06.641510+0000 mgr.gibba044.wflcwh (mgr.34466) 3084 : audit [DBG] from='client.46128 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:06:07.136 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T21:06:07.136 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T21:06:07.136 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:06:07.137 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:06:07.137 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T21:06:07.137 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:06:07.137 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:06:07.137 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T21:06:07.138 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:06:07.138 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:06:07.138 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T21:06:07.138 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T21:06:07.139 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:06:07.139 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T21:06:07.139 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T21:06:07.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:07 gibba023 bash[30844]: audit 2021-03-10T21:06:06.869751+0000 mgr.gibba044.wflcwh (mgr.34466) 3085 : audit [DBG] from='client.46134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:06:07.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:07 gibba023 bash[30844]: audit 2021-03-10T21:06:07.132544+0000 mon.a (mon.0) 1401 : audit [DBG] from='client.? 172.21.2.123:0/375802516' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:07.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:07 gibba023 bash[31815]: audit 2021-03-10T21:06:06.869751+0000 mgr.gibba044.wflcwh (mgr.34466) 3085 : audit [DBG] from='client.46134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:06:07.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:07 gibba023 bash[31815]: audit 2021-03-10T21:06:07.132544+0000 mon.a (mon.0) 1401 : audit [DBG] from='client.? 172.21.2.123:0/375802516' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:08.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:07 gibba044 bash[25485]: audit 2021-03-10T21:06:06.869751+0000 mgr.gibba044.wflcwh (mgr.34466) 3085 : audit [DBG] from='client.46134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:06:08.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:07 gibba044 bash[25485]: audit 2021-03-10T21:06:07.132544+0000 mon.a (mon.0) 1401 : audit [DBG] from='client.? 172.21.2.123:0/375802516' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:09.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:08 gibba044 bash[25485]: cluster 2021-03-10T21:06:07.807129+0000 mgr.gibba044.wflcwh (mgr.34466) 3086 : cluster [DBG] pgmap v1744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:09.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:08 gibba023 bash[30844]: cluster 2021-03-10T21:06:07.807129+0000 mgr.gibba044.wflcwh (mgr.34466) 3086 : cluster [DBG] pgmap v1744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:09.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:08 gibba023 bash[31815]: cluster 2021-03-10T21:06:07.807129+0000 mgr.gibba044.wflcwh (mgr.34466) 3086 : cluster [DBG] pgmap v1744: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:11.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:10 gibba023 bash[30844]: cluster 2021-03-10T21:06:09.808376+0000 mgr.gibba044.wflcwh (mgr.34466) 3087 : cluster [DBG] pgmap v1745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:11.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:10 gibba023 bash[31815]: cluster 2021-03-10T21:06:09.808376+0000 mgr.gibba044.wflcwh (mgr.34466) 3087 : cluster [DBG] pgmap v1745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:11.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:10 gibba044 bash[25485]: cluster 2021-03-10T21:06:09.808376+0000 mgr.gibba044.wflcwh (mgr.34466) 3087 : cluster [DBG] pgmap v1745: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:13.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:13 gibba023 bash[30844]: cluster 2021-03-10T21:06:11.809739+0000 mgr.gibba044.wflcwh (mgr.34466) 3088 : cluster [DBG] pgmap v1746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:13.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:13 gibba023 bash[31815]: cluster 2021-03-10T21:06:11.809739+0000 mgr.gibba044.wflcwh (mgr.34466) 3088 : cluster [DBG] pgmap v1746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:14.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:13 gibba044 bash[25485]: cluster 2021-03-10T21:06:11.809739+0000 mgr.gibba044.wflcwh (mgr.34466) 3088 : cluster [DBG] pgmap v1746: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:15.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:14 gibba044 bash[25485]: cluster 2021-03-10T21:06:13.811415+0000 mgr.gibba044.wflcwh (mgr.34466) 3089 : cluster [DBG] pgmap v1747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:15.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:14 gibba023 bash[30844]: cluster 2021-03-10T21:06:13.811415+0000 mgr.gibba044.wflcwh (mgr.34466) 3089 : cluster [DBG] pgmap v1747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:15.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:14 gibba023 bash[31815]: cluster 2021-03-10T21:06:13.811415+0000 mgr.gibba044.wflcwh (mgr.34466) 3089 : cluster [DBG] pgmap v1747: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:17.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:16 gibba023 bash[30844]: cluster 2021-03-10T21:06:15.813101+0000 mgr.gibba044.wflcwh (mgr.34466) 3090 : cluster [DBG] pgmap v1748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:17.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:16 gibba023 bash[31815]: cluster 2021-03-10T21:06:15.813101+0000 mgr.gibba044.wflcwh (mgr.34466) 3090 : cluster [DBG] pgmap v1748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:17.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:16 gibba044 bash[25485]: cluster 2021-03-10T21:06:15.813101+0000 mgr.gibba044.wflcwh (mgr.34466) 3090 : cluster [DBG] pgmap v1748: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:18.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:18 gibba023 bash[31815]: cephadm 2021-03-10T21:06:17.459975+0000 mgr.gibba044.wflcwh (mgr.34466) 3091 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:06:18.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:18 gibba023 bash[30844]: cephadm 2021-03-10T21:06:17.459975+0000 mgr.gibba044.wflcwh (mgr.34466) 3091 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:06:19.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:18 gibba044 bash[25485]: cephadm 2021-03-10T21:06:17.459975+0000 mgr.gibba044.wflcwh (mgr.34466) 3091 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:06:19.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:19 gibba023 bash[30844]: cluster 2021-03-10T21:06:17.814783+0000 mgr.gibba044.wflcwh (mgr.34466) 3092 : cluster [DBG] pgmap v1749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:19.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:19 gibba023 bash[31815]: cluster 2021-03-10T21:06:17.814783+0000 mgr.gibba044.wflcwh (mgr.34466) 3092 : cluster [DBG] pgmap v1749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:20.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:19 gibba044 bash[25485]: cluster 2021-03-10T21:06:17.814783+0000 mgr.gibba044.wflcwh (mgr.34466) 3092 : cluster [DBG] pgmap v1749: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:21.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:20 gibba044 bash[25485]: cluster 2021-03-10T21:06:19.816001+0000 mgr.gibba044.wflcwh (mgr.34466) 3093 : cluster [DBG] pgmap v1750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:21.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:20 gibba023 bash[30844]: cluster 2021-03-10T21:06:19.816001+0000 mgr.gibba044.wflcwh (mgr.34466) 3093 : cluster [DBG] pgmap v1750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:21.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:20 gibba023 bash[31815]: cluster 2021-03-10T21:06:19.816001+0000 mgr.gibba044.wflcwh (mgr.34466) 3093 : cluster [DBG] pgmap v1750: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:23.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:23 gibba023 bash[31815]: cluster 2021-03-10T21:06:21.817347+0000 mgr.gibba044.wflcwh (mgr.34466) 3094 : cluster [DBG] pgmap v1751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:23.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:23 gibba023 bash[30844]: cluster 2021-03-10T21:06:21.817347+0000 mgr.gibba044.wflcwh (mgr.34466) 3094 : cluster [DBG] pgmap v1751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:24.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:23 gibba044 bash[25485]: cluster 2021-03-10T21:06:21.817347+0000 mgr.gibba044.wflcwh (mgr.34466) 3094 : cluster [DBG] pgmap v1751: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:25.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:24 gibba044 bash[25485]: cluster 2021-03-10T21:06:23.818918+0000 mgr.gibba044.wflcwh (mgr.34466) 3095 : cluster [DBG] pgmap v1752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:25.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:24 gibba023 bash[30844]: cluster 2021-03-10T21:06:23.818918+0000 mgr.gibba044.wflcwh (mgr.34466) 3095 : cluster [DBG] pgmap v1752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:25.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:24 gibba023 bash[31815]: cluster 2021-03-10T21:06:23.818918+0000 mgr.gibba044.wflcwh (mgr.34466) 3095 : cluster [DBG] pgmap v1752: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:27.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:26 gibba023 bash[30844]: cluster 2021-03-10T21:06:25.820647+0000 mgr.gibba044.wflcwh (mgr.34466) 3096 : cluster [DBG] pgmap v1753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:27.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:26 gibba023 bash[31815]: cluster 2021-03-10T21:06:25.820647+0000 mgr.gibba044.wflcwh (mgr.34466) 3096 : cluster [DBG] pgmap v1753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:27.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:26 gibba044 bash[25485]: cluster 2021-03-10T21:06:25.820647+0000 mgr.gibba044.wflcwh (mgr.34466) 3096 : cluster [DBG] pgmap v1753: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:28.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:27 gibba023 bash[30844]: audit 2021-03-10T21:06:27.424935+0000 mon.a (mon.0) 1402 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:06:28.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:27 gibba023 bash[30844]: audit 2021-03-10T21:06:27.425556+0000 mon.a (mon.0) 1403 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:06:28.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:27 gibba023 bash[30844]: audit 2021-03-10T21:06:27.426209+0000 mon.a (mon.0) 1404 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T21:06:28.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:27 gibba023 bash[30844]: audit 2021-03-10T21:06:27.426980+0000 mon.a (mon.0) 1405 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T21:06:28.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:27 gibba023 bash[30844]: audit 2021-03-10T21:06:27.427657+0000 mon.a (mon.0) 1406 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T21:06:28.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:27 gibba023 bash[30844]: audit 2021-03-10T21:06:27.428334+0000 mon.a (mon.0) 1407 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T21:06:28.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:27 gibba023 bash[31815]: audit 2021-03-10T21:06:27.424935+0000 mon.a (mon.0) 1402 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:06:28.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:27 gibba023 bash[31815]: audit 2021-03-10T21:06:27.425556+0000 mon.a (mon.0) 1403 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:06:28.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:27 gibba023 bash[31815]: audit 2021-03-10T21:06:27.426209+0000 mon.a (mon.0) 1404 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T21:06:28.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:27 gibba023 bash[31815]: audit 2021-03-10T21:06:27.426980+0000 mon.a (mon.0) 1405 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T21:06:28.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:27 gibba023 bash[31815]: audit 2021-03-10T21:06:27.427657+0000 mon.a (mon.0) 1406 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T21:06:28.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:27 gibba023 bash[31815]: audit 2021-03-10T21:06:27.428334+0000 mon.a (mon.0) 1407 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T21:06:28.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:27 gibba044 bash[25485]: audit 2021-03-10T21:06:27.424935+0000 mon.a (mon.0) 1402 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:06:28.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:27 gibba044 bash[25485]: audit 2021-03-10T21:06:27.425556+0000 mon.a (mon.0) 1403 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:06:28.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:27 gibba044 bash[25485]: audit 2021-03-10T21:06:27.426209+0000 mon.a (mon.0) 1404 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.9", "id": [7, 2]}]: dispatch 2021-03-10T21:06:28.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:27 gibba044 bash[25485]: audit 2021-03-10T21:06:27.426980+0000 mon.a (mon.0) 1405 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-03-10T21:06:28.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:27 gibba044 bash[25485]: audit 2021-03-10T21:06:27.427657+0000 mon.a (mon.0) 1406 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T21:06:28.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:27 gibba044 bash[25485]: audit 2021-03-10T21:06:27.428334+0000 mon.a (mon.0) 1407 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T21:06:29.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:29 gibba023 bash[30844]: cluster 2021-03-10T21:06:27.822039+0000 mgr.gibba044.wflcwh (mgr.34466) 3097 : cluster [DBG] pgmap v1754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:29.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:29 gibba023 bash[31815]: cluster 2021-03-10T21:06:27.822039+0000 mgr.gibba044.wflcwh (mgr.34466) 3097 : cluster [DBG] pgmap v1754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:30.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:29 gibba044 bash[25485]: cluster 2021-03-10T21:06:27.822039+0000 mgr.gibba044.wflcwh (mgr.34466) 3097 : cluster [DBG] pgmap v1754: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:31.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:30 gibba044 bash[25485]: cluster 2021-03-10T21:06:29.823407+0000 mgr.gibba044.wflcwh (mgr.34466) 3098 : cluster [DBG] pgmap v1755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:31.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:30 gibba023 bash[30844]: cluster 2021-03-10T21:06:29.823407+0000 mgr.gibba044.wflcwh (mgr.34466) 3098 : cluster [DBG] pgmap v1755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:31.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:30 gibba023 bash[31815]: cluster 2021-03-10T21:06:29.823407+0000 mgr.gibba044.wflcwh (mgr.34466) 3098 : cluster [DBG] pgmap v1755: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:33.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:33 gibba023 bash[30844]: cluster 2021-03-10T21:06:31.824785+0000 mgr.gibba044.wflcwh (mgr.34466) 3099 : cluster [DBG] pgmap v1756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:33.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:33 gibba023 bash[30844]: cephadm 2021-03-10T21:06:32.475995+0000 mgr.gibba044.wflcwh (mgr.34466) 3100 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:06:33.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:33 gibba023 bash[31815]: cluster 2021-03-10T21:06:31.824785+0000 mgr.gibba044.wflcwh (mgr.34466) 3099 : cluster [DBG] pgmap v1756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:33.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:33 gibba023 bash[31815]: cephadm 2021-03-10T21:06:32.475995+0000 mgr.gibba044.wflcwh (mgr.34466) 3100 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:06:34.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:33 gibba044 bash[25485]: cluster 2021-03-10T21:06:31.824785+0000 mgr.gibba044.wflcwh (mgr.34466) 3099 : cluster [DBG] pgmap v1756: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:34.183 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:33 gibba044 bash[25485]: cephadm 2021-03-10T21:06:32.475995+0000 mgr.gibba044.wflcwh (mgr.34466) 3100 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:06:35.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:34 gibba044 bash[25485]: cluster 2021-03-10T21:06:33.826360+0000 mgr.gibba044.wflcwh (mgr.34466) 3101 : cluster [DBG] pgmap v1757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:35.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:34 gibba023 bash[30844]: cluster 2021-03-10T21:06:33.826360+0000 mgr.gibba044.wflcwh (mgr.34466) 3101 : cluster [DBG] pgmap v1757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:35.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:34 gibba023 bash[31815]: cluster 2021-03-10T21:06:33.826360+0000 mgr.gibba044.wflcwh (mgr.34466) 3101 : cluster [DBG] pgmap v1757: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:37.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:36 gibba023 bash[30844]: cluster 2021-03-10T21:06:35.828085+0000 mgr.gibba044.wflcwh (mgr.34466) 3102 : cluster [DBG] pgmap v1758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:37.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:36 gibba023 bash[31815]: cluster 2021-03-10T21:06:35.828085+0000 mgr.gibba044.wflcwh (mgr.34466) 3102 : cluster [DBG] pgmap v1758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:37.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:36 gibba044 bash[25485]: cluster 2021-03-10T21:06:35.828085+0000 mgr.gibba044.wflcwh (mgr.34466) 3102 : cluster [DBG] pgmap v1758: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:37.380 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T21:06:37.609 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:06:37.610 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (57m) 2m ago 63m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T21:06:37.610 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (63m) 110s ago 63m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T21:06:37.610 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (58m) 110s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T21:06:37.611 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (58m) 110s ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T21:06:37.611 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (57m) 2m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T21:06:37.611 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (57m) 2m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T21:06:37.611 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (56m) 110s ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T21:06:37.612 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (57m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T21:06:37.612 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (63m) 2m ago 63m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T21:06:37.612 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (63m) 110s ago 63m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T21:06:37.612 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (56m) 2m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T21:06:37.613 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (55m) 2m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T21:06:37.613 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (55m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T21:06:37.613 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (54m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T21:06:37.613 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (54m) 110s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T21:06:37.614 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (53m) 110s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T21:06:37.614 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (53m) 110s ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T21:06:37.614 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (52m) 110s ago 63m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T21:06:37.614 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (62m) 110s ago 63m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T21:06:37.615 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 2m ago 61m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:06:37.615 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 110s ago 61m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:06:37.862 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T21:06:37.863 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T21:06:37.863 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:06:37.863 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:06:37.863 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T21:06:37.864 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:06:37.864 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:06:37.864 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T21:06:37.864 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:06:37.865 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:06:37.865 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T21:06:37.865 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T21:06:37.865 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:06:37.865 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T21:06:37.866 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T21:06:39.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:38 gibba044 bash[25485]: audit 2021-03-10T21:06:37.367343+0000 mgr.gibba044.wflcwh (mgr.34466) 3103 : audit [DBG] from='client.56125 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:06:39.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:38 gibba044 bash[25485]: audit 2021-03-10T21:06:37.594648+0000 mgr.gibba044.wflcwh (mgr.34466) 3104 : audit [DBG] from='client.56131 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:06:39.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:38 gibba044 bash[25485]: audit 2021-03-10T21:06:37.859365+0000 mon.a (mon.0) 1408 : audit [DBG] from='client.? 172.21.2.123:0/540861714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:39.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:38 gibba023 bash[30844]: audit 2021-03-10T21:06:37.367343+0000 mgr.gibba044.wflcwh (mgr.34466) 3103 : audit [DBG] from='client.56125 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:06:39.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:38 gibba023 bash[30844]: audit 2021-03-10T21:06:37.594648+0000 mgr.gibba044.wflcwh (mgr.34466) 3104 : audit [DBG] from='client.56131 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:06:39.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:38 gibba023 bash[30844]: audit 2021-03-10T21:06:37.859365+0000 mon.a (mon.0) 1408 : audit [DBG] from='client.? 172.21.2.123:0/540861714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:39.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:38 gibba023 bash[31815]: audit 2021-03-10T21:06:37.367343+0000 mgr.gibba044.wflcwh (mgr.34466) 3103 : audit [DBG] from='client.56125 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:06:39.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:38 gibba023 bash[31815]: audit 2021-03-10T21:06:37.594648+0000 mgr.gibba044.wflcwh (mgr.34466) 3104 : audit [DBG] from='client.56131 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:06:39.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:38 gibba023 bash[31815]: audit 2021-03-10T21:06:37.859365+0000 mon.a (mon.0) 1408 : audit [DBG] from='client.? 172.21.2.123:0/540861714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:40.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:39 gibba044 bash[25485]: cluster 2021-03-10T21:06:37.829824+0000 mgr.gibba044.wflcwh (mgr.34466) 3105 : cluster [DBG] pgmap v1759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:40.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:39 gibba023 bash[30844]: cluster 2021-03-10T21:06:37.829824+0000 mgr.gibba044.wflcwh (mgr.34466) 3105 : cluster [DBG] pgmap v1759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:40.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:39 gibba023 bash[31815]: cluster 2021-03-10T21:06:37.829824+0000 mgr.gibba044.wflcwh (mgr.34466) 3105 : cluster [DBG] pgmap v1759: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:41.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:40 gibba044 bash[25485]: cluster 2021-03-10T21:06:39.831029+0000 mgr.gibba044.wflcwh (mgr.34466) 3106 : cluster [DBG] pgmap v1760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:41.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:40 gibba023 bash[30844]: cluster 2021-03-10T21:06:39.831029+0000 mgr.gibba044.wflcwh (mgr.34466) 3106 : cluster [DBG] pgmap v1760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:41.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:40 gibba023 bash[31815]: cluster 2021-03-10T21:06:39.831029+0000 mgr.gibba044.wflcwh (mgr.34466) 3106 : cluster [DBG] pgmap v1760: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:43.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:43 gibba023 bash[30844]: cluster 2021-03-10T21:06:41.832633+0000 mgr.gibba044.wflcwh (mgr.34466) 3107 : cluster [DBG] pgmap v1761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:43.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:43 gibba023 bash[31815]: cluster 2021-03-10T21:06:41.832633+0000 mgr.gibba044.wflcwh (mgr.34466) 3107 : cluster [DBG] pgmap v1761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:44.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:43 gibba044 bash[25485]: cluster 2021-03-10T21:06:41.832633+0000 mgr.gibba044.wflcwh (mgr.34466) 3107 : cluster [DBG] pgmap v1761: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:45.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:44 gibba044 bash[25485]: cluster 2021-03-10T21:06:43.834475+0000 mgr.gibba044.wflcwh (mgr.34466) 3108 : cluster [DBG] pgmap v1762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:45.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:44 gibba023 bash[30844]: cluster 2021-03-10T21:06:43.834475+0000 mgr.gibba044.wflcwh (mgr.34466) 3108 : cluster [DBG] pgmap v1762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:45.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:44 gibba023 bash[31815]: cluster 2021-03-10T21:06:43.834475+0000 mgr.gibba044.wflcwh (mgr.34466) 3108 : cluster [DBG] pgmap v1762: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:47.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:46 gibba023 bash[30844]: cluster 2021-03-10T21:06:45.835972+0000 mgr.gibba044.wflcwh (mgr.34466) 3109 : cluster [DBG] pgmap v1763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:47.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:46 gibba023 bash[31815]: cluster 2021-03-10T21:06:45.835972+0000 mgr.gibba044.wflcwh (mgr.34466) 3109 : cluster [DBG] pgmap v1763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:47.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:46 gibba044 bash[25485]: cluster 2021-03-10T21:06:45.835972+0000 mgr.gibba044.wflcwh (mgr.34466) 3109 : cluster [DBG] pgmap v1763: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:48.927 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:48 gibba023 bash[31815]: cephadm 2021-03-10T21:06:47.489288+0000 mgr.gibba044.wflcwh (mgr.34466) 3110 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:06:48.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:48 gibba023 bash[31815]: cephadm 2021-03-10T21:06:47.490923+0000 mgr.gibba044.wflcwh (mgr.34466) 3111 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:06:48.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:48 gibba023 bash[31815]: audit 2021-03-10T21:06:47.703023+0000 mon.a (mon.0) 1409 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:06:48.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:48 gibba023 bash[31815]: audit 2021-03-10T21:06:47.706610+0000 mon.a (mon.0) 1410 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:06:48.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:48 gibba023 bash[31815]: audit 2021-03-10T21:06:47.708255+0000 mon.a (mon.0) 1411 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:48.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:48 gibba023 bash[31815]: audit 2021-03-10T21:06:47.709792+0000 mon.a (mon.0) 1412 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:48.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:48 gibba023 bash[31815]: audit 2021-03-10T21:06:47.710976+0000 mon.a (mon.0) 1413 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:48.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:48 gibba023 bash[31815]: audit 2021-03-10T21:06:47.713500+0000 mon.a (mon.0) 1414 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:48.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:48 gibba023 bash[31815]: audit 2021-03-10T21:06:47.715092+0000 mon.a (mon.0) 1415 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:48.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:48 gibba023 bash[30844]: cephadm 2021-03-10T21:06:47.489288+0000 mgr.gibba044.wflcwh (mgr.34466) 3110 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:06:48.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:48 gibba023 bash[30844]: cephadm 2021-03-10T21:06:47.490923+0000 mgr.gibba044.wflcwh (mgr.34466) 3111 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:06:48.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:48 gibba023 bash[30844]: audit 2021-03-10T21:06:47.703023+0000 mon.a (mon.0) 1409 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:06:48.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:48 gibba023 bash[30844]: audit 2021-03-10T21:06:47.706610+0000 mon.a (mon.0) 1410 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:06:48.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:48 gibba023 bash[30844]: audit 2021-03-10T21:06:47.708255+0000 mon.a (mon.0) 1411 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:48.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:48 gibba023 bash[30844]: audit 2021-03-10T21:06:47.709792+0000 mon.a (mon.0) 1412 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:48.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:48 gibba023 bash[30844]: audit 2021-03-10T21:06:47.710976+0000 mon.a (mon.0) 1413 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:48.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:48 gibba023 bash[30844]: audit 2021-03-10T21:06:47.713500+0000 mon.a (mon.0) 1414 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:48.932 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:48 gibba023 bash[30844]: audit 2021-03-10T21:06:47.715092+0000 mon.a (mon.0) 1415 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:49.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:48 gibba044 bash[25485]: cephadm 2021-03-10T21:06:47.489288+0000 mgr.gibba044.wflcwh (mgr.34466) 3110 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:06:49.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:48 gibba044 bash[25485]: cephadm 2021-03-10T21:06:47.490923+0000 mgr.gibba044.wflcwh (mgr.34466) 3111 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:06:49.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:48 gibba044 bash[25485]: audit 2021-03-10T21:06:47.703023+0000 mon.a (mon.0) 1409 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:06:49.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:48 gibba044 bash[25485]: audit 2021-03-10T21:06:47.706610+0000 mon.a (mon.0) 1410 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:06:49.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:48 gibba044 bash[25485]: audit 2021-03-10T21:06:47.708255+0000 mon.a (mon.0) 1411 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:49.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:48 gibba044 bash[25485]: audit 2021-03-10T21:06:47.709792+0000 mon.a (mon.0) 1412 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:49.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:48 gibba044 bash[25485]: audit 2021-03-10T21:06:47.710976+0000 mon.a (mon.0) 1413 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:49.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:48 gibba044 bash[25485]: audit 2021-03-10T21:06:47.713500+0000 mon.a (mon.0) 1414 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:49.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:48 gibba044 bash[25485]: audit 2021-03-10T21:06:47.715092+0000 mon.a (mon.0) 1415 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:06:50.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:49 gibba044 bash[25485]: cephadm 2021-03-10T21:06:47.706334+0000 mgr.gibba044.wflcwh (mgr.34466) 3112 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:06:50.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:49 gibba044 bash[25485]: cephadm 2021-03-10T21:06:47.708270+0000 mgr.gibba044.wflcwh (mgr.34466) 3113 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:06:50.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:49 gibba044 bash[25485]: cephadm 2021-03-10T21:06:47.709834+0000 mgr.gibba044.wflcwh (mgr.34466) 3114 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:06:50.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:49 gibba044 bash[25485]: cephadm 2021-03-10T21:06:47.709871+0000 mgr.gibba044.wflcwh (mgr.34466) 3115 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:06:50.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:49 gibba044 bash[25485]: cephadm 2021-03-10T21:06:47.711114+0000 mgr.gibba044.wflcwh (mgr.34466) 3116 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:06:50.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:49 gibba044 bash[25485]: cephadm 2021-03-10T21:06:47.711150+0000 mgr.gibba044.wflcwh (mgr.34466) 3117 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:06:50.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:49 gibba044 bash[25485]: cephadm 2021-03-10T21:06:47.712270+0000 mgr.gibba044.wflcwh (mgr.34466) 3118 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:06:50.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:49 gibba044 bash[25485]: cephadm 2021-03-10T21:06:47.713609+0000 mgr.gibba044.wflcwh (mgr.34466) 3119 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:06:50.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:49 gibba044 bash[25485]: cephadm 2021-03-10T21:06:47.713646+0000 mgr.gibba044.wflcwh (mgr.34466) 3120 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:06:50.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:49 gibba044 bash[25485]: cephadm 2021-03-10T21:06:47.714999+0000 mgr.gibba044.wflcwh (mgr.34466) 3121 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:06:50.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:49 gibba044 bash[25485]: cephadm 2021-03-10T21:06:47.715306+0000 mgr.gibba044.wflcwh (mgr.34466) 3122 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:06:50.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:49 gibba044 bash[25485]: cephadm 2021-03-10T21:06:47.716503+0000 mgr.gibba044.wflcwh (mgr.34466) 3123 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:06:50.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:49 gibba044 bash[25485]: cephadm 2021-03-10T21:06:47.716559+0000 mgr.gibba044.wflcwh (mgr.34466) 3124 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:06:50.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:49 gibba044 bash[25485]: cephadm 2021-03-10T21:06:47.716685+0000 mgr.gibba044.wflcwh (mgr.34466) 3125 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:06:50.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:49 gibba044 bash[25485]: cluster 2021-03-10T21:06:47.837380+0000 mgr.gibba044.wflcwh (mgr.34466) 3126 : cluster [DBG] pgmap v1764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:50.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[30844]: cephadm 2021-03-10T21:06:47.706334+0000 mgr.gibba044.wflcwh (mgr.34466) 3112 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:06:50.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[30844]: cephadm 2021-03-10T21:06:47.708270+0000 mgr.gibba044.wflcwh (mgr.34466) 3113 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:06:50.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[30844]: cephadm 2021-03-10T21:06:47.709834+0000 mgr.gibba044.wflcwh (mgr.34466) 3114 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:06:50.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[30844]: cephadm 2021-03-10T21:06:47.709871+0000 mgr.gibba044.wflcwh (mgr.34466) 3115 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:06:50.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[30844]: cephadm 2021-03-10T21:06:47.711114+0000 mgr.gibba044.wflcwh (mgr.34466) 3116 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:06:50.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[30844]: cephadm 2021-03-10T21:06:47.711150+0000 mgr.gibba044.wflcwh (mgr.34466) 3117 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:06:50.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[30844]: cephadm 2021-03-10T21:06:47.712270+0000 mgr.gibba044.wflcwh (mgr.34466) 3118 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:06:50.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[30844]: cephadm 2021-03-10T21:06:47.713609+0000 mgr.gibba044.wflcwh (mgr.34466) 3119 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:06:50.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[30844]: cephadm 2021-03-10T21:06:47.713646+0000 mgr.gibba044.wflcwh (mgr.34466) 3120 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:06:50.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[30844]: cephadm 2021-03-10T21:06:47.714999+0000 mgr.gibba044.wflcwh (mgr.34466) 3121 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:06:50.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[30844]: cephadm 2021-03-10T21:06:47.715306+0000 mgr.gibba044.wflcwh (mgr.34466) 3122 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:06:50.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[30844]: cephadm 2021-03-10T21:06:47.716503+0000 mgr.gibba044.wflcwh (mgr.34466) 3123 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:06:50.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[30844]: cephadm 2021-03-10T21:06:47.716559+0000 mgr.gibba044.wflcwh (mgr.34466) 3124 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:06:50.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[30844]: cephadm 2021-03-10T21:06:47.716685+0000 mgr.gibba044.wflcwh (mgr.34466) 3125 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:06:50.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[30844]: cluster 2021-03-10T21:06:47.837380+0000 mgr.gibba044.wflcwh (mgr.34466) 3126 : cluster [DBG] pgmap v1764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:50.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[31815]: cephadm 2021-03-10T21:06:47.706334+0000 mgr.gibba044.wflcwh (mgr.34466) 3112 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:06:50.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[31815]: cephadm 2021-03-10T21:06:47.708270+0000 mgr.gibba044.wflcwh (mgr.34466) 3113 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:06:50.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[31815]: cephadm 2021-03-10T21:06:47.709834+0000 mgr.gibba044.wflcwh (mgr.34466) 3114 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:06:50.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[31815]: cephadm 2021-03-10T21:06:47.709871+0000 mgr.gibba044.wflcwh (mgr.34466) 3115 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:06:50.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[31815]: cephadm 2021-03-10T21:06:47.711114+0000 mgr.gibba044.wflcwh (mgr.34466) 3116 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:06:50.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[31815]: cephadm 2021-03-10T21:06:47.711150+0000 mgr.gibba044.wflcwh (mgr.34466) 3117 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:06:50.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[31815]: cephadm 2021-03-10T21:06:47.712270+0000 mgr.gibba044.wflcwh (mgr.34466) 3118 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:06:50.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[31815]: cephadm 2021-03-10T21:06:47.713609+0000 mgr.gibba044.wflcwh (mgr.34466) 3119 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:06:50.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[31815]: cephadm 2021-03-10T21:06:47.713646+0000 mgr.gibba044.wflcwh (mgr.34466) 3120 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:06:50.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[31815]: cephadm 2021-03-10T21:06:47.714999+0000 mgr.gibba044.wflcwh (mgr.34466) 3121 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:06:50.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[31815]: cephadm 2021-03-10T21:06:47.715306+0000 mgr.gibba044.wflcwh (mgr.34466) 3122 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:06:50.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[31815]: cephadm 2021-03-10T21:06:47.716503+0000 mgr.gibba044.wflcwh (mgr.34466) 3123 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:06:50.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[31815]: cephadm 2021-03-10T21:06:47.716559+0000 mgr.gibba044.wflcwh (mgr.34466) 3124 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:06:50.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[31815]: cephadm 2021-03-10T21:06:47.716685+0000 mgr.gibba044.wflcwh (mgr.34466) 3125 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:06:50.186 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:49 gibba023 bash[31815]: cluster 2021-03-10T21:06:47.837380+0000 mgr.gibba044.wflcwh (mgr.34466) 3126 : cluster [DBG] pgmap v1764: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:51.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:50 gibba044 bash[25485]: cluster 2021-03-10T21:06:49.838556+0000 mgr.gibba044.wflcwh (mgr.34466) 3127 : cluster [DBG] pgmap v1765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:51.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:50 gibba023 bash[30844]: cluster 2021-03-10T21:06:49.838556+0000 mgr.gibba044.wflcwh (mgr.34466) 3127 : cluster [DBG] pgmap v1765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:51.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:50 gibba023 bash[31815]: cluster 2021-03-10T21:06:49.838556+0000 mgr.gibba044.wflcwh (mgr.34466) 3127 : cluster [DBG] pgmap v1765: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:54.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:53 gibba044 bash[25485]: cluster 2021-03-10T21:06:51.840098+0000 mgr.gibba044.wflcwh (mgr.34466) 3128 : cluster [DBG] pgmap v1766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:54.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:53 gibba023 bash[30844]: cluster 2021-03-10T21:06:51.840098+0000 mgr.gibba044.wflcwh (mgr.34466) 3128 : cluster [DBG] pgmap v1766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:54.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:53 gibba023 bash[31815]: cluster 2021-03-10T21:06:51.840098+0000 mgr.gibba044.wflcwh (mgr.34466) 3128 : cluster [DBG] pgmap v1766: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:55.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:54 gibba044 bash[25485]: cluster 2021-03-10T21:06:53.841669+0000 mgr.gibba044.wflcwh (mgr.34466) 3129 : cluster [DBG] pgmap v1767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:55.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:54 gibba023 bash[30844]: cluster 2021-03-10T21:06:53.841669+0000 mgr.gibba044.wflcwh (mgr.34466) 3129 : cluster [DBG] pgmap v1767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:55.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:54 gibba023 bash[31815]: cluster 2021-03-10T21:06:53.841669+0000 mgr.gibba044.wflcwh (mgr.34466) 3129 : cluster [DBG] pgmap v1767: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:57.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:56 gibba023 bash[30844]: cluster 2021-03-10T21:06:55.843263+0000 mgr.gibba044.wflcwh (mgr.34466) 3130 : cluster [DBG] pgmap v1768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:57.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:56 gibba023 bash[31815]: cluster 2021-03-10T21:06:55.843263+0000 mgr.gibba044.wflcwh (mgr.34466) 3130 : cluster [DBG] pgmap v1768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:57.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:56 gibba044 bash[25485]: cluster 2021-03-10T21:06:55.843263+0000 mgr.gibba044.wflcwh (mgr.34466) 3130 : cluster [DBG] pgmap v1768: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:59.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:06:58 gibba044 bash[25485]: cluster 2021-03-10T21:06:57.844876+0000 mgr.gibba044.wflcwh (mgr.34466) 3131 : cluster [DBG] pgmap v1769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:59.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:06:58 gibba023 bash[30844]: cluster 2021-03-10T21:06:57.844876+0000 mgr.gibba044.wflcwh (mgr.34466) 3131 : cluster [DBG] pgmap v1769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:06:59.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:06:58 gibba023 bash[31815]: cluster 2021-03-10T21:06:57.844876+0000 mgr.gibba044.wflcwh (mgr.34466) 3131 : cluster [DBG] pgmap v1769: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:01.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:00 gibba023 bash[30844]: cluster 2021-03-10T21:06:59.846096+0000 mgr.gibba044.wflcwh (mgr.34466) 3132 : cluster [DBG] pgmap v1770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:01.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:00 gibba023 bash[31815]: cluster 2021-03-10T21:06:59.846096+0000 mgr.gibba044.wflcwh (mgr.34466) 3132 : cluster [DBG] pgmap v1770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:01.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:00 gibba044 bash[25485]: cluster 2021-03-10T21:06:59.846096+0000 mgr.gibba044.wflcwh (mgr.34466) 3132 : cluster [DBG] pgmap v1770: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:04.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:03 gibba044 bash[25485]: cluster 2021-03-10T21:07:01.847584+0000 mgr.gibba044.wflcwh (mgr.34466) 3133 : cluster [DBG] pgmap v1771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:04.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:03 gibba023 bash[30844]: cluster 2021-03-10T21:07:01.847584+0000 mgr.gibba044.wflcwh (mgr.34466) 3133 : cluster [DBG] pgmap v1771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:04.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:03 gibba023 bash[31815]: cluster 2021-03-10T21:07:01.847584+0000 mgr.gibba044.wflcwh (mgr.34466) 3133 : cluster [DBG] pgmap v1771: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:05.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:04 gibba044 bash[25485]: cephadm 2021-03-10T21:07:02.732125+0000 mgr.gibba044.wflcwh (mgr.34466) 3134 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:07:05.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:04 gibba044 bash[25485]: cluster 2021-03-10T21:07:03.849135+0000 mgr.gibba044.wflcwh (mgr.34466) 3135 : cluster [DBG] pgmap v1772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:05.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:04 gibba023 bash[30844]: cephadm 2021-03-10T21:07:02.732125+0000 mgr.gibba044.wflcwh (mgr.34466) 3134 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:07:05.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:04 gibba023 bash[30844]: cluster 2021-03-10T21:07:03.849135+0000 mgr.gibba044.wflcwh (mgr.34466) 3135 : cluster [DBG] pgmap v1772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:05.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:04 gibba023 bash[31815]: cephadm 2021-03-10T21:07:02.732125+0000 mgr.gibba044.wflcwh (mgr.34466) 3134 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:07:05.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:04 gibba023 bash[31815]: cluster 2021-03-10T21:07:03.849135+0000 mgr.gibba044.wflcwh (mgr.34466) 3135 : cluster [DBG] pgmap v1772: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:07.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:06 gibba023 bash[30844]: cluster 2021-03-10T21:07:05.850805+0000 mgr.gibba044.wflcwh (mgr.34466) 3136 : cluster [DBG] pgmap v1773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:07.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:06 gibba023 bash[31815]: cluster 2021-03-10T21:07:05.850805+0000 mgr.gibba044.wflcwh (mgr.34466) 3136 : cluster [DBG] pgmap v1773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:07.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:06 gibba044 bash[25485]: cluster 2021-03-10T21:07:05.850805+0000 mgr.gibba044.wflcwh (mgr.34466) 3136 : cluster [DBG] pgmap v1773: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:08.106 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T21:07:08.336 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:07:08.336 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (58m) 3m ago 63m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T21:07:08.337 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (63m) 2m ago 63m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T21:07:08.337 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (58m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T21:07:08.337 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (58m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T21:07:08.337 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (57m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T21:07:08.337 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (57m) 3m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T21:07:08.338 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (57m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T21:07:08.338 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (57m) 3m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T21:07:08.338 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (63m) 3m ago 63m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T21:07:08.339 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (63m) 2m ago 63m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T21:07:08.339 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (56m) 3m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T21:07:08.339 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (56m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T21:07:08.339 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (55m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T21:07:08.340 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (55m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T21:07:08.341 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (54m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T21:07:08.341 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (54m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T21:07:08.342 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (53m) 2m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T21:07:08.342 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (53m) 2m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T21:07:08.343 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (63m) 2m ago 64m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T21:07:08.343 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 3m ago 61m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:07:08.343 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 2m ago 61m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:07:08.584 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T21:07:08.585 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T21:07:08.585 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:07:08.585 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:07:08.585 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T21:07:08.585 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:07:08.586 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:07:08.586 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T21:07:08.586 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:07:08.586 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:07:08.587 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T21:07:08.587 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T21:07:08.587 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:07:08.587 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T21:07:08.588 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T21:07:09.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:08 gibba044 bash[25485]: audit 2021-03-10T21:07:08.581157+0000 mon.c (mon.1) 70 : audit [DBG] from='client.? 172.21.2.123:0/3814629997' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:09.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:08 gibba023 bash[30844]: audit 2021-03-10T21:07:08.581157+0000 mon.c (mon.1) 70 : audit [DBG] from='client.? 172.21.2.123:0/3814629997' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:09.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:08 gibba023 bash[31815]: audit 2021-03-10T21:07:08.581157+0000 mon.c (mon.1) 70 : audit [DBG] from='client.? 172.21.2.123:0/3814629997' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:10.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:09 gibba044 bash[25485]: cluster 2021-03-10T21:07:07.852540+0000 mgr.gibba044.wflcwh (mgr.34466) 3137 : cluster [DBG] pgmap v1774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:10.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:09 gibba044 bash[25485]: audit 2021-03-10T21:07:08.094840+0000 mgr.gibba044.wflcwh (mgr.34466) 3138 : audit [DBG] from='client.46164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:07:10.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:09 gibba044 bash[25485]: audit 2021-03-10T21:07:08.320604+0000 mgr.gibba044.wflcwh (mgr.34466) 3139 : audit [DBG] from='client.46170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:07:10.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:09 gibba023 bash[30844]: cluster 2021-03-10T21:07:07.852540+0000 mgr.gibba044.wflcwh (mgr.34466) 3137 : cluster [DBG] pgmap v1774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:10.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:09 gibba023 bash[30844]: audit 2021-03-10T21:07:08.094840+0000 mgr.gibba044.wflcwh (mgr.34466) 3138 : audit [DBG] from='client.46164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:07:10.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:09 gibba023 bash[30844]: audit 2021-03-10T21:07:08.320604+0000 mgr.gibba044.wflcwh (mgr.34466) 3139 : audit [DBG] from='client.46170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:07:10.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:09 gibba023 bash[31815]: cluster 2021-03-10T21:07:07.852540+0000 mgr.gibba044.wflcwh (mgr.34466) 3137 : cluster [DBG] pgmap v1774: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:10.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:09 gibba023 bash[31815]: audit 2021-03-10T21:07:08.094840+0000 mgr.gibba044.wflcwh (mgr.34466) 3138 : audit [DBG] from='client.46164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:07:10.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:09 gibba023 bash[31815]: audit 2021-03-10T21:07:08.320604+0000 mgr.gibba044.wflcwh (mgr.34466) 3139 : audit [DBG] from='client.46170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:07:11.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:10 gibba044 bash[25485]: cluster 2021-03-10T21:07:09.853782+0000 mgr.gibba044.wflcwh (mgr.34466) 3140 : cluster [DBG] pgmap v1775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:11.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:10 gibba023 bash[30844]: cluster 2021-03-10T21:07:09.853782+0000 mgr.gibba044.wflcwh (mgr.34466) 3140 : cluster [DBG] pgmap v1775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:11.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:10 gibba023 bash[31815]: cluster 2021-03-10T21:07:09.853782+0000 mgr.gibba044.wflcwh (mgr.34466) 3140 : cluster [DBG] pgmap v1775: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:14.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:13 gibba044 bash[25485]: cluster 2021-03-10T21:07:11.855440+0000 mgr.gibba044.wflcwh (mgr.34466) 3141 : cluster [DBG] pgmap v1776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:14.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:13 gibba023 bash[30844]: cluster 2021-03-10T21:07:11.855440+0000 mgr.gibba044.wflcwh (mgr.34466) 3141 : cluster [DBG] pgmap v1776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:14.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:13 gibba023 bash[31815]: cluster 2021-03-10T21:07:11.855440+0000 mgr.gibba044.wflcwh (mgr.34466) 3141 : cluster [DBG] pgmap v1776: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:15.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:14 gibba044 bash[25485]: cluster 2021-03-10T21:07:13.857214+0000 mgr.gibba044.wflcwh (mgr.34466) 3142 : cluster [DBG] pgmap v1777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:15.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:14 gibba023 bash[30844]: cluster 2021-03-10T21:07:13.857214+0000 mgr.gibba044.wflcwh (mgr.34466) 3142 : cluster [DBG] pgmap v1777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:15.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:14 gibba023 bash[31815]: cluster 2021-03-10T21:07:13.857214+0000 mgr.gibba044.wflcwh (mgr.34466) 3142 : cluster [DBG] pgmap v1777: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:17.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:16 gibba023 bash[30844]: cluster 2021-03-10T21:07:15.858801+0000 mgr.gibba044.wflcwh (mgr.34466) 3143 : cluster [DBG] pgmap v1778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:17.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:16 gibba023 bash[31815]: cluster 2021-03-10T21:07:15.858801+0000 mgr.gibba044.wflcwh (mgr.34466) 3143 : cluster [DBG] pgmap v1778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:17.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:16 gibba044 bash[25485]: cluster 2021-03-10T21:07:15.858801+0000 mgr.gibba044.wflcwh (mgr.34466) 3143 : cluster [DBG] pgmap v1778: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:19.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:18 gibba044 bash[25485]: cephadm 2021-03-10T21:07:17.747754+0000 mgr.gibba044.wflcwh (mgr.34466) 3144 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:07:19.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:18 gibba044 bash[25485]: cluster 2021-03-10T21:07:17.860579+0000 mgr.gibba044.wflcwh (mgr.34466) 3145 : cluster [DBG] pgmap v1779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:19.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:18 gibba023 bash[30844]: cephadm 2021-03-10T21:07:17.747754+0000 mgr.gibba044.wflcwh (mgr.34466) 3144 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:07:19.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:18 gibba023 bash[30844]: cluster 2021-03-10T21:07:17.860579+0000 mgr.gibba044.wflcwh (mgr.34466) 3145 : cluster [DBG] pgmap v1779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:19.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:18 gibba023 bash[31815]: cephadm 2021-03-10T21:07:17.747754+0000 mgr.gibba044.wflcwh (mgr.34466) 3144 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:07:19.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:18 gibba023 bash[31815]: cluster 2021-03-10T21:07:17.860579+0000 mgr.gibba044.wflcwh (mgr.34466) 3145 : cluster [DBG] pgmap v1779: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:21.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:20 gibba023 bash[30844]: cluster 2021-03-10T21:07:19.861762+0000 mgr.gibba044.wflcwh (mgr.34466) 3146 : cluster [DBG] pgmap v1780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:21.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:20 gibba023 bash[31815]: cluster 2021-03-10T21:07:19.861762+0000 mgr.gibba044.wflcwh (mgr.34466) 3146 : cluster [DBG] pgmap v1780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:21.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:20 gibba044 bash[25485]: cluster 2021-03-10T21:07:19.861762+0000 mgr.gibba044.wflcwh (mgr.34466) 3146 : cluster [DBG] pgmap v1780: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:23.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:22 gibba044 bash[25485]: cluster 2021-03-10T21:07:21.863098+0000 mgr.gibba044.wflcwh (mgr.34466) 3147 : cluster [DBG] pgmap v1781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:23.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:22 gibba023 bash[30844]: cluster 2021-03-10T21:07:21.863098+0000 mgr.gibba044.wflcwh (mgr.34466) 3147 : cluster [DBG] pgmap v1781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:23.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:22 gibba023 bash[31815]: cluster 2021-03-10T21:07:21.863098+0000 mgr.gibba044.wflcwh (mgr.34466) 3147 : cluster [DBG] pgmap v1781: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:25.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:24 gibba044 bash[25485]: cluster 2021-03-10T21:07:23.864840+0000 mgr.gibba044.wflcwh (mgr.34466) 3148 : cluster [DBG] pgmap v1782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:25.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:24 gibba023 bash[30844]: cluster 2021-03-10T21:07:23.864840+0000 mgr.gibba044.wflcwh (mgr.34466) 3148 : cluster [DBG] pgmap v1782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:25.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:24 gibba023 bash[31815]: cluster 2021-03-10T21:07:23.864840+0000 mgr.gibba044.wflcwh (mgr.34466) 3148 : cluster [DBG] pgmap v1782: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:27.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:26 gibba044 bash[25485]: cluster 2021-03-10T21:07:25.866506+0000 mgr.gibba044.wflcwh (mgr.34466) 3149 : cluster [DBG] pgmap v1783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:27.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:26 gibba023 bash[30844]: cluster 2021-03-10T21:07:25.866506+0000 mgr.gibba044.wflcwh (mgr.34466) 3149 : cluster [DBG] pgmap v1783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:27.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:26 gibba023 bash[31815]: cluster 2021-03-10T21:07:25.866506+0000 mgr.gibba044.wflcwh (mgr.34466) 3149 : cluster [DBG] pgmap v1783: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:28.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:27 gibba044 bash[25485]: audit 2021-03-10T21:07:27.431313+0000 mon.a (mon.0) 1416 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:07:28.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:27 gibba044 bash[25485]: audit 2021-03-10T21:07:27.432022+0000 mon.a (mon.0) 1417 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:07:28.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:27 gibba044 bash[25485]: audit 2021-03-10T21:07:27.433272+0000 mon.a (mon.0) 1418 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T21:07:28.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:27 gibba044 bash[25485]: audit 2021-03-10T21:07:27.434028+0000 mon.a (mon.0) 1419 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T21:07:28.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:27 gibba044 bash[25485]: audit 2021-03-10T21:07:27.434799+0000 mon.a (mon.0) 1420 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T21:07:28.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:27 gibba044 bash[25485]: audit 2021-03-10T21:07:27.435480+0000 mon.a (mon.0) 1421 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T21:07:28.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:27 gibba023 bash[30844]: audit 2021-03-10T21:07:27.431313+0000 mon.a (mon.0) 1416 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:07:28.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:27 gibba023 bash[30844]: audit 2021-03-10T21:07:27.432022+0000 mon.a (mon.0) 1417 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:07:28.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:27 gibba023 bash[30844]: audit 2021-03-10T21:07:27.433272+0000 mon.a (mon.0) 1418 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T21:07:28.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:27 gibba023 bash[30844]: audit 2021-03-10T21:07:27.434028+0000 mon.a (mon.0) 1419 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T21:07:28.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:27 gibba023 bash[30844]: audit 2021-03-10T21:07:27.434799+0000 mon.a (mon.0) 1420 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T21:07:28.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:27 gibba023 bash[30844]: audit 2021-03-10T21:07:27.435480+0000 mon.a (mon.0) 1421 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T21:07:28.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:27 gibba023 bash[31815]: audit 2021-03-10T21:07:27.431313+0000 mon.a (mon.0) 1416 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:07:28.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:27 gibba023 bash[31815]: audit 2021-03-10T21:07:27.432022+0000 mon.a (mon.0) 1417 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:07:28.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:27 gibba023 bash[31815]: audit 2021-03-10T21:07:27.433272+0000 mon.a (mon.0) 1418 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T21:07:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:27 gibba023 bash[31815]: audit 2021-03-10T21:07:27.434028+0000 mon.a (mon.0) 1419 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2021-03-10T21:07:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:27 gibba023 bash[31815]: audit 2021-03-10T21:07:27.434799+0000 mon.a (mon.0) 1420 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2021-03-10T21:07:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:27 gibba023 bash[31815]: audit 2021-03-10T21:07:27.435480+0000 mon.a (mon.0) 1421 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2021-03-10T21:07:29.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:28 gibba044 bash[25485]: cluster 2021-03-10T21:07:27.868192+0000 mgr.gibba044.wflcwh (mgr.34466) 3150 : cluster [DBG] pgmap v1784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:29.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:28 gibba023 bash[30844]: cluster 2021-03-10T21:07:27.868192+0000 mgr.gibba044.wflcwh (mgr.34466) 3150 : cluster [DBG] pgmap v1784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:29.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:28 gibba023 bash[31815]: cluster 2021-03-10T21:07:27.868192+0000 mgr.gibba044.wflcwh (mgr.34466) 3150 : cluster [DBG] pgmap v1784: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:31.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:30 gibba044 bash[25485]: cluster 2021-03-10T21:07:29.869428+0000 mgr.gibba044.wflcwh (mgr.34466) 3151 : cluster [DBG] pgmap v1785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:31.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:30 gibba023 bash[30844]: cluster 2021-03-10T21:07:29.869428+0000 mgr.gibba044.wflcwh (mgr.34466) 3151 : cluster [DBG] pgmap v1785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:31.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:30 gibba023 bash[31815]: cluster 2021-03-10T21:07:29.869428+0000 mgr.gibba044.wflcwh (mgr.34466) 3151 : cluster [DBG] pgmap v1785: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:33.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:32 gibba044 bash[25485]: cluster 2021-03-10T21:07:31.870828+0000 mgr.gibba044.wflcwh (mgr.34466) 3152 : cluster [DBG] pgmap v1786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:33.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:32 gibba023 bash[30844]: cluster 2021-03-10T21:07:31.870828+0000 mgr.gibba044.wflcwh (mgr.34466) 3152 : cluster [DBG] pgmap v1786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:33.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:32 gibba023 bash[31815]: cluster 2021-03-10T21:07:31.870828+0000 mgr.gibba044.wflcwh (mgr.34466) 3152 : cluster [DBG] pgmap v1786: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:34.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:33 gibba044 bash[25485]: cephadm 2021-03-10T21:07:32.763818+0000 mgr.gibba044.wflcwh (mgr.34466) 3153 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:07:34.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:33 gibba023 bash[30844]: cephadm 2021-03-10T21:07:32.763818+0000 mgr.gibba044.wflcwh (mgr.34466) 3153 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:07:34.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:33 gibba023 bash[31815]: cephadm 2021-03-10T21:07:32.763818+0000 mgr.gibba044.wflcwh (mgr.34466) 3153 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:07:35.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:34 gibba044 bash[25485]: cluster 2021-03-10T21:07:33.872693+0000 mgr.gibba044.wflcwh (mgr.34466) 3154 : cluster [DBG] pgmap v1787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:35.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:34 gibba023 bash[30844]: cluster 2021-03-10T21:07:33.872693+0000 mgr.gibba044.wflcwh (mgr.34466) 3154 : cluster [DBG] pgmap v1787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:35.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:34 gibba023 bash[31815]: cluster 2021-03-10T21:07:33.872693+0000 mgr.gibba044.wflcwh (mgr.34466) 3154 : cluster [DBG] pgmap v1787: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:37.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:37 gibba023 bash[30844]: cluster 2021-03-10T21:07:35.874310+0000 mgr.gibba044.wflcwh (mgr.34466) 3155 : cluster [DBG] pgmap v1788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:37.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:37 gibba023 bash[31815]: cluster 2021-03-10T21:07:35.874310+0000 mgr.gibba044.wflcwh (mgr.34466) 3155 : cluster [DBG] pgmap v1788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:37.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:37 gibba044 bash[25485]: cluster 2021-03-10T21:07:35.874310+0000 mgr.gibba044.wflcwh (mgr.34466) 3155 : cluster [DBG] pgmap v1788: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:38.833 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T21:07:39.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:38 gibba044 bash[25485]: cluster 2021-03-10T21:07:37.876128+0000 mgr.gibba044.wflcwh (mgr.34466) 3156 : cluster [DBG] pgmap v1789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:39.070 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:07:39.070 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (58m) 3m ago 64m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T21:07:39.070 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (64m) 2m ago 64m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T21:07:39.071 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (59m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T21:07:39.071 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (59m) 2m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T21:07:39.071 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (58m) 3m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T21:07:39.071 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (58m) 3m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T21:07:39.071 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (57m) 2m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T21:07:39.072 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (58m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T21:07:39.072 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (64m) 3m ago 64m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T21:07:39.072 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (64m) 2m ago 64m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T21:07:39.072 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (57m) 3m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T21:07:39.073 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (56m) 3m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T21:07:39.073 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (56m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T21:07:39.073 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (55m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T21:07:39.073 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (55m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T21:07:39.073 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (54m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T21:07:39.074 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (54m) 2m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T21:07:39.074 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (53m) 2m ago 64m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T21:07:39.074 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (63m) 2m ago 64m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T21:07:39.074 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 3m ago 62m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:07:39.075 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 2m ago 62m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:07:39.177 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:38 gibba023 bash[30844]: cluster 2021-03-10T21:07:37.876128+0000 mgr.gibba044.wflcwh (mgr.34466) 3156 : cluster [DBG] pgmap v1789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:39.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:38 gibba023 bash[31815]: cluster 2021-03-10T21:07:37.876128+0000 mgr.gibba044.wflcwh (mgr.34466) 3156 : cluster [DBG] pgmap v1789: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:39.322 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T21:07:39.322 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T21:07:39.322 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:07:39.323 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:07:39.323 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T21:07:39.323 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:07:39.323 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:07:39.324 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T21:07:39.324 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:07:39.324 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:07:39.324 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T21:07:39.324 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T21:07:39.325 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:07:39.325 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T21:07:39.325 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T21:07:40.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:39 gibba044 bash[25485]: audit 2021-03-10T21:07:38.821146+0000 mgr.gibba044.wflcwh (mgr.34466) 3157 : audit [DBG] from='client.46182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:07:40.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:39 gibba044 bash[25485]: audit 2021-03-10T21:07:39.054354+0000 mgr.gibba044.wflcwh (mgr.34466) 3158 : audit [DBG] from='client.46188 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:07:40.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:39 gibba044 bash[25485]: audit 2021-03-10T21:07:39.317994+0000 mon.a (mon.0) 1422 : audit [DBG] from='client.? 172.21.2.123:0/392428142' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:40.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:39 gibba023 bash[30844]: audit 2021-03-10T21:07:38.821146+0000 mgr.gibba044.wflcwh (mgr.34466) 3157 : audit [DBG] from='client.46182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:07:40.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:39 gibba023 bash[30844]: audit 2021-03-10T21:07:39.054354+0000 mgr.gibba044.wflcwh (mgr.34466) 3158 : audit [DBG] from='client.46188 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:07:40.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:39 gibba023 bash[30844]: audit 2021-03-10T21:07:39.317994+0000 mon.a (mon.0) 1422 : audit [DBG] from='client.? 172.21.2.123:0/392428142' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:40.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:39 gibba023 bash[31815]: audit 2021-03-10T21:07:38.821146+0000 mgr.gibba044.wflcwh (mgr.34466) 3157 : audit [DBG] from='client.46182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:07:40.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:39 gibba023 bash[31815]: audit 2021-03-10T21:07:39.054354+0000 mgr.gibba044.wflcwh (mgr.34466) 3158 : audit [DBG] from='client.46188 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:07:40.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:39 gibba023 bash[31815]: audit 2021-03-10T21:07:39.317994+0000 mon.a (mon.0) 1422 : audit [DBG] from='client.? 172.21.2.123:0/392428142' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:41.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:40 gibba044 bash[25485]: cluster 2021-03-10T21:07:39.877556+0000 mgr.gibba044.wflcwh (mgr.34466) 3159 : cluster [DBG] pgmap v1790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:41.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:40 gibba023 bash[30844]: cluster 2021-03-10T21:07:39.877556+0000 mgr.gibba044.wflcwh (mgr.34466) 3159 : cluster [DBG] pgmap v1790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:41.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:40 gibba023 bash[31815]: cluster 2021-03-10T21:07:39.877556+0000 mgr.gibba044.wflcwh (mgr.34466) 3159 : cluster [DBG] pgmap v1790: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:43.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:42 gibba044 bash[25485]: cluster 2021-03-10T21:07:41.879355+0000 mgr.gibba044.wflcwh (mgr.34466) 3160 : cluster [DBG] pgmap v1791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:43.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:42 gibba023 bash[30844]: cluster 2021-03-10T21:07:41.879355+0000 mgr.gibba044.wflcwh (mgr.34466) 3160 : cluster [DBG] pgmap v1791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:43.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:42 gibba023 bash[31815]: cluster 2021-03-10T21:07:41.879355+0000 mgr.gibba044.wflcwh (mgr.34466) 3160 : cluster [DBG] pgmap v1791: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:45.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:44 gibba044 bash[25485]: cluster 2021-03-10T21:07:43.881114+0000 mgr.gibba044.wflcwh (mgr.34466) 3161 : cluster [DBG] pgmap v1792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:45.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:44 gibba023 bash[30844]: cluster 2021-03-10T21:07:43.881114+0000 mgr.gibba044.wflcwh (mgr.34466) 3161 : cluster [DBG] pgmap v1792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:45.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:44 gibba023 bash[31815]: cluster 2021-03-10T21:07:43.881114+0000 mgr.gibba044.wflcwh (mgr.34466) 3161 : cluster [DBG] pgmap v1792: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:47.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:46 gibba044 bash[25485]: cluster 2021-03-10T21:07:45.883012+0000 mgr.gibba044.wflcwh (mgr.34466) 3162 : cluster [DBG] pgmap v1793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:47.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:46 gibba023 bash[30844]: cluster 2021-03-10T21:07:45.883012+0000 mgr.gibba044.wflcwh (mgr.34466) 3162 : cluster [DBG] pgmap v1793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:47.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:46 gibba023 bash[31815]: cluster 2021-03-10T21:07:45.883012+0000 mgr.gibba044.wflcwh (mgr.34466) 3162 : cluster [DBG] pgmap v1793: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:49.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[30844]: cephadm 2021-03-10T21:07:47.780359+0000 mgr.gibba044.wflcwh (mgr.34466) 3163 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:07:49.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[30844]: cephadm 2021-03-10T21:07:47.781962+0000 mgr.gibba044.wflcwh (mgr.34466) 3164 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:07:49.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[30844]: cluster 2021-03-10T21:07:47.883739+0000 mgr.gibba044.wflcwh (mgr.34466) 3165 : cluster [DBG] pgmap v1794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:49.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[30844]: audit 2021-03-10T21:07:48.053080+0000 mon.a (mon.0) 1423 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:07:49.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[30844]: cephadm 2021-03-10T21:07:48.056516+0000 mgr.gibba044.wflcwh (mgr.34466) 3166 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:07:49.432 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[30844]: audit 2021-03-10T21:07:48.056664+0000 mon.a (mon.0) 1424 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:07:49.432 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[30844]: audit 2021-03-10T21:07:48.058356+0000 mon.a (mon.0) 1425 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:49.432 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[30844]: cephadm 2021-03-10T21:07:48.058485+0000 mgr.gibba044.wflcwh (mgr.34466) 3167 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:07:49.433 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[30844]: audit 2021-03-10T21:07:48.059908+0000 mon.a (mon.0) 1426 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:49.433 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[30844]: cephadm 2021-03-10T21:07:48.060009+0000 mgr.gibba044.wflcwh (mgr.34466) 3168 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:07:49.434 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[30844]: cephadm 2021-03-10T21:07:48.060046+0000 mgr.gibba044.wflcwh (mgr.34466) 3169 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:07:49.434 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[30844]: audit 2021-03-10T21:07:48.061413+0000 mon.a (mon.0) 1427 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:49.435 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[30844]: cephadm 2021-03-10T21:07:48.061595+0000 mgr.gibba044.wflcwh (mgr.34466) 3170 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:07:49.435 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[30844]: cephadm 2021-03-10T21:07:48.061632+0000 mgr.gibba044.wflcwh (mgr.34466) 3171 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:07:49.436 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[30844]: cephadm 2021-03-10T21:07:48.063036+0000 mgr.gibba044.wflcwh (mgr.34466) 3172 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:07:49.436 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[30844]: audit 2021-03-10T21:07:48.064195+0000 mon.a (mon.0) 1428 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:49.436 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[30844]: cephadm 2021-03-10T21:07:48.064253+0000 mgr.gibba044.wflcwh (mgr.34466) 3173 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:07:49.437 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[30844]: cephadm 2021-03-10T21:07:48.064288+0000 mgr.gibba044.wflcwh (mgr.34466) 3174 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:07:49.438 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[30844]: cephadm 2021-03-10T21:07:48.065742+0000 mgr.gibba044.wflcwh (mgr.34466) 3175 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:07:49.438 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[30844]: audit 2021-03-10T21:07:48.065814+0000 mon.a (mon.0) 1429 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:49.439 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[31815]: cephadm 2021-03-10T21:07:47.780359+0000 mgr.gibba044.wflcwh (mgr.34466) 3163 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:07:49.439 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[31815]: cephadm 2021-03-10T21:07:47.781962+0000 mgr.gibba044.wflcwh (mgr.34466) 3164 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:07:49.440 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[31815]: cluster 2021-03-10T21:07:47.883739+0000 mgr.gibba044.wflcwh (mgr.34466) 3165 : cluster [DBG] pgmap v1794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:49.441 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[31815]: audit 2021-03-10T21:07:48.053080+0000 mon.a (mon.0) 1423 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:07:49.441 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[31815]: cephadm 2021-03-10T21:07:48.056516+0000 mgr.gibba044.wflcwh (mgr.34466) 3166 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:07:49.441 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[31815]: audit 2021-03-10T21:07:48.056664+0000 mon.a (mon.0) 1424 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:07:49.441 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[31815]: audit 2021-03-10T21:07:48.058356+0000 mon.a (mon.0) 1425 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:49.442 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[31815]: cephadm 2021-03-10T21:07:48.058485+0000 mgr.gibba044.wflcwh (mgr.34466) 3167 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:07:49.442 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[31815]: audit 2021-03-10T21:07:48.059908+0000 mon.a (mon.0) 1426 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:49.443 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[31815]: cephadm 2021-03-10T21:07:48.060009+0000 mgr.gibba044.wflcwh (mgr.34466) 3168 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:07:49.443 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[31815]: cephadm 2021-03-10T21:07:48.060046+0000 mgr.gibba044.wflcwh (mgr.34466) 3169 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:07:49.444 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[31815]: audit 2021-03-10T21:07:48.061413+0000 mon.a (mon.0) 1427 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:49.444 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[31815]: cephadm 2021-03-10T21:07:48.061595+0000 mgr.gibba044.wflcwh (mgr.34466) 3170 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:07:49.445 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[31815]: cephadm 2021-03-10T21:07:48.061632+0000 mgr.gibba044.wflcwh (mgr.34466) 3171 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:07:49.445 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[31815]: cephadm 2021-03-10T21:07:48.063036+0000 mgr.gibba044.wflcwh (mgr.34466) 3172 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:07:49.446 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[31815]: audit 2021-03-10T21:07:48.064195+0000 mon.a (mon.0) 1428 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:49.446 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[31815]: cephadm 2021-03-10T21:07:48.064253+0000 mgr.gibba044.wflcwh (mgr.34466) 3173 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:07:49.447 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[31815]: cephadm 2021-03-10T21:07:48.064288+0000 mgr.gibba044.wflcwh (mgr.34466) 3174 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:07:49.447 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[31815]: cephadm 2021-03-10T21:07:48.065742+0000 mgr.gibba044.wflcwh (mgr.34466) 3175 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:07:49.448 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[31815]: audit 2021-03-10T21:07:48.065814+0000 mon.a (mon.0) 1429 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:49.449 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[30844]: cephadm 2021-03-10T21:07:48.066059+0000 mgr.gibba044.wflcwh (mgr.34466) 3176 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:07:49.449 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[30844]: cephadm 2021-03-10T21:07:48.067559+0000 mgr.gibba044.wflcwh (mgr.34466) 3177 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:07:49.450 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[30844]: cephadm 2021-03-10T21:07:48.067603+0000 mgr.gibba044.wflcwh (mgr.34466) 3178 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:07:49.450 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[30844]: cephadm 2021-03-10T21:07:48.067795+0000 mgr.gibba044.wflcwh (mgr.34466) 3179 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:07:49.451 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[31815]: cephadm 2021-03-10T21:07:48.066059+0000 mgr.gibba044.wflcwh (mgr.34466) 3176 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:07:49.452 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[31815]: cephadm 2021-03-10T21:07:48.067559+0000 mgr.gibba044.wflcwh (mgr.34466) 3177 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:07:49.452 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[31815]: cephadm 2021-03-10T21:07:48.067603+0000 mgr.gibba044.wflcwh (mgr.34466) 3178 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:07:49.452 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:49 gibba023 bash[31815]: cephadm 2021-03-10T21:07:48.067795+0000 mgr.gibba044.wflcwh (mgr.34466) 3179 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:07:49.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:49 gibba044 bash[25485]: cephadm 2021-03-10T21:07:47.780359+0000 mgr.gibba044.wflcwh (mgr.34466) 3163 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:07:49.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:49 gibba044 bash[25485]: cephadm 2021-03-10T21:07:47.781962+0000 mgr.gibba044.wflcwh (mgr.34466) 3164 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:07:49.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:49 gibba044 bash[25485]: cluster 2021-03-10T21:07:47.883739+0000 mgr.gibba044.wflcwh (mgr.34466) 3165 : cluster [DBG] pgmap v1794: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:49.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:49 gibba044 bash[25485]: audit 2021-03-10T21:07:48.053080+0000 mon.a (mon.0) 1423 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:07:49.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:49 gibba044 bash[25485]: cephadm 2021-03-10T21:07:48.056516+0000 mgr.gibba044.wflcwh (mgr.34466) 3166 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:07:49.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:49 gibba044 bash[25485]: audit 2021-03-10T21:07:48.056664+0000 mon.a (mon.0) 1424 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:07:49.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:49 gibba044 bash[25485]: audit 2021-03-10T21:07:48.058356+0000 mon.a (mon.0) 1425 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:49.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:49 gibba044 bash[25485]: cephadm 2021-03-10T21:07:48.058485+0000 mgr.gibba044.wflcwh (mgr.34466) 3167 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:07:49.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:49 gibba044 bash[25485]: audit 2021-03-10T21:07:48.059908+0000 mon.a (mon.0) 1426 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:49.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:49 gibba044 bash[25485]: cephadm 2021-03-10T21:07:48.060009+0000 mgr.gibba044.wflcwh (mgr.34466) 3168 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:07:49.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:49 gibba044 bash[25485]: cephadm 2021-03-10T21:07:48.060046+0000 mgr.gibba044.wflcwh (mgr.34466) 3169 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:07:49.508 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:49 gibba044 bash[25485]: audit 2021-03-10T21:07:48.061413+0000 mon.a (mon.0) 1427 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:49.508 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:49 gibba044 bash[25485]: cephadm 2021-03-10T21:07:48.061595+0000 mgr.gibba044.wflcwh (mgr.34466) 3170 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:07:49.508 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:49 gibba044 bash[25485]: cephadm 2021-03-10T21:07:48.061632+0000 mgr.gibba044.wflcwh (mgr.34466) 3171 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:07:49.508 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:49 gibba044 bash[25485]: cephadm 2021-03-10T21:07:48.063036+0000 mgr.gibba044.wflcwh (mgr.34466) 3172 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:07:49.508 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:49 gibba044 bash[25485]: audit 2021-03-10T21:07:48.064195+0000 mon.a (mon.0) 1428 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:49.509 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:49 gibba044 bash[25485]: cephadm 2021-03-10T21:07:48.064253+0000 mgr.gibba044.wflcwh (mgr.34466) 3173 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:07:49.509 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:49 gibba044 bash[25485]: cephadm 2021-03-10T21:07:48.064288+0000 mgr.gibba044.wflcwh (mgr.34466) 3174 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:07:49.509 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:49 gibba044 bash[25485]: cephadm 2021-03-10T21:07:48.065742+0000 mgr.gibba044.wflcwh (mgr.34466) 3175 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:07:49.509 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:49 gibba044 bash[25485]: audit 2021-03-10T21:07:48.065814+0000 mon.a (mon.0) 1429 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:07:49.510 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:49 gibba044 bash[25485]: cephadm 2021-03-10T21:07:48.066059+0000 mgr.gibba044.wflcwh (mgr.34466) 3176 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:07:49.510 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:49 gibba044 bash[25485]: cephadm 2021-03-10T21:07:48.067559+0000 mgr.gibba044.wflcwh (mgr.34466) 3177 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:07:49.510 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:49 gibba044 bash[25485]: cephadm 2021-03-10T21:07:48.067603+0000 mgr.gibba044.wflcwh (mgr.34466) 3178 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:07:49.510 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:49 gibba044 bash[25485]: cephadm 2021-03-10T21:07:48.067795+0000 mgr.gibba044.wflcwh (mgr.34466) 3179 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:07:51.440 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:51 gibba023 bash[30844]: cluster 2021-03-10T21:07:49.884854+0000 mgr.gibba044.wflcwh (mgr.34466) 3180 : cluster [DBG] pgmap v1795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:51.445 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:51 gibba023 bash[31815]: cluster 2021-03-10T21:07:49.884854+0000 mgr.gibba044.wflcwh (mgr.34466) 3180 : cluster [DBG] pgmap v1795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:51.517 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:51 gibba044 bash[25485]: cluster 2021-03-10T21:07:49.884854+0000 mgr.gibba044.wflcwh (mgr.34466) 3180 : cluster [DBG] pgmap v1795: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:53.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:53 gibba023 bash[30844]: cluster 2021-03-10T21:07:51.886328+0000 mgr.gibba044.wflcwh (mgr.34466) 3181 : cluster [DBG] pgmap v1796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:53.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:53 gibba023 bash[31815]: cluster 2021-03-10T21:07:51.886328+0000 mgr.gibba044.wflcwh (mgr.34466) 3181 : cluster [DBG] pgmap v1796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:53.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:53 gibba044 bash[25485]: cluster 2021-03-10T21:07:51.886328+0000 mgr.gibba044.wflcwh (mgr.34466) 3181 : cluster [DBG] pgmap v1796: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:55.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:55 gibba023 bash[30844]: cluster 2021-03-10T21:07:53.888189+0000 mgr.gibba044.wflcwh (mgr.34466) 3182 : cluster [DBG] pgmap v1797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:55.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:55 gibba023 bash[31815]: cluster 2021-03-10T21:07:53.888189+0000 mgr.gibba044.wflcwh (mgr.34466) 3182 : cluster [DBG] pgmap v1797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:55.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:55 gibba044 bash[25485]: cluster 2021-03-10T21:07:53.888189+0000 mgr.gibba044.wflcwh (mgr.34466) 3182 : cluster [DBG] pgmap v1797: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:57.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:57 gibba023 bash[30844]: cluster 2021-03-10T21:07:55.889828+0000 mgr.gibba044.wflcwh (mgr.34466) 3183 : cluster [DBG] pgmap v1798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:57.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:57 gibba023 bash[31815]: cluster 2021-03-10T21:07:55.889828+0000 mgr.gibba044.wflcwh (mgr.34466) 3183 : cluster [DBG] pgmap v1798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:57.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:57 gibba044 bash[25485]: cluster 2021-03-10T21:07:55.889828+0000 mgr.gibba044.wflcwh (mgr.34466) 3183 : cluster [DBG] pgmap v1798: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:59.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:07:58 gibba044 bash[25485]: cluster 2021-03-10T21:07:57.891534+0000 mgr.gibba044.wflcwh (mgr.34466) 3184 : cluster [DBG] pgmap v1799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:59.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:07:58 gibba023 bash[30844]: cluster 2021-03-10T21:07:57.891534+0000 mgr.gibba044.wflcwh (mgr.34466) 3184 : cluster [DBG] pgmap v1799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:07:59.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:07:58 gibba023 bash[31815]: cluster 2021-03-10T21:07:57.891534+0000 mgr.gibba044.wflcwh (mgr.34466) 3184 : cluster [DBG] pgmap v1799: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:01.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:00 gibba044 bash[25485]: cluster 2021-03-10T21:07:59.892786+0000 mgr.gibba044.wflcwh (mgr.34466) 3185 : cluster [DBG] pgmap v1800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:01.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:00 gibba023 bash[30844]: cluster 2021-03-10T21:07:59.892786+0000 mgr.gibba044.wflcwh (mgr.34466) 3185 : cluster [DBG] pgmap v1800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:01.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:00 gibba023 bash[31815]: cluster 2021-03-10T21:07:59.892786+0000 mgr.gibba044.wflcwh (mgr.34466) 3185 : cluster [DBG] pgmap v1800: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:03.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:02 gibba044 bash[25485]: cluster 2021-03-10T21:08:01.894338+0000 mgr.gibba044.wflcwh (mgr.34466) 3186 : cluster [DBG] pgmap v1801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:03.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:02 gibba023 bash[30844]: cluster 2021-03-10T21:08:01.894338+0000 mgr.gibba044.wflcwh (mgr.34466) 3186 : cluster [DBG] pgmap v1801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:03.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:02 gibba023 bash[31815]: cluster 2021-03-10T21:08:01.894338+0000 mgr.gibba044.wflcwh (mgr.34466) 3186 : cluster [DBG] pgmap v1801: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:04.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:03 gibba044 bash[25485]: cephadm 2021-03-10T21:08:03.080384+0000 mgr.gibba044.wflcwh (mgr.34466) 3187 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:08:04.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:03 gibba023 bash[30844]: cephadm 2021-03-10T21:08:03.080384+0000 mgr.gibba044.wflcwh (mgr.34466) 3187 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:08:04.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:03 gibba023 bash[31815]: cephadm 2021-03-10T21:08:03.080384+0000 mgr.gibba044.wflcwh (mgr.34466) 3187 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:08:05.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:04 gibba044 bash[25485]: cluster 2021-03-10T21:08:03.895927+0000 mgr.gibba044.wflcwh (mgr.34466) 3188 : cluster [DBG] pgmap v1802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:05.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:04 gibba023 bash[30844]: cluster 2021-03-10T21:08:03.895927+0000 mgr.gibba044.wflcwh (mgr.34466) 3188 : cluster [DBG] pgmap v1802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:05.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:04 gibba023 bash[31815]: cluster 2021-03-10T21:08:03.895927+0000 mgr.gibba044.wflcwh (mgr.34466) 3188 : cluster [DBG] pgmap v1802: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:07.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:06 gibba044 bash[25485]: cluster 2021-03-10T21:08:05.897661+0000 mgr.gibba044.wflcwh (mgr.34466) 3189 : cluster [DBG] pgmap v1803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:07.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:06 gibba023 bash[30844]: cluster 2021-03-10T21:08:05.897661+0000 mgr.gibba044.wflcwh (mgr.34466) 3189 : cluster [DBG] pgmap v1803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:07.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:06 gibba023 bash[31815]: cluster 2021-03-10T21:08:05.897661+0000 mgr.gibba044.wflcwh (mgr.34466) 3189 : cluster [DBG] pgmap v1803: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:09.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:08 gibba044 bash[25485]: cluster 2021-03-10T21:08:07.899116+0000 mgr.gibba044.wflcwh (mgr.34466) 3190 : cluster [DBG] pgmap v1804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:09.183 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:08 gibba023 bash[30844]: cluster 2021-03-10T21:08:07.899116+0000 mgr.gibba044.wflcwh (mgr.34466) 3190 : cluster [DBG] pgmap v1804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:09.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:08 gibba023 bash[31815]: cluster 2021-03-10T21:08:07.899116+0000 mgr.gibba044.wflcwh (mgr.34466) 3190 : cluster [DBG] pgmap v1804: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:09.567 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T21:08:09.826 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:08:09.827 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (59m) 4m ago 64m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T21:08:09.827 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (64m) 3m ago 64m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T21:08:09.827 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (59m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T21:08:09.828 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (59m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T21:08:09.828 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (58m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T21:08:09.828 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (58m) 4m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T21:08:09.828 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (58m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T21:08:09.828 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (58m) 4m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T21:08:09.829 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (64m) 4m ago 65m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T21:08:09.829 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (64m) 3m ago 65m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T21:08:09.829 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (57m) 4m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T21:08:09.829 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (57m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T21:08:09.830 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (56m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T21:08:09.834 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (56m) 4m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T21:08:09.835 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (55m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T21:08:09.835 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (55m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T21:08:09.835 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (54m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T21:08:09.835 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (54m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T21:08:09.836 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (64m) 3m ago 65m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T21:08:09.836 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 4m ago 62m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:08:09.836 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 3m ago 62m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:08:10.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:09 gibba044 bash[25485]: audit 2021-03-10T21:08:09.556096+0000 mgr.gibba044.wflcwh (mgr.34466) 3191 : audit [DBG] from='client.46200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:08:10.088 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T21:08:10.089 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T21:08:10.089 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:08:10.089 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:08:10.089 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T21:08:10.090 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:08:10.090 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:08:10.090 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T21:08:10.090 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:08:10.091 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:08:10.091 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T21:08:10.091 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T21:08:10.091 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:08:10.091 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T21:08:10.092 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T21:08:10.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:09 gibba023 bash[30844]: audit 2021-03-10T21:08:09.556096+0000 mgr.gibba044.wflcwh (mgr.34466) 3191 : audit [DBG] from='client.46200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:08:10.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:09 gibba023 bash[31815]: audit 2021-03-10T21:08:09.556096+0000 mgr.gibba044.wflcwh (mgr.34466) 3191 : audit [DBG] from='client.46200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:08:11.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:10 gibba044 bash[25485]: audit 2021-03-10T21:08:09.784704+0000 mgr.gibba044.wflcwh (mgr.34466) 3192 : audit [DBG] from='client.56185 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:08:11.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:10 gibba044 bash[25485]: cluster 2021-03-10T21:08:09.900508+0000 mgr.gibba044.wflcwh (mgr.34466) 3193 : cluster [DBG] pgmap v1805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:11.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:10 gibba044 bash[25485]: audit 2021-03-10T21:08:10.085275+0000 mon.a (mon.0) 1430 : audit [DBG] from='client.? 172.21.2.123:0/3140869776' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:11.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:10 gibba023 bash[30844]: audit 2021-03-10T21:08:09.784704+0000 mgr.gibba044.wflcwh (mgr.34466) 3192 : audit [DBG] from='client.56185 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:08:11.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:10 gibba023 bash[30844]: cluster 2021-03-10T21:08:09.900508+0000 mgr.gibba044.wflcwh (mgr.34466) 3193 : cluster [DBG] pgmap v1805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:11.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:10 gibba023 bash[30844]: audit 2021-03-10T21:08:10.085275+0000 mon.a (mon.0) 1430 : audit [DBG] from='client.? 172.21.2.123:0/3140869776' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:11.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:10 gibba023 bash[31815]: audit 2021-03-10T21:08:09.784704+0000 mgr.gibba044.wflcwh (mgr.34466) 3192 : audit [DBG] from='client.56185 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:08:11.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:10 gibba023 bash[31815]: cluster 2021-03-10T21:08:09.900508+0000 mgr.gibba044.wflcwh (mgr.34466) 3193 : cluster [DBG] pgmap v1805: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:11.180 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:10 gibba023 bash[31815]: audit 2021-03-10T21:08:10.085275+0000 mon.a (mon.0) 1430 : audit [DBG] from='client.? 172.21.2.123:0/3140869776' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:13.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:12 gibba044 bash[25485]: cluster 2021-03-10T21:08:11.901813+0000 mgr.gibba044.wflcwh (mgr.34466) 3194 : cluster [DBG] pgmap v1806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:13.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:12 gibba023 bash[30844]: cluster 2021-03-10T21:08:11.901813+0000 mgr.gibba044.wflcwh (mgr.34466) 3194 : cluster [DBG] pgmap v1806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:13.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:12 gibba023 bash[31815]: cluster 2021-03-10T21:08:11.901813+0000 mgr.gibba044.wflcwh (mgr.34466) 3194 : cluster [DBG] pgmap v1806: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:15.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:14 gibba044 bash[25485]: cluster 2021-03-10T21:08:13.902720+0000 mgr.gibba044.wflcwh (mgr.34466) 3195 : cluster [DBG] pgmap v1807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:15.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:14 gibba023 bash[30844]: cluster 2021-03-10T21:08:13.902720+0000 mgr.gibba044.wflcwh (mgr.34466) 3195 : cluster [DBG] pgmap v1807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:15.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:14 gibba023 bash[31815]: cluster 2021-03-10T21:08:13.902720+0000 mgr.gibba044.wflcwh (mgr.34466) 3195 : cluster [DBG] pgmap v1807: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:17.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:16 gibba044 bash[25485]: cluster 2021-03-10T21:08:15.904364+0000 mgr.gibba044.wflcwh (mgr.34466) 3196 : cluster [DBG] pgmap v1808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:17.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:16 gibba023 bash[30844]: cluster 2021-03-10T21:08:15.904364+0000 mgr.gibba044.wflcwh (mgr.34466) 3196 : cluster [DBG] pgmap v1808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:17.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:16 gibba023 bash[31815]: cluster 2021-03-10T21:08:15.904364+0000 mgr.gibba044.wflcwh (mgr.34466) 3196 : cluster [DBG] pgmap v1808: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:19.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:18 gibba044 bash[25485]: cluster 2021-03-10T21:08:17.905748+0000 mgr.gibba044.wflcwh (mgr.34466) 3197 : cluster [DBG] pgmap v1809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:19.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:18 gibba044 bash[25485]: cephadm 2021-03-10T21:08:18.096378+0000 mgr.gibba044.wflcwh (mgr.34466) 3198 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:08:19.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:18 gibba023 bash[30844]: cluster 2021-03-10T21:08:17.905748+0000 mgr.gibba044.wflcwh (mgr.34466) 3197 : cluster [DBG] pgmap v1809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:19.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:18 gibba023 bash[30844]: cephadm 2021-03-10T21:08:18.096378+0000 mgr.gibba044.wflcwh (mgr.34466) 3198 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:08:19.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:18 gibba023 bash[31815]: cluster 2021-03-10T21:08:17.905748+0000 mgr.gibba044.wflcwh (mgr.34466) 3197 : cluster [DBG] pgmap v1809: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:19.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:18 gibba023 bash[31815]: cephadm 2021-03-10T21:08:18.096378+0000 mgr.gibba044.wflcwh (mgr.34466) 3198 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:08:21.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:20 gibba044 bash[25485]: cluster 2021-03-10T21:08:19.906892+0000 mgr.gibba044.wflcwh (mgr.34466) 3199 : cluster [DBG] pgmap v1810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:21.433 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:20 gibba023 bash[30844]: cluster 2021-03-10T21:08:19.906892+0000 mgr.gibba044.wflcwh (mgr.34466) 3199 : cluster [DBG] pgmap v1810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:21.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:20 gibba023 bash[31815]: cluster 2021-03-10T21:08:19.906892+0000 mgr.gibba044.wflcwh (mgr.34466) 3199 : cluster [DBG] pgmap v1810: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:23.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:22 gibba044 bash[25485]: cluster 2021-03-10T21:08:21.908517+0000 mgr.gibba044.wflcwh (mgr.34466) 3200 : cluster [DBG] pgmap v1811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:23.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:22 gibba023 bash[30844]: cluster 2021-03-10T21:08:21.908517+0000 mgr.gibba044.wflcwh (mgr.34466) 3200 : cluster [DBG] pgmap v1811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:23.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:22 gibba023 bash[31815]: cluster 2021-03-10T21:08:21.908517+0000 mgr.gibba044.wflcwh (mgr.34466) 3200 : cluster [DBG] pgmap v1811: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:25.258 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:24 gibba044 bash[25485]: cluster 2021-03-10T21:08:23.909324+0000 mgr.gibba044.wflcwh (mgr.34466) 3201 : cluster [DBG] pgmap v1812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:25.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:24 gibba023 bash[30844]: cluster 2021-03-10T21:08:23.909324+0000 mgr.gibba044.wflcwh (mgr.34466) 3201 : cluster [DBG] pgmap v1812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:25.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:24 gibba023 bash[31815]: cluster 2021-03-10T21:08:23.909324+0000 mgr.gibba044.wflcwh (mgr.34466) 3201 : cluster [DBG] pgmap v1812: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:27.259 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:26 gibba044 bash[25485]: cluster 2021-03-10T21:08:25.910963+0000 mgr.gibba044.wflcwh (mgr.34466) 3202 : cluster [DBG] pgmap v1813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:27.435 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:26 gibba023 bash[30844]: cluster 2021-03-10T21:08:25.910963+0000 mgr.gibba044.wflcwh (mgr.34466) 3202 : cluster [DBG] pgmap v1813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:27.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:26 gibba023 bash[31815]: cluster 2021-03-10T21:08:25.910963+0000 mgr.gibba044.wflcwh (mgr.34466) 3202 : cluster [DBG] pgmap v1813: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:28.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:28 gibba044 bash[25485]: audit 2021-03-10T21:08:27.437851+0000 mon.a (mon.0) 1431 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:08:28.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:28 gibba044 bash[25485]: audit 2021-03-10T21:08:27.438528+0000 mon.a (mon.0) 1432 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:08:28.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:28 gibba044 bash[25485]: audit 2021-03-10T21:08:27.439120+0000 mon.a (mon.0) 1433 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T21:08:28.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:28 gibba044 bash[25485]: audit 2021-03-10T21:08:27.439891+0000 mon.a (mon.0) 1434 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T21:08:28.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:28 gibba044 bash[25485]: audit 2021-03-10T21:08:27.440594+0000 mon.a (mon.0) 1435 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:08:28.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:28 gibba044 bash[25485]: audit 2021-03-10T21:08:27.441295+0000 mon.a (mon.0) 1436 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T21:08:28.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:27 gibba023 bash[30844]: audit 2021-03-10T21:08:27.437851+0000 mon.a (mon.0) 1431 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:08:28.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:27 gibba023 bash[30844]: audit 2021-03-10T21:08:27.438528+0000 mon.a (mon.0) 1432 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:08:28.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:27 gibba023 bash[30844]: audit 2021-03-10T21:08:27.439120+0000 mon.a (mon.0) 1433 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T21:08:28.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:27 gibba023 bash[30844]: audit 2021-03-10T21:08:27.439891+0000 mon.a (mon.0) 1434 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T21:08:28.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:27 gibba023 bash[30844]: audit 2021-03-10T21:08:27.440594+0000 mon.a (mon.0) 1435 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:08:28.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:27 gibba023 bash[30844]: audit 2021-03-10T21:08:27.441295+0000 mon.a (mon.0) 1436 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T21:08:28.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:27 gibba023 bash[31815]: audit 2021-03-10T21:08:27.437851+0000 mon.a (mon.0) 1431 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:08:28.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:27 gibba023 bash[31815]: audit 2021-03-10T21:08:27.438528+0000 mon.a (mon.0) 1432 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:08:28.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:27 gibba023 bash[31815]: audit 2021-03-10T21:08:27.439120+0000 mon.a (mon.0) 1433 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T21:08:28.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:27 gibba023 bash[31815]: audit 2021-03-10T21:08:27.439891+0000 mon.a (mon.0) 1434 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2021-03-10T21:08:28.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:27 gibba023 bash[31815]: audit 2021-03-10T21:08:27.440594+0000 mon.a (mon.0) 1435 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:08:28.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:27 gibba023 bash[31815]: audit 2021-03-10T21:08:27.441295+0000 mon.a (mon.0) 1436 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2021-03-10T21:08:29.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:29 gibba023 bash[30844]: cluster 2021-03-10T21:08:27.912716+0000 mgr.gibba044.wflcwh (mgr.34466) 3203 : cluster [DBG] pgmap v1814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:29.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:29 gibba023 bash[31815]: cluster 2021-03-10T21:08:27.912716+0000 mgr.gibba044.wflcwh (mgr.34466) 3203 : cluster [DBG] pgmap v1814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:29.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:29 gibba044 bash[25485]: cluster 2021-03-10T21:08:27.912716+0000 mgr.gibba044.wflcwh (mgr.34466) 3203 : cluster [DBG] pgmap v1814: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:31.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:31 gibba023 bash[30844]: cluster 2021-03-10T21:08:29.913934+0000 mgr.gibba044.wflcwh (mgr.34466) 3204 : cluster [DBG] pgmap v1815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:31.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:31 gibba023 bash[31815]: cluster 2021-03-10T21:08:29.913934+0000 mgr.gibba044.wflcwh (mgr.34466) 3204 : cluster [DBG] pgmap v1815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:31.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:31 gibba044 bash[25485]: cluster 2021-03-10T21:08:29.913934+0000 mgr.gibba044.wflcwh (mgr.34466) 3204 : cluster [DBG] pgmap v1815: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:33.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:33 gibba023 bash[30844]: cluster 2021-03-10T21:08:31.915471+0000 mgr.gibba044.wflcwh (mgr.34466) 3205 : cluster [DBG] pgmap v1816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:33.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:33 gibba023 bash[31815]: cluster 2021-03-10T21:08:31.915471+0000 mgr.gibba044.wflcwh (mgr.34466) 3205 : cluster [DBG] pgmap v1816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:33.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:33 gibba044 bash[25485]: cluster 2021-03-10T21:08:31.915471+0000 mgr.gibba044.wflcwh (mgr.34466) 3205 : cluster [DBG] pgmap v1816: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:34.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:34 gibba023 bash[30844]: cephadm 2021-03-10T21:08:33.112369+0000 mgr.gibba044.wflcwh (mgr.34466) 3206 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:08:34.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:34 gibba023 bash[31815]: cephadm 2021-03-10T21:08:33.112369+0000 mgr.gibba044.wflcwh (mgr.34466) 3206 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:08:34.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:34 gibba044 bash[25485]: cephadm 2021-03-10T21:08:33.112369+0000 mgr.gibba044.wflcwh (mgr.34466) 3206 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:08:35.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:35 gibba023 bash[30844]: cluster 2021-03-10T21:08:33.916266+0000 mgr.gibba044.wflcwh (mgr.34466) 3207 : cluster [DBG] pgmap v1817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:35.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:35 gibba023 bash[31815]: cluster 2021-03-10T21:08:33.916266+0000 mgr.gibba044.wflcwh (mgr.34466) 3207 : cluster [DBG] pgmap v1817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:35.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:35 gibba044 bash[25485]: cluster 2021-03-10T21:08:33.916266+0000 mgr.gibba044.wflcwh (mgr.34466) 3207 : cluster [DBG] pgmap v1817: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:37.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:37 gibba023 bash[30844]: cluster 2021-03-10T21:08:35.916893+0000 mgr.gibba044.wflcwh (mgr.34466) 3208 : cluster [DBG] pgmap v1818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:37.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:37 gibba023 bash[31815]: cluster 2021-03-10T21:08:35.916893+0000 mgr.gibba044.wflcwh (mgr.34466) 3208 : cluster [DBG] pgmap v1818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:37.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:37 gibba044 bash[25485]: cluster 2021-03-10T21:08:35.916893+0000 mgr.gibba044.wflcwh (mgr.34466) 3208 : cluster [DBG] pgmap v1818: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:39.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:38 gibba044 bash[25485]: cluster 2021-03-10T21:08:37.918187+0000 mgr.gibba044.wflcwh (mgr.34466) 3209 : cluster [DBG] pgmap v1819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:39.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:38 gibba023 bash[30844]: cluster 2021-03-10T21:08:37.918187+0000 mgr.gibba044.wflcwh (mgr.34466) 3209 : cluster [DBG] pgmap v1819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:39.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:38 gibba023 bash[31815]: cluster 2021-03-10T21:08:37.918187+0000 mgr.gibba044.wflcwh (mgr.34466) 3209 : cluster [DBG] pgmap v1819: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:40.328 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T21:08:40.557 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:08:40.557 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (59m) 4m ago 65m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T21:08:40.557 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (65m) 3m ago 65m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T21:08:40.558 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (60m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T21:08:40.558 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (60m) 3m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T21:08:40.558 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (59m) 4m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T21:08:40.558 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (59m) 4m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T21:08:40.558 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (58m) 3m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T21:08:40.559 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (59m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T21:08:40.559 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (65m) 4m ago 65m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T21:08:40.559 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (65m) 3m ago 65m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T21:08:40.559 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (58m) 4m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T21:08:40.560 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (57m) 4m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T21:08:40.560 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (57m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T21:08:40.560 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (56m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T21:08:40.560 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (56m) 3m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T21:08:40.560 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (55m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T21:08:40.561 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (55m) 3m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T21:08:40.561 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (55m) 3m ago 65m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T21:08:40.561 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (64m) 3m ago 65m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T21:08:40.561 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 4m ago 63m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:08:40.562 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 3m ago 63m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:08:40.808 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T21:08:40.808 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T21:08:40.808 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:08:40.808 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:08:40.809 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T21:08:40.809 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:08:40.809 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:08:40.809 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T21:08:40.810 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:08:40.810 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:08:40.810 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T21:08:40.810 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T21:08:40.810 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:08:40.811 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T21:08:40.811 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T21:08:41.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:40 gibba044 bash[25485]: cluster 2021-03-10T21:08:39.919402+0000 mgr.gibba044.wflcwh (mgr.34466) 3210 : cluster [DBG] pgmap v1820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:41.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:40 gibba044 bash[25485]: audit 2021-03-10T21:08:40.316998+0000 mgr.gibba044.wflcwh (mgr.34466) 3211 : audit [DBG] from='client.46218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:08:41.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:40 gibba044 bash[25485]: audit 2021-03-10T21:08:40.541691+0000 mgr.gibba044.wflcwh (mgr.34466) 3212 : audit [DBG] from='client.56203 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:08:41.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:40 gibba044 bash[25485]: audit 2021-03-10T21:08:40.803355+0000 mon.c (mon.1) 71 : audit [DBG] from='client.? 172.21.2.123:0/810318763' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:41.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:40 gibba023 bash[30844]: cluster 2021-03-10T21:08:39.919402+0000 mgr.gibba044.wflcwh (mgr.34466) 3210 : cluster [DBG] pgmap v1820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:41.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:40 gibba023 bash[30844]: audit 2021-03-10T21:08:40.316998+0000 mgr.gibba044.wflcwh (mgr.34466) 3211 : audit [DBG] from='client.46218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:08:41.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:40 gibba023 bash[30844]: audit 2021-03-10T21:08:40.541691+0000 mgr.gibba044.wflcwh (mgr.34466) 3212 : audit [DBG] from='client.56203 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:08:41.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:40 gibba023 bash[30844]: audit 2021-03-10T21:08:40.803355+0000 mon.c (mon.1) 71 : audit [DBG] from='client.? 172.21.2.123:0/810318763' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:41.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:40 gibba023 bash[31815]: cluster 2021-03-10T21:08:39.919402+0000 mgr.gibba044.wflcwh (mgr.34466) 3210 : cluster [DBG] pgmap v1820: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:41.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:40 gibba023 bash[31815]: audit 2021-03-10T21:08:40.316998+0000 mgr.gibba044.wflcwh (mgr.34466) 3211 : audit [DBG] from='client.46218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:08:41.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:40 gibba023 bash[31815]: audit 2021-03-10T21:08:40.541691+0000 mgr.gibba044.wflcwh (mgr.34466) 3212 : audit [DBG] from='client.56203 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:08:41.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:40 gibba023 bash[31815]: audit 2021-03-10T21:08:40.803355+0000 mon.c (mon.1) 71 : audit [DBG] from='client.? 172.21.2.123:0/810318763' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:43.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:42 gibba044 bash[25485]: cluster 2021-03-10T21:08:41.920170+0000 mgr.gibba044.wflcwh (mgr.34466) 3213 : cluster [DBG] pgmap v1821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:43.433 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:42 gibba023 bash[30844]: cluster 2021-03-10T21:08:41.920170+0000 mgr.gibba044.wflcwh (mgr.34466) 3213 : cluster [DBG] pgmap v1821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:43.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:42 gibba023 bash[31815]: cluster 2021-03-10T21:08:41.920170+0000 mgr.gibba044.wflcwh (mgr.34466) 3213 : cluster [DBG] pgmap v1821: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:45.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:44 gibba044 bash[25485]: cluster 2021-03-10T21:08:43.920689+0000 mgr.gibba044.wflcwh (mgr.34466) 3214 : cluster [DBG] pgmap v1822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:45.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:44 gibba023 bash[30844]: cluster 2021-03-10T21:08:43.920689+0000 mgr.gibba044.wflcwh (mgr.34466) 3214 : cluster [DBG] pgmap v1822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:45.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:44 gibba023 bash[31815]: cluster 2021-03-10T21:08:43.920689+0000 mgr.gibba044.wflcwh (mgr.34466) 3214 : cluster [DBG] pgmap v1822: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:47.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:47 gibba023 bash[30844]: cluster 2021-03-10T21:08:45.922251+0000 mgr.gibba044.wflcwh (mgr.34466) 3215 : cluster [DBG] pgmap v1823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:47.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:47 gibba023 bash[31815]: cluster 2021-03-10T21:08:45.922251+0000 mgr.gibba044.wflcwh (mgr.34466) 3215 : cluster [DBG] pgmap v1823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:47.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:47 gibba044 bash[25485]: cluster 2021-03-10T21:08:45.922251+0000 mgr.gibba044.wflcwh (mgr.34466) 3215 : cluster [DBG] pgmap v1823: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:49.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[30844]: cluster 2021-03-10T21:08:47.923013+0000 mgr.gibba044.wflcwh (mgr.34466) 3216 : cluster [DBG] pgmap v1824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:49.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[30844]: cephadm 2021-03-10T21:08:48.129129+0000 mgr.gibba044.wflcwh (mgr.34466) 3217 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:08:49.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[30844]: cephadm 2021-03-10T21:08:48.130640+0000 mgr.gibba044.wflcwh (mgr.34466) 3218 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:08:49.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[30844]: audit 2021-03-10T21:08:48.341956+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:08:49.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[30844]: cephadm 2021-03-10T21:08:48.345370+0000 mgr.gibba044.wflcwh (mgr.34466) 3219 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:08:49.680 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[30844]: audit 2021-03-10T21:08:48.345376+0000 mon.a (mon.0) 1438 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:08:49.681 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[30844]: audit 2021-03-10T21:08:48.346801+0000 mon.a (mon.0) 1439 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:49.681 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[30844]: cephadm 2021-03-10T21:08:48.346982+0000 mgr.gibba044.wflcwh (mgr.34466) 3220 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:08:49.681 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[30844]: audit 2021-03-10T21:08:48.348730+0000 mon.a (mon.0) 1440 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:49.681 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[30844]: cephadm 2021-03-10T21:08:48.348764+0000 mgr.gibba044.wflcwh (mgr.34466) 3221 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:08:49.682 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[30844]: cephadm 2021-03-10T21:08:48.348800+0000 mgr.gibba044.wflcwh (mgr.34466) 3222 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:08:49.683 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[30844]: audit 2021-03-10T21:08:48.350006+0000 mon.a (mon.0) 1441 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:49.684 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[30844]: cephadm 2021-03-10T21:08:48.350340+0000 mgr.gibba044.wflcwh (mgr.34466) 3223 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:08:49.684 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[30844]: cephadm 2021-03-10T21:08:48.350378+0000 mgr.gibba044.wflcwh (mgr.34466) 3224 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:08:49.684 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[30844]: cephadm 2021-03-10T21:08:48.351521+0000 mgr.gibba044.wflcwh (mgr.34466) 3225 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:08:49.684 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[30844]: audit 2021-03-10T21:08:48.352456+0000 mon.a (mon.0) 1442 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:49.685 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[30844]: cephadm 2021-03-10T21:08:48.352714+0000 mgr.gibba044.wflcwh (mgr.34466) 3226 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:08:49.685 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[30844]: cephadm 2021-03-10T21:08:48.352750+0000 mgr.gibba044.wflcwh (mgr.34466) 3227 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:08:49.685 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[30844]: audit 2021-03-10T21:08:48.353949+0000 mon.a (mon.0) 1443 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:49.685 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[30844]: cephadm 2021-03-10T21:08:48.353958+0000 mgr.gibba044.wflcwh (mgr.34466) 3228 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:08:49.686 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[31815]: cluster 2021-03-10T21:08:47.923013+0000 mgr.gibba044.wflcwh (mgr.34466) 3216 : cluster [DBG] pgmap v1824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:49.686 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[31815]: cephadm 2021-03-10T21:08:48.129129+0000 mgr.gibba044.wflcwh (mgr.34466) 3217 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:08:49.686 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[31815]: cephadm 2021-03-10T21:08:48.130640+0000 mgr.gibba044.wflcwh (mgr.34466) 3218 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:08:49.687 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[31815]: audit 2021-03-10T21:08:48.341956+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:08:49.687 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[31815]: cephadm 2021-03-10T21:08:48.345370+0000 mgr.gibba044.wflcwh (mgr.34466) 3219 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:08:49.687 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[31815]: audit 2021-03-10T21:08:48.345376+0000 mon.a (mon.0) 1438 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:08:49.687 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[31815]: audit 2021-03-10T21:08:48.346801+0000 mon.a (mon.0) 1439 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:49.688 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[31815]: cephadm 2021-03-10T21:08:48.346982+0000 mgr.gibba044.wflcwh (mgr.34466) 3220 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:08:49.688 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[31815]: audit 2021-03-10T21:08:48.348730+0000 mon.a (mon.0) 1440 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:49.688 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[31815]: cephadm 2021-03-10T21:08:48.348764+0000 mgr.gibba044.wflcwh (mgr.34466) 3221 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:08:49.688 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[31815]: cephadm 2021-03-10T21:08:48.348800+0000 mgr.gibba044.wflcwh (mgr.34466) 3222 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:08:49.689 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[31815]: audit 2021-03-10T21:08:48.350006+0000 mon.a (mon.0) 1441 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:49.689 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[31815]: cephadm 2021-03-10T21:08:48.350340+0000 mgr.gibba044.wflcwh (mgr.34466) 3223 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:08:49.689 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[31815]: cephadm 2021-03-10T21:08:48.350378+0000 mgr.gibba044.wflcwh (mgr.34466) 3224 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:08:49.689 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[31815]: cephadm 2021-03-10T21:08:48.351521+0000 mgr.gibba044.wflcwh (mgr.34466) 3225 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:08:49.690 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[31815]: audit 2021-03-10T21:08:48.352456+0000 mon.a (mon.0) 1442 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:49.690 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[31815]: cephadm 2021-03-10T21:08:48.352714+0000 mgr.gibba044.wflcwh (mgr.34466) 3226 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:08:49.690 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[31815]: cephadm 2021-03-10T21:08:48.352750+0000 mgr.gibba044.wflcwh (mgr.34466) 3227 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:08:49.690 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[31815]: audit 2021-03-10T21:08:48.353949+0000 mon.a (mon.0) 1443 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:49.691 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[31815]: cephadm 2021-03-10T21:08:48.353958+0000 mgr.gibba044.wflcwh (mgr.34466) 3228 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:08:49.691 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[30844]: cephadm 2021-03-10T21:08:48.354273+0000 mgr.gibba044.wflcwh (mgr.34466) 3229 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:08:49.691 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[30844]: cephadm 2021-03-10T21:08:48.355339+0000 mgr.gibba044.wflcwh (mgr.34466) 3230 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:08:49.692 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[30844]: cephadm 2021-03-10T21:08:48.355377+0000 mgr.gibba044.wflcwh (mgr.34466) 3231 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:08:49.692 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[30844]: cephadm 2021-03-10T21:08:48.355502+0000 mgr.gibba044.wflcwh (mgr.34466) 3232 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:08:49.692 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[31815]: cephadm 2021-03-10T21:08:48.354273+0000 mgr.gibba044.wflcwh (mgr.34466) 3229 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:08:49.694 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[31815]: cephadm 2021-03-10T21:08:48.355339+0000 mgr.gibba044.wflcwh (mgr.34466) 3230 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:08:49.694 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[31815]: cephadm 2021-03-10T21:08:48.355377+0000 mgr.gibba044.wflcwh (mgr.34466) 3231 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:08:49.695 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:49 gibba023 bash[31815]: cephadm 2021-03-10T21:08:48.355502+0000 mgr.gibba044.wflcwh (mgr.34466) 3232 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:08:49.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:49 gibba044 bash[25485]: cluster 2021-03-10T21:08:47.923013+0000 mgr.gibba044.wflcwh (mgr.34466) 3216 : cluster [DBG] pgmap v1824: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:49.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:49 gibba044 bash[25485]: cephadm 2021-03-10T21:08:48.129129+0000 mgr.gibba044.wflcwh (mgr.34466) 3217 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:08:49.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:49 gibba044 bash[25485]: cephadm 2021-03-10T21:08:48.130640+0000 mgr.gibba044.wflcwh (mgr.34466) 3218 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:08:49.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:49 gibba044 bash[25485]: audit 2021-03-10T21:08:48.341956+0000 mon.a (mon.0) 1437 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:08:49.756 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:49 gibba044 bash[25485]: cephadm 2021-03-10T21:08:48.345370+0000 mgr.gibba044.wflcwh (mgr.34466) 3219 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:08:49.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:49 gibba044 bash[25485]: audit 2021-03-10T21:08:48.345376+0000 mon.a (mon.0) 1438 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:08:49.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:49 gibba044 bash[25485]: audit 2021-03-10T21:08:48.346801+0000 mon.a (mon.0) 1439 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:49.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:49 gibba044 bash[25485]: cephadm 2021-03-10T21:08:48.346982+0000 mgr.gibba044.wflcwh (mgr.34466) 3220 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:08:49.757 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:49 gibba044 bash[25485]: audit 2021-03-10T21:08:48.348730+0000 mon.a (mon.0) 1440 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:49.758 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:49 gibba044 bash[25485]: cephadm 2021-03-10T21:08:48.348764+0000 mgr.gibba044.wflcwh (mgr.34466) 3221 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:08:49.758 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:49 gibba044 bash[25485]: cephadm 2021-03-10T21:08:48.348800+0000 mgr.gibba044.wflcwh (mgr.34466) 3222 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:08:49.758 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:49 gibba044 bash[25485]: audit 2021-03-10T21:08:48.350006+0000 mon.a (mon.0) 1441 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:49.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:49 gibba044 bash[25485]: cephadm 2021-03-10T21:08:48.350340+0000 mgr.gibba044.wflcwh (mgr.34466) 3223 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:08:49.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:49 gibba044 bash[25485]: cephadm 2021-03-10T21:08:48.350378+0000 mgr.gibba044.wflcwh (mgr.34466) 3224 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:08:49.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:49 gibba044 bash[25485]: cephadm 2021-03-10T21:08:48.351521+0000 mgr.gibba044.wflcwh (mgr.34466) 3225 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:08:49.759 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:49 gibba044 bash[25485]: audit 2021-03-10T21:08:48.352456+0000 mon.a (mon.0) 1442 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:49.760 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:49 gibba044 bash[25485]: cephadm 2021-03-10T21:08:48.352714+0000 mgr.gibba044.wflcwh (mgr.34466) 3226 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:08:49.760 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:49 gibba044 bash[25485]: cephadm 2021-03-10T21:08:48.352750+0000 mgr.gibba044.wflcwh (mgr.34466) 3227 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:08:49.761 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:49 gibba044 bash[25485]: audit 2021-03-10T21:08:48.353949+0000 mon.a (mon.0) 1443 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:08:49.761 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:49 gibba044 bash[25485]: cephadm 2021-03-10T21:08:48.353958+0000 mgr.gibba044.wflcwh (mgr.34466) 3228 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:08:49.761 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:49 gibba044 bash[25485]: cephadm 2021-03-10T21:08:48.354273+0000 mgr.gibba044.wflcwh (mgr.34466) 3229 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:08:49.761 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:49 gibba044 bash[25485]: cephadm 2021-03-10T21:08:48.355339+0000 mgr.gibba044.wflcwh (mgr.34466) 3230 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:08:49.762 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:49 gibba044 bash[25485]: cephadm 2021-03-10T21:08:48.355377+0000 mgr.gibba044.wflcwh (mgr.34466) 3231 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:08:49.762 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:49 gibba044 bash[25485]: cephadm 2021-03-10T21:08:48.355502+0000 mgr.gibba044.wflcwh (mgr.34466) 3232 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:08:51.677 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:51 gibba023 bash[30844]: cluster 2021-03-10T21:08:49.924134+0000 mgr.gibba044.wflcwh (mgr.34466) 3233 : cluster [DBG] pgmap v1825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:51.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:51 gibba023 bash[31815]: cluster 2021-03-10T21:08:49.924134+0000 mgr.gibba044.wflcwh (mgr.34466) 3233 : cluster [DBG] pgmap v1825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:51.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:51 gibba044 bash[25485]: cluster 2021-03-10T21:08:49.924134+0000 mgr.gibba044.wflcwh (mgr.34466) 3233 : cluster [DBG] pgmap v1825: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:53.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:53 gibba023 bash[30844]: cluster 2021-03-10T21:08:51.925669+0000 mgr.gibba044.wflcwh (mgr.34466) 3234 : cluster [DBG] pgmap v1826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:53.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:53 gibba023 bash[31815]: cluster 2021-03-10T21:08:51.925669+0000 mgr.gibba044.wflcwh (mgr.34466) 3234 : cluster [DBG] pgmap v1826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:53.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:53 gibba044 bash[25485]: cluster 2021-03-10T21:08:51.925669+0000 mgr.gibba044.wflcwh (mgr.34466) 3234 : cluster [DBG] pgmap v1826: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:55.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:55 gibba023 bash[30844]: cluster 2021-03-10T21:08:53.927446+0000 mgr.gibba044.wflcwh (mgr.34466) 3235 : cluster [DBG] pgmap v1827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:55.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:55 gibba023 bash[31815]: cluster 2021-03-10T21:08:53.927446+0000 mgr.gibba044.wflcwh (mgr.34466) 3235 : cluster [DBG] pgmap v1827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:55.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:55 gibba044 bash[25485]: cluster 2021-03-10T21:08:53.927446+0000 mgr.gibba044.wflcwh (mgr.34466) 3235 : cluster [DBG] pgmap v1827: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:57.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:57 gibba023 bash[30844]: cluster 2021-03-10T21:08:55.929133+0000 mgr.gibba044.wflcwh (mgr.34466) 3236 : cluster [DBG] pgmap v1828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:57.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:57 gibba023 bash[31815]: cluster 2021-03-10T21:08:55.929133+0000 mgr.gibba044.wflcwh (mgr.34466) 3236 : cluster [DBG] pgmap v1828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:57.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:57 gibba044 bash[25485]: cluster 2021-03-10T21:08:55.929133+0000 mgr.gibba044.wflcwh (mgr.34466) 3236 : cluster [DBG] pgmap v1828: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:59.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:08:58 gibba044 bash[25485]: cluster 2021-03-10T21:08:57.930845+0000 mgr.gibba044.wflcwh (mgr.34466) 3237 : cluster [DBG] pgmap v1829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:59.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:08:58 gibba023 bash[30844]: cluster 2021-03-10T21:08:57.930845+0000 mgr.gibba044.wflcwh (mgr.34466) 3237 : cluster [DBG] pgmap v1829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:08:59.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:08:58 gibba023 bash[31815]: cluster 2021-03-10T21:08:57.930845+0000 mgr.gibba044.wflcwh (mgr.34466) 3237 : cluster [DBG] pgmap v1829: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:01.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:00 gibba044 bash[25485]: cluster 2021-03-10T21:08:59.932253+0000 mgr.gibba044.wflcwh (mgr.34466) 3238 : cluster [DBG] pgmap v1830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:01.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:00 gibba023 bash[30844]: cluster 2021-03-10T21:08:59.932253+0000 mgr.gibba044.wflcwh (mgr.34466) 3238 : cluster [DBG] pgmap v1830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:01.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:00 gibba023 bash[31815]: cluster 2021-03-10T21:08:59.932253+0000 mgr.gibba044.wflcwh (mgr.34466) 3238 : cluster [DBG] pgmap v1830: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:03.374 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:03 gibba044 bash[25485]: cluster 2021-03-10T21:09:01.933836+0000 mgr.gibba044.wflcwh (mgr.34466) 3239 : cluster [DBG] pgmap v1831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:03.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:03 gibba023 bash[30844]: cluster 2021-03-10T21:09:01.933836+0000 mgr.gibba044.wflcwh (mgr.34466) 3239 : cluster [DBG] pgmap v1831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:03.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:03 gibba023 bash[31815]: cluster 2021-03-10T21:09:01.933836+0000 mgr.gibba044.wflcwh (mgr.34466) 3239 : cluster [DBG] pgmap v1831: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:04.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:04 gibba023 bash[30844]: cephadm 2021-03-10T21:09:03.371549+0000 mgr.gibba044.wflcwh (mgr.34466) 3240 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:09:04.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:04 gibba023 bash[31815]: cephadm 2021-03-10T21:09:03.371549+0000 mgr.gibba044.wflcwh (mgr.34466) 3240 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:09:04.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:04 gibba044 bash[25485]: cephadm 2021-03-10T21:09:03.371549+0000 mgr.gibba044.wflcwh (mgr.34466) 3240 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:09:05.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:05 gibba023 bash[30844]: cluster 2021-03-10T21:09:03.934730+0000 mgr.gibba044.wflcwh (mgr.34466) 3241 : cluster [DBG] pgmap v1832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:05.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:05 gibba023 bash[31815]: cluster 2021-03-10T21:09:03.934730+0000 mgr.gibba044.wflcwh (mgr.34466) 3241 : cluster [DBG] pgmap v1832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:05.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:05 gibba044 bash[25485]: cluster 2021-03-10T21:09:03.934730+0000 mgr.gibba044.wflcwh (mgr.34466) 3241 : cluster [DBG] pgmap v1832: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:07.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:07 gibba023 bash[30844]: cluster 2021-03-10T21:09:05.935582+0000 mgr.gibba044.wflcwh (mgr.34466) 3242 : cluster [DBG] pgmap v1833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:07.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:07 gibba023 bash[31815]: cluster 2021-03-10T21:09:05.935582+0000 mgr.gibba044.wflcwh (mgr.34466) 3242 : cluster [DBG] pgmap v1833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:07.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:07 gibba044 bash[25485]: cluster 2021-03-10T21:09:05.935582+0000 mgr.gibba044.wflcwh (mgr.34466) 3242 : cluster [DBG] pgmap v1833: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:09.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:08 gibba044 bash[25485]: cluster 2021-03-10T21:09:07.937209+0000 mgr.gibba044.wflcwh (mgr.34466) 3243 : cluster [DBG] pgmap v1834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:09.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:08 gibba023 bash[30844]: cluster 2021-03-10T21:09:07.937209+0000 mgr.gibba044.wflcwh (mgr.34466) 3243 : cluster [DBG] pgmap v1834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:09.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:08 gibba023 bash[31815]: cluster 2021-03-10T21:09:07.937209+0000 mgr.gibba044.wflcwh (mgr.34466) 3243 : cluster [DBG] pgmap v1834: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:11.048 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T21:09:11.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:10 gibba044 bash[25485]: cluster 2021-03-10T21:09:09.938390+0000 mgr.gibba044.wflcwh (mgr.34466) 3244 : cluster [DBG] pgmap v1835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:11.278 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:09:11.278 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (60m) 5m ago 65m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T21:09:11.279 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (65m) 4m ago 65m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T21:09:11.279 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (60m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T21:09:11.280 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (60m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T21:09:11.280 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (60m) 5m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T21:09:11.281 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (59m) 5m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T21:09:11.281 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (59m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T21:09:11.281 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (59m) 5m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T21:09:11.282 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (66m) 5m ago 66m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T21:09:11.285 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (66m) 4m ago 66m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T21:09:11.285 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (58m) 5m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T21:09:11.285 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (58m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T21:09:11.286 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (57m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T21:09:11.286 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (57m) 5m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T21:09:11.286 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (56m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T21:09:11.286 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (56m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T21:09:11.287 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (55m) 4m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T21:09:11.287 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (55m) 4m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T21:09:11.287 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (65m) 4m ago 66m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T21:09:11.288 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 5m ago 63m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:09:11.288 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 4m ago 63m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:09:11.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:10 gibba023 bash[30844]: cluster 2021-03-10T21:09:09.938390+0000 mgr.gibba044.wflcwh (mgr.34466) 3244 : cluster [DBG] pgmap v1835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:11.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:10 gibba023 bash[31815]: cluster 2021-03-10T21:09:09.938390+0000 mgr.gibba044.wflcwh (mgr.34466) 3244 : cluster [DBG] pgmap v1835: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:11.526 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T21:09:11.526 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T21:09:11.527 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:09:11.527 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:09:11.527 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T21:09:11.527 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:09:11.528 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:09:11.528 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T21:09:11.528 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:09:11.528 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:09:11.529 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T21:09:11.529 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T21:09:11.529 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:09:11.529 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T21:09:11.530 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T21:09:12.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:12 gibba023 bash[30844]: audit 2021-03-10T21:09:11.038093+0000 mgr.gibba044.wflcwh (mgr.34466) 3245 : audit [DBG] from='client.56215 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:09:12.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:12 gibba023 bash[30844]: audit 2021-03-10T21:09:11.262760+0000 mgr.gibba044.wflcwh (mgr.34466) 3246 : audit [DBG] from='client.56221 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:09:12.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:12 gibba023 bash[30844]: audit 2021-03-10T21:09:11.522427+0000 mon.c (mon.1) 72 : audit [DBG] from='client.? 172.21.2.123:0/1549591688' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:12.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:12 gibba023 bash[31815]: audit 2021-03-10T21:09:11.038093+0000 mgr.gibba044.wflcwh (mgr.34466) 3245 : audit [DBG] from='client.56215 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:09:12.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:12 gibba023 bash[31815]: audit 2021-03-10T21:09:11.262760+0000 mgr.gibba044.wflcwh (mgr.34466) 3246 : audit [DBG] from='client.56221 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:09:12.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:12 gibba023 bash[31815]: audit 2021-03-10T21:09:11.522427+0000 mon.c (mon.1) 72 : audit [DBG] from='client.? 172.21.2.123:0/1549591688' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:12.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:12 gibba044 bash[25485]: audit 2021-03-10T21:09:11.038093+0000 mgr.gibba044.wflcwh (mgr.34466) 3245 : audit [DBG] from='client.56215 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:09:12.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:12 gibba044 bash[25485]: audit 2021-03-10T21:09:11.262760+0000 mgr.gibba044.wflcwh (mgr.34466) 3246 : audit [DBG] from='client.56221 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:09:12.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:12 gibba044 bash[25485]: audit 2021-03-10T21:09:11.522427+0000 mon.c (mon.1) 72 : audit [DBG] from='client.? 172.21.2.123:0/1549591688' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:13.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:13 gibba023 bash[30844]: cluster 2021-03-10T21:09:11.939355+0000 mgr.gibba044.wflcwh (mgr.34466) 3247 : cluster [DBG] pgmap v1836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:13.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:13 gibba023 bash[31815]: cluster 2021-03-10T21:09:11.939355+0000 mgr.gibba044.wflcwh (mgr.34466) 3247 : cluster [DBG] pgmap v1836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:13.509 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:13 gibba044 bash[25485]: cluster 2021-03-10T21:09:11.939355+0000 mgr.gibba044.wflcwh (mgr.34466) 3247 : cluster [DBG] pgmap v1836: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:15.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:15 gibba023 bash[30844]: cluster 2021-03-10T21:09:13.940223+0000 mgr.gibba044.wflcwh (mgr.34466) 3248 : cluster [DBG] pgmap v1837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:15.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:15 gibba023 bash[31815]: cluster 2021-03-10T21:09:13.940223+0000 mgr.gibba044.wflcwh (mgr.34466) 3248 : cluster [DBG] pgmap v1837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:15.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:15 gibba044 bash[25485]: cluster 2021-03-10T21:09:13.940223+0000 mgr.gibba044.wflcwh (mgr.34466) 3248 : cluster [DBG] pgmap v1837: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:17.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:17 gibba023 bash[30844]: cluster 2021-03-10T21:09:15.941736+0000 mgr.gibba044.wflcwh (mgr.34466) 3249 : cluster [DBG] pgmap v1838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:17.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:17 gibba023 bash[31815]: cluster 2021-03-10T21:09:15.941736+0000 mgr.gibba044.wflcwh (mgr.34466) 3249 : cluster [DBG] pgmap v1838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:17.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:17 gibba044 bash[25485]: cluster 2021-03-10T21:09:15.941736+0000 mgr.gibba044.wflcwh (mgr.34466) 3249 : cluster [DBG] pgmap v1838: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:19.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:18 gibba023 bash[30844]: cluster 2021-03-10T21:09:17.942564+0000 mgr.gibba044.wflcwh (mgr.34466) 3250 : cluster [DBG] pgmap v1839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:19.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:18 gibba023 bash[30844]: cephadm 2021-03-10T21:09:18.387709+0000 mgr.gibba044.wflcwh (mgr.34466) 3251 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:09:19.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:18 gibba023 bash[31815]: cluster 2021-03-10T21:09:17.942564+0000 mgr.gibba044.wflcwh (mgr.34466) 3250 : cluster [DBG] pgmap v1839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:19.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:18 gibba023 bash[31815]: cephadm 2021-03-10T21:09:18.387709+0000 mgr.gibba044.wflcwh (mgr.34466) 3251 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:09:19.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:18 gibba044 bash[25485]: cluster 2021-03-10T21:09:17.942564+0000 mgr.gibba044.wflcwh (mgr.34466) 3250 : cluster [DBG] pgmap v1839: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:19.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:18 gibba044 bash[25485]: cephadm 2021-03-10T21:09:18.387709+0000 mgr.gibba044.wflcwh (mgr.34466) 3251 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:09:21.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:21 gibba023 bash[30844]: cluster 2021-03-10T21:09:19.943755+0000 mgr.gibba044.wflcwh (mgr.34466) 3252 : cluster [DBG] pgmap v1840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:21.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:21 gibba023 bash[31815]: cluster 2021-03-10T21:09:19.943755+0000 mgr.gibba044.wflcwh (mgr.34466) 3252 : cluster [DBG] pgmap v1840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:21.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:21 gibba044 bash[25485]: cluster 2021-03-10T21:09:19.943755+0000 mgr.gibba044.wflcwh (mgr.34466) 3252 : cluster [DBG] pgmap v1840: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:23.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:23 gibba023 bash[30844]: cluster 2021-03-10T21:09:21.945322+0000 mgr.gibba044.wflcwh (mgr.34466) 3253 : cluster [DBG] pgmap v1841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:23.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:23 gibba023 bash[31815]: cluster 2021-03-10T21:09:21.945322+0000 mgr.gibba044.wflcwh (mgr.34466) 3253 : cluster [DBG] pgmap v1841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:23.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:23 gibba044 bash[25485]: cluster 2021-03-10T21:09:21.945322+0000 mgr.gibba044.wflcwh (mgr.34466) 3253 : cluster [DBG] pgmap v1841: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:25.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:25 gibba023 bash[30844]: cluster 2021-03-10T21:09:23.947073+0000 mgr.gibba044.wflcwh (mgr.34466) 3254 : cluster [DBG] pgmap v1842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:25.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:25 gibba023 bash[31815]: cluster 2021-03-10T21:09:23.947073+0000 mgr.gibba044.wflcwh (mgr.34466) 3254 : cluster [DBG] pgmap v1842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:25.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:25 gibba044 bash[25485]: cluster 2021-03-10T21:09:23.947073+0000 mgr.gibba044.wflcwh (mgr.34466) 3254 : cluster [DBG] pgmap v1842: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:27.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:27 gibba023 bash[30844]: cluster 2021-03-10T21:09:25.948814+0000 mgr.gibba044.wflcwh (mgr.34466) 3255 : cluster [DBG] pgmap v1843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:27.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:27 gibba023 bash[31815]: cluster 2021-03-10T21:09:25.948814+0000 mgr.gibba044.wflcwh (mgr.34466) 3255 : cluster [DBG] pgmap v1843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:27.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:27 gibba044 bash[25485]: cluster 2021-03-10T21:09:25.948814+0000 mgr.gibba044.wflcwh (mgr.34466) 3255 : cluster [DBG] pgmap v1843: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:28.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:28 gibba023 bash[30844]: audit 2021-03-10T21:09:27.446612+0000 mon.a (mon.0) 1444 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:09:28.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:28 gibba023 bash[30844]: audit 2021-03-10T21:09:27.447260+0000 mon.a (mon.0) 1445 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:09:28.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:28 gibba023 bash[30844]: audit 2021-03-10T21:09:27.447883+0000 mon.a (mon.0) 1446 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T21:09:28.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:28 gibba023 bash[30844]: audit 2021-03-10T21:09:27.448601+0000 mon.a (mon.0) 1447 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T21:09:28.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:28 gibba023 bash[30844]: audit 2021-03-10T21:09:27.449333+0000 mon.a (mon.0) 1448 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T21:09:28.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:28 gibba023 bash[30844]: audit 2021-03-10T21:09:27.450009+0000 mon.a (mon.0) 1449 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:09:28.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:28 gibba023 bash[31815]: audit 2021-03-10T21:09:27.446612+0000 mon.a (mon.0) 1444 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:09:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:28 gibba023 bash[31815]: audit 2021-03-10T21:09:27.447260+0000 mon.a (mon.0) 1445 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:09:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:28 gibba023 bash[31815]: audit 2021-03-10T21:09:27.447883+0000 mon.a (mon.0) 1446 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T21:09:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:28 gibba023 bash[31815]: audit 2021-03-10T21:09:27.448601+0000 mon.a (mon.0) 1447 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T21:09:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:28 gibba023 bash[31815]: audit 2021-03-10T21:09:27.449333+0000 mon.a (mon.0) 1448 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T21:09:28.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:28 gibba023 bash[31815]: audit 2021-03-10T21:09:27.450009+0000 mon.a (mon.0) 1449 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:09:28.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:28 gibba044 bash[25485]: audit 2021-03-10T21:09:27.446612+0000 mon.a (mon.0) 1444 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:09:28.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:28 gibba044 bash[25485]: audit 2021-03-10T21:09:27.447260+0000 mon.a (mon.0) 1445 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:09:28.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:28 gibba044 bash[25485]: audit 2021-03-10T21:09:27.447883+0000 mon.a (mon.0) 1446 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2021-03-10T21:09:28.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:28 gibba044 bash[25485]: audit 2021-03-10T21:09:27.448601+0000 mon.a (mon.0) 1447 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T21:09:28.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:28 gibba044 bash[25485]: audit 2021-03-10T21:09:27.449333+0000 mon.a (mon.0) 1448 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T21:09:28.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:28 gibba044 bash[25485]: audit 2021-03-10T21:09:27.450009+0000 mon.a (mon.0) 1449 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:09:29.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:29 gibba023 bash[30844]: cluster 2021-03-10T21:09:27.950544+0000 mgr.gibba044.wflcwh (mgr.34466) 3256 : cluster [DBG] pgmap v1844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:29.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:29 gibba023 bash[31815]: cluster 2021-03-10T21:09:27.950544+0000 mgr.gibba044.wflcwh (mgr.34466) 3256 : cluster [DBG] pgmap v1844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:29.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:29 gibba044 bash[25485]: cluster 2021-03-10T21:09:27.950544+0000 mgr.gibba044.wflcwh (mgr.34466) 3256 : cluster [DBG] pgmap v1844: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:31.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:31 gibba023 bash[30844]: cluster 2021-03-10T21:09:29.951909+0000 mgr.gibba044.wflcwh (mgr.34466) 3257 : cluster [DBG] pgmap v1845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:31.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:31 gibba023 bash[31815]: cluster 2021-03-10T21:09:29.951909+0000 mgr.gibba044.wflcwh (mgr.34466) 3257 : cluster [DBG] pgmap v1845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:31.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:31 gibba044 bash[25485]: cluster 2021-03-10T21:09:29.951909+0000 mgr.gibba044.wflcwh (mgr.34466) 3257 : cluster [DBG] pgmap v1845: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:33.409 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:33 gibba044 bash[25485]: cluster 2021-03-10T21:09:31.953387+0000 mgr.gibba044.wflcwh (mgr.34466) 3258 : cluster [DBG] pgmap v1846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:33.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:33 gibba023 bash[30844]: cluster 2021-03-10T21:09:31.953387+0000 mgr.gibba044.wflcwh (mgr.34466) 3258 : cluster [DBG] pgmap v1846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:33.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:33 gibba023 bash[31815]: cluster 2021-03-10T21:09:31.953387+0000 mgr.gibba044.wflcwh (mgr.34466) 3258 : cluster [DBG] pgmap v1846: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:34.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:34 gibba023 bash[30844]: cephadm 2021-03-10T21:09:33.403700+0000 mgr.gibba044.wflcwh (mgr.34466) 3259 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:09:34.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:34 gibba023 bash[31815]: cephadm 2021-03-10T21:09:33.403700+0000 mgr.gibba044.wflcwh (mgr.34466) 3259 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:09:34.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:34 gibba044 bash[25485]: cephadm 2021-03-10T21:09:33.403700+0000 mgr.gibba044.wflcwh (mgr.34466) 3259 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:09:35.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:35 gibba023 bash[30844]: cluster 2021-03-10T21:09:33.954320+0000 mgr.gibba044.wflcwh (mgr.34466) 3260 : cluster [DBG] pgmap v1847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:35.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:35 gibba023 bash[31815]: cluster 2021-03-10T21:09:33.954320+0000 mgr.gibba044.wflcwh (mgr.34466) 3260 : cluster [DBG] pgmap v1847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:35.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:35 gibba044 bash[25485]: cluster 2021-03-10T21:09:33.954320+0000 mgr.gibba044.wflcwh (mgr.34466) 3260 : cluster [DBG] pgmap v1847: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:37.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:37 gibba023 bash[30844]: cluster 2021-03-10T21:09:35.955919+0000 mgr.gibba044.wflcwh (mgr.34466) 3261 : cluster [DBG] pgmap v1848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:37.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:37 gibba023 bash[31815]: cluster 2021-03-10T21:09:35.955919+0000 mgr.gibba044.wflcwh (mgr.34466) 3261 : cluster [DBG] pgmap v1848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:37.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:37 gibba044 bash[25485]: cluster 2021-03-10T21:09:35.955919+0000 mgr.gibba044.wflcwh (mgr.34466) 3261 : cluster [DBG] pgmap v1848: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:39.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:38 gibba023 bash[30844]: cluster 2021-03-10T21:09:37.957284+0000 mgr.gibba044.wflcwh (mgr.34466) 3262 : cluster [DBG] pgmap v1849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:39.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:38 gibba023 bash[31815]: cluster 2021-03-10T21:09:37.957284+0000 mgr.gibba044.wflcwh (mgr.34466) 3262 : cluster [DBG] pgmap v1849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:39.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:38 gibba044 bash[25485]: cluster 2021-03-10T21:09:37.957284+0000 mgr.gibba044.wflcwh (mgr.34466) 3262 : cluster [DBG] pgmap v1849: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:41.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:41 gibba023 bash[30844]: cluster 2021-03-10T21:09:39.958523+0000 mgr.gibba044.wflcwh (mgr.34466) 3263 : cluster [DBG] pgmap v1850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:41.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:41 gibba023 bash[31815]: cluster 2021-03-10T21:09:39.958523+0000 mgr.gibba044.wflcwh (mgr.34466) 3263 : cluster [DBG] pgmap v1850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:41.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:41 gibba044 bash[25485]: cluster 2021-03-10T21:09:39.958523+0000 mgr.gibba044.wflcwh (mgr.34466) 3263 : cluster [DBG] pgmap v1850: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:41.771 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T21:09:42.001 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:09:42.002 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (60m) 5m ago 66m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T21:09:42.002 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (66m) 4m ago 66m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T21:09:42.002 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (61m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T21:09:42.003 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (61m) 4m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T21:09:42.003 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (60m) 5m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T21:09:42.003 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (60m) 5m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T21:09:42.003 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (59m) 4m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T21:09:42.004 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (60m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T21:09:42.004 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (66m) 5m ago 66m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T21:09:42.004 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (66m) 4m ago 66m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T21:09:42.004 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (59m) 5m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T21:09:42.005 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (58m) 5m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T21:09:42.005 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (58m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T21:09:42.005 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (57m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T21:09:42.005 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (57m) 4m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T21:09:42.009 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (56m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T21:09:42.009 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (56m) 4m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T21:09:42.010 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (56m) 4m ago 66m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T21:09:42.010 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (65m) 4m ago 66m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T21:09:42.010 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 5m ago 64m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:09:42.011 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 4m ago 64m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:09:42.254 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T21:09:42.255 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T21:09:42.255 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:09:42.255 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:09:42.255 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T21:09:42.256 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:09:42.256 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:09:42.256 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T21:09:42.256 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:09:42.256 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:09:42.257 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T21:09:42.257 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T21:09:42.257 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:09:42.257 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T21:09:42.258 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T21:09:43.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:43 gibba023 bash[30844]: audit 2021-03-10T21:09:41.759361+0000 mgr.gibba044.wflcwh (mgr.34466) 3264 : audit [DBG] from='client.56233 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:09:43.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:43 gibba023 bash[30844]: cluster 2021-03-10T21:09:41.959400+0000 mgr.gibba044.wflcwh (mgr.34466) 3265 : cluster [DBG] pgmap v1851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:43.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:43 gibba023 bash[30844]: audit 2021-03-10T21:09:41.986006+0000 mgr.gibba044.wflcwh (mgr.34466) 3266 : audit [DBG] from='client.46260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:09:43.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:43 gibba023 bash[30844]: audit 2021-03-10T21:09:42.250880+0000 mon.a (mon.0) 1450 : audit [DBG] from='client.? 172.21.2.123:0/2841940087' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:43.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:43 gibba023 bash[31815]: audit 2021-03-10T21:09:41.759361+0000 mgr.gibba044.wflcwh (mgr.34466) 3264 : audit [DBG] from='client.56233 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:09:43.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:43 gibba023 bash[31815]: cluster 2021-03-10T21:09:41.959400+0000 mgr.gibba044.wflcwh (mgr.34466) 3265 : cluster [DBG] pgmap v1851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:43.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:43 gibba023 bash[31815]: audit 2021-03-10T21:09:41.986006+0000 mgr.gibba044.wflcwh (mgr.34466) 3266 : audit [DBG] from='client.46260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:09:43.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:43 gibba023 bash[31815]: audit 2021-03-10T21:09:42.250880+0000 mon.a (mon.0) 1450 : audit [DBG] from='client.? 172.21.2.123:0/2841940087' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:43.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:43 gibba044 bash[25485]: audit 2021-03-10T21:09:41.759361+0000 mgr.gibba044.wflcwh (mgr.34466) 3264 : audit [DBG] from='client.56233 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:09:43.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:43 gibba044 bash[25485]: cluster 2021-03-10T21:09:41.959400+0000 mgr.gibba044.wflcwh (mgr.34466) 3265 : cluster [DBG] pgmap v1851: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:43.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:43 gibba044 bash[25485]: audit 2021-03-10T21:09:41.986006+0000 mgr.gibba044.wflcwh (mgr.34466) 3266 : audit [DBG] from='client.46260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:09:43.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:43 gibba044 bash[25485]: audit 2021-03-10T21:09:42.250880+0000 mon.a (mon.0) 1450 : audit [DBG] from='client.? 172.21.2.123:0/2841940087' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:45.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:45 gibba023 bash[30844]: cluster 2021-03-10T21:09:43.960202+0000 mgr.gibba044.wflcwh (mgr.34466) 3267 : cluster [DBG] pgmap v1852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:45.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:45 gibba023 bash[31815]: cluster 2021-03-10T21:09:43.960202+0000 mgr.gibba044.wflcwh (mgr.34466) 3267 : cluster [DBG] pgmap v1852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:45.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:45 gibba044 bash[25485]: cluster 2021-03-10T21:09:43.960202+0000 mgr.gibba044.wflcwh (mgr.34466) 3267 : cluster [DBG] pgmap v1852: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:47.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:47 gibba023 bash[30844]: cluster 2021-03-10T21:09:45.961580+0000 mgr.gibba044.wflcwh (mgr.34466) 3268 : cluster [DBG] pgmap v1853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:47.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:47 gibba023 bash[31815]: cluster 2021-03-10T21:09:45.961580+0000 mgr.gibba044.wflcwh (mgr.34466) 3268 : cluster [DBG] pgmap v1853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:47.511 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:47 gibba044 bash[25485]: cluster 2021-03-10T21:09:45.961580+0000 mgr.gibba044.wflcwh (mgr.34466) 3268 : cluster [DBG] pgmap v1853: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:49.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:49 gibba023 bash[30844]: cluster 2021-03-10T21:09:47.963163+0000 mgr.gibba044.wflcwh (mgr.34466) 3269 : cluster [DBG] pgmap v1854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:49.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:49 gibba023 bash[30844]: cephadm 2021-03-10T21:09:48.418440+0000 mgr.gibba044.wflcwh (mgr.34466) 3270 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:09:49.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:49 gibba023 bash[30844]: audit 2021-03-10T21:09:48.606466+0000 mon.a (mon.0) 1451 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:09:49.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:49 gibba023 bash[30844]: cephadm 2021-03-10T21:09:48.607730+0000 mgr.gibba044.wflcwh (mgr.34466) 3271 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:09:49.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:49 gibba023 bash[30844]: audit 2021-03-10T21:09:48.792458+0000 mon.a (mon.0) 1452 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:09:49.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:49 gibba023 bash[30844]: audit 2021-03-10T21:09:48.796929+0000 mon.a (mon.0) 1453 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:09:49.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:49 gibba023 bash[30844]: audit 2021-03-10T21:09:48.798538+0000 mon.a (mon.0) 1454 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:49.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:49 gibba023 bash[30844]: audit 2021-03-10T21:09:48.800047+0000 mon.a (mon.0) 1455 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:49.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:49 gibba023 bash[30844]: audit 2021-03-10T21:09:48.801367+0000 mon.a (mon.0) 1456 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:49.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:49 gibba023 bash[30844]: audit 2021-03-10T21:09:48.804491+0000 mon.a (mon.0) 1457 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:49.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:49 gibba023 bash[30844]: audit 2021-03-10T21:09:48.806530+0000 mon.a (mon.0) 1458 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:49.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:49 gibba023 bash[31815]: cluster 2021-03-10T21:09:47.963163+0000 mgr.gibba044.wflcwh (mgr.34466) 3269 : cluster [DBG] pgmap v1854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:49.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:49 gibba023 bash[31815]: cephadm 2021-03-10T21:09:48.418440+0000 mgr.gibba044.wflcwh (mgr.34466) 3270 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:09:49.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:49 gibba023 bash[31815]: audit 2021-03-10T21:09:48.606466+0000 mon.a (mon.0) 1451 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:09:49.932 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:49 gibba023 bash[31815]: cephadm 2021-03-10T21:09:48.607730+0000 mgr.gibba044.wflcwh (mgr.34466) 3271 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:09:49.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:49 gibba023 bash[31815]: audit 2021-03-10T21:09:48.792458+0000 mon.a (mon.0) 1452 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:09:49.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:49 gibba023 bash[31815]: audit 2021-03-10T21:09:48.796929+0000 mon.a (mon.0) 1453 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:09:49.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:49 gibba023 bash[31815]: audit 2021-03-10T21:09:48.798538+0000 mon.a (mon.0) 1454 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:49.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:49 gibba023 bash[31815]: audit 2021-03-10T21:09:48.800047+0000 mon.a (mon.0) 1455 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:49.936 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:49 gibba023 bash[31815]: audit 2021-03-10T21:09:48.801367+0000 mon.a (mon.0) 1456 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:49.936 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:49 gibba023 bash[31815]: audit 2021-03-10T21:09:48.804491+0000 mon.a (mon.0) 1457 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:49.937 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:49 gibba023 bash[31815]: audit 2021-03-10T21:09:48.806530+0000 mon.a (mon.0) 1458 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:50.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:49 gibba044 bash[25485]: cluster 2021-03-10T21:09:47.963163+0000 mgr.gibba044.wflcwh (mgr.34466) 3269 : cluster [DBG] pgmap v1854: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:50.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:49 gibba044 bash[25485]: cephadm 2021-03-10T21:09:48.418440+0000 mgr.gibba044.wflcwh (mgr.34466) 3270 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:09:50.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:49 gibba044 bash[25485]: audit 2021-03-10T21:09:48.606466+0000 mon.a (mon.0) 1451 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:09:50.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:49 gibba044 bash[25485]: cephadm 2021-03-10T21:09:48.607730+0000 mgr.gibba044.wflcwh (mgr.34466) 3271 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:09:50.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:49 gibba044 bash[25485]: audit 2021-03-10T21:09:48.792458+0000 mon.a (mon.0) 1452 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:09:50.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:49 gibba044 bash[25485]: audit 2021-03-10T21:09:48.796929+0000 mon.a (mon.0) 1453 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:09:50.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:49 gibba044 bash[25485]: audit 2021-03-10T21:09:48.798538+0000 mon.a (mon.0) 1454 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:50.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:49 gibba044 bash[25485]: audit 2021-03-10T21:09:48.800047+0000 mon.a (mon.0) 1455 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:50.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:49 gibba044 bash[25485]: audit 2021-03-10T21:09:48.801367+0000 mon.a (mon.0) 1456 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:50.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:49 gibba044 bash[25485]: audit 2021-03-10T21:09:48.804491+0000 mon.a (mon.0) 1457 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:50.009 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:49 gibba044 bash[25485]: audit 2021-03-10T21:09:48.806530+0000 mon.a (mon.0) 1458 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:09:50.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:50 gibba023 bash[30844]: cephadm 2021-03-10T21:09:48.796605+0000 mgr.gibba044.wflcwh (mgr.34466) 3272 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:09:50.929 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:50 gibba023 bash[30844]: cephadm 2021-03-10T21:09:48.798871+0000 mgr.gibba044.wflcwh (mgr.34466) 3273 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:09:50.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:50 gibba023 bash[30844]: cephadm 2021-03-10T21:09:48.800203+0000 mgr.gibba044.wflcwh (mgr.34466) 3274 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:09:50.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:50 gibba023 bash[30844]: cephadm 2021-03-10T21:09:48.800258+0000 mgr.gibba044.wflcwh (mgr.34466) 3275 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:09:50.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:50 gibba023 bash[30844]: cephadm 2021-03-10T21:09:48.801632+0000 mgr.gibba044.wflcwh (mgr.34466) 3276 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:09:50.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:50 gibba023 bash[30844]: cephadm 2021-03-10T21:09:48.801687+0000 mgr.gibba044.wflcwh (mgr.34466) 3277 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:09:50.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:50 gibba023 bash[30844]: cephadm 2021-03-10T21:09:48.802913+0000 mgr.gibba044.wflcwh (mgr.34466) 3278 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:09:50.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:50 gibba023 bash[30844]: cephadm 2021-03-10T21:09:48.804476+0000 mgr.gibba044.wflcwh (mgr.34466) 3279 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:09:50.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:50 gibba023 bash[30844]: cephadm 2021-03-10T21:09:48.804530+0000 mgr.gibba044.wflcwh (mgr.34466) 3280 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:09:50.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:50 gibba023 bash[30844]: cephadm 2021-03-10T21:09:48.806262+0000 mgr.gibba044.wflcwh (mgr.34466) 3281 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:09:50.932 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:50 gibba023 bash[30844]: cephadm 2021-03-10T21:09:48.806777+0000 mgr.gibba044.wflcwh (mgr.34466) 3282 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:09:50.932 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:50 gibba023 bash[30844]: cephadm 2021-03-10T21:09:48.808357+0000 mgr.gibba044.wflcwh (mgr.34466) 3283 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:09:50.932 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:50 gibba023 bash[30844]: cephadm 2021-03-10T21:09:48.808418+0000 mgr.gibba044.wflcwh (mgr.34466) 3284 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:09:50.932 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:50 gibba023 bash[30844]: cephadm 2021-03-10T21:09:48.808624+0000 mgr.gibba044.wflcwh (mgr.34466) 3285 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:09:50.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:50 gibba023 bash[31815]: cephadm 2021-03-10T21:09:48.796605+0000 mgr.gibba044.wflcwh (mgr.34466) 3272 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:09:50.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:50 gibba023 bash[31815]: cephadm 2021-03-10T21:09:48.798871+0000 mgr.gibba044.wflcwh (mgr.34466) 3273 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:09:50.933 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:50 gibba023 bash[31815]: cephadm 2021-03-10T21:09:48.800203+0000 mgr.gibba044.wflcwh (mgr.34466) 3274 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:09:50.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:50 gibba023 bash[31815]: cephadm 2021-03-10T21:09:48.800258+0000 mgr.gibba044.wflcwh (mgr.34466) 3275 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:09:50.934 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:50 gibba023 bash[31815]: cephadm 2021-03-10T21:09:48.801632+0000 mgr.gibba044.wflcwh (mgr.34466) 3276 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:09:50.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:50 gibba023 bash[31815]: cephadm 2021-03-10T21:09:48.801687+0000 mgr.gibba044.wflcwh (mgr.34466) 3277 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:09:50.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:50 gibba023 bash[31815]: cephadm 2021-03-10T21:09:48.802913+0000 mgr.gibba044.wflcwh (mgr.34466) 3278 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:09:50.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:50 gibba023 bash[31815]: cephadm 2021-03-10T21:09:48.804476+0000 mgr.gibba044.wflcwh (mgr.34466) 3279 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:09:50.936 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:50 gibba023 bash[31815]: cephadm 2021-03-10T21:09:48.804530+0000 mgr.gibba044.wflcwh (mgr.34466) 3280 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:09:50.936 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:50 gibba023 bash[31815]: cephadm 2021-03-10T21:09:48.806262+0000 mgr.gibba044.wflcwh (mgr.34466) 3281 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:09:50.936 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:50 gibba023 bash[31815]: cephadm 2021-03-10T21:09:48.806777+0000 mgr.gibba044.wflcwh (mgr.34466) 3282 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:09:50.937 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:50 gibba023 bash[31815]: cephadm 2021-03-10T21:09:48.808357+0000 mgr.gibba044.wflcwh (mgr.34466) 3283 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:09:50.937 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:50 gibba023 bash[31815]: cephadm 2021-03-10T21:09:48.808418+0000 mgr.gibba044.wflcwh (mgr.34466) 3284 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:09:50.937 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:50 gibba023 bash[31815]: cephadm 2021-03-10T21:09:48.808624+0000 mgr.gibba044.wflcwh (mgr.34466) 3285 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:09:51.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:50 gibba044 bash[25485]: cephadm 2021-03-10T21:09:48.796605+0000 mgr.gibba044.wflcwh (mgr.34466) 3272 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:09:51.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:50 gibba044 bash[25485]: cephadm 2021-03-10T21:09:48.798871+0000 mgr.gibba044.wflcwh (mgr.34466) 3273 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:09:51.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:50 gibba044 bash[25485]: cephadm 2021-03-10T21:09:48.800203+0000 mgr.gibba044.wflcwh (mgr.34466) 3274 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:09:51.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:50 gibba044 bash[25485]: cephadm 2021-03-10T21:09:48.800258+0000 mgr.gibba044.wflcwh (mgr.34466) 3275 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:09:51.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:50 gibba044 bash[25485]: cephadm 2021-03-10T21:09:48.801632+0000 mgr.gibba044.wflcwh (mgr.34466) 3276 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:09:51.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:50 gibba044 bash[25485]: cephadm 2021-03-10T21:09:48.801687+0000 mgr.gibba044.wflcwh (mgr.34466) 3277 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:09:51.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:50 gibba044 bash[25485]: cephadm 2021-03-10T21:09:48.802913+0000 mgr.gibba044.wflcwh (mgr.34466) 3278 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:09:51.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:50 gibba044 bash[25485]: cephadm 2021-03-10T21:09:48.804476+0000 mgr.gibba044.wflcwh (mgr.34466) 3279 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:09:51.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:50 gibba044 bash[25485]: cephadm 2021-03-10T21:09:48.804530+0000 mgr.gibba044.wflcwh (mgr.34466) 3280 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:09:51.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:50 gibba044 bash[25485]: cephadm 2021-03-10T21:09:48.806262+0000 mgr.gibba044.wflcwh (mgr.34466) 3281 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:09:51.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:50 gibba044 bash[25485]: cephadm 2021-03-10T21:09:48.806777+0000 mgr.gibba044.wflcwh (mgr.34466) 3282 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:09:51.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:50 gibba044 bash[25485]: cephadm 2021-03-10T21:09:48.808357+0000 mgr.gibba044.wflcwh (mgr.34466) 3283 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:09:51.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:50 gibba044 bash[25485]: cephadm 2021-03-10T21:09:48.808418+0000 mgr.gibba044.wflcwh (mgr.34466) 3284 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:09:51.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:50 gibba044 bash[25485]: cephadm 2021-03-10T21:09:48.808624+0000 mgr.gibba044.wflcwh (mgr.34466) 3285 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:09:51.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:51 gibba023 bash[30844]: cluster 2021-03-10T21:09:49.964424+0000 mgr.gibba044.wflcwh (mgr.34466) 3286 : cluster [DBG] pgmap v1855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:51.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:51 gibba023 bash[31815]: cluster 2021-03-10T21:09:49.964424+0000 mgr.gibba044.wflcwh (mgr.34466) 3286 : cluster [DBG] pgmap v1855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:52.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:51 gibba044 bash[25485]: cluster 2021-03-10T21:09:49.964424+0000 mgr.gibba044.wflcwh (mgr.34466) 3286 : cluster [DBG] pgmap v1855: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:53.927 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:53 gibba023 bash[30844]: cluster 2021-03-10T21:09:51.965784+0000 mgr.gibba044.wflcwh (mgr.34466) 3287 : cluster [DBG] pgmap v1856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:53.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:53 gibba023 bash[31815]: cluster 2021-03-10T21:09:51.965784+0000 mgr.gibba044.wflcwh (mgr.34466) 3287 : cluster [DBG] pgmap v1856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:54.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:53 gibba044 bash[25485]: cluster 2021-03-10T21:09:51.965784+0000 mgr.gibba044.wflcwh (mgr.34466) 3287 : cluster [DBG] pgmap v1856: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:55.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:55 gibba023 bash[30844]: cluster 2021-03-10T21:09:53.967356+0000 mgr.gibba044.wflcwh (mgr.34466) 3288 : cluster [DBG] pgmap v1857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:55.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:55 gibba023 bash[31815]: cluster 2021-03-10T21:09:53.967356+0000 mgr.gibba044.wflcwh (mgr.34466) 3288 : cluster [DBG] pgmap v1857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:56.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:55 gibba044 bash[25485]: cluster 2021-03-10T21:09:53.967356+0000 mgr.gibba044.wflcwh (mgr.34466) 3288 : cluster [DBG] pgmap v1857: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:57.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:57 gibba023 bash[30844]: cluster 2021-03-10T21:09:55.968803+0000 mgr.gibba044.wflcwh (mgr.34466) 3289 : cluster [DBG] pgmap v1858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:57.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:57 gibba023 bash[31815]: cluster 2021-03-10T21:09:55.968803+0000 mgr.gibba044.wflcwh (mgr.34466) 3289 : cluster [DBG] pgmap v1858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:58.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:57 gibba044 bash[25485]: cluster 2021-03-10T21:09:55.968803+0000 mgr.gibba044.wflcwh (mgr.34466) 3289 : cluster [DBG] pgmap v1858: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:59.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:09:58 gibba023 bash[30844]: cluster 2021-03-10T21:09:57.970222+0000 mgr.gibba044.wflcwh (mgr.34466) 3290 : cluster [DBG] pgmap v1859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:59.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:09:58 gibba023 bash[31815]: cluster 2021-03-10T21:09:57.970222+0000 mgr.gibba044.wflcwh (mgr.34466) 3290 : cluster [DBG] pgmap v1859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:09:59.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:09:58 gibba044 bash[25485]: cluster 2021-03-10T21:09:57.970222+0000 mgr.gibba044.wflcwh (mgr.34466) 3290 : cluster [DBG] pgmap v1859: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:00.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:00 gibba023 bash[30844]: debug 2021-03-10T21:09:59.995+0000 7fa7fde59700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T21:10:00.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:00 gibba023 bash[30844]: cluster 2021-03-10T21:10:00.000259+0000 mon.a (mon.0) 1459 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T21:10:00.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:00 gibba023 bash[31815]: cluster 2021-03-10T21:10:00.000259+0000 mon.a (mon.0) 1459 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T21:10:00.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:00 gibba044 bash[25485]: cluster 2021-03-10T21:10:00.000259+0000 mon.a (mon.0) 1459 : cluster [ERR] overall HEALTH_ERR 2 failed cephadm daemon(s); Module 'dashboard' has failed: Timeout('Port 8443 not free on ::.',) 2021-03-10T21:10:01.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:01 gibba023 bash[30844]: cluster 2021-03-10T21:09:59.971491+0000 mgr.gibba044.wflcwh (mgr.34466) 3291 : cluster [DBG] pgmap v1860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:01.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:01 gibba023 bash[31815]: cluster 2021-03-10T21:09:59.971491+0000 mgr.gibba044.wflcwh (mgr.34466) 3291 : cluster [DBG] pgmap v1860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:01.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:01 gibba044 bash[25485]: cluster 2021-03-10T21:09:59.971491+0000 mgr.gibba044.wflcwh (mgr.34466) 3291 : cluster [DBG] pgmap v1860: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:03.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:03 gibba023 bash[30844]: cluster 2021-03-10T21:10:01.972858+0000 mgr.gibba044.wflcwh (mgr.34466) 3292 : cluster [DBG] pgmap v1861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:03.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:03 gibba023 bash[31815]: cluster 2021-03-10T21:10:01.972858+0000 mgr.gibba044.wflcwh (mgr.34466) 3292 : cluster [DBG] pgmap v1861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:03.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:03 gibba044 bash[25485]: cluster 2021-03-10T21:10:01.972858+0000 mgr.gibba044.wflcwh (mgr.34466) 3292 : cluster [DBG] pgmap v1861: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:05.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:05 gibba023 bash[30844]: cephadm 2021-03-10T21:10:03.824514+0000 mgr.gibba044.wflcwh (mgr.34466) 3293 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:10:05.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:05 gibba023 bash[30844]: cluster 2021-03-10T21:10:03.974509+0000 mgr.gibba044.wflcwh (mgr.34466) 3294 : cluster [DBG] pgmap v1862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:05.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:05 gibba023 bash[31815]: cephadm 2021-03-10T21:10:03.824514+0000 mgr.gibba044.wflcwh (mgr.34466) 3293 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:10:05.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:05 gibba023 bash[31815]: cluster 2021-03-10T21:10:03.974509+0000 mgr.gibba044.wflcwh (mgr.34466) 3294 : cluster [DBG] pgmap v1862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:05.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:05 gibba044 bash[25485]: cephadm 2021-03-10T21:10:03.824514+0000 mgr.gibba044.wflcwh (mgr.34466) 3293 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:10:05.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:05 gibba044 bash[25485]: cluster 2021-03-10T21:10:03.974509+0000 mgr.gibba044.wflcwh (mgr.34466) 3294 : cluster [DBG] pgmap v1862: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:07.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:07 gibba023 bash[30844]: cluster 2021-03-10T21:10:05.976155+0000 mgr.gibba044.wflcwh (mgr.34466) 3295 : cluster [DBG] pgmap v1863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:07.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:07 gibba023 bash[31815]: cluster 2021-03-10T21:10:05.976155+0000 mgr.gibba044.wflcwh (mgr.34466) 3295 : cluster [DBG] pgmap v1863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:07.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:07 gibba044 bash[25485]: cluster 2021-03-10T21:10:05.976155+0000 mgr.gibba044.wflcwh (mgr.34466) 3295 : cluster [DBG] pgmap v1863: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:09.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:08 gibba023 bash[30844]: cluster 2021-03-10T21:10:07.977679+0000 mgr.gibba044.wflcwh (mgr.34466) 3296 : cluster [DBG] pgmap v1864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:09.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:08 gibba023 bash[31815]: cluster 2021-03-10T21:10:07.977679+0000 mgr.gibba044.wflcwh (mgr.34466) 3296 : cluster [DBG] pgmap v1864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:09.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:08 gibba044 bash[25485]: cluster 2021-03-10T21:10:07.977679+0000 mgr.gibba044.wflcwh (mgr.34466) 3296 : cluster [DBG] pgmap v1864: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:11.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:11 gibba023 bash[30844]: cluster 2021-03-10T21:10:09.978989+0000 mgr.gibba044.wflcwh (mgr.34466) 3297 : cluster [DBG] pgmap v1865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:11.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:11 gibba023 bash[31815]: cluster 2021-03-10T21:10:09.978989+0000 mgr.gibba044.wflcwh (mgr.34466) 3297 : cluster [DBG] pgmap v1865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:11.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:11 gibba044 bash[25485]: cluster 2021-03-10T21:10:09.978989+0000 mgr.gibba044.wflcwh (mgr.34466) 3297 : cluster [DBG] pgmap v1865: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:12.497 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T21:10:12.727 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:10:12.727 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (61m) 6m ago 66m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T21:10:12.727 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (66m) 5m ago 66m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T21:10:12.728 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (61m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T21:10:12.728 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (62m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T21:10:12.728 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (61m) 6m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T21:10:12.728 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (60m) 6m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T21:10:12.729 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (60m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T21:10:12.729 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (60m) 6m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T21:10:12.729 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (67m) 6m ago 67m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T21:10:12.729 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (67m) 5m ago 67m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T21:10:12.729 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (59m) 6m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T21:10:12.730 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (59m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T21:10:12.730 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (58m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T21:10:12.730 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (58m) 6m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T21:10:12.730 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (57m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T21:10:12.730 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (57m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T21:10:12.731 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (56m) 5m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T21:10:12.731 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (56m) 5m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T21:10:12.731 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (66m) 5m ago 67m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T21:10:12.731 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 6m ago 64m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:10:12.732 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 5m ago 64m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:10:12.978 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T21:10:12.978 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T21:10:12.979 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:10:12.979 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:10:12.979 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T21:10:12.979 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:10:12.980 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:10:12.980 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T21:10:12.980 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:10:12.980 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:10:12.981 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T21:10:12.981 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T21:10:12.981 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:10:12.981 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T21:10:12.981 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T21:10:13.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:13 gibba023 bash[30844]: cluster 2021-03-10T21:10:11.979990+0000 mgr.gibba044.wflcwh (mgr.34466) 3298 : cluster [DBG] pgmap v1866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:13.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:13 gibba023 bash[30844]: audit 2021-03-10T21:10:12.486213+0000 mgr.gibba044.wflcwh (mgr.34466) 3299 : audit [DBG] from='client.56251 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:10:13.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:13 gibba023 bash[30844]: audit 2021-03-10T21:10:12.713715+0000 mgr.gibba044.wflcwh (mgr.34466) 3300 : audit [DBG] from='client.56257 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:10:13.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:13 gibba023 bash[30844]: audit 2021-03-10T21:10:12.974757+0000 mon.a (mon.0) 1460 : audit [DBG] from='client.? 172.21.2.123:0/3917410924' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:13.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:13 gibba023 bash[31815]: cluster 2021-03-10T21:10:11.979990+0000 mgr.gibba044.wflcwh (mgr.34466) 3298 : cluster [DBG] pgmap v1866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:13.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:13 gibba023 bash[31815]: audit 2021-03-10T21:10:12.486213+0000 mgr.gibba044.wflcwh (mgr.34466) 3299 : audit [DBG] from='client.56251 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:10:13.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:13 gibba023 bash[31815]: audit 2021-03-10T21:10:12.713715+0000 mgr.gibba044.wflcwh (mgr.34466) 3300 : audit [DBG] from='client.56257 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:10:13.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:13 gibba023 bash[31815]: audit 2021-03-10T21:10:12.974757+0000 mon.a (mon.0) 1460 : audit [DBG] from='client.? 172.21.2.123:0/3917410924' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:13.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:13 gibba044 bash[25485]: cluster 2021-03-10T21:10:11.979990+0000 mgr.gibba044.wflcwh (mgr.34466) 3298 : cluster [DBG] pgmap v1866: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:13.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:13 gibba044 bash[25485]: audit 2021-03-10T21:10:12.486213+0000 mgr.gibba044.wflcwh (mgr.34466) 3299 : audit [DBG] from='client.56251 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:10:13.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:13 gibba044 bash[25485]: audit 2021-03-10T21:10:12.713715+0000 mgr.gibba044.wflcwh (mgr.34466) 3300 : audit [DBG] from='client.56257 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:10:13.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:13 gibba044 bash[25485]: audit 2021-03-10T21:10:12.974757+0000 mon.a (mon.0) 1460 : audit [DBG] from='client.? 172.21.2.123:0/3917410924' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:15.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:15 gibba023 bash[30844]: cluster 2021-03-10T21:10:13.980803+0000 mgr.gibba044.wflcwh (mgr.34466) 3301 : cluster [DBG] pgmap v1867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:15.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:15 gibba023 bash[31815]: cluster 2021-03-10T21:10:13.980803+0000 mgr.gibba044.wflcwh (mgr.34466) 3301 : cluster [DBG] pgmap v1867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:15.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:15 gibba044 bash[25485]: cluster 2021-03-10T21:10:13.980803+0000 mgr.gibba044.wflcwh (mgr.34466) 3301 : cluster [DBG] pgmap v1867: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:17.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:17 gibba023 bash[30844]: cluster 2021-03-10T21:10:15.982432+0000 mgr.gibba044.wflcwh (mgr.34466) 3302 : cluster [DBG] pgmap v1868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:17.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:17 gibba023 bash[31815]: cluster 2021-03-10T21:10:15.982432+0000 mgr.gibba044.wflcwh (mgr.34466) 3302 : cluster [DBG] pgmap v1868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:17.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:17 gibba044 bash[25485]: cluster 2021-03-10T21:10:15.982432+0000 mgr.gibba044.wflcwh (mgr.34466) 3302 : cluster [DBG] pgmap v1868: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:19.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:18 gibba023 bash[30844]: cluster 2021-03-10T21:10:17.984216+0000 mgr.gibba044.wflcwh (mgr.34466) 3303 : cluster [DBG] pgmap v1869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:19.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:18 gibba023 bash[31815]: cluster 2021-03-10T21:10:17.984216+0000 mgr.gibba044.wflcwh (mgr.34466) 3303 : cluster [DBG] pgmap v1869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:19.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:18 gibba044 bash[25485]: cluster 2021-03-10T21:10:17.984216+0000 mgr.gibba044.wflcwh (mgr.34466) 3303 : cluster [DBG] pgmap v1869: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:20.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:19 gibba023 bash[30844]: cephadm 2021-03-10T21:10:18.840148+0000 mgr.gibba044.wflcwh (mgr.34466) 3304 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:10:20.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:19 gibba023 bash[31815]: cephadm 2021-03-10T21:10:18.840148+0000 mgr.gibba044.wflcwh (mgr.34466) 3304 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:10:20.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:19 gibba044 bash[25485]: cephadm 2021-03-10T21:10:18.840148+0000 mgr.gibba044.wflcwh (mgr.34466) 3304 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:10:21.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:20 gibba023 bash[30844]: cluster 2021-03-10T21:10:19.985503+0000 mgr.gibba044.wflcwh (mgr.34466) 3305 : cluster [DBG] pgmap v1870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:21.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:20 gibba023 bash[31815]: cluster 2021-03-10T21:10:19.985503+0000 mgr.gibba044.wflcwh (mgr.34466) 3305 : cluster [DBG] pgmap v1870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:21.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:20 gibba044 bash[25485]: cluster 2021-03-10T21:10:19.985503+0000 mgr.gibba044.wflcwh (mgr.34466) 3305 : cluster [DBG] pgmap v1870: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:23.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:23 gibba023 bash[30844]: cluster 2021-03-10T21:10:21.987152+0000 mgr.gibba044.wflcwh (mgr.34466) 3306 : cluster [DBG] pgmap v1871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:23.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:23 gibba023 bash[31815]: cluster 2021-03-10T21:10:21.987152+0000 mgr.gibba044.wflcwh (mgr.34466) 3306 : cluster [DBG] pgmap v1871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:23.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:23 gibba044 bash[25485]: cluster 2021-03-10T21:10:21.987152+0000 mgr.gibba044.wflcwh (mgr.34466) 3306 : cluster [DBG] pgmap v1871: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:25.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:25 gibba023 bash[30844]: cluster 2021-03-10T21:10:23.988939+0000 mgr.gibba044.wflcwh (mgr.34466) 3307 : cluster [DBG] pgmap v1872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:25.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:25 gibba023 bash[31815]: cluster 2021-03-10T21:10:23.988939+0000 mgr.gibba044.wflcwh (mgr.34466) 3307 : cluster [DBG] pgmap v1872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:25.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:25 gibba044 bash[25485]: cluster 2021-03-10T21:10:23.988939+0000 mgr.gibba044.wflcwh (mgr.34466) 3307 : cluster [DBG] pgmap v1872: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:27.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:27 gibba023 bash[30844]: cluster 2021-03-10T21:10:25.990709+0000 mgr.gibba044.wflcwh (mgr.34466) 3308 : cluster [DBG] pgmap v1873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:27.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:27 gibba023 bash[31815]: cluster 2021-03-10T21:10:25.990709+0000 mgr.gibba044.wflcwh (mgr.34466) 3308 : cluster [DBG] pgmap v1873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:27.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:27 gibba044 bash[25485]: cluster 2021-03-10T21:10:25.990709+0000 mgr.gibba044.wflcwh (mgr.34466) 3308 : cluster [DBG] pgmap v1873: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:28.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:28 gibba023 bash[30844]: audit 2021-03-10T21:10:27.453282+0000 mon.a (mon.0) 1461 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:10:28.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:28 gibba023 bash[30844]: audit 2021-03-10T21:10:27.453972+0000 mon.a (mon.0) 1462 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:10:28.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:28 gibba023 bash[30844]: audit 2021-03-10T21:10:27.454661+0000 mon.a (mon.0) 1463 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T21:10:28.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:28 gibba023 bash[30844]: audit 2021-03-10T21:10:27.455425+0000 mon.a (mon.0) 1464 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T21:10:28.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:28 gibba023 bash[30844]: audit 2021-03-10T21:10:27.456106+0000 mon.a (mon.0) 1465 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T21:10:28.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:28 gibba023 bash[30844]: audit 2021-03-10T21:10:27.456811+0000 mon.a (mon.0) 1466 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T21:10:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:28 gibba023 bash[31815]: audit 2021-03-10T21:10:27.453282+0000 mon.a (mon.0) 1461 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:10:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:28 gibba023 bash[31815]: audit 2021-03-10T21:10:27.453972+0000 mon.a (mon.0) 1462 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:10:28.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:28 gibba023 bash[31815]: audit 2021-03-10T21:10:27.454661+0000 mon.a (mon.0) 1463 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T21:10:28.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:28 gibba023 bash[31815]: audit 2021-03-10T21:10:27.455425+0000 mon.a (mon.0) 1464 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T21:10:28.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:28 gibba023 bash[31815]: audit 2021-03-10T21:10:27.456106+0000 mon.a (mon.0) 1465 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T21:10:28.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:28 gibba023 bash[31815]: audit 2021-03-10T21:10:27.456811+0000 mon.a (mon.0) 1466 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T21:10:28.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:28 gibba044 bash[25485]: audit 2021-03-10T21:10:27.453282+0000 mon.a (mon.0) 1461 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:10:28.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:28 gibba044 bash[25485]: audit 2021-03-10T21:10:27.453972+0000 mon.a (mon.0) 1462 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:10:28.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:28 gibba044 bash[25485]: audit 2021-03-10T21:10:27.454661+0000 mon.a (mon.0) 1463 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2021-03-10T21:10:28.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:28 gibba044 bash[25485]: audit 2021-03-10T21:10:27.455425+0000 mon.a (mon.0) 1464 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T21:10:28.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:28 gibba044 bash[25485]: audit 2021-03-10T21:10:27.456106+0000 mon.a (mon.0) 1465 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2021-03-10T21:10:28.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:28 gibba044 bash[25485]: audit 2021-03-10T21:10:27.456811+0000 mon.a (mon.0) 1466 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2021-03-10T21:10:29.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:29 gibba023 bash[30844]: cluster 2021-03-10T21:10:27.992510+0000 mgr.gibba044.wflcwh (mgr.34466) 3309 : cluster [DBG] pgmap v1874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:29.458 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:29 gibba023 bash[31815]: cluster 2021-03-10T21:10:27.992510+0000 mgr.gibba044.wflcwh (mgr.34466) 3309 : cluster [DBG] pgmap v1874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:29.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:29 gibba044 bash[25485]: cluster 2021-03-10T21:10:27.992510+0000 mgr.gibba044.wflcwh (mgr.34466) 3309 : cluster [DBG] pgmap v1874: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:31.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:31 gibba023 bash[30844]: cluster 2021-03-10T21:10:29.994098+0000 mgr.gibba044.wflcwh (mgr.34466) 3310 : cluster [DBG] pgmap v1875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:31.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:31 gibba023 bash[31815]: cluster 2021-03-10T21:10:29.994098+0000 mgr.gibba044.wflcwh (mgr.34466) 3310 : cluster [DBG] pgmap v1875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:31.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:31 gibba044 bash[25485]: cluster 2021-03-10T21:10:29.994098+0000 mgr.gibba044.wflcwh (mgr.34466) 3310 : cluster [DBG] pgmap v1875: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:33.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:33 gibba023 bash[30844]: cluster 2021-03-10T21:10:31.995719+0000 mgr.gibba044.wflcwh (mgr.34466) 3311 : cluster [DBG] pgmap v1876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:33.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:33 gibba023 bash[31815]: cluster 2021-03-10T21:10:31.995719+0000 mgr.gibba044.wflcwh (mgr.34466) 3311 : cluster [DBG] pgmap v1876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:33.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:33 gibba044 bash[25485]: cluster 2021-03-10T21:10:31.995719+0000 mgr.gibba044.wflcwh (mgr.34466) 3311 : cluster [DBG] pgmap v1876: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:35.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:35 gibba023 bash[30844]: cephadm 2021-03-10T21:10:33.856212+0000 mgr.gibba044.wflcwh (mgr.34466) 3312 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:10:35.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:35 gibba023 bash[30844]: cluster 2021-03-10T21:10:33.997510+0000 mgr.gibba044.wflcwh (mgr.34466) 3313 : cluster [DBG] pgmap v1877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:35.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:35 gibba023 bash[31815]: cephadm 2021-03-10T21:10:33.856212+0000 mgr.gibba044.wflcwh (mgr.34466) 3312 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:10:35.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:35 gibba023 bash[31815]: cluster 2021-03-10T21:10:33.997510+0000 mgr.gibba044.wflcwh (mgr.34466) 3313 : cluster [DBG] pgmap v1877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:35.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:35 gibba044 bash[25485]: cephadm 2021-03-10T21:10:33.856212+0000 mgr.gibba044.wflcwh (mgr.34466) 3312 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:10:35.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:35 gibba044 bash[25485]: cluster 2021-03-10T21:10:33.997510+0000 mgr.gibba044.wflcwh (mgr.34466) 3313 : cluster [DBG] pgmap v1877: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:37.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:37 gibba023 bash[30844]: cluster 2021-03-10T21:10:35.999109+0000 mgr.gibba044.wflcwh (mgr.34466) 3314 : cluster [DBG] pgmap v1878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:37.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:37 gibba023 bash[31815]: cluster 2021-03-10T21:10:35.999109+0000 mgr.gibba044.wflcwh (mgr.34466) 3314 : cluster [DBG] pgmap v1878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:37.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:37 gibba044 bash[25485]: cluster 2021-03-10T21:10:35.999109+0000 mgr.gibba044.wflcwh (mgr.34466) 3314 : cluster [DBG] pgmap v1878: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:39.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:38 gibba023 bash[30844]: cluster 2021-03-10T21:10:38.000741+0000 mgr.gibba044.wflcwh (mgr.34466) 3315 : cluster [DBG] pgmap v1879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:39.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:38 gibba023 bash[31815]: cluster 2021-03-10T21:10:38.000741+0000 mgr.gibba044.wflcwh (mgr.34466) 3315 : cluster [DBG] pgmap v1879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:39.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:38 gibba044 bash[25485]: cluster 2021-03-10T21:10:38.000741+0000 mgr.gibba044.wflcwh (mgr.34466) 3315 : cluster [DBG] pgmap v1879: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:41.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:41 gibba023 bash[30844]: cluster 2021-03-10T21:10:40.001993+0000 mgr.gibba044.wflcwh (mgr.34466) 3316 : cluster [DBG] pgmap v1880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:41.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:41 gibba023 bash[31815]: cluster 2021-03-10T21:10:40.001993+0000 mgr.gibba044.wflcwh (mgr.34466) 3316 : cluster [DBG] pgmap v1880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:41.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:41 gibba044 bash[25485]: cluster 2021-03-10T21:10:40.001993+0000 mgr.gibba044.wflcwh (mgr.34466) 3316 : cluster [DBG] pgmap v1880: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:43.222 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T21:10:43.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:43 gibba023 bash[30844]: cluster 2021-03-10T21:10:42.003476+0000 mgr.gibba044.wflcwh (mgr.34466) 3317 : cluster [DBG] pgmap v1881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:43.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:43 gibba023 bash[31815]: cluster 2021-03-10T21:10:42.003476+0000 mgr.gibba044.wflcwh (mgr.34466) 3317 : cluster [DBG] pgmap v1881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:43.451 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:10:43.452 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (61m) 7m ago 67m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T21:10:43.452 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (67m) 5m ago 67m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T21:10:43.452 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (62m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T21:10:43.452 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (62m) 5m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T21:10:43.453 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (61m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T21:10:43.453 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (61m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T21:10:43.453 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (60m) 5m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T21:10:43.453 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (61m) 7m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T21:10:43.454 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (67m) 7m ago 67m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T21:10:43.454 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (67m) 5m ago 67m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T21:10:43.454 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (60m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T21:10:43.454 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (59m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T21:10:43.455 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (59m) 7m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T21:10:43.455 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (58m) 7m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T21:10:43.455 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (58m) 5m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T21:10:43.455 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (57m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T21:10:43.455 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (57m) 5m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T21:10:43.456 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (57m) 5m ago 67m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T21:10:43.456 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (66m) 5m ago 67m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T21:10:43.456 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 7m ago 65m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:10:43.456 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 5m ago 65m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:10:43.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:43 gibba044 bash[25485]: cluster 2021-03-10T21:10:42.003476+0000 mgr.gibba044.wflcwh (mgr.34466) 3317 : cluster [DBG] pgmap v1881: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:43.702 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T21:10:43.702 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T21:10:43.703 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:10:43.703 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:10:43.703 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T21:10:43.704 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:10:43.704 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:10:43.704 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T21:10:43.704 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:10:43.705 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:10:43.705 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T21:10:43.705 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T21:10:43.705 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:10:43.706 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T21:10:43.706 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T21:10:44.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:44 gibba023 bash[30844]: audit 2021-03-10T21:10:43.209831+0000 mgr.gibba044.wflcwh (mgr.34466) 3318 : audit [DBG] from='client.56269 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:10:44.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:44 gibba023 bash[30844]: audit 2021-03-10T21:10:43.436471+0000 mgr.gibba044.wflcwh (mgr.34466) 3319 : audit [DBG] from='client.46296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:10:44.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:44 gibba023 bash[30844]: audit 2021-03-10T21:10:43.698822+0000 mon.a (mon.0) 1467 : audit [DBG] from='client.? 172.21.2.123:0/4286973660' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:44.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:44 gibba023 bash[31815]: audit 2021-03-10T21:10:43.209831+0000 mgr.gibba044.wflcwh (mgr.34466) 3318 : audit [DBG] from='client.56269 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:10:44.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:44 gibba023 bash[31815]: audit 2021-03-10T21:10:43.436471+0000 mgr.gibba044.wflcwh (mgr.34466) 3319 : audit [DBG] from='client.46296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:10:44.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:44 gibba023 bash[31815]: audit 2021-03-10T21:10:43.698822+0000 mon.a (mon.0) 1467 : audit [DBG] from='client.? 172.21.2.123:0/4286973660' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:44.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:44 gibba044 bash[25485]: audit 2021-03-10T21:10:43.209831+0000 mgr.gibba044.wflcwh (mgr.34466) 3318 : audit [DBG] from='client.56269 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:10:44.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:44 gibba044 bash[25485]: audit 2021-03-10T21:10:43.436471+0000 mgr.gibba044.wflcwh (mgr.34466) 3319 : audit [DBG] from='client.46296 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:10:44.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:44 gibba044 bash[25485]: audit 2021-03-10T21:10:43.698822+0000 mon.a (mon.0) 1467 : audit [DBG] from='client.? 172.21.2.123:0/4286973660' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:45.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:45 gibba023 bash[30844]: cluster 2021-03-10T21:10:44.005065+0000 mgr.gibba044.wflcwh (mgr.34466) 3320 : cluster [DBG] pgmap v1882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:45.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:45 gibba023 bash[31815]: cluster 2021-03-10T21:10:44.005065+0000 mgr.gibba044.wflcwh (mgr.34466) 3320 : cluster [DBG] pgmap v1882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:45.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:45 gibba044 bash[25485]: cluster 2021-03-10T21:10:44.005065+0000 mgr.gibba044.wflcwh (mgr.34466) 3320 : cluster [DBG] pgmap v1882: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:47.432 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:47 gibba023 bash[30844]: cluster 2021-03-10T21:10:46.006610+0000 mgr.gibba044.wflcwh (mgr.34466) 3321 : cluster [DBG] pgmap v1883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:47.433 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:47 gibba023 bash[31815]: cluster 2021-03-10T21:10:46.006610+0000 mgr.gibba044.wflcwh (mgr.34466) 3321 : cluster [DBG] pgmap v1883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:47.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:47 gibba044 bash[25485]: cluster 2021-03-10T21:10:46.006610+0000 mgr.gibba044.wflcwh (mgr.34466) 3321 : cluster [DBG] pgmap v1883: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:49.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:48 gibba023 bash[30844]: cluster 2021-03-10T21:10:48.008370+0000 mgr.gibba044.wflcwh (mgr.34466) 3322 : cluster [DBG] pgmap v1884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:49.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:48 gibba023 bash[31815]: cluster 2021-03-10T21:10:48.008370+0000 mgr.gibba044.wflcwh (mgr.34466) 3322 : cluster [DBG] pgmap v1884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:49.253 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:48 gibba044 bash[25485]: cluster 2021-03-10T21:10:48.008370+0000 mgr.gibba044.wflcwh (mgr.34466) 3322 : cluster [DBG] pgmap v1884: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:50.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[30844]: cephadm 2021-03-10T21:10:48.867473+0000 mgr.gibba044.wflcwh (mgr.34466) 3323 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:10:50.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[30844]: audit 2021-03-10T21:10:49.063159+0000 mon.a (mon.0) 1468 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:10:50.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[30844]: cephadm 2021-03-10T21:10:49.064467+0000 mgr.gibba044.wflcwh (mgr.34466) 3324 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:10:50.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[30844]: audit 2021-03-10T21:10:49.271784+0000 mon.a (mon.0) 1469 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:10:50.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[30844]: cephadm 2021-03-10T21:10:49.275341+0000 mgr.gibba044.wflcwh (mgr.34466) 3325 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:10:50.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[30844]: audit 2021-03-10T21:10:49.275659+0000 mon.a (mon.0) 1470 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:10:50.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[30844]: audit 2021-03-10T21:10:49.277525+0000 mon.a (mon.0) 1471 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:50.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[30844]: cephadm 2021-03-10T21:10:49.277844+0000 mgr.gibba044.wflcwh (mgr.34466) 3326 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:10:50.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[30844]: audit 2021-03-10T21:10:49.279206+0000 mon.a (mon.0) 1472 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:50.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[30844]: cephadm 2021-03-10T21:10:49.279340+0000 mgr.gibba044.wflcwh (mgr.34466) 3327 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:10:50.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[30844]: cephadm 2021-03-10T21:10:49.279377+0000 mgr.gibba044.wflcwh (mgr.34466) 3328 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:10:50.432 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[30844]: audit 2021-03-10T21:10:49.281094+0000 mon.a (mon.0) 1473 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:50.432 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[30844]: cephadm 2021-03-10T21:10:49.281311+0000 mgr.gibba044.wflcwh (mgr.34466) 3329 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:10:50.432 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[30844]: cephadm 2021-03-10T21:10:49.281347+0000 mgr.gibba044.wflcwh (mgr.34466) 3330 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:10:50.432 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[30844]: cephadm 2021-03-10T21:10:49.283081+0000 mgr.gibba044.wflcwh (mgr.34466) 3331 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:10:50.432 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[30844]: audit 2021-03-10T21:10:49.284267+0000 mon.a (mon.0) 1474 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:50.433 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[30844]: cephadm 2021-03-10T21:10:49.284320+0000 mgr.gibba044.wflcwh (mgr.34466) 3332 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:10:50.433 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[30844]: cephadm 2021-03-10T21:10:49.284356+0000 mgr.gibba044.wflcwh (mgr.34466) 3333 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:10:50.433 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[30844]: cephadm 2021-03-10T21:10:49.286414+0000 mgr.gibba044.wflcwh (mgr.34466) 3334 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:10:50.433 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[30844]: audit 2021-03-10T21:10:49.286526+0000 mon.a (mon.0) 1475 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:50.434 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[30844]: cephadm 2021-03-10T21:10:49.286722+0000 mgr.gibba044.wflcwh (mgr.34466) 3335 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:10:50.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[31815]: cephadm 2021-03-10T21:10:48.867473+0000 mgr.gibba044.wflcwh (mgr.34466) 3323 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:10:50.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[31815]: audit 2021-03-10T21:10:49.063159+0000 mon.a (mon.0) 1468 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:10:50.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[31815]: cephadm 2021-03-10T21:10:49.064467+0000 mgr.gibba044.wflcwh (mgr.34466) 3324 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:10:50.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[31815]: audit 2021-03-10T21:10:49.271784+0000 mon.a (mon.0) 1469 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:10:50.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[31815]: cephadm 2021-03-10T21:10:49.275341+0000 mgr.gibba044.wflcwh (mgr.34466) 3325 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:10:50.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[31815]: audit 2021-03-10T21:10:49.275659+0000 mon.a (mon.0) 1470 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:10:50.435 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[31815]: audit 2021-03-10T21:10:49.277525+0000 mon.a (mon.0) 1471 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:50.436 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[31815]: cephadm 2021-03-10T21:10:49.277844+0000 mgr.gibba044.wflcwh (mgr.34466) 3326 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:10:50.436 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[31815]: audit 2021-03-10T21:10:49.279206+0000 mon.a (mon.0) 1472 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:50.436 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[31815]: cephadm 2021-03-10T21:10:49.279340+0000 mgr.gibba044.wflcwh (mgr.34466) 3327 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:10:50.436 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[31815]: cephadm 2021-03-10T21:10:49.279377+0000 mgr.gibba044.wflcwh (mgr.34466) 3328 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:10:50.436 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[31815]: audit 2021-03-10T21:10:49.281094+0000 mon.a (mon.0) 1473 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:50.437 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[31815]: cephadm 2021-03-10T21:10:49.281311+0000 mgr.gibba044.wflcwh (mgr.34466) 3329 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:10:50.437 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[31815]: cephadm 2021-03-10T21:10:49.281347+0000 mgr.gibba044.wflcwh (mgr.34466) 3330 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:10:50.437 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[31815]: cephadm 2021-03-10T21:10:49.283081+0000 mgr.gibba044.wflcwh (mgr.34466) 3331 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:10:50.437 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[31815]: audit 2021-03-10T21:10:49.284267+0000 mon.a (mon.0) 1474 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:50.441 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[31815]: cephadm 2021-03-10T21:10:49.284320+0000 mgr.gibba044.wflcwh (mgr.34466) 3332 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:10:50.441 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[31815]: cephadm 2021-03-10T21:10:49.284356+0000 mgr.gibba044.wflcwh (mgr.34466) 3333 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:10:50.442 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[31815]: cephadm 2021-03-10T21:10:49.286414+0000 mgr.gibba044.wflcwh (mgr.34466) 3334 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:10:50.442 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[31815]: audit 2021-03-10T21:10:49.286526+0000 mon.a (mon.0) 1475 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:50.442 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[31815]: cephadm 2021-03-10T21:10:49.286722+0000 mgr.gibba044.wflcwh (mgr.34466) 3335 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:10:50.443 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[30844]: cephadm 2021-03-10T21:10:49.288850+0000 mgr.gibba044.wflcwh (mgr.34466) 3336 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:10:50.443 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[30844]: cephadm 2021-03-10T21:10:49.288887+0000 mgr.gibba044.wflcwh (mgr.34466) 3337 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:10:50.443 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[30844]: cephadm 2021-03-10T21:10:49.289017+0000 mgr.gibba044.wflcwh (mgr.34466) 3338 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:10:50.444 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[31815]: cephadm 2021-03-10T21:10:49.288850+0000 mgr.gibba044.wflcwh (mgr.34466) 3336 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:10:50.444 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[31815]: cephadm 2021-03-10T21:10:49.288887+0000 mgr.gibba044.wflcwh (mgr.34466) 3337 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:10:50.444 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:50 gibba023 bash[31815]: cephadm 2021-03-10T21:10:49.289017+0000 mgr.gibba044.wflcwh (mgr.34466) 3338 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:10:50.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:50 gibba044 bash[25485]: cephadm 2021-03-10T21:10:48.867473+0000 mgr.gibba044.wflcwh (mgr.34466) 3323 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:10:50.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:50 gibba044 bash[25485]: audit 2021-03-10T21:10:49.063159+0000 mon.a (mon.0) 1468 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:10:50.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:50 gibba044 bash[25485]: cephadm 2021-03-10T21:10:49.064467+0000 mgr.gibba044.wflcwh (mgr.34466) 3324 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:10:50.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:50 gibba044 bash[25485]: audit 2021-03-10T21:10:49.271784+0000 mon.a (mon.0) 1469 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:10:50.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:50 gibba044 bash[25485]: cephadm 2021-03-10T21:10:49.275341+0000 mgr.gibba044.wflcwh (mgr.34466) 3325 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:10:50.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:50 gibba044 bash[25485]: audit 2021-03-10T21:10:49.275659+0000 mon.a (mon.0) 1470 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:10:50.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:50 gibba044 bash[25485]: audit 2021-03-10T21:10:49.277525+0000 mon.a (mon.0) 1471 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:50.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:50 gibba044 bash[25485]: cephadm 2021-03-10T21:10:49.277844+0000 mgr.gibba044.wflcwh (mgr.34466) 3326 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:10:50.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:50 gibba044 bash[25485]: audit 2021-03-10T21:10:49.279206+0000 mon.a (mon.0) 1472 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:50.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:50 gibba044 bash[25485]: cephadm 2021-03-10T21:10:49.279340+0000 mgr.gibba044.wflcwh (mgr.34466) 3327 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:10:50.507 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:50 gibba044 bash[25485]: cephadm 2021-03-10T21:10:49.279377+0000 mgr.gibba044.wflcwh (mgr.34466) 3328 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:10:50.508 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:50 gibba044 bash[25485]: audit 2021-03-10T21:10:49.281094+0000 mon.a (mon.0) 1473 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:50.508 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:50 gibba044 bash[25485]: cephadm 2021-03-10T21:10:49.281311+0000 mgr.gibba044.wflcwh (mgr.34466) 3329 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:10:50.508 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:50 gibba044 bash[25485]: cephadm 2021-03-10T21:10:49.281347+0000 mgr.gibba044.wflcwh (mgr.34466) 3330 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:10:50.508 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:50 gibba044 bash[25485]: cephadm 2021-03-10T21:10:49.283081+0000 mgr.gibba044.wflcwh (mgr.34466) 3331 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:10:50.508 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:50 gibba044 bash[25485]: audit 2021-03-10T21:10:49.284267+0000 mon.a (mon.0) 1474 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:50.509 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:50 gibba044 bash[25485]: cephadm 2021-03-10T21:10:49.284320+0000 mgr.gibba044.wflcwh (mgr.34466) 3332 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:10:50.509 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:50 gibba044 bash[25485]: cephadm 2021-03-10T21:10:49.284356+0000 mgr.gibba044.wflcwh (mgr.34466) 3333 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:10:50.509 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:50 gibba044 bash[25485]: cephadm 2021-03-10T21:10:49.286414+0000 mgr.gibba044.wflcwh (mgr.34466) 3334 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:10:50.509 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:50 gibba044 bash[25485]: audit 2021-03-10T21:10:49.286526+0000 mon.a (mon.0) 1475 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:10:50.510 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:50 gibba044 bash[25485]: cephadm 2021-03-10T21:10:49.286722+0000 mgr.gibba044.wflcwh (mgr.34466) 3335 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:10:50.510 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:50 gibba044 bash[25485]: cephadm 2021-03-10T21:10:49.288850+0000 mgr.gibba044.wflcwh (mgr.34466) 3336 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:10:50.510 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:50 gibba044 bash[25485]: cephadm 2021-03-10T21:10:49.288887+0000 mgr.gibba044.wflcwh (mgr.34466) 3337 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:10:50.510 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:50 gibba044 bash[25485]: cephadm 2021-03-10T21:10:49.289017+0000 mgr.gibba044.wflcwh (mgr.34466) 3338 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:10:51.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:51 gibba023 bash[31815]: cluster 2021-03-10T21:10:50.008915+0000 mgr.gibba044.wflcwh (mgr.34466) 3339 : cluster [DBG] pgmap v1885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:51.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:51 gibba023 bash[30844]: cluster 2021-03-10T21:10:50.008915+0000 mgr.gibba044.wflcwh (mgr.34466) 3339 : cluster [DBG] pgmap v1885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:51.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:51 gibba044 bash[25485]: cluster 2021-03-10T21:10:50.008915+0000 mgr.gibba044.wflcwh (mgr.34466) 3339 : cluster [DBG] pgmap v1885: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:53.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:53 gibba023 bash[30844]: cluster 2021-03-10T21:10:52.010163+0000 mgr.gibba044.wflcwh (mgr.34466) 3340 : cluster [DBG] pgmap v1886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:53.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:53 gibba023 bash[31815]: cluster 2021-03-10T21:10:52.010163+0000 mgr.gibba044.wflcwh (mgr.34466) 3340 : cluster [DBG] pgmap v1886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:53.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:53 gibba044 bash[25485]: cluster 2021-03-10T21:10:52.010163+0000 mgr.gibba044.wflcwh (mgr.34466) 3340 : cluster [DBG] pgmap v1886: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:55.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:55 gibba023 bash[30844]: cluster 2021-03-10T21:10:54.011940+0000 mgr.gibba044.wflcwh (mgr.34466) 3341 : cluster [DBG] pgmap v1887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:55.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:55 gibba023 bash[31815]: cluster 2021-03-10T21:10:54.011940+0000 mgr.gibba044.wflcwh (mgr.34466) 3341 : cluster [DBG] pgmap v1887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:55.754 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:55 gibba044 bash[25485]: cluster 2021-03-10T21:10:54.011940+0000 mgr.gibba044.wflcwh (mgr.34466) 3341 : cluster [DBG] pgmap v1887: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:57.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:57 gibba023 bash[30844]: cluster 2021-03-10T21:10:56.013629+0000 mgr.gibba044.wflcwh (mgr.34466) 3342 : cluster [DBG] pgmap v1888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:57.678 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:57 gibba023 bash[31815]: cluster 2021-03-10T21:10:56.013629+0000 mgr.gibba044.wflcwh (mgr.34466) 3342 : cluster [DBG] pgmap v1888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:57.755 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:57 gibba044 bash[25485]: cluster 2021-03-10T21:10:56.013629+0000 mgr.gibba044.wflcwh (mgr.34466) 3342 : cluster [DBG] pgmap v1888: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:59.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:10:58 gibba023 bash[30844]: cluster 2021-03-10T21:10:58.015158+0000 mgr.gibba044.wflcwh (mgr.34466) 3343 : cluster [DBG] pgmap v1889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:59.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:10:58 gibba023 bash[31815]: cluster 2021-03-10T21:10:58.015158+0000 mgr.gibba044.wflcwh (mgr.34466) 3343 : cluster [DBG] pgmap v1889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:10:59.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:10:58 gibba044 bash[25485]: cluster 2021-03-10T21:10:58.015158+0000 mgr.gibba044.wflcwh (mgr.34466) 3343 : cluster [DBG] pgmap v1889: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:01.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:01 gibba023 bash[30844]: cluster 2021-03-10T21:11:00.016367+0000 mgr.gibba044.wflcwh (mgr.34466) 3344 : cluster [DBG] pgmap v1890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:01.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:01 gibba023 bash[31815]: cluster 2021-03-10T21:11:00.016367+0000 mgr.gibba044.wflcwh (mgr.34466) 3344 : cluster [DBG] pgmap v1890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:01.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:01 gibba044 bash[25485]: cluster 2021-03-10T21:11:00.016367+0000 mgr.gibba044.wflcwh (mgr.34466) 3344 : cluster [DBG] pgmap v1890: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:03.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:03 gibba023 bash[30844]: cluster 2021-03-10T21:11:02.017990+0000 mgr.gibba044.wflcwh (mgr.34466) 3345 : cluster [DBG] pgmap v1891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:03.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:03 gibba023 bash[31815]: cluster 2021-03-10T21:11:02.017990+0000 mgr.gibba044.wflcwh (mgr.34466) 3345 : cluster [DBG] pgmap v1891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:03.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:03 gibba044 bash[25485]: cluster 2021-03-10T21:11:02.017990+0000 mgr.gibba044.wflcwh (mgr.34466) 3345 : cluster [DBG] pgmap v1891: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:05.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:05 gibba023 bash[30844]: cluster 2021-03-10T21:11:04.019824+0000 mgr.gibba044.wflcwh (mgr.34466) 3346 : cluster [DBG] pgmap v1892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:05.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:05 gibba023 bash[30844]: cephadm 2021-03-10T21:11:04.304881+0000 mgr.gibba044.wflcwh (mgr.34466) 3347 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:11:05.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:05 gibba023 bash[31815]: cluster 2021-03-10T21:11:04.019824+0000 mgr.gibba044.wflcwh (mgr.34466) 3346 : cluster [DBG] pgmap v1892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:05.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:05 gibba023 bash[31815]: cephadm 2021-03-10T21:11:04.304881+0000 mgr.gibba044.wflcwh (mgr.34466) 3347 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:11:05.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:05 gibba044 bash[25485]: cluster 2021-03-10T21:11:04.019824+0000 mgr.gibba044.wflcwh (mgr.34466) 3346 : cluster [DBG] pgmap v1892: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:05.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:05 gibba044 bash[25485]: cephadm 2021-03-10T21:11:04.304881+0000 mgr.gibba044.wflcwh (mgr.34466) 3347 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:11:07.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:07 gibba023 bash[30844]: cluster 2021-03-10T21:11:06.021696+0000 mgr.gibba044.wflcwh (mgr.34466) 3348 : cluster [DBG] pgmap v1893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:07.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:07 gibba023 bash[31815]: cluster 2021-03-10T21:11:06.021696+0000 mgr.gibba044.wflcwh (mgr.34466) 3348 : cluster [DBG] pgmap v1893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:07.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:07 gibba044 bash[25485]: cluster 2021-03-10T21:11:06.021696+0000 mgr.gibba044.wflcwh (mgr.34466) 3348 : cluster [DBG] pgmap v1893: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:09.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:08 gibba023 bash[30844]: cluster 2021-03-10T21:11:08.023395+0000 mgr.gibba044.wflcwh (mgr.34466) 3349 : cluster [DBG] pgmap v1894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:09.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:08 gibba023 bash[31815]: cluster 2021-03-10T21:11:08.023395+0000 mgr.gibba044.wflcwh (mgr.34466) 3349 : cluster [DBG] pgmap v1894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:09.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:08 gibba044 bash[25485]: cluster 2021-03-10T21:11:08.023395+0000 mgr.gibba044.wflcwh (mgr.34466) 3349 : cluster [DBG] pgmap v1894: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:11.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:11 gibba023 bash[30844]: cluster 2021-03-10T21:11:10.023938+0000 mgr.gibba044.wflcwh (mgr.34466) 3350 : cluster [DBG] pgmap v1895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:11.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:11 gibba023 bash[31815]: cluster 2021-03-10T21:11:10.023938+0000 mgr.gibba044.wflcwh (mgr.34466) 3350 : cluster [DBG] pgmap v1895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:11.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:11 gibba044 bash[25485]: cluster 2021-03-10T21:11:10.023938+0000 mgr.gibba044.wflcwh (mgr.34466) 3350 : cluster [DBG] pgmap v1895: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:13.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:13 gibba023 bash[30844]: cluster 2021-03-10T21:11:12.025178+0000 mgr.gibba044.wflcwh (mgr.34466) 3351 : cluster [DBG] pgmap v1896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:13.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:13 gibba023 bash[31815]: cluster 2021-03-10T21:11:12.025178+0000 mgr.gibba044.wflcwh (mgr.34466) 3351 : cluster [DBG] pgmap v1896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:13.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:13 gibba044 bash[25485]: cluster 2021-03-10T21:11:12.025178+0000 mgr.gibba044.wflcwh (mgr.34466) 3351 : cluster [DBG] pgmap v1896: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:13.947 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T21:11:14.196 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:11:14.196 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (62m) 7m ago 67m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T21:11:14.196 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (67m) 6m ago 67m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T21:11:14.197 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (62m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T21:11:14.197 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (63m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T21:11:14.197 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (62m) 7m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T21:11:14.197 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (61m) 7m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T21:11:14.198 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (61m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T21:11:14.198 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (61m) 7m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T21:11:14.198 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (68m) 7m ago 68m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T21:11:14.199 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (68m) 6m ago 68m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T21:11:14.199 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (60m) 7m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T21:11:14.199 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (60m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T21:11:14.199 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (59m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T21:11:14.200 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (59m) 7m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T21:11:14.200 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (58m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T21:11:14.200 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (58m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T21:11:14.200 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (58m) 6m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T21:11:14.200 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (57m) 6m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T21:11:14.201 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (67m) 6m ago 68m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T21:11:14.201 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 7m ago 65m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:11:14.201 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 6m ago 65m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:11:14.444 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T21:11:14.444 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T21:11:14.444 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:11:14.445 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:11:14.445 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T21:11:14.445 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:11:14.445 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:11:14.446 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T21:11:14.446 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:11:14.446 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:11:14.446 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T21:11:14.446 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T21:11:14.447 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:11:14.447 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T21:11:14.447 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T21:11:15.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:15 gibba023 bash[30844]: audit 2021-03-10T21:11:13.936515+0000 mgr.gibba044.wflcwh (mgr.34466) 3352 : audit [DBG] from='client.56287 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:11:15.821 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:15 gibba023 bash[30844]: cluster 2021-03-10T21:11:14.026843+0000 mgr.gibba044.wflcwh (mgr.34466) 3353 : cluster [DBG] pgmap v1897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:15.821 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:15 gibba023 bash[30844]: audit 2021-03-10T21:11:14.161486+0000 mgr.gibba044.wflcwh (mgr.34466) 3354 : audit [DBG] from='client.46314 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:11:15.821 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:15 gibba023 bash[30844]: audit 2021-03-10T21:11:14.440486+0000 mon.a (mon.0) 1476 : audit [DBG] from='client.? 172.21.2.123:0/2163544078' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:15.822 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:15 gibba023 bash[31815]: audit 2021-03-10T21:11:13.936515+0000 mgr.gibba044.wflcwh (mgr.34466) 3352 : audit [DBG] from='client.56287 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:11:15.822 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:15 gibba023 bash[31815]: cluster 2021-03-10T21:11:14.026843+0000 mgr.gibba044.wflcwh (mgr.34466) 3353 : cluster [DBG] pgmap v1897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:15.822 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:15 gibba023 bash[31815]: audit 2021-03-10T21:11:14.161486+0000 mgr.gibba044.wflcwh (mgr.34466) 3354 : audit [DBG] from='client.46314 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:11:15.822 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:15 gibba023 bash[31815]: audit 2021-03-10T21:11:14.440486+0000 mon.a (mon.0) 1476 : audit [DBG] from='client.? 172.21.2.123:0/2163544078' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:15.823 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:15 gibba044 bash[25485]: audit 2021-03-10T21:11:13.936515+0000 mgr.gibba044.wflcwh (mgr.34466) 3352 : audit [DBG] from='client.56287 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:11:15.823 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:15 gibba044 bash[25485]: cluster 2021-03-10T21:11:14.026843+0000 mgr.gibba044.wflcwh (mgr.34466) 3353 : cluster [DBG] pgmap v1897: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:15.824 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:15 gibba044 bash[25485]: audit 2021-03-10T21:11:14.161486+0000 mgr.gibba044.wflcwh (mgr.34466) 3354 : audit [DBG] from='client.46314 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:11:15.824 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:15 gibba044 bash[25485]: audit 2021-03-10T21:11:14.440486+0000 mon.a (mon.0) 1476 : audit [DBG] from='client.? 172.21.2.123:0/2163544078' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:17.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:17 gibba023 bash[30844]: cluster 2021-03-10T21:11:16.028603+0000 mgr.gibba044.wflcwh (mgr.34466) 3355 : cluster [DBG] pgmap v1898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:17.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:17 gibba023 bash[31815]: cluster 2021-03-10T21:11:16.028603+0000 mgr.gibba044.wflcwh (mgr.34466) 3355 : cluster [DBG] pgmap v1898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:17.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:17 gibba044 bash[25485]: cluster 2021-03-10T21:11:16.028603+0000 mgr.gibba044.wflcwh (mgr.34466) 3355 : cluster [DBG] pgmap v1898: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:19.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:18 gibba023 bash[30844]: cluster 2021-03-10T21:11:18.029986+0000 mgr.gibba044.wflcwh (mgr.34466) 3356 : cluster [DBG] pgmap v1899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:19.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:18 gibba023 bash[31815]: cluster 2021-03-10T21:11:18.029986+0000 mgr.gibba044.wflcwh (mgr.34466) 3356 : cluster [DBG] pgmap v1899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:19.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:18 gibba044 bash[25485]: cluster 2021-03-10T21:11:18.029986+0000 mgr.gibba044.wflcwh (mgr.34466) 3356 : cluster [DBG] pgmap v1899: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:20.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:19 gibba023 bash[30844]: cephadm 2021-03-10T21:11:19.320885+0000 mgr.gibba044.wflcwh (mgr.34466) 3357 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:11:20.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:19 gibba023 bash[31815]: cephadm 2021-03-10T21:11:19.320885+0000 mgr.gibba044.wflcwh (mgr.34466) 3357 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:11:20.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:19 gibba044 bash[25485]: cephadm 2021-03-10T21:11:19.320885+0000 mgr.gibba044.wflcwh (mgr.34466) 3357 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:11:21.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:20 gibba023 bash[30844]: cluster 2021-03-10T21:11:20.031258+0000 mgr.gibba044.wflcwh (mgr.34466) 3358 : cluster [DBG] pgmap v1900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:21.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:20 gibba023 bash[31815]: cluster 2021-03-10T21:11:20.031258+0000 mgr.gibba044.wflcwh (mgr.34466) 3358 : cluster [DBG] pgmap v1900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:21.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:20 gibba044 bash[25485]: cluster 2021-03-10T21:11:20.031258+0000 mgr.gibba044.wflcwh (mgr.34466) 3358 : cluster [DBG] pgmap v1900: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:23.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:23 gibba023 bash[30844]: cluster 2021-03-10T21:11:22.032713+0000 mgr.gibba044.wflcwh (mgr.34466) 3359 : cluster [DBG] pgmap v1901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:23.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:23 gibba023 bash[31815]: cluster 2021-03-10T21:11:22.032713+0000 mgr.gibba044.wflcwh (mgr.34466) 3359 : cluster [DBG] pgmap v1901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:23.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:23 gibba044 bash[25485]: cluster 2021-03-10T21:11:22.032713+0000 mgr.gibba044.wflcwh (mgr.34466) 3359 : cluster [DBG] pgmap v1901: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:25.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:25 gibba023 bash[30844]: cluster 2021-03-10T21:11:24.034575+0000 mgr.gibba044.wflcwh (mgr.34466) 3360 : cluster [DBG] pgmap v1902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:25.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:25 gibba023 bash[31815]: cluster 2021-03-10T21:11:24.034575+0000 mgr.gibba044.wflcwh (mgr.34466) 3360 : cluster [DBG] pgmap v1902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:25.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:25 gibba044 bash[25485]: cluster 2021-03-10T21:11:24.034575+0000 mgr.gibba044.wflcwh (mgr.34466) 3360 : cluster [DBG] pgmap v1902: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:27.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:27 gibba023 bash[30844]: cluster 2021-03-10T21:11:26.036281+0000 mgr.gibba044.wflcwh (mgr.34466) 3361 : cluster [DBG] pgmap v1903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:27.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:27 gibba023 bash[31815]: cluster 2021-03-10T21:11:26.036281+0000 mgr.gibba044.wflcwh (mgr.34466) 3361 : cluster [DBG] pgmap v1903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:27.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:27 gibba044 bash[25485]: cluster 2021-03-10T21:11:26.036281+0000 mgr.gibba044.wflcwh (mgr.34466) 3361 : cluster [DBG] pgmap v1903: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:28.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:28 gibba023 bash[30844]: audit 2021-03-10T21:11:27.460427+0000 mon.a (mon.0) 1477 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:11:28.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:28 gibba023 bash[30844]: audit 2021-03-10T21:11:27.461102+0000 mon.a (mon.0) 1478 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:11:28.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:28 gibba023 bash[30844]: audit 2021-03-10T21:11:27.461714+0000 mon.a (mon.0) 1479 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T21:11:28.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:28 gibba023 bash[30844]: audit 2021-03-10T21:11:27.462482+0000 mon.a (mon.0) 1480 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T21:11:28.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:28 gibba023 bash[30844]: audit 2021-03-10T21:11:27.463168+0000 mon.a (mon.0) 1481 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T21:11:28.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:28 gibba023 bash[30844]: audit 2021-03-10T21:11:27.463849+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:11:28.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:28 gibba023 bash[31815]: audit 2021-03-10T21:11:27.460427+0000 mon.a (mon.0) 1477 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:11:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:28 gibba023 bash[31815]: audit 2021-03-10T21:11:27.461102+0000 mon.a (mon.0) 1478 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:11:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:28 gibba023 bash[31815]: audit 2021-03-10T21:11:27.461714+0000 mon.a (mon.0) 1479 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T21:11:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:28 gibba023 bash[31815]: audit 2021-03-10T21:11:27.462482+0000 mon.a (mon.0) 1480 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T21:11:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:28 gibba023 bash[31815]: audit 2021-03-10T21:11:27.463168+0000 mon.a (mon.0) 1481 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T21:11:28.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:28 gibba023 bash[31815]: audit 2021-03-10T21:11:27.463849+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:11:28.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:28 gibba044 bash[25485]: audit 2021-03-10T21:11:27.460427+0000 mon.a (mon.0) 1477 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:11:28.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:28 gibba044 bash[25485]: audit 2021-03-10T21:11:27.461102+0000 mon.a (mon.0) 1478 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:11:28.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:28 gibba044 bash[25485]: audit 2021-03-10T21:11:27.461714+0000 mon.a (mon.0) 1479 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2021-03-10T21:11:28.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:28 gibba044 bash[25485]: audit 2021-03-10T21:11:27.462482+0000 mon.a (mon.0) 1480 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 5]}]: dispatch 2021-03-10T21:11:28.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:28 gibba044 bash[25485]: audit 2021-03-10T21:11:27.463168+0000 mon.a (mon.0) 1481 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2021-03-10T21:11:28.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:28 gibba044 bash[25485]: audit 2021-03-10T21:11:27.463849+0000 mon.a (mon.0) 1482 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:11:29.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:29 gibba023 bash[30844]: cluster 2021-03-10T21:11:28.037963+0000 mgr.gibba044.wflcwh (mgr.34466) 3362 : cluster [DBG] pgmap v1904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:29.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:29 gibba023 bash[31815]: cluster 2021-03-10T21:11:28.037963+0000 mgr.gibba044.wflcwh (mgr.34466) 3362 : cluster [DBG] pgmap v1904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:29.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:29 gibba044 bash[25485]: cluster 2021-03-10T21:11:28.037963+0000 mgr.gibba044.wflcwh (mgr.34466) 3362 : cluster [DBG] pgmap v1904: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:31.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:31 gibba023 bash[30844]: cluster 2021-03-10T21:11:30.038507+0000 mgr.gibba044.wflcwh (mgr.34466) 3363 : cluster [DBG] pgmap v1905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:31.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:31 gibba023 bash[31815]: cluster 2021-03-10T21:11:30.038507+0000 mgr.gibba044.wflcwh (mgr.34466) 3363 : cluster [DBG] pgmap v1905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:31.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:31 gibba044 bash[25485]: cluster 2021-03-10T21:11:30.038507+0000 mgr.gibba044.wflcwh (mgr.34466) 3363 : cluster [DBG] pgmap v1905: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:33.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:33 gibba023 bash[30844]: cluster 2021-03-10T21:11:32.039902+0000 mgr.gibba044.wflcwh (mgr.34466) 3364 : cluster [DBG] pgmap v1906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:33.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:33 gibba023 bash[31815]: cluster 2021-03-10T21:11:32.039902+0000 mgr.gibba044.wflcwh (mgr.34466) 3364 : cluster [DBG] pgmap v1906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:33.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:33 gibba044 bash[25485]: cluster 2021-03-10T21:11:32.039902+0000 mgr.gibba044.wflcwh (mgr.34466) 3364 : cluster [DBG] pgmap v1906: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:35.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:35 gibba023 bash[30844]: cluster 2021-03-10T21:11:34.041763+0000 mgr.gibba044.wflcwh (mgr.34466) 3365 : cluster [DBG] pgmap v1907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:35.433 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:35 gibba023 bash[30844]: cephadm 2021-03-10T21:11:34.336587+0000 mgr.gibba044.wflcwh (mgr.34466) 3366 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:11:35.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:35 gibba023 bash[31815]: cluster 2021-03-10T21:11:34.041763+0000 mgr.gibba044.wflcwh (mgr.34466) 3365 : cluster [DBG] pgmap v1907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:35.434 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:35 gibba023 bash[31815]: cephadm 2021-03-10T21:11:34.336587+0000 mgr.gibba044.wflcwh (mgr.34466) 3366 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:11:35.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:35 gibba044 bash[25485]: cluster 2021-03-10T21:11:34.041763+0000 mgr.gibba044.wflcwh (mgr.34466) 3365 : cluster [DBG] pgmap v1907: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:35.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:35 gibba044 bash[25485]: cephadm 2021-03-10T21:11:34.336587+0000 mgr.gibba044.wflcwh (mgr.34466) 3366 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:11:37.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:37 gibba023 bash[30844]: cluster 2021-03-10T21:11:36.043320+0000 mgr.gibba044.wflcwh (mgr.34466) 3367 : cluster [DBG] pgmap v1908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:37.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:37 gibba023 bash[31815]: cluster 2021-03-10T21:11:36.043320+0000 mgr.gibba044.wflcwh (mgr.34466) 3367 : cluster [DBG] pgmap v1908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:37.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:37 gibba044 bash[25485]: cluster 2021-03-10T21:11:36.043320+0000 mgr.gibba044.wflcwh (mgr.34466) 3367 : cluster [DBG] pgmap v1908: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:39.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:38 gibba023 bash[30844]: cluster 2021-03-10T21:11:38.044981+0000 mgr.gibba044.wflcwh (mgr.34466) 3368 : cluster [DBG] pgmap v1909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:39.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:38 gibba023 bash[31815]: cluster 2021-03-10T21:11:38.044981+0000 mgr.gibba044.wflcwh (mgr.34466) 3368 : cluster [DBG] pgmap v1909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:39.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:38 gibba044 bash[25485]: cluster 2021-03-10T21:11:38.044981+0000 mgr.gibba044.wflcwh (mgr.34466) 3368 : cluster [DBG] pgmap v1909: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:41.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:41 gibba023 bash[30844]: cluster 2021-03-10T21:11:40.045574+0000 mgr.gibba044.wflcwh (mgr.34466) 3369 : cluster [DBG] pgmap v1910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:41.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:41 gibba023 bash[31815]: cluster 2021-03-10T21:11:40.045574+0000 mgr.gibba044.wflcwh (mgr.34466) 3369 : cluster [DBG] pgmap v1910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:41.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:41 gibba044 bash[25485]: cluster 2021-03-10T21:11:40.045574+0000 mgr.gibba044.wflcwh (mgr.34466) 3369 : cluster [DBG] pgmap v1910: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:43.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:43 gibba023 bash[30844]: cluster 2021-03-10T21:11:42.046998+0000 mgr.gibba044.wflcwh (mgr.34466) 3370 : cluster [DBG] pgmap v1911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:43.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:43 gibba023 bash[31815]: cluster 2021-03-10T21:11:42.046998+0000 mgr.gibba044.wflcwh (mgr.34466) 3370 : cluster [DBG] pgmap v1911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:43.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:43 gibba044 bash[25485]: cluster 2021-03-10T21:11:42.046998+0000 mgr.gibba044.wflcwh (mgr.34466) 3370 : cluster [DBG] pgmap v1911: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:44.686 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T21:11:44.910 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:11:44.910 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (62m) 8m ago 68m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T21:11:44.911 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (68m) 6m ago 68m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T21:11:44.911 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (63m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T21:11:44.911 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (63m) 6m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T21:11:44.911 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (62m) 8m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T21:11:44.912 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (62m) 8m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T21:11:44.912 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (61m) 6m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T21:11:44.912 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (62m) 8m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T21:11:44.912 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (68m) 8m ago 68m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T21:11:44.912 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (68m) 6m ago 68m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T21:11:44.913 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (61m) 8m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T21:11:44.913 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (60m) 8m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T21:11:44.913 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (60m) 8m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T21:11:44.913 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (59m) 8m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T21:11:44.914 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (59m) 6m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T21:11:44.914 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (58m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T21:11:44.914 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (58m) 6m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T21:11:44.915 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (58m) 6m ago 68m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T21:11:44.915 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (67m) 6m ago 68m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T21:11:44.915 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 8m ago 66m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:11:44.915 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 6m ago 66m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:11:45.158 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T21:11:45.159 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T21:11:45.159 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:11:45.159 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:11:45.160 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T21:11:45.160 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:11:45.160 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:11:45.160 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T21:11:45.161 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:11:45.161 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:11:45.161 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T21:11:45.161 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T21:11:45.162 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:11:45.162 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T21:11:45.162 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T21:11:45.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:45 gibba023 bash[30844]: cluster 2021-03-10T21:11:44.048922+0000 mgr.gibba044.wflcwh (mgr.34466) 3371 : cluster [DBG] pgmap v1912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:45.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:45 gibba023 bash[30844]: audit 2021-03-10T21:11:44.675347+0000 mgr.gibba044.wflcwh (mgr.34466) 3372 : audit [DBG] from='client.46326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:11:45.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:45 gibba023 bash[31815]: cluster 2021-03-10T21:11:44.048922+0000 mgr.gibba044.wflcwh (mgr.34466) 3371 : cluster [DBG] pgmap v1912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:45.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:45 gibba023 bash[31815]: audit 2021-03-10T21:11:44.675347+0000 mgr.gibba044.wflcwh (mgr.34466) 3372 : audit [DBG] from='client.46326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:11:45.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:45 gibba044 bash[25485]: cluster 2021-03-10T21:11:44.048922+0000 mgr.gibba044.wflcwh (mgr.34466) 3371 : cluster [DBG] pgmap v1912: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:45.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:45 gibba044 bash[25485]: audit 2021-03-10T21:11:44.675347+0000 mgr.gibba044.wflcwh (mgr.34466) 3372 : audit [DBG] from='client.46326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:11:46.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:46 gibba023 bash[30844]: audit 2021-03-10T21:11:44.899474+0000 mgr.gibba044.wflcwh (mgr.34466) 3373 : audit [DBG] from='client.56311 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:11:46.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:46 gibba023 bash[30844]: audit 2021-03-10T21:11:45.155309+0000 mon.a (mon.0) 1483 : audit [DBG] from='client.? 172.21.2.123:0/2787458341' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:46.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:46 gibba023 bash[31815]: audit 2021-03-10T21:11:44.899474+0000 mgr.gibba044.wflcwh (mgr.34466) 3373 : audit [DBG] from='client.56311 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:11:46.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:46 gibba023 bash[31815]: audit 2021-03-10T21:11:45.155309+0000 mon.a (mon.0) 1483 : audit [DBG] from='client.? 172.21.2.123:0/2787458341' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:46.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:46 gibba044 bash[25485]: audit 2021-03-10T21:11:44.899474+0000 mgr.gibba044.wflcwh (mgr.34466) 3373 : audit [DBG] from='client.56311 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:11:46.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:46 gibba044 bash[25485]: audit 2021-03-10T21:11:45.155309+0000 mon.a (mon.0) 1483 : audit [DBG] from='client.? 172.21.2.123:0/2787458341' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:47.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:47 gibba023 bash[30844]: cluster 2021-03-10T21:11:46.050386+0000 mgr.gibba044.wflcwh (mgr.34466) 3374 : cluster [DBG] pgmap v1913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:47.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:47 gibba023 bash[31815]: cluster 2021-03-10T21:11:46.050386+0000 mgr.gibba044.wflcwh (mgr.34466) 3374 : cluster [DBG] pgmap v1913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:47.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:47 gibba044 bash[25485]: cluster 2021-03-10T21:11:46.050386+0000 mgr.gibba044.wflcwh (mgr.34466) 3374 : cluster [DBG] pgmap v1913: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:49.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:48 gibba023 bash[30844]: cluster 2021-03-10T21:11:48.052165+0000 mgr.gibba044.wflcwh (mgr.34466) 3375 : cluster [DBG] pgmap v1914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:49.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:48 gibba023 bash[31815]: cluster 2021-03-10T21:11:48.052165+0000 mgr.gibba044.wflcwh (mgr.34466) 3375 : cluster [DBG] pgmap v1914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:49.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:48 gibba044 bash[25485]: cluster 2021-03-10T21:11:48.052165+0000 mgr.gibba044.wflcwh (mgr.34466) 3375 : cluster [DBG] pgmap v1914: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:50.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[30844]: cephadm 2021-03-10T21:11:49.353301+0000 mgr.gibba044.wflcwh (mgr.34466) 3376 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:11:50.930 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[30844]: cephadm 2021-03-10T21:11:49.354854+0000 mgr.gibba044.wflcwh (mgr.34466) 3377 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:11:50.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[30844]: audit 2021-03-10T21:11:49.564388+0000 mon.a (mon.0) 1484 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:11:50.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[30844]: cephadm 2021-03-10T21:11:49.567968+0000 mgr.gibba044.wflcwh (mgr.34466) 3378 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:11:50.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[30844]: audit 2021-03-10T21:11:49.568088+0000 mon.a (mon.0) 1485 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:11:50.931 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[30844]: audit 2021-03-10T21:11:49.569805+0000 mon.a (mon.0) 1486 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:50.932 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[30844]: cephadm 2021-03-10T21:11:49.570024+0000 mgr.gibba044.wflcwh (mgr.34466) 3379 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:11:50.932 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[30844]: audit 2021-03-10T21:11:49.571517+0000 mon.a (mon.0) 1487 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:50.932 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[30844]: cephadm 2021-03-10T21:11:49.571606+0000 mgr.gibba044.wflcwh (mgr.34466) 3380 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:11:50.932 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[30844]: cephadm 2021-03-10T21:11:49.571743+0000 mgr.gibba044.wflcwh (mgr.34466) 3381 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:11:50.932 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[30844]: audit 2021-03-10T21:11:49.573092+0000 mon.a (mon.0) 1488 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:50.933 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[30844]: cephadm 2021-03-10T21:11:49.573331+0000 mgr.gibba044.wflcwh (mgr.34466) 3382 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:11:50.933 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[30844]: cephadm 2021-03-10T21:11:49.573392+0000 mgr.gibba044.wflcwh (mgr.34466) 3383 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:11:50.933 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[30844]: cephadm 2021-03-10T21:11:49.574685+0000 mgr.gibba044.wflcwh (mgr.34466) 3384 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:11:50.933 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[30844]: audit 2021-03-10T21:11:49.575884+0000 mon.a (mon.0) 1489 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:50.933 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[30844]: cephadm 2021-03-10T21:11:49.575991+0000 mgr.gibba044.wflcwh (mgr.34466) 3385 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:11:50.934 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[30844]: cephadm 2021-03-10T21:11:49.576048+0000 mgr.gibba044.wflcwh (mgr.34466) 3386 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:11:50.934 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[30844]: audit 2021-03-10T21:11:49.577584+0000 mon.a (mon.0) 1490 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:50.934 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[30844]: cephadm 2021-03-10T21:11:49.577773+0000 mgr.gibba044.wflcwh (mgr.34466) 3387 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:11:50.934 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[30844]: cephadm 2021-03-10T21:11:49.578112+0000 mgr.gibba044.wflcwh (mgr.34466) 3388 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:11:50.935 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[30844]: cephadm 2021-03-10T21:11:49.579338+0000 mgr.gibba044.wflcwh (mgr.34466) 3389 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:11:50.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[31815]: cephadm 2021-03-10T21:11:49.353301+0000 mgr.gibba044.wflcwh (mgr.34466) 3376 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:11:50.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[31815]: cephadm 2021-03-10T21:11:49.354854+0000 mgr.gibba044.wflcwh (mgr.34466) 3377 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:11:50.935 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[31815]: audit 2021-03-10T21:11:49.564388+0000 mon.a (mon.0) 1484 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:11:50.936 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[31815]: cephadm 2021-03-10T21:11:49.567968+0000 mgr.gibba044.wflcwh (mgr.34466) 3378 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:11:50.936 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[31815]: audit 2021-03-10T21:11:49.568088+0000 mon.a (mon.0) 1485 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:11:50.936 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[31815]: audit 2021-03-10T21:11:49.569805+0000 mon.a (mon.0) 1486 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:50.936 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[31815]: cephadm 2021-03-10T21:11:49.570024+0000 mgr.gibba044.wflcwh (mgr.34466) 3379 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:11:50.937 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[31815]: audit 2021-03-10T21:11:49.571517+0000 mon.a (mon.0) 1487 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:50.937 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[31815]: cephadm 2021-03-10T21:11:49.571606+0000 mgr.gibba044.wflcwh (mgr.34466) 3380 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:11:50.937 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[31815]: cephadm 2021-03-10T21:11:49.571743+0000 mgr.gibba044.wflcwh (mgr.34466) 3381 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:11:50.937 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[31815]: audit 2021-03-10T21:11:49.573092+0000 mon.a (mon.0) 1488 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:50.938 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[31815]: cephadm 2021-03-10T21:11:49.573331+0000 mgr.gibba044.wflcwh (mgr.34466) 3382 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:11:50.938 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[31815]: cephadm 2021-03-10T21:11:49.573392+0000 mgr.gibba044.wflcwh (mgr.34466) 3383 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:11:50.938 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[31815]: cephadm 2021-03-10T21:11:49.574685+0000 mgr.gibba044.wflcwh (mgr.34466) 3384 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:11:50.938 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[31815]: audit 2021-03-10T21:11:49.575884+0000 mon.a (mon.0) 1489 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:50.939 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[31815]: cephadm 2021-03-10T21:11:49.575991+0000 mgr.gibba044.wflcwh (mgr.34466) 3385 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:11:50.939 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[31815]: cephadm 2021-03-10T21:11:49.576048+0000 mgr.gibba044.wflcwh (mgr.34466) 3386 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:11:50.939 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[31815]: audit 2021-03-10T21:11:49.577584+0000 mon.a (mon.0) 1490 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:50.939 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[31815]: cephadm 2021-03-10T21:11:49.577773+0000 mgr.gibba044.wflcwh (mgr.34466) 3387 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:11:50.939 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[31815]: cephadm 2021-03-10T21:11:49.578112+0000 mgr.gibba044.wflcwh (mgr.34466) 3388 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:11:50.940 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[31815]: cephadm 2021-03-10T21:11:49.579338+0000 mgr.gibba044.wflcwh (mgr.34466) 3389 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:11:50.940 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[30844]: cephadm 2021-03-10T21:11:49.579445+0000 mgr.gibba044.wflcwh (mgr.34466) 3390 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:11:50.940 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[30844]: cephadm 2021-03-10T21:11:49.579814+0000 mgr.gibba044.wflcwh (mgr.34466) 3391 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:11:50.941 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[31815]: cephadm 2021-03-10T21:11:49.579445+0000 mgr.gibba044.wflcwh (mgr.34466) 3390 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:11:50.941 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:50 gibba023 bash[31815]: cephadm 2021-03-10T21:11:49.579814+0000 mgr.gibba044.wflcwh (mgr.34466) 3391 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:11:51.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:50 gibba044 bash[25485]: cephadm 2021-03-10T21:11:49.353301+0000 mgr.gibba044.wflcwh (mgr.34466) 3376 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:11:51.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:50 gibba044 bash[25485]: cephadm 2021-03-10T21:11:49.354854+0000 mgr.gibba044.wflcwh (mgr.34466) 3377 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:11:51.005 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:50 gibba044 bash[25485]: audit 2021-03-10T21:11:49.564388+0000 mon.a (mon.0) 1484 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:11:51.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:50 gibba044 bash[25485]: cephadm 2021-03-10T21:11:49.567968+0000 mgr.gibba044.wflcwh (mgr.34466) 3378 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:11:51.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:50 gibba044 bash[25485]: audit 2021-03-10T21:11:49.568088+0000 mon.a (mon.0) 1485 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:11:51.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:50 gibba044 bash[25485]: audit 2021-03-10T21:11:49.569805+0000 mon.a (mon.0) 1486 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:51.006 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:50 gibba044 bash[25485]: cephadm 2021-03-10T21:11:49.570024+0000 mgr.gibba044.wflcwh (mgr.34466) 3379 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:11:51.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:50 gibba044 bash[25485]: audit 2021-03-10T21:11:49.571517+0000 mon.a (mon.0) 1487 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:51.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:50 gibba044 bash[25485]: cephadm 2021-03-10T21:11:49.571606+0000 mgr.gibba044.wflcwh (mgr.34466) 3380 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:11:51.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:50 gibba044 bash[25485]: cephadm 2021-03-10T21:11:49.571743+0000 mgr.gibba044.wflcwh (mgr.34466) 3381 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:11:51.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:50 gibba044 bash[25485]: audit 2021-03-10T21:11:49.573092+0000 mon.a (mon.0) 1488 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:51.007 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:50 gibba044 bash[25485]: cephadm 2021-03-10T21:11:49.573331+0000 mgr.gibba044.wflcwh (mgr.34466) 3382 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:11:51.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:50 gibba044 bash[25485]: cephadm 2021-03-10T21:11:49.573392+0000 mgr.gibba044.wflcwh (mgr.34466) 3383 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:11:51.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:50 gibba044 bash[25485]: cephadm 2021-03-10T21:11:49.574685+0000 mgr.gibba044.wflcwh (mgr.34466) 3384 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:11:51.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:50 gibba044 bash[25485]: audit 2021-03-10T21:11:49.575884+0000 mon.a (mon.0) 1489 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:51.008 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:50 gibba044 bash[25485]: cephadm 2021-03-10T21:11:49.575991+0000 mgr.gibba044.wflcwh (mgr.34466) 3385 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:11:51.009 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:50 gibba044 bash[25485]: cephadm 2021-03-10T21:11:49.576048+0000 mgr.gibba044.wflcwh (mgr.34466) 3386 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:11:51.009 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:50 gibba044 bash[25485]: audit 2021-03-10T21:11:49.577584+0000 mon.a (mon.0) 1490 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:11:51.009 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:50 gibba044 bash[25485]: cephadm 2021-03-10T21:11:49.577773+0000 mgr.gibba044.wflcwh (mgr.34466) 3387 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:11:51.009 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:50 gibba044 bash[25485]: cephadm 2021-03-10T21:11:49.578112+0000 mgr.gibba044.wflcwh (mgr.34466) 3388 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:11:51.009 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:50 gibba044 bash[25485]: cephadm 2021-03-10T21:11:49.579338+0000 mgr.gibba044.wflcwh (mgr.34466) 3389 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:11:51.010 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:50 gibba044 bash[25485]: cephadm 2021-03-10T21:11:49.579445+0000 mgr.gibba044.wflcwh (mgr.34466) 3390 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:11:51.010 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:50 gibba044 bash[25485]: cephadm 2021-03-10T21:11:49.579814+0000 mgr.gibba044.wflcwh (mgr.34466) 3391 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:11:51.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:51 gibba023 bash[30844]: cluster 2021-03-10T21:11:50.052744+0000 mgr.gibba044.wflcwh (mgr.34466) 3392 : cluster [DBG] pgmap v1915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:51.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:51 gibba023 bash[31815]: cluster 2021-03-10T21:11:50.052744+0000 mgr.gibba044.wflcwh (mgr.34466) 3392 : cluster [DBG] pgmap v1915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:52.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:51 gibba044 bash[25485]: cluster 2021-03-10T21:11:50.052744+0000 mgr.gibba044.wflcwh (mgr.34466) 3392 : cluster [DBG] pgmap v1915: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:53.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:53 gibba023 bash[30844]: cluster 2021-03-10T21:11:52.054274+0000 mgr.gibba044.wflcwh (mgr.34466) 3393 : cluster [DBG] pgmap v1916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:53.928 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:53 gibba023 bash[31815]: cluster 2021-03-10T21:11:52.054274+0000 mgr.gibba044.wflcwh (mgr.34466) 3393 : cluster [DBG] pgmap v1916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:54.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:53 gibba044 bash[25485]: cluster 2021-03-10T21:11:52.054274+0000 mgr.gibba044.wflcwh (mgr.34466) 3393 : cluster [DBG] pgmap v1916: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:55.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:55 gibba023 bash[30844]: cluster 2021-03-10T21:11:54.056009+0000 mgr.gibba044.wflcwh (mgr.34466) 3394 : cluster [DBG] pgmap v1917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:55.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:55 gibba023 bash[31815]: cluster 2021-03-10T21:11:54.056009+0000 mgr.gibba044.wflcwh (mgr.34466) 3394 : cluster [DBG] pgmap v1917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:56.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:55 gibba044 bash[25485]: cluster 2021-03-10T21:11:54.056009+0000 mgr.gibba044.wflcwh (mgr.34466) 3394 : cluster [DBG] pgmap v1917: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:57.928 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:57 gibba023 bash[30844]: cluster 2021-03-10T21:11:56.057564+0000 mgr.gibba044.wflcwh (mgr.34466) 3395 : cluster [DBG] pgmap v1918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:57.929 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:57 gibba023 bash[31815]: cluster 2021-03-10T21:11:56.057564+0000 mgr.gibba044.wflcwh (mgr.34466) 3395 : cluster [DBG] pgmap v1918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:58.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:57 gibba044 bash[25485]: cluster 2021-03-10T21:11:56.057564+0000 mgr.gibba044.wflcwh (mgr.34466) 3395 : cluster [DBG] pgmap v1918: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:59.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:11:58 gibba023 bash[30844]: cluster 2021-03-10T21:11:58.059231+0000 mgr.gibba044.wflcwh (mgr.34466) 3396 : cluster [DBG] pgmap v1919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:59.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:11:58 gibba023 bash[31815]: cluster 2021-03-10T21:11:58.059231+0000 mgr.gibba044.wflcwh (mgr.34466) 3396 : cluster [DBG] pgmap v1919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:11:59.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:11:58 gibba044 bash[25485]: cluster 2021-03-10T21:11:58.059231+0000 mgr.gibba044.wflcwh (mgr.34466) 3396 : cluster [DBG] pgmap v1919: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:01.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:01 gibba023 bash[30844]: cluster 2021-03-10T21:12:00.060618+0000 mgr.gibba044.wflcwh (mgr.34466) 3397 : cluster [DBG] pgmap v1920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:01.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:01 gibba023 bash[31815]: cluster 2021-03-10T21:12:00.060618+0000 mgr.gibba044.wflcwh (mgr.34466) 3397 : cluster [DBG] pgmap v1920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:01.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:01 gibba044 bash[25485]: cluster 2021-03-10T21:12:00.060618+0000 mgr.gibba044.wflcwh (mgr.34466) 3397 : cluster [DBG] pgmap v1920: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:03.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:03 gibba023 bash[30844]: cluster 2021-03-10T21:12:02.062215+0000 mgr.gibba044.wflcwh (mgr.34466) 3398 : cluster [DBG] pgmap v1921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:03.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:03 gibba023 bash[31815]: cluster 2021-03-10T21:12:02.062215+0000 mgr.gibba044.wflcwh (mgr.34466) 3398 : cluster [DBG] pgmap v1921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:03.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:03 gibba044 bash[25485]: cluster 2021-03-10T21:12:02.062215+0000 mgr.gibba044.wflcwh (mgr.34466) 3398 : cluster [DBG] pgmap v1921: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:05.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:05 gibba023 bash[30844]: cluster 2021-03-10T21:12:04.063903+0000 mgr.gibba044.wflcwh (mgr.34466) 3399 : cluster [DBG] pgmap v1922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:05.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:05 gibba023 bash[30844]: cephadm 2021-03-10T21:12:04.590617+0000 mgr.gibba044.wflcwh (mgr.34466) 3400 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:12:05.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:05 gibba023 bash[31815]: cluster 2021-03-10T21:12:04.063903+0000 mgr.gibba044.wflcwh (mgr.34466) 3399 : cluster [DBG] pgmap v1922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:05.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:05 gibba023 bash[31815]: cephadm 2021-03-10T21:12:04.590617+0000 mgr.gibba044.wflcwh (mgr.34466) 3400 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:12:05.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:05 gibba044 bash[25485]: cluster 2021-03-10T21:12:04.063903+0000 mgr.gibba044.wflcwh (mgr.34466) 3399 : cluster [DBG] pgmap v1922: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:05.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:05 gibba044 bash[25485]: cephadm 2021-03-10T21:12:04.590617+0000 mgr.gibba044.wflcwh (mgr.34466) 3400 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:12:07.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:07 gibba023 bash[30844]: cluster 2021-03-10T21:12:06.065446+0000 mgr.gibba044.wflcwh (mgr.34466) 3401 : cluster [DBG] pgmap v1923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:07.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:07 gibba023 bash[31815]: cluster 2021-03-10T21:12:06.065446+0000 mgr.gibba044.wflcwh (mgr.34466) 3401 : cluster [DBG] pgmap v1923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:07.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:07 gibba044 bash[25485]: cluster 2021-03-10T21:12:06.065446+0000 mgr.gibba044.wflcwh (mgr.34466) 3401 : cluster [DBG] pgmap v1923: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:09.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:08 gibba023 bash[30844]: cluster 2021-03-10T21:12:08.066791+0000 mgr.gibba044.wflcwh (mgr.34466) 3402 : cluster [DBG] pgmap v1924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:09.178 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:08 gibba023 bash[31815]: cluster 2021-03-10T21:12:08.066791+0000 mgr.gibba044.wflcwh (mgr.34466) 3402 : cluster [DBG] pgmap v1924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:09.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:08 gibba044 bash[25485]: cluster 2021-03-10T21:12:08.066791+0000 mgr.gibba044.wflcwh (mgr.34466) 3402 : cluster [DBG] pgmap v1924: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:11.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:11 gibba023 bash[30844]: cluster 2021-03-10T21:12:10.067717+0000 mgr.gibba044.wflcwh (mgr.34466) 3403 : cluster [DBG] pgmap v1925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:11.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:11 gibba023 bash[31815]: cluster 2021-03-10T21:12:10.067717+0000 mgr.gibba044.wflcwh (mgr.34466) 3403 : cluster [DBG] pgmap v1925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:11.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:11 gibba044 bash[25485]: cluster 2021-03-10T21:12:10.067717+0000 mgr.gibba044.wflcwh (mgr.34466) 3403 : cluster [DBG] pgmap v1925: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:13.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:13 gibba023 bash[30844]: cluster 2021-03-10T21:12:12.069182+0000 mgr.gibba044.wflcwh (mgr.34466) 3404 : cluster [DBG] pgmap v1926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:13.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:13 gibba023 bash[31815]: cluster 2021-03-10T21:12:12.069182+0000 mgr.gibba044.wflcwh (mgr.34466) 3404 : cluster [DBG] pgmap v1926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:13.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:13 gibba044 bash[25485]: cluster 2021-03-10T21:12:12.069182+0000 mgr.gibba044.wflcwh (mgr.34466) 3404 : cluster [DBG] pgmap v1926: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:15.400 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T21:12:15.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:15 gibba023 bash[30844]: cluster 2021-03-10T21:12:14.070854+0000 mgr.gibba044.wflcwh (mgr.34466) 3405 : cluster [DBG] pgmap v1927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:15.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:15 gibba023 bash[31815]: cluster 2021-03-10T21:12:14.070854+0000 mgr.gibba044.wflcwh (mgr.34466) 3405 : cluster [DBG] pgmap v1927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:15.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:15 gibba044 bash[25485]: cluster 2021-03-10T21:12:14.070854+0000 mgr.gibba044.wflcwh (mgr.34466) 3405 : cluster [DBG] pgmap v1927: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:15.628 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:12:15.629 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (63m) 8m ago 68m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T21:12:15.629 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (68m) 7m ago 68m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T21:12:15.629 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (63m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T21:12:15.630 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (64m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T21:12:15.630 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (63m) 8m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T21:12:15.630 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (62m) 8m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T21:12:15.630 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (62m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T21:12:15.631 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (62m) 8m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T21:12:15.631 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (69m) 8m ago 69m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T21:12:15.631 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (69m) 7m ago 69m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T21:12:15.631 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (61m) 8m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T21:12:15.631 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (61m) 8m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T21:12:15.632 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (60m) 8m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T21:12:15.632 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (60m) 8m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T21:12:15.632 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (59m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T21:12:15.632 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (59m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T21:12:15.633 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (59m) 7m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T21:12:15.633 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (58m) 7m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T21:12:15.633 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (68m) 7m ago 69m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T21:12:15.633 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 8m ago 66m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:12:15.633 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 7m ago 66m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:12:15.881 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T21:12:15.881 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T21:12:15.881 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:12:15.882 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:12:15.882 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T21:12:15.882 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:12:15.882 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:12:15.882 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T21:12:15.883 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:12:15.883 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:12:15.883 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T21:12:15.883 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T21:12:15.884 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:12:15.884 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T21:12:15.884 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T21:12:16.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:16 gibba023 bash[30844]: audit 2021-03-10T21:12:15.388784+0000 mgr.gibba044.wflcwh (mgr.34466) 3406 : audit [DBG] from='client.56323 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:12:16.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:16 gibba023 bash[30844]: audit 2021-03-10T21:12:15.613391+0000 mgr.gibba044.wflcwh (mgr.34466) 3407 : audit [DBG] from='client.56329 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:12:16.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:16 gibba023 bash[30844]: audit 2021-03-10T21:12:15.877320+0000 mon.c (mon.1) 73 : audit [DBG] from='client.? 172.21.2.123:0/357622629' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:16.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:16 gibba023 bash[31815]: audit 2021-03-10T21:12:15.388784+0000 mgr.gibba044.wflcwh (mgr.34466) 3406 : audit [DBG] from='client.56323 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:12:16.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:16 gibba023 bash[31815]: audit 2021-03-10T21:12:15.613391+0000 mgr.gibba044.wflcwh (mgr.34466) 3407 : audit [DBG] from='client.56329 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:12:16.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:16 gibba023 bash[31815]: audit 2021-03-10T21:12:15.877320+0000 mon.c (mon.1) 73 : audit [DBG] from='client.? 172.21.2.123:0/357622629' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:16.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:16 gibba044 bash[25485]: audit 2021-03-10T21:12:15.388784+0000 mgr.gibba044.wflcwh (mgr.34466) 3406 : audit [DBG] from='client.56323 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:12:16.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:16 gibba044 bash[25485]: audit 2021-03-10T21:12:15.613391+0000 mgr.gibba044.wflcwh (mgr.34466) 3407 : audit [DBG] from='client.56329 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:12:16.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:16 gibba044 bash[25485]: audit 2021-03-10T21:12:15.877320+0000 mon.c (mon.1) 73 : audit [DBG] from='client.? 172.21.2.123:0/357622629' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:17.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:17 gibba023 bash[30844]: cluster 2021-03-10T21:12:16.072532+0000 mgr.gibba044.wflcwh (mgr.34466) 3408 : cluster [DBG] pgmap v1928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:17.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:17 gibba023 bash[31815]: cluster 2021-03-10T21:12:16.072532+0000 mgr.gibba044.wflcwh (mgr.34466) 3408 : cluster [DBG] pgmap v1928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:17.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:17 gibba044 bash[25485]: cluster 2021-03-10T21:12:16.072532+0000 mgr.gibba044.wflcwh (mgr.34466) 3408 : cluster [DBG] pgmap v1928: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:19.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:18 gibba023 bash[30844]: cluster 2021-03-10T21:12:18.073946+0000 mgr.gibba044.wflcwh (mgr.34466) 3409 : cluster [DBG] pgmap v1929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:19.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:18 gibba023 bash[31815]: cluster 2021-03-10T21:12:18.073946+0000 mgr.gibba044.wflcwh (mgr.34466) 3409 : cluster [DBG] pgmap v1929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:19.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:18 gibba044 bash[25485]: cluster 2021-03-10T21:12:18.073946+0000 mgr.gibba044.wflcwh (mgr.34466) 3409 : cluster [DBG] pgmap v1929: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:20.004 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:19 gibba044 bash[25485]: cephadm 2021-03-10T21:12:19.606550+0000 mgr.gibba044.wflcwh (mgr.34466) 3410 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:12:20.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:19 gibba023 bash[30844]: cephadm 2021-03-10T21:12:19.606550+0000 mgr.gibba044.wflcwh (mgr.34466) 3410 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:12:20.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:19 gibba023 bash[31815]: cephadm 2021-03-10T21:12:19.606550+0000 mgr.gibba044.wflcwh (mgr.34466) 3410 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:12:21.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:20 gibba023 bash[30844]: cluster 2021-03-10T21:12:20.075342+0000 mgr.gibba044.wflcwh (mgr.34466) 3411 : cluster [DBG] pgmap v1930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:21.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:20 gibba023 bash[31815]: cluster 2021-03-10T21:12:20.075342+0000 mgr.gibba044.wflcwh (mgr.34466) 3411 : cluster [DBG] pgmap v1930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:21.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:20 gibba044 bash[25485]: cluster 2021-03-10T21:12:20.075342+0000 mgr.gibba044.wflcwh (mgr.34466) 3411 : cluster [DBG] pgmap v1930: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:23.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:23 gibba023 bash[30844]: cluster 2021-03-10T21:12:22.077080+0000 mgr.gibba044.wflcwh (mgr.34466) 3412 : cluster [DBG] pgmap v1931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:23.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:23 gibba023 bash[31815]: cluster 2021-03-10T21:12:22.077080+0000 mgr.gibba044.wflcwh (mgr.34466) 3412 : cluster [DBG] pgmap v1931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:23.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:23 gibba044 bash[25485]: cluster 2021-03-10T21:12:22.077080+0000 mgr.gibba044.wflcwh (mgr.34466) 3412 : cluster [DBG] pgmap v1931: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:25.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:25 gibba023 bash[30844]: cluster 2021-03-10T21:12:24.078690+0000 mgr.gibba044.wflcwh (mgr.34466) 3413 : cluster [DBG] pgmap v1932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:25.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:25 gibba023 bash[31815]: cluster 2021-03-10T21:12:24.078690+0000 mgr.gibba044.wflcwh (mgr.34466) 3413 : cluster [DBG] pgmap v1932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:25.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:25 gibba044 bash[25485]: cluster 2021-03-10T21:12:24.078690+0000 mgr.gibba044.wflcwh (mgr.34466) 3413 : cluster [DBG] pgmap v1932: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:27.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:27 gibba023 bash[30844]: cluster 2021-03-10T21:12:26.080377+0000 mgr.gibba044.wflcwh (mgr.34466) 3414 : cluster [DBG] pgmap v1933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:27.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:27 gibba023 bash[31815]: cluster 2021-03-10T21:12:26.080377+0000 mgr.gibba044.wflcwh (mgr.34466) 3414 : cluster [DBG] pgmap v1933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:27.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:27 gibba044 bash[25485]: cluster 2021-03-10T21:12:26.080377+0000 mgr.gibba044.wflcwh (mgr.34466) 3414 : cluster [DBG] pgmap v1933: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:28.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:28 gibba023 bash[30844]: audit 2021-03-10T21:12:27.467733+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:12:28.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:28 gibba023 bash[30844]: audit 2021-03-10T21:12:27.468424+0000 mon.a (mon.0) 1492 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:12:28.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:28 gibba023 bash[30844]: audit 2021-03-10T21:12:27.469051+0000 mon.a (mon.0) 1493 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T21:12:28.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:28 gibba023 bash[30844]: audit 2021-03-10T21:12:27.469798+0000 mon.a (mon.0) 1494 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T21:12:28.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:28 gibba023 bash[30844]: audit 2021-03-10T21:12:27.470556+0000 mon.a (mon.0) 1495 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T21:12:28.430 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:28 gibba023 bash[30844]: audit 2021-03-10T21:12:27.471280+0000 mon.a (mon.0) 1496 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:12:28.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:28 gibba023 bash[31815]: audit 2021-03-10T21:12:27.467733+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:12:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:28 gibba023 bash[31815]: audit 2021-03-10T21:12:27.468424+0000 mon.a (mon.0) 1492 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:12:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:28 gibba023 bash[31815]: audit 2021-03-10T21:12:27.469051+0000 mon.a (mon.0) 1493 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T21:12:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:28 gibba023 bash[31815]: audit 2021-03-10T21:12:27.469798+0000 mon.a (mon.0) 1494 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T21:12:28.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:28 gibba023 bash[31815]: audit 2021-03-10T21:12:27.470556+0000 mon.a (mon.0) 1495 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T21:12:28.432 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:28 gibba023 bash[31815]: audit 2021-03-10T21:12:27.471280+0000 mon.a (mon.0) 1496 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:12:28.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:28 gibba044 bash[25485]: audit 2021-03-10T21:12:27.467733+0000 mon.a (mon.0) 1491 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/trash_purge_schedule"}]: dispatch 2021-03-10T21:12:28.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:28 gibba044 bash[25485]: audit 2021-03-10T21:12:27.468424+0000 mon.a (mon.0) 1492 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/gibba044.wflcwh/mirror_snapshot_schedule"}]: dispatch 2021-03-10T21:12:28.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:28 gibba044 bash[25485]: audit 2021-03-10T21:12:27.469051+0000 mon.a (mon.0) 1493 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2021-03-10T21:12:28.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:28 gibba044 bash[25485]: audit 2021-03-10T21:12:27.469798+0000 mon.a (mon.0) 1494 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2021-03-10T21:12:28.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:28 gibba044 bash[25485]: audit 2021-03-10T21:12:27.470556+0000 mon.a (mon.0) 1495 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2021-03-10T21:12:28.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:28 gibba044 bash[25485]: audit 2021-03-10T21:12:27.471280+0000 mon.a (mon.0) 1496 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2021-03-10T21:12:29.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:29 gibba023 bash[30844]: cluster 2021-03-10T21:12:28.081794+0000 mgr.gibba044.wflcwh (mgr.34466) 3415 : cluster [DBG] pgmap v1934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:29.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:29 gibba023 bash[31815]: cluster 2021-03-10T21:12:28.081794+0000 mgr.gibba044.wflcwh (mgr.34466) 3415 : cluster [DBG] pgmap v1934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:29.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:29 gibba044 bash[25485]: cluster 2021-03-10T21:12:28.081794+0000 mgr.gibba044.wflcwh (mgr.34466) 3415 : cluster [DBG] pgmap v1934: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:31.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:31 gibba044 bash[25485]: cluster 2021-03-10T21:12:30.083000+0000 mgr.gibba044.wflcwh (mgr.34466) 3416 : cluster [DBG] pgmap v1935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:31.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:31 gibba023 bash[30844]: cluster 2021-03-10T21:12:30.083000+0000 mgr.gibba044.wflcwh (mgr.34466) 3416 : cluster [DBG] pgmap v1935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:31.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:31 gibba023 bash[31815]: cluster 2021-03-10T21:12:30.083000+0000 mgr.gibba044.wflcwh (mgr.34466) 3416 : cluster [DBG] pgmap v1935: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:33.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:33 gibba044 bash[25485]: cluster 2021-03-10T21:12:32.084792+0000 mgr.gibba044.wflcwh (mgr.34466) 3417 : cluster [DBG] pgmap v1936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:33.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:33 gibba023 bash[30844]: cluster 2021-03-10T21:12:32.084792+0000 mgr.gibba044.wflcwh (mgr.34466) 3417 : cluster [DBG] pgmap v1936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:33.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:33 gibba023 bash[31815]: cluster 2021-03-10T21:12:32.084792+0000 mgr.gibba044.wflcwh (mgr.34466) 3417 : cluster [DBG] pgmap v1936: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:35.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:35 gibba044 bash[25485]: cluster 2021-03-10T21:12:34.086385+0000 mgr.gibba044.wflcwh (mgr.34466) 3418 : cluster [DBG] pgmap v1937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:35.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:35 gibba044 bash[25485]: cephadm 2021-03-10T21:12:34.614587+0000 mgr.gibba044.wflcwh (mgr.34466) 3419 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:12:35.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:35 gibba023 bash[30844]: cluster 2021-03-10T21:12:34.086385+0000 mgr.gibba044.wflcwh (mgr.34466) 3418 : cluster [DBG] pgmap v1937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:35.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:35 gibba023 bash[30844]: cephadm 2021-03-10T21:12:34.614587+0000 mgr.gibba044.wflcwh (mgr.34466) 3419 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:12:35.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:35 gibba023 bash[31815]: cluster 2021-03-10T21:12:34.086385+0000 mgr.gibba044.wflcwh (mgr.34466) 3418 : cluster [DBG] pgmap v1937: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:35.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:35 gibba023 bash[31815]: cephadm 2021-03-10T21:12:34.614587+0000 mgr.gibba044.wflcwh (mgr.34466) 3419 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:12:37.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:37 gibba044 bash[25485]: cluster 2021-03-10T21:12:36.088161+0000 mgr.gibba044.wflcwh (mgr.34466) 3420 : cluster [DBG] pgmap v1938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:37.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:37 gibba023 bash[30844]: cluster 2021-03-10T21:12:36.088161+0000 mgr.gibba044.wflcwh (mgr.34466) 3420 : cluster [DBG] pgmap v1938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:37.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:37 gibba023 bash[31815]: cluster 2021-03-10T21:12:36.088161+0000 mgr.gibba044.wflcwh (mgr.34466) 3420 : cluster [DBG] pgmap v1938: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:39.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:38 gibba023 bash[30844]: cluster 2021-03-10T21:12:38.089595+0000 mgr.gibba044.wflcwh (mgr.34466) 3421 : cluster [DBG] pgmap v1939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:39.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:38 gibba023 bash[31815]: cluster 2021-03-10T21:12:38.089595+0000 mgr.gibba044.wflcwh (mgr.34466) 3421 : cluster [DBG] pgmap v1939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:39.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:38 gibba044 bash[25485]: cluster 2021-03-10T21:12:38.089595+0000 mgr.gibba044.wflcwh (mgr.34466) 3421 : cluster [DBG] pgmap v1939: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:41.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:41 gibba023 bash[30844]: cluster 2021-03-10T21:12:40.090842+0000 mgr.gibba044.wflcwh (mgr.34466) 3422 : cluster [DBG] pgmap v1940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:41.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:41 gibba023 bash[31815]: cluster 2021-03-10T21:12:40.090842+0000 mgr.gibba044.wflcwh (mgr.34466) 3422 : cluster [DBG] pgmap v1940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:41.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:41 gibba044 bash[25485]: cluster 2021-03-10T21:12:40.090842+0000 mgr.gibba044.wflcwh (mgr.34466) 3422 : cluster [DBG] pgmap v1940: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:43.431 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:43 gibba023 bash[30844]: cluster 2021-03-10T21:12:42.092692+0000 mgr.gibba044.wflcwh (mgr.34466) 3423 : cluster [DBG] pgmap v1941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:43.431 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:43 gibba023 bash[31815]: cluster 2021-03-10T21:12:42.092692+0000 mgr.gibba044.wflcwh (mgr.34466) 3423 : cluster [DBG] pgmap v1941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:43.506 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:43 gibba044 bash[25485]: cluster 2021-03-10T21:12:42.092692+0000 mgr.gibba044.wflcwh (mgr.34466) 3423 : cluster [DBG] pgmap v1941: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:45.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:45 gibba023 bash[30844]: cluster 2021-03-10T21:12:44.094318+0000 mgr.gibba044.wflcwh (mgr.34466) 3424 : cluster [DBG] pgmap v1942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:45.428 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:45 gibba023 bash[31815]: cluster 2021-03-10T21:12:44.094318+0000 mgr.gibba044.wflcwh (mgr.34466) 3424 : cluster [DBG] pgmap v1942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:45.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:45 gibba044 bash[25485]: cluster 2021-03-10T21:12:44.094318+0000 mgr.gibba044.wflcwh (mgr.34466) 3424 : cluster [DBG] pgmap v1942: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:46.123 INFO:teuthology.orchestra.run.gibba023.stdout:true 2021-03-10T21:12:46.354 INFO:teuthology.orchestra.run.gibba023.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2021-03-10T21:12:46.354 INFO:teuthology.orchestra.run.gibba023.stdout:alertmanager.a gibba023 running (63m) 9m ago 69m 0.21.0 prom/alertmanager c876f5897d7b 16ead90c14c6 2021-03-10T21:12:46.355 INFO:teuthology.orchestra.run.gibba023.stdout:grafana.a gibba044 running (69m) 7m ago 69m 6.6.2 ceph/ceph-grafana:latest 87a51ecf0b1c d690033c2b45 2021-03-10T21:12:46.355 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.gibba044.wflcwh gibba044 running (64m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8f2a6baeb229 2021-03-10T21:12:46.355 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.x gibba044 running (64m) 7m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 90ed8e18c7f4 2021-03-10T21:12:46.355 INFO:teuthology.orchestra.run.gibba023.stdout:mgr.y gibba023 running (63m) 9m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 513df908ba68 2021-03-10T21:12:46.356 INFO:teuthology.orchestra.run.gibba023.stdout:mon.a gibba023 running (63m) 9m ago 74m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da ab5236b7dab5 2021-03-10T21:12:46.356 INFO:teuthology.orchestra.run.gibba023.stdout:mon.b gibba044 running (62m) 7m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da cb76fc7fc5d2 2021-03-10T21:12:46.356 INFO:teuthology.orchestra.run.gibba023.stdout:mon.c gibba023 running (63m) 9m ago 73m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1667336db24 2021-03-10T21:12:46.356 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.a gibba023 running (69m) 9m ago 69m 1.1.2 prom/node-exporter c19ae228f069 251ac7cf8b4d 2021-03-10T21:12:46.357 INFO:teuthology.orchestra.run.gibba023.stdout:node-exporter.b gibba044 running (69m) 7m ago 69m 1.1.2 prom/node-exporter c19ae228f069 c8ae65356dfd 2021-03-10T21:12:46.357 INFO:teuthology.orchestra.run.gibba023.stdout:osd.0 gibba023 running (62m) 9m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da b1edb7880150 2021-03-10T21:12:46.357 INFO:teuthology.orchestra.run.gibba023.stdout:osd.1 gibba023 running (61m) 9m ago 72m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 769dc6f326ab 2021-03-10T21:12:46.357 INFO:teuthology.orchestra.run.gibba023.stdout:osd.2 gibba023 running (61m) 9m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 1a37d125f6f3 2021-03-10T21:12:46.358 INFO:teuthology.orchestra.run.gibba023.stdout:osd.3 gibba023 running (60m) 9m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 86590d755ce9 2021-03-10T21:12:46.358 INFO:teuthology.orchestra.run.gibba023.stdout:osd.4 gibba044 running (60m) 7m ago 71m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 8524bf31fab2 2021-03-10T21:12:46.358 INFO:teuthology.orchestra.run.gibba023.stdout:osd.5 gibba044 running (59m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da d2f9ae91cfc0 2021-03-10T21:12:46.358 INFO:teuthology.orchestra.run.gibba023.stdout:osd.6 gibba044 running (59m) 7m ago 70m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da a8f8eb045b26 2021-03-10T21:12:46.358 INFO:teuthology.orchestra.run.gibba023.stdout:osd.7 gibba044 running (59m) 7m ago 69m 17.0.0-1749-gb26fc080 quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a d4615e7085da 01de3ebb60e9 2021-03-10T21:12:46.359 INFO:teuthology.orchestra.run.gibba023.stdout:prometheus.a gibba044 running (68m) 7m ago 69m 2.25.0 prom/prometheus:latest a618f5685492 c7fd441724c1 2021-03-10T21:12:46.359 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba023.rsfdop gibba023 error 9m ago 67m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:12:46.359 INFO:teuthology.orchestra.run.gibba023.stdout:rgw.r.z.gibba044.rblqpl gibba044 error 7m ago 67m docker.io/ceph/ceph:v15.2.0 2021-03-10T21:12:46.604 INFO:teuthology.orchestra.run.gibba023.stdout:{ 2021-03-10T21:12:46.605 INFO:teuthology.orchestra.run.gibba023.stdout: "mon": { 2021-03-10T21:12:46.605 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:12:46.605 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:12:46.605 INFO:teuthology.orchestra.run.gibba023.stdout: "mgr": { 2021-03-10T21:12:46.606 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 3 2021-03-10T21:12:46.606 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:12:46.606 INFO:teuthology.orchestra.run.gibba023.stdout: "osd": { 2021-03-10T21:12:46.606 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 8 2021-03-10T21:12:46.607 INFO:teuthology.orchestra.run.gibba023.stdout: }, 2021-03-10T21:12:46.607 INFO:teuthology.orchestra.run.gibba023.stdout: "mds": {}, 2021-03-10T21:12:46.607 INFO:teuthology.orchestra.run.gibba023.stdout: "overall": { 2021-03-10T21:12:46.607 INFO:teuthology.orchestra.run.gibba023.stdout: "ceph version 17.0.0-1749-gb26fc080 (b26fc080937a021ce826cdc94d1adb52c064381a) quincy (dev)": 14 2021-03-10T21:12:46.607 INFO:teuthology.orchestra.run.gibba023.stdout: } 2021-03-10T21:12:46.608 INFO:teuthology.orchestra.run.gibba023.stdout:} 2021-03-10T21:12:47.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:47 gibba044 bash[25485]: cluster 2021-03-10T21:12:46.096046+0000 mgr.gibba044.wflcwh (mgr.34466) 3425 : cluster [DBG] pgmap v1943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:47.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:47 gibba044 bash[25485]: audit 2021-03-10T21:12:46.112049+0000 mgr.gibba044.wflcwh (mgr.34466) 3426 : audit [DBG] from='client.56341 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:12:47.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:47 gibba044 bash[25485]: audit 2021-03-10T21:12:46.338726+0000 mgr.gibba044.wflcwh (mgr.34466) 3427 : audit [DBG] from='client.46368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:12:47.505 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:47 gibba044 bash[25485]: audit 2021-03-10T21:12:46.600980+0000 mon.a (mon.0) 1497 : audit [DBG] from='client.? 172.21.2.123:0/874160116' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:47.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:47 gibba023 bash[30844]: cluster 2021-03-10T21:12:46.096046+0000 mgr.gibba044.wflcwh (mgr.34466) 3425 : cluster [DBG] pgmap v1943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:47.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:47 gibba023 bash[30844]: audit 2021-03-10T21:12:46.112049+0000 mgr.gibba044.wflcwh (mgr.34466) 3426 : audit [DBG] from='client.56341 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:12:47.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:47 gibba023 bash[30844]: audit 2021-03-10T21:12:46.338726+0000 mgr.gibba044.wflcwh (mgr.34466) 3427 : audit [DBG] from='client.46368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:12:47.679 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:47 gibba023 bash[30844]: audit 2021-03-10T21:12:46.600980+0000 mon.a (mon.0) 1497 : audit [DBG] from='client.? 172.21.2.123:0/874160116' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:47.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:47 gibba023 bash[31815]: cluster 2021-03-10T21:12:46.096046+0000 mgr.gibba044.wflcwh (mgr.34466) 3425 : cluster [DBG] pgmap v1943: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:47.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:47 gibba023 bash[31815]: audit 2021-03-10T21:12:46.112049+0000 mgr.gibba044.wflcwh (mgr.34466) 3426 : audit [DBG] from='client.56341 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:12:47.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:47 gibba023 bash[31815]: audit 2021-03-10T21:12:46.338726+0000 mgr.gibba044.wflcwh (mgr.34466) 3427 : audit [DBG] from='client.46368 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-03-10T21:12:47.680 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:47 gibba023 bash[31815]: audit 2021-03-10T21:12:46.600980+0000 mon.a (mon.0) 1497 : audit [DBG] from='client.? 172.21.2.123:0/874160116' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:49.178 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:48 gibba023 bash[30844]: cluster 2021-03-10T21:12:48.097786+0000 mgr.gibba044.wflcwh (mgr.34466) 3428 : cluster [DBG] pgmap v1944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:49.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:48 gibba023 bash[31815]: cluster 2021-03-10T21:12:48.097786+0000 mgr.gibba044.wflcwh (mgr.34466) 3428 : cluster [DBG] pgmap v1944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:49.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:48 gibba044 bash[25485]: cluster 2021-03-10T21:12:48.097786+0000 mgr.gibba044.wflcwh (mgr.34466) 3428 : cluster [DBG] pgmap v1944: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:50.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:49 gibba023 bash[30844]: cephadm 2021-03-10T21:12:49.616842+0000 mgr.gibba044.wflcwh (mgr.34466) 3429 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:12:50.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:49 gibba023 bash[30844]: cephadm 2021-03-10T21:12:49.618416+0000 mgr.gibba044.wflcwh (mgr.34466) 3430 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:12:50.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:49 gibba023 bash[30844]: audit 2021-03-10T21:12:49.824885+0000 mon.a (mon.0) 1498 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:12:50.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:49 gibba023 bash[30844]: audit 2021-03-10T21:12:49.828301+0000 mon.a (mon.0) 1499 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:12:50.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:49 gibba023 bash[30844]: audit 2021-03-10T21:12:49.829872+0000 mon.a (mon.0) 1500 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:50.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:49 gibba023 bash[30844]: audit 2021-03-10T21:12:49.831471+0000 mon.a (mon.0) 1501 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:50.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:49 gibba023 bash[30844]: audit 2021-03-10T21:12:49.832777+0000 mon.a (mon.0) 1502 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:50.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:49 gibba023 bash[30844]: audit 2021-03-10T21:12:49.835130+0000 mon.a (mon.0) 1503 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:50.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:49 gibba023 bash[30844]: audit 2021-03-10T21:12:49.836655+0000 mon.a (mon.0) 1504 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:50.181 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:49 gibba023 bash[31815]: cephadm 2021-03-10T21:12:49.616842+0000 mgr.gibba044.wflcwh (mgr.34466) 3429 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:12:50.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:49 gibba023 bash[31815]: cephadm 2021-03-10T21:12:49.618416+0000 mgr.gibba044.wflcwh (mgr.34466) 3430 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:12:50.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:49 gibba023 bash[31815]: audit 2021-03-10T21:12:49.824885+0000 mon.a (mon.0) 1498 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:12:50.182 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:49 gibba023 bash[31815]: audit 2021-03-10T21:12:49.828301+0000 mon.a (mon.0) 1499 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:12:50.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:49 gibba023 bash[31815]: audit 2021-03-10T21:12:49.829872+0000 mon.a (mon.0) 1500 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:50.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:49 gibba023 bash[31815]: audit 2021-03-10T21:12:49.831471+0000 mon.a (mon.0) 1501 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:50.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:49 gibba023 bash[31815]: audit 2021-03-10T21:12:49.832777+0000 mon.a (mon.0) 1502 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:50.183 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:49 gibba023 bash[31815]: audit 2021-03-10T21:12:49.835130+0000 mon.a (mon.0) 1503 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:50.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:49 gibba023 bash[31815]: audit 2021-03-10T21:12:49.836655+0000 mon.a (mon.0) 1504 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:50.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:49 gibba044 bash[25485]: cephadm 2021-03-10T21:12:49.616842+0000 mgr.gibba044.wflcwh (mgr.34466) 3429 : cephadm [INF] Refreshing gibba023 facts 2021-03-10T21:12:50.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:49 gibba044 bash[25485]: cephadm 2021-03-10T21:12:49.618416+0000 mgr.gibba044.wflcwh (mgr.34466) 3430 : cephadm [INF] Refreshing gibba044 facts 2021-03-10T21:12:50.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:49 gibba044 bash[25485]: audit 2021-03-10T21:12:49.824885+0000 mon.a (mon.0) 1498 : audit [INF] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' 2021-03-10T21:12:50.255 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:49 gibba044 bash[25485]: audit 2021-03-10T21:12:49.828301+0000 mon.a (mon.0) 1499 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-03-10T21:12:50.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:49 gibba044 bash[25485]: audit 2021-03-10T21:12:49.829872+0000 mon.a (mon.0) 1500 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:50.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:49 gibba044 bash[25485]: audit 2021-03-10T21:12:49.831471+0000 mon.a (mon.0) 1501 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:50.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:49 gibba044 bash[25485]: audit 2021-03-10T21:12:49.832777+0000 mon.a (mon.0) 1502 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:50.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:49 gibba044 bash[25485]: audit 2021-03-10T21:12:49.835130+0000 mon.a (mon.0) 1503 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:50.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:49 gibba044 bash[25485]: audit 2021-03-10T21:12:49.836655+0000 mon.a (mon.0) 1504 : audit [DBG] from='mgr.34466 172.21.2.144:0/4180857032' entity='mgr.gibba044.wflcwh' cmd=[{"prefix": "versions"}]: dispatch 2021-03-10T21:12:51.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[30844]: cephadm 2021-03-10T21:12:49.828412+0000 mgr.gibba044.wflcwh (mgr.34466) 3431 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:12:51.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[30844]: cephadm 2021-03-10T21:12:49.830288+0000 mgr.gibba044.wflcwh (mgr.34466) 3432 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:12:51.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[30844]: cephadm 2021-03-10T21:12:49.831778+0000 mgr.gibba044.wflcwh (mgr.34466) 3433 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:12:51.180 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[30844]: cephadm 2021-03-10T21:12:49.831821+0000 mgr.gibba044.wflcwh (mgr.34466) 3434 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:12:51.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[30844]: cephadm 2021-03-10T21:12:49.833282+0000 mgr.gibba044.wflcwh (mgr.34466) 3435 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:12:51.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[30844]: cephadm 2021-03-10T21:12:49.833317+0000 mgr.gibba044.wflcwh (mgr.34466) 3436 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:12:51.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[30844]: cephadm 2021-03-10T21:12:49.834440+0000 mgr.gibba044.wflcwh (mgr.34466) 3437 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:12:51.181 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[30844]: cephadm 2021-03-10T21:12:49.835472+0000 mgr.gibba044.wflcwh (mgr.34466) 3438 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:12:51.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[30844]: cephadm 2021-03-10T21:12:49.835516+0000 mgr.gibba044.wflcwh (mgr.34466) 3439 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:12:51.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[30844]: cephadm 2021-03-10T21:12:49.836825+0000 mgr.gibba044.wflcwh (mgr.34466) 3440 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:12:51.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[30844]: cephadm 2021-03-10T21:12:49.837148+0000 mgr.gibba044.wflcwh (mgr.34466) 3441 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:12:51.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[30844]: cephadm 2021-03-10T21:12:49.838599+0000 mgr.gibba044.wflcwh (mgr.34466) 3442 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:12:51.182 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[30844]: cephadm 2021-03-10T21:12:49.838639+0000 mgr.gibba044.wflcwh (mgr.34466) 3443 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:12:51.183 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[30844]: cephadm 2021-03-10T21:12:49.838770+0000 mgr.gibba044.wflcwh (mgr.34466) 3444 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:12:51.183 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[30844]: cluster 2021-03-10T21:12:50.098294+0000 mgr.gibba044.wflcwh (mgr.34466) 3445 : cluster [DBG] pgmap v1945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:51.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[31815]: cephadm 2021-03-10T21:12:49.828412+0000 mgr.gibba044.wflcwh (mgr.34466) 3431 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:12:51.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[31815]: cephadm 2021-03-10T21:12:49.830288+0000 mgr.gibba044.wflcwh (mgr.34466) 3432 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:12:51.184 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[31815]: cephadm 2021-03-10T21:12:49.831778+0000 mgr.gibba044.wflcwh (mgr.34466) 3433 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:12:51.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[31815]: cephadm 2021-03-10T21:12:49.831821+0000 mgr.gibba044.wflcwh (mgr.34466) 3434 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:12:51.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[31815]: cephadm 2021-03-10T21:12:49.833282+0000 mgr.gibba044.wflcwh (mgr.34466) 3435 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:12:51.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[31815]: cephadm 2021-03-10T21:12:49.833317+0000 mgr.gibba044.wflcwh (mgr.34466) 3436 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:12:51.185 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[31815]: cephadm 2021-03-10T21:12:49.834440+0000 mgr.gibba044.wflcwh (mgr.34466) 3437 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:12:51.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[31815]: cephadm 2021-03-10T21:12:49.835472+0000 mgr.gibba044.wflcwh (mgr.34466) 3438 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:12:51.187 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[31815]: cephadm 2021-03-10T21:12:49.835516+0000 mgr.gibba044.wflcwh (mgr.34466) 3439 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:12:51.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[31815]: cephadm 2021-03-10T21:12:49.836825+0000 mgr.gibba044.wflcwh (mgr.34466) 3440 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:12:51.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[31815]: cephadm 2021-03-10T21:12:49.837148+0000 mgr.gibba044.wflcwh (mgr.34466) 3441 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:12:51.188 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[31815]: cephadm 2021-03-10T21:12:49.838599+0000 mgr.gibba044.wflcwh (mgr.34466) 3442 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:12:51.189 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[31815]: cephadm 2021-03-10T21:12:49.838639+0000 mgr.gibba044.wflcwh (mgr.34466) 3443 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:12:51.190 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[31815]: cephadm 2021-03-10T21:12:49.838770+0000 mgr.gibba044.wflcwh (mgr.34466) 3444 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:12:51.190 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:50 gibba023 bash[31815]: cluster 2021-03-10T21:12:50.098294+0000 mgr.gibba044.wflcwh (mgr.34466) 3445 : cluster [DBG] pgmap v1945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:51.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:50 gibba044 bash[25485]: cephadm 2021-03-10T21:12:49.828412+0000 mgr.gibba044.wflcwh (mgr.34466) 3431 : cephadm [INF] Upgrade: Target is version 17.0.0-1749-gb26fc080 (quincy), container quay.ceph.io/ceph-ci/ceph:b26fc080937a021ce826cdc94d1adb52c064381a digests ['quay.ceph.io/ceph-ci/ceph@sha256:530c3c162b28671b21709357145385150b49dbeaa7896ba51de446d049615c54'] 2021-03-10T21:12:51.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:50 gibba044 bash[25485]: cephadm 2021-03-10T21:12:49.830288+0000 mgr.gibba044.wflcwh (mgr.34466) 3432 : cephadm [INF] Upgrade: Checking mgr daemons 2021-03-10T21:12:51.256 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:50 gibba044 bash[25485]: cephadm 2021-03-10T21:12:49.831778+0000 mgr.gibba044.wflcwh (mgr.34466) 3433 : cephadm [INF] Upgrade: All mgr daemons are up to date. 2021-03-10T21:12:51.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:50 gibba044 bash[25485]: cephadm 2021-03-10T21:12:49.831821+0000 mgr.gibba044.wflcwh (mgr.34466) 3434 : cephadm [INF] Upgrade: Checking mon daemons 2021-03-10T21:12:51.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:50 gibba044 bash[25485]: cephadm 2021-03-10T21:12:49.833282+0000 mgr.gibba044.wflcwh (mgr.34466) 3435 : cephadm [INF] Upgrade: All mon daemons are up to date. 2021-03-10T21:12:51.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:50 gibba044 bash[25485]: cephadm 2021-03-10T21:12:49.833317+0000 mgr.gibba044.wflcwh (mgr.34466) 3436 : cephadm [INF] Upgrade: Checking crash daemons 2021-03-10T21:12:51.257 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:50 gibba044 bash[25485]: cephadm 2021-03-10T21:12:49.834440+0000 mgr.gibba044.wflcwh (mgr.34466) 3437 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-03-10T21:12:51.258 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:50 gibba044 bash[25485]: cephadm 2021-03-10T21:12:49.835472+0000 mgr.gibba044.wflcwh (mgr.34466) 3438 : cephadm [INF] Upgrade: All crash daemons are up to date. 2021-03-10T21:12:51.258 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:50 gibba044 bash[25485]: cephadm 2021-03-10T21:12:49.835516+0000 mgr.gibba044.wflcwh (mgr.34466) 3439 : cephadm [INF] Upgrade: Checking osd daemons 2021-03-10T21:12:51.258 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:50 gibba044 bash[25485]: cephadm 2021-03-10T21:12:49.836825+0000 mgr.gibba044.wflcwh (mgr.34466) 3440 : cephadm [INF] Upgrade: All osd daemons are up to date. 2021-03-10T21:12:51.258 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:50 gibba044 bash[25485]: cephadm 2021-03-10T21:12:49.837148+0000 mgr.gibba044.wflcwh (mgr.34466) 3441 : cephadm [INF] Upgrade: Checking mds daemons 2021-03-10T21:12:51.259 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:50 gibba044 bash[25485]: cephadm 2021-03-10T21:12:49.838599+0000 mgr.gibba044.wflcwh (mgr.34466) 3442 : cephadm [INF] Upgrade: All mds daemons are up to date. 2021-03-10T21:12:51.259 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:50 gibba044 bash[25485]: cephadm 2021-03-10T21:12:49.838639+0000 mgr.gibba044.wflcwh (mgr.34466) 3443 : cephadm [INF] Upgrade: Checking rgw daemons 2021-03-10T21:12:51.259 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:50 gibba044 bash[25485]: cephadm 2021-03-10T21:12:49.838770+0000 mgr.gibba044.wflcwh (mgr.34466) 3444 : cephadm [ERR] Upgrade: ALERT: Cannot stop ['rgw.r.z.gibba023.rsfdop'] in RGW service. Not enough remaining RGW daemons. Please deploy at least 2 RGW daemons before stopping ['rgw.r.z.gibba023.rsfdop']. 2021-03-10T21:12:51.260 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:50 gibba044 bash[25485]: cluster 2021-03-10T21:12:50.098294+0000 mgr.gibba044.wflcwh (mgr.34466) 3445 : cluster [DBG] pgmap v1945: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:53.429 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:53 gibba023 bash[30844]: cluster 2021-03-10T21:12:52.099903+0000 mgr.gibba044.wflcwh (mgr.34466) 3446 : cluster [DBG] pgmap v1946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:53.430 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:53 gibba023 bash[31815]: cluster 2021-03-10T21:12:52.099903+0000 mgr.gibba044.wflcwh (mgr.34466) 3446 : cluster [DBG] pgmap v1946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:53.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:53 gibba044 bash[25485]: cluster 2021-03-10T21:12:52.099903+0000 mgr.gibba044.wflcwh (mgr.34466) 3446 : cluster [DBG] pgmap v1946: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:55.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:55 gibba023 bash[30844]: cluster 2021-03-10T21:12:54.101590+0000 mgr.gibba044.wflcwh (mgr.34466) 3447 : cluster [DBG] pgmap v1947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:55.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:55 gibba023 bash[31815]: cluster 2021-03-10T21:12:54.101590+0000 mgr.gibba044.wflcwh (mgr.34466) 3447 : cluster [DBG] pgmap v1947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:55.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:55 gibba044 bash[25485]: cluster 2021-03-10T21:12:54.101590+0000 mgr.gibba044.wflcwh (mgr.34466) 3447 : cluster [DBG] pgmap v1947: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:57.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:57 gibba044 bash[25485]: cluster 2021-03-10T21:12:56.103365+0000 mgr.gibba044.wflcwh (mgr.34466) 3448 : cluster [DBG] pgmap v1948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:57.678 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:57 gibba023 bash[30844]: cluster 2021-03-10T21:12:56.103365+0000 mgr.gibba044.wflcwh (mgr.34466) 3448 : cluster [DBG] pgmap v1948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:57.679 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:57 gibba023 bash[31815]: cluster 2021-03-10T21:12:56.103365+0000 mgr.gibba044.wflcwh (mgr.34466) 3448 : cluster [DBG] pgmap v1948: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:59.179 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:12:58 gibba023 bash[30844]: cluster 2021-03-10T21:12:58.105033+0000 mgr.gibba044.wflcwh (mgr.34466) 3449 : cluster [DBG] pgmap v1949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:59.179 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:12:58 gibba023 bash[31815]: cluster 2021-03-10T21:12:58.105033+0000 mgr.gibba044.wflcwh (mgr.34466) 3449 : cluster [DBG] pgmap v1949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:12:59.254 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:12:58 gibba044 bash[25485]: cluster 2021-03-10T21:12:58.105033+0000 mgr.gibba044.wflcwh (mgr.34466) 3449 : cluster [DBG] pgmap v1949: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:13:01.428 INFO:journalctl@ceph.mon.a.gibba023.stdout:Mar 10 21:13:01 gibba023 bash[30844]: cluster 2021-03-10T21:13:00.106243+0000 mgr.gibba044.wflcwh (mgr.34466) 3450 : cluster [DBG] pgmap v1950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:13:01.429 INFO:journalctl@ceph.mon.c.gibba023.stdout:Mar 10 21:13:01 gibba023 bash[31815]: cluster 2021-03-10T21:13:00.106243+0000 mgr.gibba044.wflcwh (mgr.34466) 3450 : cluster [DBG] pgmap v1950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:13:01.504 INFO:journalctl@ceph.mon.b.gibba044.stdout:Mar 10 21:13:01 gibba044 bash[25485]: cluster 2021-03-10T21:13:00.106243+0000 mgr.gibba044.wflcwh (mgr.34466) 3450 : cluster [DBG] pgmap v1950: 129 pgs: 129 active+clean; 7.0 KiB data, 54 MiB used, 672 GiB / 672 GiB avail 2021-03-10T21:13:03.006 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-03-10T21:13:03.007 DEBUG:teuthology.task.console_log:Killing console logger for gibba023 2021-03-10T21:13:03.009 DEBUG:teuthology.task.console_log:Killing console logger for gibba044 2021-03-10T21:13:03.009 DEBUG:teuthology.exit:Finished running handlers